2024-04-24T01:34:29.343 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T01:34:29.343 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} --verbose --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613 --name teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/orig.config.yaml 2024-04-24T01:34:29.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T01:34:29.453 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7670613' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9360 sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3hLdUAWWOT4cAqmZD1mWWe0wwaHQRgN8Gyuv2j3/r/q8McWSI92z2kEVL7bB5wYNyqGjpJMVlB7WCaht/d0dU= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBvR23NdOna5oc7+bVP/3//TAi48K/IW/ntaXdKp6l7UQXmZ0DJHFzEHTtWQEqPtb2S5AGXAEzRnWpuaskJooM= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T01:34:29.454 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa; will attempt to use it 2024-04-24T01:34:29.454 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa/tasks 2024-04-24T01:34:29.455 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T01:34:29.456 INFO:teuthology.task.internal:Checking packages... 2024-04-24T01:34:29.480 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b98aab6c00f483888c049d0d8e7bc507e115dd86' 2024-04-24T01:34:29.480 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T01:34:29.480 INFO:teuthology.packaging:ref: None 2024-04-24T01:34:29.480 INFO:teuthology.packaging:tag: None 2024-04-24T01:34:29.480 INFO:teuthology.packaging:branch: squid 2024-04-24T01:34:29.480 INFO:teuthology.packaging:sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:34:29.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-24T01:34:29.803 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2424.gb98aab6c 2024-04-24T01:34:29.805 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T01:34:29.814 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T01:34:29.814 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T01:34:29.856 INFO:teuthology.task.internal:Saving configuration 2024-04-24T01:34:29.868 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T01:34:29.882 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T01:34:29.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:29:24.279493', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3hLdUAWWOT4cAqmZD1mWWe0wwaHQRgN8Gyuv2j3/r/q8McWSI92z2kEVL7bB5wYNyqGjpJMVlB7WCaht/d0dU='} 2024-04-24T01:34:29.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:29:24.277866', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBvR23NdOna5oc7+bVP/3//TAi48K/IW/ntaXdKp6l7UQXmZ0DJHFzEHTtWQEqPtb2S5AGXAEzRnWpuaskJooM='} 2024-04-24T01:34:29.932 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T01:34:29.940 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-24T01:34:29.940 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-24T01:34:29.940 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T01:34:30.058 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65a223ce50>, signals=[15]) 2024-04-24T01:34:30.059 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T01:34:30.067 INFO:teuthology.task.internal:Opening connections... 2024-04-24T01:34:30.067 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-04-24T01:34:30.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:34:30.142 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:34:30.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:34:30.216 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T01:34:30.223 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-04-24T01:34:30.241 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-04-24T01:34:30.241 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-04-24T01:34:30.298 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-04-24T01:34:30.298 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-04-24T01:34:30.298 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-04-24T01:34:30.298 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-04-24T01:34:30.298 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-04-24T01:34:30.298 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T01:34:30.299 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T01:34:30.300 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-04-24T01:34:30.323 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-04-24T01:34:30.341 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-04-24T01:34:30.341 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-04-24T01:34:30.398 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-04-24T01:34:30.398 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-04-24T01:34:30.398 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-04-24T01:34:30.398 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-04-24T01:34:30.398 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-04-24T01:34:30.398 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T01:34:30.399 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T01:34:30.399 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-04-24T01:34:30.423 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T01:34:30.434 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T01:34:30.466 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T01:34:30.466 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-04-24T01:34:30.469 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-04-24T01:34:30.485 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T01:34:30.492 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T01:34:30.492 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-04-24T01:34:30.525 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-04-24T01:34:30.773 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T01:34:30.829 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T01:34:30.850 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-24T01:34:30.850 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-24T01:34:30.851 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T01:34:30.851 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T01:34:30.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:34:30.869 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-04-24T01:34:30.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:34:30.871 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-04-24T01:34:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-437.el9.x86_64 2024-04-24T01:34:30.927 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.14.0-437.el9.x86_64 2024-04-24T01:34:30.927 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2024-04-24T01:34:30.929 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-437.el9.x86_64 2024-04-24T01:34:30.929 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-437.el9.x86_64 2024-04-24T01:34:30.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-04-24T01:34:33.345 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.0 MB 00:00 2024-04-24T01:34:33.418 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.0 MB 00:00 2024-04-24T01:34:39.587 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 19 MB 00:05 2024-04-24T01:34:41.884 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 19 MB 00:07 2024-04-24T01:34:43.821 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-24T01:34:46.732 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 16 kB 00:01 2024-04-24T01:34:50.560 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 21 MB 00:03 2024-04-24T01:34:53.233 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 815 kB/s | 6.2 MB 00:07 2024-04-24T01:34:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-04-24T01:34:56.211 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 9.9 kB/s | 16 kB 00:01 2024-04-24T01:34:57.410 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-24T01:34:57.437 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T01:34:57.438 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T01:34:57.521 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:34:57.522 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:34:57.523 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:34:57.649 DEBUG:teuthology.orchestra.run.smithi131:> echo no | sudo yum reinstall kernel || true 2024-04-24T01:34:58.147 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:34:55 AM UTC. 2024-04-24T01:34:58.275 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:34:58.290 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:Reinstalling: 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 255 k 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 0 2024-04-24T01:34:58.291 INFO:teuthology.orchestra.run.smithi131.stderr:Operation aborted. 2024-04-24T01:34:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:Is this ok [y/N]: 2024-04-24T01:34:58.364 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum reinstall -y kernel || true 2024-04-24T01:34:58.857 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:34:55 AM UTC. 2024-04-24T01:34:58.973 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:34:58.974 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:34:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-04-24T01:34:58.974 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:34:58.974 INFO:teuthology.orchestra.run.smithi131.stdout:Reinstalling: 2024-04-24T01:34:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:34:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:34:58.974 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:34:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:34:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:34:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 255 k 2024-04-24T01:34:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 0 2024-04-24T01:34:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:34:59.251 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.3 MB/s | 255 kB 00:00 2024-04-24T01:34:59.251 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:34:59.251 INFO:teuthology.orchestra.run.smithi131.stdout:Total 921 kB/s | 255 kB 00:00 2024-04-24T01:34:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:34:59.463 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:34:59.463 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:34:59.468 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:34:59.469 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:34:59.605 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:34:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:34:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:35:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:35:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:35:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:35:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:35:01.058 INFO:teuthology.orchestra.run.smithi131.stdout:Reinstalled: 2024-04-24T01:35:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T01:35:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:35:01.059 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:35:01.231 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T01:35:01.279 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T01:35:01.279 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T01:35:01.279 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T01:35:01.280 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-24T01:35:01.280 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T01:35:01.310 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-04-24T01:35:01.329 DEBUG:teuthology.parallel:result is None 2024-04-24T01:35:02.427 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-24T01:35:04.316 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T01:35:04.316 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T01:35:04.402 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:35:04.403 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:35:04.403 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:35:04.524 DEBUG:teuthology.orchestra.run.smithi107:> echo no | sudo yum reinstall kernel || true 2024-04-24T01:35:05.021 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:35:02 AM UTC. 2024-04-24T01:35:05.148 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:35:05.154 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:35:05.154 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-04-24T01:35:05.155 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:35:05.155 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalling: 2024-04-24T01:35:05.155 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:35:05.155 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:35:05.155 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:35:05.155 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:35:05.155 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:35:05.156 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 255 k 2024-04-24T01:35:05.156 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 0 2024-04-24T01:35:05.156 INFO:teuthology.orchestra.run.smithi107.stderr:Operation aborted. 2024-04-24T01:35:05.218 INFO:teuthology.orchestra.run.smithi107.stdout:Is this ok [y/N]: 2024-04-24T01:35:05.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum reinstall -y kernel || true 2024-04-24T01:35:05.708 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:35:02 AM UTC. 2024-04-24T01:35:05.823 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalling: 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:35:05.824 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:35:05.825 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:35:05.825 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 255 k 2024-04-24T01:35:05.825 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 0 2024-04-24T01:35:05.825 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:35:07.037 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-437.el9.x86_64.rpm 274 kB/s | 255 kB 00:00 2024-04-24T01:35:07.037 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:35:07.037 INFO:teuthology.orchestra.run.smithi107.stdout:Total 210 kB/s | 255 kB 00:01 2024-04-24T01:35:07.055 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:35:07.244 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:35:07.245 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:35:07.249 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:35:07.250 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:35:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:35:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:35:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:35:08.114 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:35:08.114 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:35:08.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:35:08.777 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:35:08.777 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalled: 2024-04-24T01:35:08.777 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T01:35:08.777 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:35:08.777 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:35:08.958 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T01:35:09.005 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T01:35:09.005 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T01:35:09.005 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T01:35:09.006 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T01:35:09.006 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T01:35:09.041 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-04-24T01:35:09.059 DEBUG:teuthology.parallel:result is None 2024-04-24T01:35:09.059 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T01:35:09.067 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T01:35:09.067 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T01:35:09.102 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T01:35:09.119 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T01:35:09.126 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T01:35:09.150 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T01:35:09.151 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T01:35:09.156 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T01:35:09.188 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T01:35:09.195 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T01:35:09.195 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T01:35:09.220 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T01:35:09.243 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:35:09.252 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:35:09.279 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:35:09.290 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:35:09.292 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T01:35:09.299 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T01:35:09.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T01:35:09.301 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T01:35:09.327 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T01:35:09.336 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T01:35:09.337 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T01:35:09.365 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T01:35:09.383 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:35:09.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:35:09.501 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:35:09.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:35:09.620 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:35:09.620 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T01:35:09.683 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:35:09.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:35:09.775 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:35:09.858 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:35:09.902 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:35:09.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T01:35:09.968 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-04-24T01:35:09.970 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-04-24T01:35:10.003 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:35:10.045 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:35:10.550 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T01:35:10.559 INFO:teuthology.task.internal:Starting timer... 2024-04-24T01:35:10.559 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T01:35:10.612 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T01:35:10.636 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-24T01:35:10.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-04-24T01:35:10.682 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-04-24T01:35:10.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-04-24T01:35:10.758 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-04-24T01:35:10.760 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T01:35:10.760 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-04-24T01:35:10.785 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-04-24T01:35:10.786 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-04-24T01:35:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-04-24T01:35:10.804 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2024-04-24T01:35:10.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:35:10.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:35:10.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:35:10.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:35:10.874 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T01:35:10.874 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-04-24T01:35:10.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-04-24T01:35:10.938 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T01:35:10.948 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T01:35:10.978 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T01:35:11.003 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T01:38:39.875 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-04-24T01:38:39.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-24T01:38:39.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:38:39.952 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-04-24T01:38:40.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-24T01:38:40.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-24T01:38:40.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:38:40.113 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-24T01:38:40.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-24T01:38:40.191 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T01:38:40.201 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T01:38:40.201 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T01:38:40.202 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:38:40.205 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T01:38:40.205 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:38:40.231 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T01:38:40.245 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T01:38:40.259 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T01:38:40.268 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-04-24T01:38:40.272 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T01:38:40.279 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-04-24T01:38:40.292 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T01:38:40.294 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-04-24T01:38:40.304 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-04-24T01:38:40.305 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T01:38:40.317 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T01:38:40.329 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T01:38:40.365 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:38:40.369 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:38:40.369 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-04-24T01:38:40.369 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.369 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.369 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.369 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.380 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:38:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:38:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-04-24T01:38:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:38:40.385 INFO:teuthology.run_tasks:Running task install... 2024-04-24T01:38:40.393 DEBUG:teuthology.task.install:project ceph 2024-04-24T01:38:40.393 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}} 2024-04-24T01:38:40.394 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'} 2024-04-24T01:38:40.394 INFO:teuthology.task.install:Using flavor: default 2024-04-24T01:38:40.399 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T01:38:40.400 INFO:teuthology.task.install:extra packages: [] 2024-04-24T01:38:40.400 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-24T01:38:40.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:38:40.402 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-24T01:38:40.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:38:40.558 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-24T01:38:40.558 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-24T01:38:40.625 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-24T01:38:40.626 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-24T01:38:40.730 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T01:38:40.731 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:38:40.731 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T01:38:40.756 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T01:38:40.756 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T01:38:40.793 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T01:38:40.793 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:38:40.793 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T01:38:40.819 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T01:38:40.820 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T01:38:40.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T01:38:40.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T01:38:40.897 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T01:38:40.958 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T01:38:40.960 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-04-24T01:38:40.961 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-04-24T01:38:41.022 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-04-24T01:38:41.023 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-04-24T01:38:41.190 INFO:teuthology.orchestra.run.smithi131.stdout:48 files removed 2024-04-24T01:38:41.218 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw 2024-04-24T01:38:41.247 INFO:teuthology.orchestra.run.smithi107.stdout:48 files removed 2024-04-24T01:38:41.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw 2024-04-24T01:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 258 kB/s | 83 kB 00:00 2024-04-24T01:38:41.922 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 212 kB/s | 83 kB 00:00 2024-04-24T01:38:42.142 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-04-24T01:38:42.281 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-04-24T01:38:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-04-24T01:38:42.631 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-24T01:38:43.834 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.0 MB 00:01 2024-04-24T01:38:51.580 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 924 kB/s | 8.0 MB 00:08 2024-04-24T01:38:53.465 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-24T01:39:01.506 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.2 MB 00:04 2024-04-24T01:39:03.441 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 16 kB 00:00 2024-04-24T01:39:04.869 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-24T01:39:05.753 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 934 kB/s | 19 MB 00:20 2024-04-24T01:39:09.958 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-24T01:39:12.135 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:39:12.137 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-24T01:39:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T01:39:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T01:39:12.140 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout:Install 30 Packages 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 2 Packages 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:12.141 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 60 M 2024-04-24T01:39:12.142 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:39:13.500 INFO:teuthology.orchestra.run.smithi107.stdout:(1/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 5.9 MB/s | 5.4 MB 00:00 2024-04-24T01:39:13.567 INFO:teuthology.orchestra.run.smithi107.stdout:(2/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 378 kB/s | 25 kB 00:00 2024-04-24T01:39:14.034 INFO:teuthology.orchestra.run.smithi107.stdout:(3/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9. 7.1 MB/s | 10 MB 00:01 2024-04-24T01:39:14.067 INFO:teuthology.orchestra.run.smithi107.stdout:(4/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 1.5 MB/s | 745 kB 00:00 2024-04-24T01:39:14.109 INFO:teuthology.orchestra.run.smithi107.stdout:(5/32): libradosstriper1-19.0.0-2424.gb98aab6c. 6.5 MB/s | 501 kB 00:00 2024-04-24T01:39:14.193 INFO:teuthology.orchestra.run.smithi107.stdout:(6/32): python3-ceph-argparse-19.0.0-2424.gb98a 543 kB/s | 45 kB 00:00 2024-04-24T01:39:14.268 INFO:teuthology.orchestra.run.smithi107.stdout:(7/32): python3-ceph-common-19.0.0-2424.gb98aab 1.7 MB/s | 133 kB 00:00 2024-04-24T01:39:14.502 INFO:teuthology.orchestra.run.smithi107.stdout:(8/32): ceph-common-19.0.0-2424.gb98aab6c.el9.x 11 MB/s | 21 MB 00:01 2024-04-24T01:39:14.527 INFO:teuthology.orchestra.run.smithi107.stdout:(9/32): python3-cephfs-19.0.0-2424.gb98aab6c.el 626 kB/s | 162 kB 00:00 2024-04-24T01:39:14.569 INFO:teuthology.orchestra.run.smithi107.stdout:(10/32): python3-rados-19.0.0-2424.gb98aab6c.el 4.7 MB/s | 321 kB 00:00 2024-04-24T01:39:14.653 INFO:teuthology.orchestra.run.smithi107.stdout:(11/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_ 9.1 MB/s | 5.3 MB 00:00 2024-04-24T01:39:14.678 INFO:teuthology.orchestra.run.smithi107.stdout:(12/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 1.9 MB/s | 299 kB 00:00 2024-04-24T01:39:14.703 INFO:teuthology.orchestra.run.smithi107.stdout:(13/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 742 kB/s | 99 kB 00:00 2024-04-24T01:39:14.878 INFO:teuthology.orchestra.run.smithi107.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 259 kB/s | 45 kB 00:00 2024-04-24T01:39:14.904 INFO:teuthology.orchestra.run.smithi107.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 427 kB/s | 107 kB 00:00 2024-04-24T01:39:14.929 INFO:teuthology.orchestra.run.smithi107.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 638 kB/s | 160 kB 00:00 2024-04-24T01:39:14.988 INFO:teuthology.orchestra.run.smithi107.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 726 kB/s | 42 kB 00:00 2024-04-24T01:39:15.022 INFO:teuthology.orchestra.run.smithi107.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-24T01:39:15.080 INFO:teuthology.orchestra.run.smithi107.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-04-24T01:39:15.105 INFO:teuthology.orchestra.run.smithi107.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 430 kB/s | 36 kB 00:00 2024-04-24T01:39:15.130 INFO:teuthology.orchestra.run.smithi107.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-04-24T01:39:15.147 INFO:teuthology.orchestra.run.smithi107.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-24T01:39:15.223 INFO:teuthology.orchestra.run.smithi107.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-24T01:39:15.265 INFO:teuthology.orchestra.run.smithi107.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.9 MB/s | 309 kB 00:00 2024-04-24T01:39:15.282 INFO:teuthology.orchestra.run.smithi107.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 828 kB/s | 49 kB 00:00 2024-04-24T01:39:15.371 INFO:teuthology.orchestra.run.smithi107.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 639 kB/s | 67 kB 00:00 2024-04-24T01:39:15.416 INFO:teuthology.orchestra.run.smithi107.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 4.2 MB/s | 192 kB 00:00 2024-04-24T01:39:15.450 INFO:teuthology.orchestra.run.smithi107.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2024-04-24T01:39:15.550 INFO:teuthology.orchestra.run.smithi107.stdout:(29/32): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-24T01:39:15.583 INFO:teuthology.orchestra.run.smithi107.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-24T01:39:15.809 INFO:teuthology.orchestra.run.smithi107.stdout:(31/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 9.4 MB/s | 3.4 MB 00:00 2024-04-24T01:39:15.867 INFO:teuthology.orchestra.run.smithi107.stdout:(32/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 9.9 MB/s | 3.1 MB 00:00 2024-04-24T01:39:15.869 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:39:15.869 INFO:teuthology.orchestra.run.smithi107.stdout:Total 16 MB/s | 60 MB 00:03 2024-04-24T01:39:15.971 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:39:16.007 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:39:16.008 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:39:16.469 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:39:16.469 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:39:17.277 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 790 kB/s | 6.2 MB 00:08 2024-04-24T01:39:17.950 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:39:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T01:39:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-24T01:39:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-24T01:39:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:39:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:39:18.362 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:39:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:39:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-24T01:39:18.891 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:39:18.983 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:39:19.037 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-24T01:39:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-24T01:39:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:39:19.163 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:39:19.192 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-24T01:39:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-24T01:39:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:39:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:39:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:39:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-24T01:39:19.536 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-24T01:39:19.568 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-24T01:39:19.616 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-24T01:39:19.642 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-24T01:39:19.671 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-24T01:39:19.704 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-24T01:39:20.017 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-24T01:39:20.058 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:39:20.148 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:39:20.180 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-24T01:39:20.215 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T01:39:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T01:39:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:39:20.774 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:39:20.851 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-24T01:39:20.880 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-24T01:39:20.896 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-24T01:39:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:39:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:39:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:39:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:39:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:39:23.848 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T01:39:23.848 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T01:39:23.848 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:23.866 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:39:26.029 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-24T01:39:28.216 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:39:28.218 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:39:28.218 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:39:28.218 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:39:28.218 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:39:28.218 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-24T01:39:28.218 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T01:39:28.219 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-24T01:39:28.220 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:39:28.221 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:39:28.222 INFO:teuthology.orchestra.run.smithi131.stdout:Install 30 Packages 2024-04-24T01:39:28.222 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 2 Packages 2024-04-24T01:39:28.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:28.223 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 60 M 2024-04-24T01:39:28.223 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout:(1/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 2.6 MB/s | 5.4 MB 00:02 2024-04-24T01:39:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:(2/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 216 kB/s | 25 kB 00:00 2024-04-24T01:39:30.823 INFO:teuthology.orchestra.run.smithi131.stdout:(3/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 3.0 MB/s | 745 kB 00:00 2024-04-24T01:39:30.981 INFO:teuthology.orchestra.run.smithi131.stdout:(4/32): libradosstriper1-19.0.0-2424.gb98aab6c. 3.1 MB/s | 501 kB 00:00 2024-04-24T01:39:32.781 INFO:teuthology.orchestra.run.smithi131.stdout:(5/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_6 3.0 MB/s | 5.3 MB 00:01 2024-04-24T01:39:33.098 INFO:teuthology.orchestra.run.smithi131.stdout:(6/32): ceph-common-19.0.0-2424.gb98aab6c.el9.x 4.5 MB/s | 21 MB 00:04 2024-04-24T01:39:33.123 INFO:teuthology.orchestra.run.smithi131.stdout:(7/32): python3-ceph-argparse-19.0.0-2424.gb98a 132 kB/s | 45 kB 00:00 2024-04-24T01:39:33.165 INFO:teuthology.orchestra.run.smithi131.stdout:(8/32): python3-ceph-common-19.0.0-2424.gb98aab 2.0 MB/s | 133 kB 00:00 2024-04-24T01:39:33.241 INFO:teuthology.orchestra.run.smithi131.stdout:(9/32): python3-rados-19.0.0-2424.gb98aab6c.el9 4.2 MB/s | 321 kB 00:00 2024-04-24T01:39:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:39:33.266 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-04-24T01:39:33.266 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-04-24T01:39:33.266 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-04-24T01:39:33.266 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-04-24T01:39:33.266 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-04-24T01:39:33.267 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-04-24T01:39:33.267 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-04-24T01:39:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:33.267 INFO:teuthology.orchestra.run.smithi131.stdout:(10/32): python3-cephfs-19.0.0-2424.gb98aab6c.e 1.1 MB/s | 162 kB 00:00 2024-04-24T01:39:33.317 INFO:teuthology.orchestra.run.smithi131.stdout:(11/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 3.9 MB/s | 299 kB 00:00 2024-04-24T01:39:33.342 INFO:teuthology.orchestra.run.smithi131.stdout:(12/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 1.3 MB/s | 99 kB 00:00 2024-04-24T01:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 754 kB/s | 107 kB 00:00 2024-04-24T01:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 960 kB/s | 160 kB 00:00 2024-04-24T01:39:33.526 INFO:teuthology.orchestra.run.smithi131.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 674 kB/s | 45 kB 00:00 2024-04-24T01:39:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-04-24T01:39:33.685 INFO:teuthology.orchestra.run.smithi131.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-04-24T01:39:33.710 INFO:teuthology.orchestra.run.smithi131.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 842 kB/s | 42 kB 00:00 2024-04-24T01:39:33.762 INFO:teuthology.orchestra.run.smithi131.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 720 kB/s | 36 kB 00:00 2024-04-24T01:39:33.794 INFO:teuthology.orchestra.run.smithi131.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-24T01:39:33.820 INFO:teuthology.orchestra.run.smithi131.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-04-24T01:39:34.186 INFO:teuthology.orchestra.run.smithi131.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 788 kB/s | 309 kB 00:00 2024-04-24T01:39:34.223 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:39:34.248 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:39:34.248 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:39:34.249 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T01:39:34.249 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:39:34.249 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:39:34.249 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:34.250 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:39:34.262 INFO:teuthology.orchestra.run.smithi131.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-24T01:39:34.318 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:39:34.318 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:39:34.362 INFO:teuthology.orchestra.run.smithi131.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-04-24T01:39:34.437 INFO:teuthology.orchestra.run.smithi131.stdout:(25/32): libarrow-9.0.0-10.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-04-24T01:39:34.463 INFO:teuthology.orchestra.run.smithi131.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-04-24T01:39:34.597 INFO:teuthology.orchestra.run.smithi131.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-04-24T01:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-24T01:39:34.781 INFO:teuthology.orchestra.run.smithi131.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-24T01:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout:(30/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 6.7 MB/s | 3.1 MB 00:00 2024-04-24T01:39:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:(31/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 4.1 MB/s | 3.4 MB 00:00 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-24T01:39:35.468 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T01:39:35.469 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T01:39:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T01:39:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T01:39:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T01:39:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T01:39:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T01:39:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T01:39:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T01:39:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:39:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T01:39:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-24T01:39:35.598 INFO:teuthology.orchestra.run.smithi131.stdout:(32/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9 1.4 MB/s | 10 MB 00:07 2024-04-24T01:39:35.601 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:39:35.602 INFO:teuthology.orchestra.run.smithi131.stdout:Total 8.1 MB/s | 60 MB 00:07 2024-04-24T01:39:35.705 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:39:35.742 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:39:35.742 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:39:36.204 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:39:36.205 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:39:36.234 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.235 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.236 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.237 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T01:39:36.238 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.238 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.238 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:36.238 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T01:39:36.238 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T01:39:36.239 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T01:39:36.239 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T01:39:36.239 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T01:39:36.239 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:36.239 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:39:36.544 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-test 2024-04-24T01:39:37.078 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:28 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:39:37.200 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T01:39:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:37.202 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:39:37.202 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:37.202 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-04-24T01:39:37.202 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:37.202 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 49 M 2024-04-24T01:39:37.202 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 207 M 2024-04-24T01:39:37.203 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:39:37.509 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 670 kB/s | 163 kB 00:00 2024-04-24T01:39:37.675 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:39:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T01:39:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-24T01:39:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-24T01:39:37.854 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 185 kB/s | 64 kB 00:00 2024-04-24T01:39:37.877 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:39:37.887 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): socat-1.7.4.1-5.el9.x86_64.rpm 490 kB/s | 305 kB 00:00 2024-04-24T01:39:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:39:38.094 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:39:38.148 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:39:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-24T01:39:38.606 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:39:38.715 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-24T01:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:39:38.904 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:39:38.933 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-24T01:39:38.976 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-24T01:39:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:39:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:39:39.124 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:39:39.158 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-24T01:39:39.265 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-24T01:39:39.301 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-24T01:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-24T01:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-24T01:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-24T01:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-24T01:39:39.762 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-24T01:39:39.817 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:39:39.908 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-24T01:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T01:39:40.205 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 16 MB/s | 48 MB 00:02 2024-04-24T01:39:40.207 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:39:40.207 INFO:teuthology.orchestra.run.smithi107.stdout:Total 16 MB/s | 49 MB 00:03 2024-04-24T01:39:40.234 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:39:40.254 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:39:40.254 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:39:40.475 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T01:39:40.503 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:39:40.574 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:39:40.618 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:39:40.618 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:39:40.653 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-24T01:39:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-24T01:39:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:39:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-24T01:39:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-24T01:39:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:39:42.989 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:39:43.110 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:39:43.653 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:39:43.689 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T01:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T01:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:39:45.793 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:39:45.869 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:39:48.345 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:39:48.346 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-24T01:39:48.346 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-24T01:39:48.346 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-24T01:39:48.596 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-24T01:39:48.596 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:48.596 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:39:48.596 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:48.596 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:48.596 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T01:39:48.596 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T01:39:48.597 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:48.597 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:39:48.852 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph 2024-04-24T01:39:49.381 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:40 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:39:49.512 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-24T01:39:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T01:39:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T01:39:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout:Install 36 Packages 2024-04-24T01:39:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:49.519 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 30 M 2024-04-24T01:39:49.519 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 107 M 2024-04-24T01:39:49.519 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:39:50.364 INFO:teuthology.orchestra.run.smithi107.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 26 kB/s | 6.6 kB 00:00 2024-04-24T01:39:50.489 INFO:teuthology.orchestra.run.smithi107.stdout:(2/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-04-24T01:39:50.581 INFO:teuthology.orchestra.run.smithi107.stdout:(3/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 5.1 MB/s | 2.4 MB 00:00 2024-04-24T01:39:50.631 INFO:teuthology.orchestra.run.smithi107.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 4.9 MB/s | 249 kB 00:00 2024-04-24T01:39:50.782 INFO:teuthology.orchestra.run.smithi107.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-04-24T01:39:50.882 INFO:teuthology.orchestra.run.smithi107.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 12 MB/s | 1.2 MB 00:00 2024-04-24T01:39:50.924 INFO:teuthology.orchestra.run.smithi107.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-24T01:39:50.974 INFO:teuthology.orchestra.run.smithi107.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-04-24T01:39:51.024 INFO:teuthology.orchestra.run.smithi107.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-04-24T01:39:51.066 INFO:teuthology.orchestra.run.smithi107.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 5.1 MB/s | 215 kB 00:00 2024-04-24T01:39:51.141 INFO:teuthology.orchestra.run.smithi107.stdout:(11/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86 6.0 MB/s | 4.7 MB 00:00 2024-04-24T01:39:51.342 INFO:teuthology.orchestra.run.smithi107.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 862 kB/s | 172 kB 00:00 2024-04-24T01:39:51.392 INFO:teuthology.orchestra.run.smithi107.stdout:(13/36): lua-5.4.4-4.el9.x86_64.rpm 579 kB/s | 188 kB 00:00 2024-04-24T01:39:51.409 INFO:teuthology.orchestra.run.smithi107.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 520 kB/s | 35 kB 00:00 2024-04-24T01:39:51.609 INFO:teuthology.orchestra.run.smithi107.stdout:(15/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86 15 MB/s | 17 MB 00:01 2024-04-24T01:39:51.634 INFO:teuthology.orchestra.run.smithi107.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 185 kB/s | 42 kB 00:00 2024-04-24T01:39:51.660 INFO:teuthology.orchestra.run.smithi107.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 191 kB/s | 51 kB 00:00 2024-04-24T01:39:51.685 INFO:teuthology.orchestra.run.smithi107.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2024-04-24T01:39:51.760 INFO:teuthology.orchestra.run.smithi107.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 434 kB/s | 43 kB 00:00 2024-04-24T01:39:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 859 kB/s | 151 kB 00:00 2024-04-24T01:39:52.785 INFO:teuthology.orchestra.run.smithi107.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 11 kB/s | 11 kB 00:00 2024-04-24T01:39:52.811 INFO:teuthology.orchestra.run.smithi107.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 153 kB/s | 172 kB 00:01 2024-04-24T01:39:53.396 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-04-24T01:39:53.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:53.427 INFO:teuthology.orchestra.run.smithi107.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 27 kB/s | 18 kB 00:00 2024-04-24T01:39:53.561 INFO:teuthology.orchestra.run.smithi107.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 31 kB/s | 23 kB 00:00 2024-04-24T01:39:53.586 INFO:teuthology.orchestra.run.smithi107.stdout:(25/36): python3-cherrypy-18.6.1-2.el9.noarch.r 196 kB/s | 358 kB 00:01 2024-04-24T01:39:53.612 INFO:teuthology.orchestra.run.smithi107.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 106 kB/s | 19 kB 00:00 2024-04-24T01:39:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 234 kB/s | 20 kB 00:00 2024-04-24T01:39:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 550 kB/s | 46 kB 00:00 2024-04-24T01:39:53.729 INFO:teuthology.orchestra.run.smithi107.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 672 kB/s | 79 kB 00:00 2024-04-24T01:39:53.788 INFO:teuthology.orchestra.run.smithi107.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 140 kB/s | 16 kB 00:00 2024-04-24T01:39:53.813 INFO:teuthology.orchestra.run.smithi107.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-04-24T01:39:53.839 INFO:teuthology.orchestra.run.smithi107.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-04-24T01:39:54.089 INFO:teuthology.orchestra.run.smithi107.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 615 kB/s | 272 kB 00:00 2024-04-24T01:39:54.114 INFO:teuthology.orchestra.run.smithi107.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 764 kB/s | 230 kB 00:00 2024-04-24T01:39:54.139 INFO:teuthology.orchestra.run.smithi107.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-04-24T01:39:54.164 INFO:teuthology.orchestra.run.smithi107.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.3 MB/s | 427 kB 00:00 2024-04-24T01:39:54.166 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:39:54.166 INFO:teuthology.orchestra.run.smithi107.stdout:Total 6.5 MB/s | 30 MB 00:04 2024-04-24T01:39:54.301 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:39:54.340 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:39:54.340 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:39:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:39:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:39:54.376 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:39:54.376 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T01:39:54.376 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:39:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:39:54.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:39:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:39:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:39:54.638 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:39:54.638 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:39:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:39:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-24T01:39:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-24T01:39:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T01:39:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T01:39:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T01:39:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T01:39:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T01:39:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T01:39:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:39:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T01:39:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-24T01:39:55.903 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:39:55.967 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T01:39:56.000 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T01:39:56.028 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T01:39:56.098 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T01:39:56.152 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T01:39:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T01:39:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T01:39:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T01:39:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T01:39:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T01:39:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:39:56.439 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T01:39:56.469 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T01:39:56.503 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T01:39:56.536 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T01:39:56.568 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T01:39:56.603 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T01:39:56.638 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T01:39:56.692 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T01:39:56.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-test 2024-04-24T01:39:56.765 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T01:39:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T01:39:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T01:39:57.037 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T01:39:57.075 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T01:39:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T01:39:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T01:39:57.250 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:31 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:39:57.371 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:39:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:39:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:39:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:39:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:39:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:Install 4 Packages 2024-04-24T01:39:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:39:57.374 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T01:39:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 49 M 2024-04-24T01:39:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 207 M 2024-04-24T01:39:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:39:57.421 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T01:39:57.490 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T01:39:57.587 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T01:39:57.629 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T01:39:57.744 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T01:39:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:(1/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 434 kB/s | 163 kB 00:00 2024-04-24T01:39:57.903 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-24T01:39:57.931 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:39:57.956 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:39:57.956 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:39:57.956 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T01:39:57.956 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:39:57.956 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:39:57.956 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:58.052 INFO:teuthology.orchestra.run.smithi131.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 499 kB/s | 305 kB 00:00 2024-04-24T01:39:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 176 kB/s | 64 kB 00:00 2024-04-24T01:39:59.381 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:39:59.407 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:39:59.408 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:39:59.408 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T01:39:59.408 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:39:59.408 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:39:59.408 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:39:59.849 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:39:59.872 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:39:59.872 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:39:59.872 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T01:39:59.872 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:39:59.872 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:39:59.872 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:00.028 INFO:teuthology.orchestra.run.smithi131.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 19 MB/s | 48 MB 00:02 2024-04-24T01:40:00.030 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:00.030 INFO:teuthology.orchestra.run.smithi131.stdout:Total 18 MB/s | 49 MB 00:02 2024-04-24T01:40:00.057 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:40:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:40:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:40:00.099 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:40:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:40:00.141 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:00.141 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T01:40:00.141 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:40:00.141 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:40:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:40:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:40:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:40:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:40:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-24T01:40:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-24T01:40:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:40:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:40:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-24T01:40:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-24T01:40:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-24T01:40:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-24T01:40:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-24T01:40:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-24T01:40:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T01:40:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T01:40:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T01:40:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T01:40:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T01:40:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T01:40:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T01:40:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T01:40:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T01:40:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T01:40:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T01:40:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T01:40:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T01:40:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T01:40:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T01:40:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T01:40:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T01:40:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T01:40:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T01:40:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T01:40:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T01:40:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:02.825 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T01:40:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T01:40:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:02.828 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:03.197 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-base 2024-04-24T01:40:03.710 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:54 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:03.788 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:03.830 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:03.835 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:03.835 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:03.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install cephadm 2024-04-24T01:40:04.427 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:55 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:04.538 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:04.538 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-04-24T01:40:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:04.540 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 762 k 2024-04-24T01:40:04.540 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 768 k 2024-04-24T01:40:04.540 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:04.965 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-24T01:40:04.966 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:04.966 INFO:teuthology.orchestra.run.smithi107.stdout:Total 1.7 MB/s | 762 kB 00:00 2024-04-24T01:40:04.966 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:04.972 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:04.972 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:04.978 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:04.978 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:05.050 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:05.499 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:05.844 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:40:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:05.919 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:40:06.099 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:06.099 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:06.099 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:06.099 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:06.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T01:40:06.849 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:57 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:06.971 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:06.972 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:06.972 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-04-24T01:40:06.972 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:06.972 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:06.972 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 145 k 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 435 k 2024-04-24T01:40:06.973 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:07.199 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 639 kB/s | 145 kB 00:00 2024-04-24T01:40:07.200 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:07.200 INFO:teuthology.orchestra.run.smithi107.stdout:Total 635 kB/s | 145 kB 00:00 2024-04-24T01:40:07.201 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:07.208 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:07.208 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:07.265 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:07.265 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:40:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:40:07.514 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:07.514 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T01:40:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:08.276 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:40:08.276 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-24T01:40:08.277 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-24T01:40:08.277 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-24T01:40:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:40:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:08.362 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:08.362 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:08.564 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-24T01:40:08.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:08.564 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:40:08.564 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:08.564 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:08.564 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T01:40:08.565 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T01:40:08.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:08.565 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:40:08.577 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr 2024-04-24T01:40:08.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph 2024-04-24T01:40:09.087 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:00 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:09.165 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:09.207 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:09.208 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:09.208 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:09.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T01:40:09.362 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:43 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:40:09.492 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:40:09.494 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:09.494 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:40:09.494 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:09.494 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T01:40:09.495 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T01:40:09.496 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T01:40:09.497 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T01:40:09.498 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T01:40:09.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:09.498 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:40:09.498 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:09.498 INFO:teuthology.orchestra.run.smithi131.stdout:Install 36 Packages 2024-04-24T01:40:09.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:09.499 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 30 M 2024-04-24T01:40:09.499 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 107 M 2024-04-24T01:40:09.499 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:40:09.786 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:00 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:09.908 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T01:40:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:09.910 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:09.911 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:09.911 INFO:teuthology.orchestra.run.smithi107.stdout:Install 12 Packages 2024-04-24T01:40:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:09.911 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 8.6 M 2024-04-24T01:40:09.911 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 103 M 2024-04-24T01:40:09.911 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:10.206 INFO:teuthology.orchestra.run.smithi131.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 39 kB/s | 6.6 kB 00:00 2024-04-24T01:40:10.407 INFO:teuthology.orchestra.run.smithi131.stdout:(2/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-04-24T01:40:10.765 INFO:teuthology.orchestra.run.smithi131.stdout:(3/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 3.2 MB/s | 2.4 MB 00:00 2024-04-24T01:40:10.874 INFO:teuthology.orchestra.run.smithi131.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 2.2 MB/s | 249 kB 00:00 2024-04-24T01:40:10.934 INFO:teuthology.orchestra.run.smithi107.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2424.gb9 98 kB/s | 32 kB 00:00 2024-04-24T01:40:10.982 INFO:teuthology.orchestra.run.smithi131.stdout:(5/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86_ 6.0 MB/s | 4.7 MB 00:00 2024-04-24T01:40:11.018 INFO:teuthology.orchestra.run.smithi107.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2424.gb98 37 kB/s | 15 kB 00:00 2024-04-24T01:40:11.058 INFO:teuthology.orchestra.run.smithi131.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-04-24T01:40:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-24T01:40:11.142 INFO:teuthology.orchestra.run.smithi131.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-04-24T01:40:11.143 INFO:teuthology.orchestra.run.smithi107.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-04-24T01:40:11.185 INFO:teuthology.orchestra.run.smithi107.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-04-24T01:40:11.192 INFO:teuthology.orchestra.run.smithi131.stdout:(9/36): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-04-24T01:40:11.217 INFO:teuthology.orchestra.run.smithi131.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-04-24T01:40:11.218 INFO:teuthology.orchestra.run.smithi107.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 11 MB/s | 863 kB 00:00 2024-04-24T01:40:11.251 INFO:teuthology.orchestra.run.smithi131.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-04-24T01:40:11.302 INFO:teuthology.orchestra.run.smithi107.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-04-24T01:40:11.443 INFO:teuthology.orchestra.run.smithi131.stdout:(12/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86 16 MB/s | 17 MB 00:01 2024-04-24T01:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout:(13/36): lua-5.4.4-4.el9.x86_64.rpm 537 kB/s | 188 kB 00:00 2024-04-24T01:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 232 kB/s | 35 kB 00:00 2024-04-24T01:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 468 kB/s | 172 kB 00:00 2024-04-24T01:40:11.644 INFO:teuthology.orchestra.run.smithi131.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-04-24T01:40:11.669 INFO:teuthology.orchestra.run.smithi131.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2024-04-24T01:40:11.720 INFO:teuthology.orchestra.run.smithi131.stdout:(18/36): python3-toml-0.10.2-6.el9.noarch.rpm 330 kB/s | 42 kB 00:00 2024-04-24T01:40:11.811 INFO:teuthology.orchestra.run.smithi107.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 876 kB/s | 548 kB 00:00 2024-04-24T01:40:11.886 INFO:teuthology.orchestra.run.smithi131.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 200 kB/s | 43 kB 00:00 2024-04-24T01:40:11.929 INFO:teuthology.orchestra.run.smithi131.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 531 kB/s | 151 kB 00:00 2024-04-24T01:40:11.936 INFO:teuthology.orchestra.run.smithi107.stdout:(8/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab6 2.6 MB/s | 3.5 MB 00:01 2024-04-24T01:40:11.996 INFO:teuthology.orchestra.run.smithi131.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-04-24T01:40:12.020 INFO:teuthology.orchestra.run.smithi107.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 369 kB/s | 31 kB 00:00 2024-04-24T01:40:12.021 INFO:teuthology.orchestra.run.smithi131.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 571 kB/s | 172 kB 00:00 2024-04-24T01:40:12.063 INFO:teuthology.orchestra.run.smithi131.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2024-04-24T01:40:12.088 INFO:teuthology.orchestra.run.smithi131.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 346 kB/s | 23 kB 00:00 2024-04-24T01:40:12.122 INFO:teuthology.orchestra.run.smithi131.stdout:(25/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-04-24T01:40:12.138 INFO:teuthology.orchestra.run.smithi131.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 257 kB/s | 19 kB 00:00 2024-04-24T01:40:12.161 INFO:teuthology.orchestra.run.smithi107.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.4 MB/s | 2.0 MB 00:00 2024-04-24T01:40:12.164 INFO:teuthology.orchestra.run.smithi131.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 259 kB/s | 20 kB 00:00 2024-04-24T01:40:12.190 INFO:teuthology.orchestra.run.smithi131.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 685 kB/s | 46 kB 00:00 2024-04-24T01:40:12.206 INFO:teuthology.orchestra.run.smithi131.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-04-24T01:40:12.248 INFO:teuthology.orchestra.run.smithi131.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-04-24T01:40:12.274 INFO:teuthology.orchestra.run.smithi131.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-04-24T01:40:12.299 INFO:teuthology.orchestra.run.smithi131.stdout:(32/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-04-24T01:40:12.303 INFO:teuthology.orchestra.run.smithi107.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 294 kB/s | 144 kB 00:00 2024-04-24T01:40:12.316 INFO:teuthology.orchestra.run.smithi131.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 532 kB/s | 36 kB 00:00 2024-04-24T01:40:12.362 INFO:teuthology.orchestra.run.smithi107.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 551 kB/s | 188 kB 00:00 2024-04-24T01:40:12.364 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:12.364 INFO:teuthology.orchestra.run.smithi107.stdout:Total 3.5 MB/s | 8.6 MB 00:02 2024-04-24T01:40:12.383 INFO:teuthology.orchestra.run.smithi131.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-04-24T01:40:12.408 INFO:teuthology.orchestra.run.smithi131.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 217 kB/s | 20 kB 00:00 2024-04-24T01:40:12.414 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:12.432 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:12.432 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:12.433 INFO:teuthology.orchestra.run.smithi131.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-04-24T01:40:12.435 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:12.435 INFO:teuthology.orchestra.run.smithi131.stdout:Total 10 MB/s | 30 MB 00:02 2024-04-24T01:40:12.573 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:40:12.587 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:12.588 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:12.613 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:40:12.613 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:40:12.906 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:40:12.907 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:40:13.109 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-24T01:40:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-24T01:40:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-24T01:40:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-24T01:40:13.367 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-24T01:40:13.492 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-24T01:40:13.595 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-24T01:40:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-24T01:40:13.679 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:40:13.714 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-24T01:40:14.133 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:40:14.195 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T01:40:14.227 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T01:40:14.263 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T01:40:14.334 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T01:40:14.404 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T01:40:14.437 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T01:40:14.528 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T01:40:14.608 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T01:40:14.657 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T01:40:14.692 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T01:40:14.722 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T01:40:14.755 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-24T01:40:14.756 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T01:40:14.790 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T01:40:14.790 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:40:14.830 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T01:40:14.865 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T01:40:14.900 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T01:40:14.938 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T01:40:15.011 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T01:40:15.156 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T01:40:15.246 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T01:40:15.299 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T01:40:15.367 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T01:40:15.420 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T01:40:15.476 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T01:40:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T01:40:15.718 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T01:40:15.796 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T01:40:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T01:40:15.917 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T01:40:16.035 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T01:40:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:40:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-24T01:40:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-24T01:40:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-24T01:40:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-24T01:40:16.228 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:40:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:40:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T01:40:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:40:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:40:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:16.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-24T01:40:16.470 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:16.470 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:16.470 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T01:40:16.470 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T01:40:16.471 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T01:40:16.472 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T01:40:16.472 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:16.472 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:16.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T01:40:17.240 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:08 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:17.361 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:17.361 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-04-24T01:40:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T01:40:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout:Install 12 Packages 2024-04-24T01:40:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:17.364 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 38 M 2024-04-24T01:40:17.364 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 209 M 2024-04-24T01:40:17.364 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:17.696 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:40:17.721 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:40:17.721 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:17.721 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T01:40:17.722 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:40:17.722 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:40:17.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:18.172 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:40:18.195 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:40:18.195 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:18.195 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T01:40:18.195 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:40:18.195 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:40:18.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:18.278 INFO:teuthology.orchestra.run.smithi107.stdout:(1/12): ceph-mgr-diskprediction-local-19.0.0-24 10 MB/s | 7.4 MB 00:00 2024-04-24T01:40:18.423 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:40:18.446 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:40:18.446 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:18.446 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T01:40:18.446 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:40:18.446 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:40:18.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 213 kB/s | 195 kB 00:00 2024-04-24T01:40:18.510 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:40:18.586 INFO:teuthology.orchestra.run.smithi107.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 106 kB/s | 33 kB 00:00 2024-04-24T01:40:18.703 INFO:teuthology.orchestra.run.smithi107.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-04-24T01:40:18.912 INFO:teuthology.orchestra.run.smithi107.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 169 kB/s | 35 kB 00:00 2024-04-24T01:40:19.404 INFO:teuthology.orchestra.run.smithi107.stdout:(6/12): libgfortran-11.4.1-3.el9.x86_64.rpm 432 kB/s | 803 kB 00:01 2024-04-24T01:40:19.763 INFO:teuthology.orchestra.run.smithi107.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2024-04-24T01:40:20.071 INFO:teuthology.orchestra.run.smithi107.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 366 kB/s | 244 kB 00:00 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T01:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T01:40:20.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T01:40:20.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T01:40:20.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T01:40:20.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T01:40:20.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T01:40:20.215 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T01:40:20.215 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T01:40:20.215 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T01:40:20.215 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T01:40:20.215 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T01:40:20.215 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T01:40:20.216 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T01:40:20.216 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T01:40:20.216 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T01:40:20.216 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T01:40:20.271 INFO:teuthology.orchestra.run.smithi107.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.2 MB/s | 250 kB 00:00 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T01:40:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T01:40:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T01:40:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T01:40:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T01:40:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:21.044 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:40:21.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-base 2024-04-24T01:40:21.884 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:55 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:40:21.963 INFO:teuthology.orchestra.run.smithi131.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:22.004 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:40:22.006 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:40:22.006 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:40:22.073 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install cephadm 2024-04-24T01:40:22.573 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:56 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:40:22.588 INFO:teuthology.orchestra.run.smithi107.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.8 MB/s | 5.1 MB 00:02 2024-04-24T01:40:22.693 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:40:22.694 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:22.694 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:40:22.694 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 762 k 2024-04-24T01:40:22.695 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 768 k 2024-04-24T01:40:22.696 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:40:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 1.2 MB/s | 4.7 MB 00:03 2024-04-24T01:40:22.990 INFO:teuthology.orchestra.run.smithi131.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 2.5 MB/s | 762 kB 00:00 2024-04-24T01:40:22.991 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:22.992 INFO:teuthology.orchestra.run.smithi131.stdout:Total 2.5 MB/s | 762 kB 00:00 2024-04-24T01:40:22.992 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:40:22.997 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:40:22.997 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:40:23.003 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:40:23.003 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:40:23.075 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:40:23.567 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:23.643 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:24.159 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:40:24.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:24.159 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:40:24.159 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:24.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:24.159 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:40:24.390 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T01:40:24.896 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:58 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:40:25.016 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:40:25.017 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:25.017 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-04-24T01:40:25.017 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:25.017 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:40:25.017 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-24T01:40:25.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:25.017 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:40:25.018 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:25.018 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-04-24T01:40:25.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:25.018 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 145 k 2024-04-24T01:40:25.018 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 435 k 2024-04-24T01:40:25.018 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:40:25.215 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 735 kB/s | 145 kB 00:00 2024-04-24T01:40:25.215 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:25.216 INFO:teuthology.orchestra.run.smithi131.stdout:Total 728 kB/s | 145 kB 00:00 2024-04-24T01:40:25.216 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:40:25.224 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:40:25.224 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:40:25.280 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:40:25.280 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:40:25.427 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:40:25.524 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:40:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:40:25.549 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:25.549 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T01:40:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:26.408 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:40:26.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:26.408 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:40:26.408 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:26.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:26.408 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:40:26.609 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr 2024-04-24T01:40:27.121 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:01 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:40:27.201 INFO:teuthology.orchestra.run.smithi131.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:27.243 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:40:27.244 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:40:27.244 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:40:27.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T01:40:27.737 INFO:teuthology.orchestra.run.smithi107.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-04-24T01:40:27.738 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:27.738 INFO:teuthology.orchestra.run.smithi107.stdout:Total 3.7 MB/s | 38 MB 00:10 2024-04-24T01:40:27.849 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:01 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:40:27.970 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T01:40:27.971 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout:Install 12 Packages 2024-04-24T01:40:27.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:27.973 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 8.6 M 2024-04-24T01:40:27.973 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 103 M 2024-04-24T01:40:27.973 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:40:28.090 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:28.116 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:28.116 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:28.524 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:28.524 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:28.562 INFO:teuthology.orchestra.run.smithi131.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2424.gb9 173 kB/s | 32 kB 00:00 2024-04-24T01:40:28.587 INFO:teuthology.orchestra.run.smithi131.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2424.gb98 73 kB/s | 15 kB 00:00 2024-04-24T01:40:28.812 INFO:teuthology.orchestra.run.smithi131.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-04-24T01:40:28.979 INFO:teuthology.orchestra.run.smithi131.stdout:(4/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab6 5.8 MB/s | 3.5 MB 00:00 2024-04-24T01:40:29.021 INFO:teuthology.orchestra.run.smithi131.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-04-24T01:40:29.046 INFO:teuthology.orchestra.run.smithi131.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.6 MB/s | 863 kB 00:00 2024-04-24T01:40:29.180 INFO:teuthology.orchestra.run.smithi131.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 122 kB/s | 19 kB 00:00 2024-04-24T01:40:29.280 INFO:teuthology.orchestra.run.smithi131.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.8 MB/s | 548 kB 00:00 2024-04-24T01:40:29.306 INFO:teuthology.orchestra.run.smithi131.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.1 MB/s | 144 kB 00:00 2024-04-24T01:40:29.331 INFO:teuthology.orchestra.run.smithi131.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 611 kB/s | 31 kB 00:00 2024-04-24T01:40:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:29.365 INFO:teuthology.orchestra.run.smithi131.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-04-24T01:40:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T01:40:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:40:29.481 INFO:teuthology.orchestra.run.smithi131.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.3 MB/s | 2.0 MB 00:00 2024-04-24T01:40:29.484 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:29.485 INFO:teuthology.orchestra.run.smithi131.stdout:Total 5.7 MB/s | 8.6 MB 00:01 2024-04-24T01:40:29.532 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:40:29.548 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:40:29.549 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:40:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:40:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T01:40:29.702 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:40:29.703 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:40:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T01:40:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T01:40:29.894 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T01:40:30.235 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:40:30.324 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-24T01:40:30.359 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-24T01:40:30.406 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-24T01:40:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-24T01:40:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-24T01:40:30.554 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T01:40:30.648 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-24T01:40:30.675 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T01:40:30.741 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-24T01:40:30.783 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-24T01:40:30.812 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:40:30.843 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-24T01:40:31.892 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-24T01:40:31.910 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:40:31.928 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:40:32.954 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T01:40:32.985 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:40:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-24T01:40:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-24T01:40:33.563 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-24T01:40:33.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:33.563 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:40:33.563 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T01:40:33.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:33.565 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:40:33.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T01:40:34.324 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:08 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:40:34.444 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:40:34.445 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-04-24T01:40:34.445 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:40:34.445 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-04-24T01:40:34.445 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:40:34.445 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-24T01:40:34.445 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T01:40:34.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:34.447 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:40:34.447 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-04-24T01:40:34.447 INFO:teuthology.orchestra.run.smithi131.stdout:Install 12 Packages 2024-04-24T01:40:34.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:40:34.447 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 38 M 2024-04-24T01:40:34.447 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 209 M 2024-04-24T01:40:34.447 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:40:35.249 INFO:teuthology.orchestra.run.smithi131.stdout:(1/12): ceph-mgr-diskprediction-local-19.0.0-24 12 MB/s | 7.4 MB 00:00 2024-04-24T01:40:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:40:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-24T01:40:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:40:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:40:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T01:40:35.470 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T01:40:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T01:40:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T01:40:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T01:40:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T01:40:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:40:35.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T01:40:35.700 INFO:teuthology.orchestra.run.smithi131.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 186 kB/s | 195 kB 00:01 2024-04-24T01:40:35.858 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T01:40:35.858 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:35.858 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:35.858 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:35.859 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 42 kB/s | 33 kB 00:00 2024-04-24T01:40:36.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-rook 2024-04-24T01:40:36.755 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:27 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:36.767 INFO:teuthology.orchestra.run.smithi131.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 26 kB/s | 18 kB 00:00 2024-04-24T01:40:36.792 INFO:teuthology.orchestra.run.smithi131.stdout:(5/12): libgfortran-11.4.1-3.el9.x86_64.rpm 375 kB/s | 803 kB 00:02 2024-04-24T01:40:36.875 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:36.876 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:36.876 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:40:36.876 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:36.876 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:36.876 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T01:40:36.877 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:36.878 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:36.878 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:36.878 INFO:teuthology.orchestra.run.smithi107.stdout:Install 13 Packages 2024-04-24T01:40:36.878 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:36.878 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.2 M 2024-04-24T01:40:36.878 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 26 M 2024-04-24T01:40:36.879 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:37.311 INFO:teuthology.orchestra.run.smithi107.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 116 kB/s | 19 kB 00:00 2024-04-24T01:40:37.337 INFO:teuthology.orchestra.run.smithi107.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 134 kB/s | 26 kB 00:00 2024-04-24T01:40:37.395 INFO:teuthology.orchestra.run.smithi107.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-04-24T01:40:37.437 INFO:teuthology.orchestra.run.smithi107.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-04-24T01:40:37.462 INFO:teuthology.orchestra.run.smithi107.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-04-24T01:40:37.495 INFO:teuthology.orchestra.run.smithi107.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-04-24T01:40:37.521 INFO:teuthology.orchestra.run.smithi107.stdout:(7/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 131 kB/s | 49 kB 00:00 2024-04-24T01:40:37.525 INFO:teuthology.orchestra.run.smithi131.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 46 kB/s | 35 kB 00:00 2024-04-24T01:40:37.788 INFO:teuthology.orchestra.run.smithi107.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 51 kB/s | 15 kB 00:00 2024-04-24T01:40:37.838 INFO:teuthology.orchestra.run.smithi107.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 86 kB/s | 32 kB 00:00 2024-04-24T01:40:38.071 INFO:teuthology.orchestra.run.smithi107.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 374 kB/s | 206 kB 00:00 2024-04-24T01:40:38.122 INFO:teuthology.orchestra.run.smithi107.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 208 kB/s | 59 kB 00:00 2024-04-24T01:40:38.314 INFO:teuthology.orchestra.run.smithi107.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 370 kB/s | 90 kB 00:00 2024-04-24T01:40:38.347 INFO:teuthology.orchestra.run.smithi107.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2024-04-24T01:40:38.350 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:38.350 INFO:teuthology.orchestra.run.smithi107.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-04-24T01:40:38.410 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:38.424 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:38.424 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:38.506 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:38.507 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:38.709 INFO:teuthology.orchestra.run.smithi131.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 206 kB/s | 244 kB 00:01 2024-04-24T01:40:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T01:40:39.240 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T01:40:39.304 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T01:40:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T01:40:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T01:40:39.501 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T01:40:39.611 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T01:40:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T01:40:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T01:40:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T01:40:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T01:40:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T01:40:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:40:40.926 INFO:teuthology.orchestra.run.smithi131.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 586 kB/s | 3.0 MB 00:05 2024-04-24T01:40:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T01:40:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T01:40:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T01:40:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T01:40:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T01:40:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T01:40:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T01:40:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T01:40:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T01:40:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:41.557 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:41.777 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T01:40:41.868 INFO:teuthology.orchestra.run.smithi131.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 266 kB/s | 250 kB 00:00 2024-04-24T01:40:42.288 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:33 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:42.407 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T01:40:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T01:40:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T01:40:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T01:40:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:42.409 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:42.409 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:42.409 INFO:teuthology.orchestra.run.smithi107.stdout:Install 6 Packages 2024-04-24T01:40:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:42.410 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 7.0 M 2024-04-24T01:40:42.410 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 33 M 2024-04-24T01:40:42.410 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:42.832 INFO:teuthology.orchestra.run.smithi107.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-04-24T01:40:42.857 INFO:teuthology.orchestra.run.smithi107.stdout:(2/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 628 kB/s | 141 kB 00:00 2024-04-24T01:40:43.000 INFO:teuthology.orchestra.run.smithi107.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-24T01:40:43.274 INFO:teuthology.orchestra.run.smithi107.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 138 kB/s | 58 kB 00:00 2024-04-24T01:40:43.349 INFO:teuthology.orchestra.run.smithi107.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 146 kB/s | 51 kB 00:00 2024-04-24T01:40:43.533 INFO:teuthology.orchestra.run.smithi107.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 782 kB/s | 548 kB 00:00 2024-04-24T01:40:43.534 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:43.534 INFO:teuthology.orchestra.run.smithi107.stdout:Total 6.2 MB/s | 7.0 MB 00:01 2024-04-24T01:40:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:43.617 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:43.617 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:43.713 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:43.714 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:43.843 INFO:teuthology.orchestra.run.smithi131.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 688 kB/s | 4.7 MB 00:07 2024-04-24T01:40:44.024 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:44.210 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T01:40:44.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T01:40:44.798 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T01:40:44.879 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T01:40:44.943 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T01:40:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:40:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:40:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-24T01:40:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T01:40:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T01:40:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T01:40:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T01:40:45.793 INFO:teuthology.orchestra.run.smithi131.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 737 kB/s | 5.1 MB 00:07 2024-04-24T01:40:45.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T01:40:45.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:45.971 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:45.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:45.972 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T01:40:45.972 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T01:40:45.972 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T01:40:45.972 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T01:40:45.972 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T01:40:45.972 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:45.972 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:46.206 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-fuse 2024-04-24T01:40:46.710 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:37 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:46.828 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:46.828 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:46.828 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:40:46.828 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:46.828 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout:Install 2 Packages 2024-04-24T01:40:46.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:46.830 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 969 k 2024-04-24T01:40:46.830 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 2.8 M 2024-04-24T01:40:46.830 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:47.159 INFO:teuthology.orchestra.run.smithi107.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 430 kB/s | 80 kB 00:00 2024-04-24T01:40:47.276 INFO:teuthology.orchestra.run.smithi107.stdout:(2/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 2.9 MB/s | 889 kB 00:00 2024-04-24T01:40:47.277 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:47.277 INFO:teuthology.orchestra.run.smithi107.stdout:Total 2.1 MB/s | 969 kB 00:00 2024-04-24T01:40:47.288 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:47.310 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:47.310 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:47.386 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:47.386 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:47.571 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T01:40:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:40:48.346 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:40:48.346 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-24T01:40:48.606 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T01:40:48.607 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:48.607 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:48.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T01:40:48.607 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:48.607 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:48.898 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-volume 2024-04-24T01:40:49.415 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:40 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:49.539 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:49.540 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:49.540 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-24T01:40:49.540 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:49.540 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:49.540 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:Install 2 Packages 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 341 k 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 1.5 M 2024-04-24T01:40:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:49.782 INFO:teuthology.orchestra.run.smithi107.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 693 kB/s | 77 kB 00:00 2024-04-24T01:40:50.033 INFO:teuthology.orchestra.run.smithi107.stdout:(2/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 729 kB/s | 264 kB 00:00 2024-04-24T01:40:50.033 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:50.033 INFO:teuthology.orchestra.run.smithi107.stdout:Total 691 kB/s | 341 kB 00:00 2024-04-24T01:40:50.045 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:50.055 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:50.055 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:50.081 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:50.081 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:50.241 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:50.424 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T01:40:50.460 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:40:50.475 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:40:50.475 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:40:50.475 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T01:40:50.475 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:51.142 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-24T01:40:51.412 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T01:40:51.412 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:51.412 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:51.412 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:40:51.412 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T01:40:51.412 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:51.413 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:51.714 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librados-devel 2024-04-24T01:40:52.232 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:43 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:52.354 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:52.355 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:52.355 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-04-24T01:40:52.355 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:52.355 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:52.355 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-24T01:40:52.355 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:52.356 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:52.356 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:52.356 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-04-24T01:40:52.356 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:52.356 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 127 k 2024-04-24T01:40:52.356 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 456 k 2024-04-24T01:40:52.356 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:52.671 INFO:teuthology.orchestra.run.smithi107.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 403 kB/s | 127 kB 00:00 2024-04-24T01:40:52.671 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:52.672 INFO:teuthology.orchestra.run.smithi107.stdout:Total 401 kB/s | 127 kB 00:00 2024-04-24T01:40:52.672 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:52.678 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:52.678 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:52.741 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:52.742 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:52.889 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:52.991 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:40:53.378 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:40:53.604 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:40:53.604 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:53.604 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:53.604 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:53.605 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:53.605 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:53.828 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs2 2024-04-24T01:40:54.348 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:45 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:54.429 INFO:teuthology.orchestra.run.smithi107.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:54.470 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:54.471 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:54.471 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:54.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs-devel 2024-04-24T01:40:55.058 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:46 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:55.177 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:55.179 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-04-24T01:40:55.179 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:55.179 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:40:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-24T01:40:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:55.179 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:40:55.180 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:40:55.180 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-04-24T01:40:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:55.180 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 32 k 2024-04-24T01:40:55.180 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 142 k 2024-04-24T01:40:55.180 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:40:55.424 INFO:teuthology.orchestra.run.smithi107.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 130 kB/s | 32 kB 00:00 2024-04-24T01:40:55.425 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:55.425 INFO:teuthology.orchestra.run.smithi107.stdout:Total 129 kB/s | 32 kB 00:00 2024-04-24T01:40:55.425 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:40:55.428 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:40:55.428 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:40:55.430 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:40:55.431 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:40:55.538 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:40:55.653 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:40:55.985 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:56.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librados2 2024-04-24T01:40:56.878 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:47 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:56.956 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:56.996 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:56.997 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:56.997 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:57.070 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librbd1 2024-04-24T01:40:57.574 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:48 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:57.652 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:57.694 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:57.695 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:57.695 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:57.761 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rados 2024-04-24T01:40:58.274 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:49 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:58.358 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:58.394 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:58.395 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:58.396 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:58.457 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rgw 2024-04-24T01:40:58.967 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:49 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:59.047 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:59.087 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:59.088 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:59.088 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:59.152 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-cephfs 2024-04-24T01:40:59.665 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:50 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:40:59.745 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:40:59.786 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:40:59.790 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:40:59.791 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:40:59.859 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rbd 2024-04-24T01:41:00.366 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:51 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:41:00.446 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:00.486 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:41:00.487 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-04-24T01:41:00.487 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:41:00.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-fuse 2024-04-24T01:41:01.059 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:52 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:41:01.178 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:01.179 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-04-24T01:41:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:01.180 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 86 k 2024-04-24T01:41:01.180 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 231 k 2024-04-24T01:41:01.180 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:41:01.393 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 402 kB/s | 86 kB 00:00 2024-04-24T01:41:01.393 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:01.393 INFO:teuthology.orchestra.run.smithi107.stdout:Total 400 kB/s | 86 kB 00:00 2024-04-24T01:41:01.393 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:41:01.400 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:41:01.400 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:41:01.463 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:41:01.463 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:41:01.608 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:41:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:02.294 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:02.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:02.294 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:41:02.294 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:02.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:02.295 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:41:02.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-mirror 2024-04-24T01:41:03.085 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:54 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:41:03.206 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:41:03.206 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 3.1 M 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 13 M 2024-04-24T01:41:03.207 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:41:03.737 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 5.8 MB/s | 3.1 MB 00:00 2024-04-24T01:41:03.739 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:03.739 INFO:teuthology.orchestra.run.smithi107.stdout:Total 5.8 MB/s | 3.1 MB 00:00 2024-04-24T01:41:03.739 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:41:03.748 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:41:03.748 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:41:03.832 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:41:03.832 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:41:04.275 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:41:04.330 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:04.355 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:04.355 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:41:04.355 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T01:41:04.355 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:41:04.355 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:41:04.356 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:04.415 INFO:teuthology.orchestra.run.smithi131.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 738 kB/s | 16 MB 00:22 2024-04-24T01:41:04.417 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:04.417 INFO:teuthology.orchestra.run.smithi131.stdout:Total 1.3 MB/s | 38 MB 00:29 2024-04-24T01:41:04.767 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:04.794 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:04.794 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:05.200 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:05.200 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:05.445 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:41:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:05.445 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:41:05.661 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-nbd 2024-04-24T01:41:06.055 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:06.120 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T01:41:06.163 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:41:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:57 ago on Wed 24 Apr 2024 01:39:09 AM UTC. 2024-04-24T01:41:06.263 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:41:06.305 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-24T01:41:06.305 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 170 k 2024-04-24T01:41:06.306 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 494 k 2024-04-24T01:41:06.307 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-24T01:41:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T01:41:06.485 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T01:41:06.539 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T01:41:06.616 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T01:41:06.649 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 497 kB/s | 170 kB 00:00 2024-04-24T01:41:06.649 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:06.650 INFO:teuthology.orchestra.run.smithi107.stdout:Total 495 kB/s | 170 kB 00:00 2024-04-24T01:41:06.650 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-24T01:41:06.658 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-24T01:41:06.658 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-24T01:41:06.720 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-24T01:41:06.720 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-24T01:41:06.881 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-24T01:41:07.011 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:07.270 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T01:41:07.387 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T01:41:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:07.652 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:07.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:07.652 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-24T01:41:07.652 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:07.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:07.652 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-24T01:41:07.883 DEBUG:teuthology.parallel:result is None 2024-04-24T01:41:08.629 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:41:09.670 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T01:41:09.707 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:41:12.442 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:41:12.442 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-24T01:41:12.442 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:41:12.442 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:41:12.442 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T01:41:12.442 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T01:41:12.443 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T01:41:12.443 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T01:41:12.443 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T01:41:12.443 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T01:41:12.443 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:41:12.443 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T01:41:12.818 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:12.819 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:13.193 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-rook 2024-04-24T01:41:13.706 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:47 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:13.824 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:13.825 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T01:41:13.826 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout:Install 13 Packages 2024-04-24T01:41:13.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:13.828 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 2.2 M 2024-04-24T01:41:13.828 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 26 M 2024-04-24T01:41:13.828 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:14.144 INFO:teuthology.orchestra.run.smithi131.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 185 kB/s | 19 kB 00:00 2024-04-24T01:41:14.170 INFO:teuthology.orchestra.run.smithi131.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 198 kB/s | 26 kB 00:00 2024-04-24T01:41:14.228 INFO:teuthology.orchestra.run.smithi131.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-04-24T01:41:14.270 INFO:teuthology.orchestra.run.smithi131.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-04-24T01:41:14.295 INFO:teuthology.orchestra.run.smithi131.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-04-24T01:41:14.312 INFO:teuthology.orchestra.run.smithi131.stdout:(6/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 181 kB/s | 49 kB 00:00 2024-04-24T01:41:14.329 INFO:teuthology.orchestra.run.smithi131.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-04-24T01:41:14.596 INFO:teuthology.orchestra.run.smithi131.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-04-24T01:41:14.613 INFO:teuthology.orchestra.run.smithi131.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 50 kB/s | 15 kB 00:00 2024-04-24T01:41:14.905 INFO:teuthology.orchestra.run.smithi131.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 203 kB/s | 59 kB 00:00 2024-04-24T01:41:15.072 INFO:teuthology.orchestra.run.smithi131.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 277 kB/s | 206 kB 00:00 2024-04-24T01:41:15.205 INFO:teuthology.orchestra.run.smithi131.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 299 kB/s | 90 kB 00:00 2024-04-24T01:41:15.572 INFO:teuthology.orchestra.run.smithi131.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.0 MB/s | 1.0 MB 00:00 2024-04-24T01:41:15.573 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:15.573 INFO:teuthology.orchestra.run.smithi131.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-04-24T01:41:15.643 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:15.743 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:15.744 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:16.410 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T01:41:16.464 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T01:41:16.519 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T01:41:16.549 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T01:41:16.590 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T01:41:16.682 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T01:41:16.792 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T01:41:16.850 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T01:41:17.557 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T01:41:17.597 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T01:41:17.631 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T01:41:17.679 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T01:41:17.701 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T01:41:18.417 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T01:41:18.418 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T01:41:18.418 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T01:41:18.738 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T01:41:18.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:18.738 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:18.738 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:41:18.738 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T01:41:18.738 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T01:41:18.738 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:18.739 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:18.994 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T01:41:19.509 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:53 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:19.629 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:19.630 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:19.630 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:41:19.630 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:19.630 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:19.630 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-24T01:41:19.630 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:41:19.630 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout:Install 6 Packages 2024-04-24T01:41:19.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:19.632 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 7.0 M 2024-04-24T01:41:19.632 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 33 M 2024-04-24T01:41:19.632 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:20.173 INFO:teuthology.orchestra.run.smithi131.stdout:(1/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 420 kB/s | 141 kB 00:00 2024-04-24T01:41:20.498 INFO:teuthology.orchestra.run.smithi131.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.6 MB/s | 548 kB 00:00 2024-04-24T01:41:20.540 INFO:teuthology.orchestra.run.smithi131.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-04-24T01:41:20.791 INFO:teuthology.orchestra.run.smithi131.stdout:(4/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 260 kB/s | 248 kB 00:00 2024-04-24T01:41:21.491 INFO:teuthology.orchestra.run.smithi131.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 54 kB/s | 51 kB 00:00 2024-04-24T01:41:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 569 kB/s | 6.0 MB 00:10 2024-04-24T01:41:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:Total 654 kB/s | 7.0 MB 00:10 2024-04-24T01:41:30.640 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:30.652 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:30.652 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:31.213 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T01:41:31.266 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T01:41:31.783 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T01:41:31.868 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T01:41:31.932 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T01:41:31.962 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:41:32.725 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:41:32.725 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-24T01:41:32.725 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T01:41:32.725 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T01:41:32.725 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T01:41:32.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T01:41:32.993 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:32.994 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:33.211 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-fuse 2024-04-24T01:41:33.726 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:07 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:33.845 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:33.845 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:41:33.845 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:33.845 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-24T01:41:33.846 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:41:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T01:41:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:33.846 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:33.846 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:33.846 INFO:teuthology.orchestra.run.smithi131.stdout:Install 2 Packages 2024-04-24T01:41:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:33.847 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 969 k 2024-04-24T01:41:33.847 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 2.8 M 2024-04-24T01:41:33.847 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:34.257 INFO:teuthology.orchestra.run.smithi131.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 541 kB/s | 80 kB 00:00 2024-04-24T01:41:34.541 INFO:teuthology.orchestra.run.smithi131.stdout:(2/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 2.0 MB/s | 889 kB 00:00 2024-04-24T01:41:34.542 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:34.542 INFO:teuthology.orchestra.run.smithi131.stdout:Total 1.4 MB/s | 969 kB 00:00 2024-04-24T01:41:34.553 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:34.574 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:34.574 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:34.655 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:34.656 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:34.837 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:34.984 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T01:41:35.047 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:41:35.675 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:41:35.675 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-24T01:41:35.903 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T01:41:35.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:35.903 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:35.903 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T01:41:35.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:35.903 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:36.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-volume 2024-04-24T01:41:36.663 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:10 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:36.785 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T01:41:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:36.787 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:36.787 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:36.787 INFO:teuthology.orchestra.run.smithi131.stdout:Install 2 Packages 2024-04-24T01:41:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:36.787 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 341 k 2024-04-24T01:41:36.787 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 1.5 M 2024-04-24T01:41:36.788 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:36.996 INFO:teuthology.orchestra.run.smithi131.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 542 kB/s | 77 kB 00:00 2024-04-24T01:41:37.221 INFO:teuthology.orchestra.run.smithi131.stdout:(2/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 718 kB/s | 264 kB 00:00 2024-04-24T01:41:37.222 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:37.222 INFO:teuthology.orchestra.run.smithi131.stdout:Total 783 kB/s | 341 kB 00:00 2024-04-24T01:41:37.233 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:37.242 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:37.242 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:37.268 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:37.269 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:37.415 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:37.621 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T01:41:37.658 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:41:37.672 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:41:37.672 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:41:37.672 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T01:41:37.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:38.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-24T01:41:38.652 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T01:41:38.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:38.652 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:38.652 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:41:38.652 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T01:41:38.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:38.652 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:39.005 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librados-devel 2024-04-24T01:41:39.528 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:13 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:39.651 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:39.651 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:39.651 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 127 k 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 456 k 2024-04-24T01:41:39.652 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:39.968 INFO:teuthology.orchestra.run.smithi131.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 401 kB/s | 127 kB 00:00 2024-04-24T01:41:39.969 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:39.969 INFO:teuthology.orchestra.run.smithi131.stdout:Total 400 kB/s | 127 kB 00:00 2024-04-24T01:41:39.969 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:39.975 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:39.975 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:40.039 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:40.039 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:40.188 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:40.289 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:40.960 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:40.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:40.960 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:40.960 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:40.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:40.960 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:41.222 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install libcephfs2 2024-04-24T01:41:41.755 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:15 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:41.837 INFO:teuthology.orchestra.run.smithi131.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:41.879 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:41.880 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:41:41.880 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:41.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install libcephfs-devel 2024-04-24T01:41:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:16 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:42.603 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:42.604 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 32 k 2024-04-24T01:41:42.605 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 142 k 2024-04-24T01:41:42.605 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:42.847 INFO:teuthology.orchestra.run.smithi131.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 131 kB/s | 32 kB 00:00 2024-04-24T01:41:42.848 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:42.848 INFO:teuthology.orchestra.run.smithi131.stdout:Total 130 kB/s | 32 kB 00:00 2024-04-24T01:41:42.848 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:42.851 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:42.852 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:42.854 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:42.854 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:42.945 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:43.043 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:43.401 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:43.617 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:43.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:43.618 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:43.618 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:43.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:43.618 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:43.786 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librados2 2024-04-24T01:41:44.291 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:18 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:44.369 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:44.410 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:44.411 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:41:44.411 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:44.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librbd1 2024-04-24T01:41:44.982 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:18 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:45.061 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:45.103 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:45.104 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:41:45.104 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:45.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rados 2024-04-24T01:41:45.683 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:19 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:45.762 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:45.805 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:45.806 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:41:45.806 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:45.868 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rgw 2024-04-24T01:41:46.374 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:20 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:46.453 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:46.494 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:46.498 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:41:46.498 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:46.564 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-cephfs 2024-04-24T01:41:47.072 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:21 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:47.152 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:47.194 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:47.194 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:41:47.195 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:47.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rbd 2024-04-24T01:41:47.770 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:21 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:47.849 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:41:47.889 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:47.890 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-04-24T01:41:47.890 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:47.959 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-fuse 2024-04-24T01:41:48.469 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:22 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:48.589 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 86 k 2024-04-24T01:41:48.590 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 231 k 2024-04-24T01:41:48.591 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:48.993 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 213 kB/s | 86 kB 00:00 2024-04-24T01:41:48.993 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:48.994 INFO:teuthology.orchestra.run.smithi131.stdout:Total 213 kB/s | 86 kB 00:00 2024-04-24T01:41:48.994 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:49.000 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:49.000 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:49.062 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:49.063 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:49.213 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:49.313 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:49.870 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:49.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:49.871 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:49.871 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:49.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:49.871 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:50.134 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-mirror 2024-04-24T01:41:50.648 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:24 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:50.771 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:50.772 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-04-24T01:41:50.772 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:50.772 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 3.1 M 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 13 M 2024-04-24T01:41:50.773 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:52.020 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 2.5 MB/s | 3.1 MB 00:01 2024-04-24T01:41:52.021 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:52.021 INFO:teuthology.orchestra.run.smithi131.stdout:Total 2.5 MB/s | 3.1 MB 00:01 2024-04-24T01:41:52.022 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:52.031 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:52.031 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:52.111 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:52.112 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:52.548 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:52.613 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:52.637 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:52.638 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:41:52.638 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T01:41:52.638 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:41:52.638 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:41:52.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:53.687 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:53.687 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:53.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-nbd 2024-04-24T01:41:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:28 ago on Wed 24 Apr 2024 01:39:26 AM UTC. 2024-04-24T01:41:54.565 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-24T01:41:54.566 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-04-24T01:41:54.566 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:54.566 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-24T01:41:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 170 k 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 494 k 2024-04-24T01:41:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-24T01:41:54.790 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 764 kB/s | 170 kB 00:00 2024-04-24T01:41:54.791 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:41:54.791 INFO:teuthology.orchestra.run.smithi131.stdout:Total 758 kB/s | 170 kB 00:00 2024-04-24T01:41:54.791 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-24T01:41:54.799 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-24T01:41:54.799 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-24T01:41:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-24T01:41:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-24T01:41:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-24T01:41:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:41:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-24T01:41:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:41:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-24T01:41:55.999 DEBUG:teuthology.parallel:result is None 2024-04-24T01:41:56.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:41:56.232 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T01:41:56.257 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-24T01:41:56.257 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-24T01:41:56.257 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-24T01:41:56.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:41:56.397 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T01:41:56.418 INFO:teuthology.orchestra.run.smithi131.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-24T01:41:56.419 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-24T01:41:56.419 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-24T01:41:56.420 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T01:41:56.421 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:56.421 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T01:41:56.449 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:41:56.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T01:41:56.483 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T01:41:56.483 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:56.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T01:41:56.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T01:41:56.582 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:41:56.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T01:41:56.607 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T01:41:56.671 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T01:41:56.671 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:56.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T01:41:56.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T01:41:56.759 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:41:56.759 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T01:41:56.782 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T01:41:56.845 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T01:41:56.845 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:56.845 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T01:41:56.869 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T01:41:56.933 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:41:56.933 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T01:41:56.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T01:41:57.021 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T01:41:57.114 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T01:41:57.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-04-24T01:41:57.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-04-24T01:41:57.139 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T01:41:57.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T01:41:57.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T01:41:57.203 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T01:41:57.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T01:41:57.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T01:41:57.275 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T01:41:57.276 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T01:41:57.276 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7670613', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9360, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3hLdUAWWOT4cAqmZD1mWWe0wwaHQRgN8Gyuv2j3/r/q8McWSI92z2kEVL7bB5wYNyqGjpJMVlB7WCaht/d0dU=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBvR23NdOna5oc7+bVP/3//TAi48K/IW/ntaXdKp6l7UQXmZ0DJHFzEHTtWQEqPtb2S5AGXAEzRnWpuaskJooM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T01:41:57.276 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T01:41:57.308 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T01:41:57.323 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T01:41:57.363 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T01:41:57.389 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:57.390 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T01:41:57.441 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T01:41:57.441 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-04-24T01:41:57.495 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T01:41:57.495 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:57.496 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-24T01:41:57.496 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:57.496 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:57.496 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-24 01:41:04.622854472 +0000 2024-04-24T01:41:57.496 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-24 01:38:20.850968837 +0000 2024-04-24T01:41:57.496 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-24 01:38:20.850968837 +0000 2024-04-24T01:41:57.496 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-24 01:38:20.850968837 +0000 2024-04-24T01:41:57.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T01:41:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-24T01:41:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-24T01:41:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000187004 s, 2.7 MB/s 2024-04-24T01:41:57.559 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T01:41:57.616 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-04-24T01:41:57.670 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T01:41:57.670 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:57.670 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-24T01:41:57.670 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:57.670 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:57.670 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-24 01:41:04.622854472 +0000 2024-04-24T01:41:57.670 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-24 01:38:21.207962403 +0000 2024-04-24T01:41:57.671 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-24 01:38:21.207962403 +0000 2024-04-24T01:41:57.671 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-24 01:38:21.207962403 +0000 2024-04-24T01:41:57.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T01:41:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-24T01:41:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-24T01:41:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000193088 s, 2.7 MB/s 2024-04-24T01:41:57.733 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T01:41:57.789 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-04-24T01:41:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T01:41:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:57.845 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-24T01:41:57.845 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:57.845 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:57.845 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-24 01:41:04.622854472 +0000 2024-04-24T01:41:57.845 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-24 01:38:21.543956347 +0000 2024-04-24T01:41:57.845 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-24 01:38:21.543956347 +0000 2024-04-24T01:41:57.846 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-24 01:38:21.543956347 +0000 2024-04-24T01:41:57.846 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T01:41:57.907 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-24T01:41:57.907 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-24T01:41:57.907 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000171674 s, 3.0 MB/s 2024-04-24T01:41:57.908 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T01:41:57.963 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-04-24T01:41:58.019 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T01:41:58.019 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:58.019 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-24T01:41:58.019 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:58.019 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:58.019 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-24 01:41:04.623854454 +0000 2024-04-24T01:41:58.019 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-24 01:38:21.889950111 +0000 2024-04-24T01:41:58.020 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-24 01:38:21.889950111 +0000 2024-04-24T01:41:58.020 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-24 01:38:21.889950111 +0000 2024-04-24T01:41:58.020 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T01:41:58.080 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-24T01:41:58.081 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-24T01:41:58.081 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000221226 s, 2.3 MB/s 2024-04-24T01:41:58.082 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T01:41:58.137 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-24T01:41:58.137 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:41:58.137 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T01:41:58.154 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T01:41:58.154 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-04-24T01:41:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-24 01:41:52.897427106 +0000 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-24 01:38:20.859412677 +0000 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-24 01:38:20.859412677 +0000 2024-04-24T01:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-24 01:38:20.859412677 +0000 2024-04-24T01:41:58.211 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T01:41:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-24T01:41:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-24T01:41:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000222577 s, 2.3 MB/s 2024-04-24T01:41:58.276 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T01:41:58.333 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-04-24T01:41:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T01:41:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-24T01:41:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-24 01:41:52.897427106 +0000 2024-04-24T01:41:58.390 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-24 01:38:21.214404986 +0000 2024-04-24T01:41:58.390 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-24 01:38:21.214404986 +0000 2024-04-24T01:41:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-24 01:38:21.214404986 +0000 2024-04-24T01:41:58.390 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T01:41:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-24T01:41:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-24T01:41:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000283097 s, 1.8 MB/s 2024-04-24T01:41:58.453 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T01:41:58.510 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-04-24T01:41:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T01:41:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-24T01:41:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:58.567 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-24 01:41:52.898427084 +0000 2024-04-24T01:41:58.567 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-24 01:38:21.547397772 +0000 2024-04-24T01:41:58.567 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-24 01:38:21.547397772 +0000 2024-04-24T01:41:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-24 01:38:21.547397772 +0000 2024-04-24T01:41:58.567 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T01:41:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-24T01:41:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-24T01:41:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000171397 s, 3.0 MB/s 2024-04-24T01:41:58.629 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T01:41:58.685 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-24 01:41:52.898427084 +0000 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-24 01:38:21.893390277 +0000 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-24 01:38:21.893390277 +0000 2024-04-24T01:41:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-24 01:38:21.893390277 +0000 2024-04-24T01:41:58.741 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T01:41:58.802 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-24T01:41:58.803 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-24T01:41:58.803 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000210656 s, 2.4 MB/s 2024-04-24T01:41:58.804 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T01:41:58.859 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:41:58.860 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-24T01:41:58.860 INFO:tasks.ceph:Generating config... 2024-04-24T01:41:58.861 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T01:41:58.861 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-24T01:41:58.861 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-24T01:41:58.861 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-24T01:41:58.861 INFO:tasks.ceph:[client] setuser = ceph 2024-04-24T01:41:58.861 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T01:41:58.861 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-24T01:41:58.861 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T01:41:58.862 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T01:41:58.863 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T01:41:58.863 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T01:41:58.863 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T01:41:58.863 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T01:41:58.863 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T01:41:58.863 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T01:41:58.863 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T01:41:58.912 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T01:41:58.915 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T01:41:58.956 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:41:59.019 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107')] 2024-04-24T01:41:59.020 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-24T01:41:59.020 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:59.021 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T01:41:59.075 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:41:59.152 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:41:59.153 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:41:59.153 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:41:59.153 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid bbf4dd9c-0d50-4da0-921c-8b1690fa6e43 2024-04-24T01:41:59.153 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = quincy 2024-04-24T01:41:59.153 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2024-04-24T01:41:59.153 INFO:teuthology.orchestra.run.smithi107.stdout:fsid bbf4dd9c-0d50-4da0-921c-8b1690fa6e43 2024-04-24T01:41:59.153 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2024-04-24T01:41:59.153612+0000 2024-04-24T01:41:59.154 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-04-24T01:41:59.153612+0000 2024-04-24T01:41:59.154 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 17 (quincy) 2024-04-24T01:41:59.154 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2024-04-24T01:41:59.154 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-04-24T01:41:59.154 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-24T01:41:59.155 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T01:41:59.209 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bbf4dd9c-0d50-4da0-921c-8b1690fa6e43... 2024-04-24T01:41:59.210 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T01:41:59.252 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T01:41:59.289 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-04-24T01:41:59.290 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-04-24T01:41:59.291 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.292 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = 172.21.15.107 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = bbf4dd9c-0d50-4da0-921c-8b1690fa6e43 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-04-24T01:41:59.293 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-04-24T01:41:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: debug objclass = 20 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-04-24T01:41:59.295 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-04-24T01:41:59.296 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-04-24T01:41:59.297 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.298 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: rgw gc obj min wait = 15 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: debug rgw = 20 2024-04-24T01:41:59.299 INFO:teuthology.orchestra.run.smithi107.stdout: setgroup = ceph 2024-04-24T01:41:59.300 INFO:teuthology.orchestra.run.smithi107.stdout: setuser = ceph 2024-04-24T01:41:59.300 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-04-24T01:41:59.300 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-04-24T01:41:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-04-24T01:41:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T01:41:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-04-24T01:41:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-04-24T01:41:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-04-24T01:41:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = 172.21.15.107 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = bbf4dd9c-0d50-4da0-921c-8b1690fa6e43 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-04-24T01:41:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: debug objclass = 20 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2024-04-24T01:41:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:41:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:41:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-04-24T01:41:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: rgw gc obj min wait = 15 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: debug rgw = 20 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: setgroup = ceph 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: setuser = ceph 2024-04-24T01:41:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-04-24T01:41:59.312 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T01:41:59.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T01:41:59.404 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T01:41:59.404 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:59.404 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T01:41:59.418 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:59.418 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T01:41:59.473 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-04-24T01:41:59.474 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:59.474 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T01:41:59.474 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:41:59.546 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:41:59.546 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:41:59.601 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:41:59.601 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:41:59.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T01:41:59.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:41:59.634 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:41:59.634 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:41:59.689 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T01:41:59.689 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T01:41:59.690 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T01:41:59.802 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T01:41:59.804 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T01:41:59.804 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T01:41:59.805 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T01:41:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T01:41:59.855 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T01:41:59.855 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-24T01:41:59.855 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T01:41:59.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-24T01:41:59.879 INFO:tasks.ceph:role: osd.0 2024-04-24T01:41:59.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-04-24T01:41:59.879 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:41:59.950 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:42:00.434 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-04-24T01:42:00.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-04-24T01:42:00.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T01:42:00.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T01:42:00.586 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:42:00.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:00.675+0000 7f052061d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T01:42:00.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:00.675+0000 7f052061d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T01:42:00.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:00.675+0000 7f052061d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T01:42:00.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:00.675+0000 7f052061d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T01:42:00.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:00.675+0000 7f052061d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T01:42:00.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:00.682+0000 7f052061d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T01:42:03.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T01:42:03.565 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T01:42:03.594 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:42:03.594 INFO:tasks.ceph:role: osd.1 2024-04-24T01:42:03.594 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:42:03.594 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T01:42:03.668 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:42:03.669 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:42:04.156 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-24T01:42:04.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-24T01:42:04.159 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-24T01:42:04.287 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T01:42:04.318 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T01:42:04.384 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:42:04.384 INFO:tasks.ceph:role: osd.2 2024-04-24T01:42:04.384 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:42:04.384 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:42:04.457 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:42:04.458 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:42:04.458 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:42:04.925 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-24T01:42:04.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-24T01:42:04.927 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-24T01:42:05.009 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T01:42:05.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T01:42:05.142 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:42:05.142 INFO:tasks.ceph:role: osd.3 2024-04-24T01:42:05.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:42:05.142 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T01:42:05.213 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:42:05.213 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:42:05.214 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:42:05.728 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-24T01:42:05.730 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-24T01:42:05.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-24T01:42:05.852 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T01:42:05.879 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:42:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:05.971+0000 7ff3d4f8e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T01:42:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:05.974+0000 7ff3d4f8e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T01:42:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:05.974+0000 7ff3d4f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T01:42:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:05.974+0000 7ff3d4f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T01:42:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:05.974+0000 7ff3d4f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T01:42:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:05.979+0000 7ff3d4f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T01:42:08.824 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T01:42:08.852 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:42:08.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:08.940+0000 7f8e895f8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T01:42:08.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:08.940+0000 7f8e895f8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T01:42:08.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:08.940+0000 7f8e895f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T01:42:08.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:08.940+0000 7f8e895f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T01:42:08.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:08.940+0000 7f8e895f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T01:42:08.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:08.941+0000 7f8e895f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T01:42:11.794 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T01:42:11.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:42:11.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:11.909+0000 7f05ca263640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T01:42:11.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:11.909+0000 7f05ca263640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T01:42:11.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:11.909+0000 7f05ca263640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T01:42:11.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:11.909+0000 7f05ca263640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T01:42:11.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:11.909+0000 7f05ca263640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T01:42:11.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:11.910+0000 7f05ca263640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T01:42:14.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T01:42:14.789 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T01:42:14.789 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:42:14.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T01:42:14.818 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:14.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T01:42:14.856 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:14.856 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T01:42:14.922 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:14.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T01:42:14.987 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:14.987 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T01:42:15.052 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:15.052 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T01:42:15.108 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T01:42:15.108 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T01:42:15.134 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-04-24T01:42:15.134 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBoYyhm1NxRKBAAFxeghwL3H568vXsoQrHS/g== 2024-04-24T01:42:15.134 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-04-24T01:42:15.134 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBnYyhmjdjZLxAAxyzHnfZbPk2AoE5JP1fcvw== 2024-04-24T01:42:15.134 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-04-24T01:42:15.134 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBtYyhm6QDwORAAwSOm4N95e5zFDjAvV/6M+g== 2024-04-24T01:42:15.135 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-04-24T01:42:15.135 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBwYyhmh8sXOBAAcJqsYLHSH0tEeQIrKVC8bw== 2024-04-24T01:42:15.135 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-04-24T01:42:15.135 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBzYyhmtZpDNhAA7NHwnT4yyBSRSzWu9LiZTQ== 2024-04-24T01:42:15.135 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-04-24T01:42:15.135 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBnYyhmzZ5MMhAAvKWz1YTTQ0WaomNAFmIHzA== 2024-04-24T01:42:15.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:42:15.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T01:42:15.284 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:42:15.334 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:42:15.382 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:42:15.430 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T01:42:15.481 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T01:42:15.481 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T01:42:15.504 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T01:42:15.597 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T01:42:15.620 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:42:15.675 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T01:42:15.675 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T01:42:15.675 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T01:42:15.717 INFO:tasks.ceph.mon.a:Started 2024-04-24T01:42:15.717 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T01:42:15.717 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T01:42:15.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T01:42:15.719 INFO:tasks.ceph.mgr.x:Started 2024-04-24T01:42:15.719 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T01:42:15.720 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f88404e6640 1 Processor -- start 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f88404e6640 1 -- start start 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f88404e6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f88381232b0 0x7f8838131750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f88404e6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88380725e0 con 0x7f88381227c0 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f88404e6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8838072310 con 0x7f88381232b0 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f883da81640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f88381232b0 0x7f8838131750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f883e282640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f88381227c0 0x7f8838122ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:42376/0 (socket says 172.21.15.107:42376) 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.814+0000 7f883e282640 1 -- 172.21.15.107:0/3999803702 learned_addr learned my addr 172.21.15.107:0/3999803702 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.815+0000 7f883da81640 1 -- 172.21.15.107:0/3999803702 >> v1:172.21.15.107:6789/0 conn(0x7f88381227c0 legacy=0x7f8838122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:15.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.815+0000 7f883da81640 1 -- 172.21.15.107:0/3999803702 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883806cf10 con 0x7f88381232b0 2024-04-24T01:42:15.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.816+0000 7f883da81640 1 --2- 172.21.15.107:0/3999803702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381232b0 0x7f8838131750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8828009720 tx=0x7f882802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489ef436d4ebcc57 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:15.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.816+0000 7f883d280640 1 -- 172.21.15.107:0/3999803702 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88280316d0 con 0x7f88381232b0 2024-04-24T01:42:15.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.816+0000 7f883d280640 1 -- 172.21.15.107:0/3999803702 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8828037070 con 0x7f88381232b0 2024-04-24T01:42:15.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.816+0000 7f883d280640 1 -- 172.21.15.107:0/3999803702 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88280319c0 con 0x7f88381232b0 2024-04-24T01:42:15.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.817+0000 7f88404e6640 1 -- 172.21.15.107:0/3999803702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381232b0 msgr2=0x7f8838131750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:15.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.817+0000 7f88404e6640 1 --2- 172.21.15.107:0/3999803702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381232b0 0x7f8838131750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8828009720 tx=0x7f882802b840 comp rx=0 tx=0).stop 2024-04-24T01:42:15.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.817+0000 7f88404e6640 1 -- 172.21.15.107:0/3999803702 shutdown_connections 2024-04-24T01:42:15.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.817+0000 7f88404e6640 1 --2- 172.21.15.107:0/3999803702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381232b0 0x7f8838131750 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:15.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.817+0000 7f88404e6640 1 -- 172.21.15.107:0/3999803702 >> 172.21.15.107:0/3999803702 conn(0x7f883809db20 msgr2=0x7f883809df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:15.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.817+0000 7f88404e6640 1 -- 172.21.15.107:0/3999803702 shutdown_connections 2024-04-24T01:42:15.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.817+0000 7f88404e6640 1 -- 172.21.15.107:0/3999803702 wait complete. 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.818+0000 7f88404e6640 1 Processor -- start 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.818+0000 7f88404e6640 1 -- start start 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.818+0000 7f88404e6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381227c0 0x7f883812e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.818+0000 7f88404e6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f883806d880 con 0x7f88381227c0 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.818+0000 7f883e282640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381227c0 0x7f883812e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.818+0000 7f883e282640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381227c0 0x7f883812e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54524/0 (socket says 172.21.15.107:54524) 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.818+0000 7f883e282640 1 -- 172.21.15.107:0/4126935490 learned_addr learned my addr 172.21.15.107:0/4126935490 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:15.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f883e282640 1 -- 172.21.15.107:0/4126935490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8838131470 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f883e282640 1 --2- 172.21.15.107:0/4126935490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381227c0 0x7f883812e2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f883400c480 tx=0x7f883400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f882effd640 1 -- 172.21.15.107:0/4126935490 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8834017070 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f882effd640 1 -- 172.21.15.107:0/4126935490 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8834005c10 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8838130780 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f882effd640 1 -- 172.21.15.107:0/4126935490 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88340070d0 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8838130e20 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f882effd640 1 -- 172.21.15.107:0/4126935490 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f883401a070 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.819+0000 7f882effd640 1 -- 172.21.15.107:0/4126935490 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8834012400 con 0x7f88381227c0 2024-04-24T01:42:15.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.820+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8838062da0 con 0x7f88381227c0 2024-04-24T01:42:15.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.822+0000 7f882effd640 1 -- 172.21.15.107:0/4126935490 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f883401c440 con 0x7f88381227c0 2024-04-24T01:42:15.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.885+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8838074160 con 0x7f88381227c0 2024-04-24T01:42:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.886+0000 7f882effd640 1 -- 172.21.15.107:0/4126935490 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f883401c700 con 0x7f88381227c0 2024-04-24T01:42:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-04-24T01:42:15.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.887+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381227c0 msgr2=0x7f883812e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.887+0000 7f88404e6640 1 --2- 172.21.15.107:0/4126935490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381227c0 0x7f883812e2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f883400c480 tx=0x7f883400c940 comp rx=0 tx=0).stop 2024-04-24T01:42:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.887+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 shutdown_connections 2024-04-24T01:42:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.887+0000 7f88404e6640 1 --2- 172.21.15.107:0/4126935490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88381227c0 0x7f883812e2f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.887+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 >> 172.21.15.107:0/4126935490 conn(0x7f883809db20 msgr2=0x7f8838129fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.887+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 shutdown_connections 2024-04-24T01:42:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:15.887+0000 7f88404e6640 1 -- 172.21.15.107:0/4126935490 wait complete. 2024-04-24T01:42:15.899 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T01:42:15.899 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T01:42:15.899 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-24T01:42:15.899 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T01:42:15.922 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:15.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T01:42:15.946 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:15.946 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T01:42:16.009 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-24T01:42:16.009 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T01:42:16.073 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new f3146761-e93e-4bdf-8311-10dc9fe86689 0 2024-04-24T01:42:16.099 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:16.097+0000 7fe7a4e11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.193+0000 7fb9d9c82640 1 Processor -- start 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.193+0000 7fb9d9c82640 1 -- start start 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d9c82640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb9d4116c40 0x7fb9d4117020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d9c82640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d4117680 con 0x7fb9d4111b00 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d9c82640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d41126a0 con 0x7fb9d4116c40 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d37fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb9d4116c40 0x7fb9d4117020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d37fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb9d4116c40 0x7fb9d4117020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43146/0 (socket says 172.21.15.131:43146) 2024-04-24T01:42:16.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d37fe640 1 -- 172.21.15.131:0/2234584712 learned_addr learned my addr 172.21.15.131:0/2234584712 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:16.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d2ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb9d4111b00 0x7fb9d4111f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:35308/0 (socket says 172.21.15.131:35308) 2024-04-24T01:42:16.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d37fe640 1 -- 172.21.15.131:0/2234584712 >> v1:172.21.15.107:6789/0 conn(0x7fb9d4111b00 legacy=0x7fb9d4111f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.194+0000 7fb9d37fe640 1 -- 172.21.15.131:0/2234584712 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d4112850 con 0x7fb9d4116c40 2024-04-24T01:42:16.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.195+0000 7fb9d37fe640 1 --2- 172.21.15.131:0/2234584712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4116c40 0x7fb9d4117020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40097f0 tx=0x7fb9c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951bf3e9e7e7a422 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.195+0000 7fb9d27fc640 1 -- 172.21.15.131:0/2234584712 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c4035020 con 0x7fb9d4116c40 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.195+0000 7fb9d27fc640 1 -- 172.21.15.131:0/2234584712 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c40317a0 con 0x7fb9d4116c40 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.195+0000 7fb9d27fc640 1 -- 172.21.15.131:0/2234584712 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c4031aa0 con 0x7fb9d4116c40 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 -- 172.21.15.131:0/2234584712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4116c40 msgr2=0x7fb9d4117020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 --2- 172.21.15.131:0/2234584712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4116c40 0x7fb9d4117020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40097f0 tx=0x7fb9c402b910 comp rx=0 tx=0).stop 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 -- 172.21.15.131:0/2234584712 shutdown_connections 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 --2- 172.21.15.131:0/2234584712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4116c40 0x7fb9d4117020 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 -- 172.21.15.131:0/2234584712 >> 172.21.15.131:0/2234584712 conn(0x7fb9d406e700 msgr2=0x7fb9d410fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 -- 172.21.15.131:0/2234584712 shutdown_connections 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 -- 172.21.15.131:0/2234584712 wait complete. 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.196+0000 7fb9d9c82640 1 Processor -- start 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.197+0000 7fb9d9c82640 1 -- start start 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.197+0000 7fb9d9c82640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4111b00 0x7fb9d41a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.197+0000 7fb9d9c82640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d411df30 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.197+0000 7fb9d37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4111b00 0x7fb9d41a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.197+0000 7fb9d37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4111b00 0x7fb9d41a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43158/0 (socket says 172.21.15.131:43158) 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.197+0000 7fb9d37fe640 1 -- 172.21.15.131:0/1411556533 learned_addr learned my addr 172.21.15.131:0/1411556533 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.197+0000 7fb9d37fe640 1 -- 172.21.15.131:0/1411556533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d41a6ef0 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9d37fe640 1 --2- 172.21.15.131:0/1411556533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4111b00 0x7fb9d41a69b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40097f0 tx=0x7fb9c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9bbfff640 1 -- 172.21.15.131:0/1411556533 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c403ad00 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9bbfff640 1 -- 172.21.15.131:0/1411556533 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c40443f0 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d41a7180 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9bbfff640 1 -- 172.21.15.131:0/1411556533 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c40446d0 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d41ab0b0 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9bbfff640 1 -- 172.21.15.131:0/1411556533 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9c404b060 con 0x7fb9d4111b00 2024-04-24T01:42:16.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.198+0000 7fb9bbfff640 1 -- 172.21.15.131:0/1411556533 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb9c404d940 con 0x7fb9d4111b00 2024-04-24T01:42:16.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.199+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d4062da0 con 0x7fb9d4111b00 2024-04-24T01:42:16.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.201+0000 7fb9bbfff640 1 -- 172.21.15.131:0/1411556533 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb9c403f070 con 0x7fb9d4111b00 2024-04-24T01:42:16.255 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:16.253+0000 7fe7a4e11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T01:42:16.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.273+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3146761-e93e-4bdf-8311-10dc9fe86689", "id": 0} v 0) -- 0x7fb9d4116c40 con 0x7fb9d4111b00 2024-04-24T01:42:16.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.274+0000 7fb9bbfff640 1 -- 172.21.15.131:0/1411556533 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3146761-e93e-4bdf-8311-10dc9fe86689", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb9c404d450 con 0x7fb9d4111b00 2024-04-24T01:42:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:0 2024-04-24T01:42:16.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.275+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4111b00 msgr2=0x7fb9d41a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.275+0000 7fb9d9c82640 1 --2- 172.21.15.131:0/1411556533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4111b00 0x7fb9d41a69b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40097f0 tx=0x7fb9c40046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.275+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 shutdown_connections 2024-04-24T01:42:16.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.275+0000 7fb9d9c82640 1 --2- 172.21.15.131:0/1411556533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9d4111b00 0x7fb9d41a69b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.275+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 >> 172.21.15.131:0/1411556533 conn(0x7fb9d406e700 msgr2=0x7fb9d411cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.275+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 shutdown_connections 2024-04-24T01:42:16.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.275+0000 7fb9d9c82640 1 -- 172.21.15.131:0/1411556533 wait complete. 2024-04-24T01:42:16.287 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c 1 2024-04-24T01:42:16.310 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:16.309+0000 7fe7a4e11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T01:42:16.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d1c03a640 1 Processor -- start 2024-04-24T01:42:16.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d1c03a640 1 -- start start 2024-04-24T01:42:16.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d1c03a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6d14116c40 0x7f6d14117020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d1c03a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d14117680 con 0x7f6d14111b00 2024-04-24T01:42:16.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d1c03a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6d141126a0 con 0x7f6d14116c40 2024-04-24T01:42:16.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d19dd6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6d14116c40 0x7f6d14117020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d19dd6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6d14116c40 0x7f6d14117020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43162/0 (socket says 172.21.15.131:43162) 2024-04-24T01:42:16.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.382+0000 7f6d19dd6640 1 -- 172.21.15.131:0/1228960752 learned_addr learned my addr 172.21.15.131:0/1228960752 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:16.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.383+0000 7f6d19dd6640 1 -- 172.21.15.131:0/1228960752 >> v1:172.21.15.107:6789/0 conn(0x7f6d14111b00 legacy=0x7f6d14111f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.383+0000 7f6d19dd6640 1 -- 172.21.15.131:0/1228960752 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d14112850 con 0x7f6d14116c40 2024-04-24T01:42:16.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.383+0000 7f6d18dd4640 1 -- 172.21.15.131:0/1228960752 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224607817 0 0) 0x7f6d14117680 con 0x7f6d14111b00 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.383+0000 7f6d19dd6640 1 --2- 172.21.15.131:0/1228960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14116c40 0x7f6d14117020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d100097f0 tx=0x7f6d1002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feab4a60c496fa67 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d18dd4640 1 -- 172.21.15.131:0/1228960752 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10035020 con 0x7f6d14116c40 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d18dd4640 1 -- 172.21.15.131:0/1228960752 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d100317a0 con 0x7f6d14116c40 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d18dd4640 1 -- 172.21.15.131:0/1228960752 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10031aa0 con 0x7f6d14116c40 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d1c03a640 1 -- 172.21.15.131:0/1228960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14116c40 msgr2=0x7f6d14117020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d1c03a640 1 --2- 172.21.15.131:0/1228960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14116c40 0x7f6d14117020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d100097f0 tx=0x7f6d1002b910 comp rx=0 tx=0).stop 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d1c03a640 1 -- 172.21.15.131:0/1228960752 shutdown_connections 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d1c03a640 1 --2- 172.21.15.131:0/1228960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14116c40 0x7f6d14117020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d1c03a640 1 -- 172.21.15.131:0/1228960752 >> 172.21.15.131:0/1228960752 conn(0x7f6d1406e700 msgr2=0x7f6d1410fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d1c03a640 1 -- 172.21.15.131:0/1228960752 shutdown_connections 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.384+0000 7f6d1c03a640 1 -- 172.21.15.131:0/1228960752 wait complete. 2024-04-24T01:42:16.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d1c03a640 1 Processor -- start 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d1c03a640 1 -- start start 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d1c03a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14111b00 0x7f6d141ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d1c03a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1411df30 con 0x7f6d14111b00 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d19dd6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14111b00 0x7f6d141ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d19dd6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14111b00 0x7f6d141ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43174/0 (socket says 172.21.15.131:43174) 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d19dd6640 1 -- 172.21.15.131:0/3106073953 learned_addr learned my addr 172.21.15.131:0/3106073953 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.385+0000 7f6d19dd6640 1 -- 172.21.15.131:0/3106073953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d141ac950 con 0x7f6d14111b00 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d19dd6640 1 --2- 172.21.15.131:0/3106073953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14111b00 0x7f6d141ac380 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c00 tx=0x7f6d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d0a7fc640 1 -- 172.21.15.131:0/3106073953 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1003ad00 con 0x7f6d14111b00 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d0a7fc640 1 -- 172.21.15.131:0/3106073953 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d100443f0 con 0x7f6d14111b00 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d141acb80 con 0x7f6d14111b00 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d0a7fc640 1 -- 172.21.15.131:0/3106073953 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10044710 con 0x7f6d14111b00 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d141a6410 con 0x7f6d14111b00 2024-04-24T01:42:16.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d0a7fc640 1 -- 172.21.15.131:0/3106073953 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d1004b060 con 0x7f6d14111b00 2024-04-24T01:42:16.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.386+0000 7f6d0a7fc640 1 -- 172.21.15.131:0/3106073953 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6d1004dcf0 con 0x7f6d14111b00 2024-04-24T01:42:16.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.387+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d14062da0 con 0x7f6d14111b00 2024-04-24T01:42:16.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.389+0000 7f6d0a7fc640 1 -- 172.21.15.131:0/3106073953 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6d10052020 con 0x7f6d14111b00 2024-04-24T01:42:16.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.461+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c", "id": 1} v 0) -- 0x7f6d14116c40 con 0x7f6d14111b00 2024-04-24T01:42:16.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.463+0000 7f6d0a7fc640 1 -- 172.21.15.131:0/3106073953 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6d1003f070 con 0x7f6d14111b00 2024-04-24T01:42:16.464 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-24T01:42:16.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.464+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14111b00 msgr2=0x7f6d141ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.464+0000 7f6d1c03a640 1 --2- 172.21.15.131:0/3106073953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14111b00 0x7f6d141ac380 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c00 tx=0x7f6d100046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.464+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 shutdown_connections 2024-04-24T01:42:16.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.464+0000 7f6d1c03a640 1 --2- 172.21.15.131:0/3106073953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d14111b00 0x7f6d141ac380 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.464+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 >> 172.21.15.131:0/3106073953 conn(0x7f6d1406e700 msgr2=0x7f6d14110140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.464+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 shutdown_connections 2024-04-24T01:42:16.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.464+0000 7f6d1c03a640 1 -- 172.21.15.131:0/3106073953 wait complete. 2024-04-24T01:42:16.480 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 55fbd99e-62cc-471f-bc45-7c8afd7708d0 2 2024-04-24T01:42:16.560 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:16.559+0000 7fe7a4e11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T01:42:16.608 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:16.606+0000 7fe7a4e11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T01:42:16.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.615+0000 7feb0bf1c640 1 Processor -- start 2024-04-24T01:42:16.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.615+0000 7feb0bf1c640 1 -- start start 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb0bf1c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb0411aaf0 0x7feb0411cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb0bf1c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb0411d420 con 0x7feb04116c40 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb0bf1c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7feb0411e600 con 0x7feb0411aaf0 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb094b7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb0411aaf0 0x7feb0411cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb09cb8640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7feb04116c40 0x7feb04117020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:35324/0 (socket says 172.21.15.131:35324) 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb09cb8640 1 -- 172.21.15.131:0/606173464 learned_addr learned my addr 172.21.15.131:0/606173464 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb094b7640 1 -- 172.21.15.131:0/606173464 >> v1:172.21.15.107:6789/0 conn(0x7feb04116c40 legacy=0x7feb04117020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb08cb6640 1 -- 172.21.15.131:0/606173464 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3925080853 0 0) 0x7feb0411d420 con 0x7feb04116c40 2024-04-24T01:42:16.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.616+0000 7feb094b7640 1 -- 172.21.15.131:0/606173464 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0411e7b0 con 0x7feb0411aaf0 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.617+0000 7feb094b7640 1 --2- 172.21.15.131:0/606173464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0411aaf0 0x7feb0411cee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009720 tx=0x7feaf402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84494893bd54c85f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb08cb6640 1 -- 172.21.15.131:0/606173464 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaf40316d0 con 0x7feb0411aaf0 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb08cb6640 1 -- 172.21.15.131:0/606173464 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf4037070 con 0x7feb0411aaf0 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb08cb6640 1 -- 172.21.15.131:0/606173464 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaf40319c0 con 0x7feb0411aaf0 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb0bf1c640 1 -- 172.21.15.131:0/606173464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0411aaf0 msgr2=0x7feb0411cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb0bf1c640 1 --2- 172.21.15.131:0/606173464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0411aaf0 0x7feb0411cee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009720 tx=0x7feaf402b840 comp rx=0 tx=0).stop 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb0bf1c640 1 -- 172.21.15.131:0/606173464 shutdown_connections 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb0bf1c640 1 --2- 172.21.15.131:0/606173464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0411aaf0 0x7feb0411cee0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb0bf1c640 1 -- 172.21.15.131:0/606173464 >> 172.21.15.131:0/606173464 conn(0x7feb0406e700 msgr2=0x7feb0410fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb0bf1c640 1 -- 172.21.15.131:0/606173464 shutdown_connections 2024-04-24T01:42:16.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.618+0000 7feb0bf1c640 1 -- 172.21.15.131:0/606173464 wait complete. 2024-04-24T01:42:16.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.619+0000 7feb0bf1c640 1 Processor -- start 2024-04-24T01:42:16.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.619+0000 7feb0bf1c640 1 -- start start 2024-04-24T01:42:16.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.619+0000 7feb0bf1c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb04116c40 0x7feb041ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.619+0000 7feb0bf1c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feb0411dad0 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.619+0000 7feb09cb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb04116c40 0x7feb041ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.619+0000 7feb09cb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb04116c40 0x7feb041ac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43184/0 (socket says 172.21.15.131:43184) 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.619+0000 7feb09cb8640 1 -- 172.21.15.131:0/510498835 learned_addr learned my addr 172.21.15.131:0/510498835 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feb09cb8640 1 -- 172.21.15.131:0/510498835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb041ac980 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feb09cb8640 1 --2- 172.21.15.131:0/510498835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb04116c40 0x7feb041ac3b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feb0000c420 tx=0x7feb0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feafa7fc640 1 -- 172.21.15.131:0/510498835 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb00018070 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feafa7fc640 1 -- 172.21.15.131:0/510498835 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb000074d0 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb041acc10 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feafa7fc640 1 -- 172.21.15.131:0/510498835 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb00004950 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb041a6620 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feafa7fc640 1 -- 172.21.15.131:0/510498835 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feb0001b070 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.620+0000 7feafa7fc640 1 -- 172.21.15.131:0/510498835 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7feb0001c7d0 con 0x7feb04116c40 2024-04-24T01:42:16.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.621+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb04062da0 con 0x7feb04116c40 2024-04-24T01:42:16.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.623+0000 7feafa7fc640 1 -- 172.21.15.131:0/510498835 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7feb00022070 con 0x7feb04116c40 2024-04-24T01:42:16.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.695+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "55fbd99e-62cc-471f-bc45-7c8afd7708d0", "id": 2} v 0) -- 0x7feb041ace40 con 0x7feb04116c40 2024-04-24T01:42:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.696+0000 7feafa7fc640 1 -- 172.21.15.131:0/510498835 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55fbd99e-62cc-471f-bc45-7c8afd7708d0", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7feb0001c4e0 con 0x7feb04116c40 2024-04-24T01:42:16.698 INFO:teuthology.orchestra.run.smithi131.stdout:2 2024-04-24T01:42:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.697+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb04116c40 msgr2=0x7feb041ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.697+0000 7feb0bf1c640 1 --2- 172.21.15.131:0/510498835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb04116c40 0x7feb041ac3b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feb0000c420 tx=0x7feb0000c8e0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.697+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 shutdown_connections 2024-04-24T01:42:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.697+0000 7feb0bf1c640 1 --2- 172.21.15.131:0/510498835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb04116c40 0x7feb041ac3b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.697+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 >> 172.21.15.131:0/510498835 conn(0x7feb0406e700 msgr2=0x7feb041157a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.697+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 shutdown_connections 2024-04-24T01:42:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.697+0000 7feb0bf1c640 1 -- 172.21.15.131:0/510498835 wait complete. 2024-04-24T01:42:16.709 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 7d0b408a-aec1-4880-87b0-b1848ad9cbb6 3 2024-04-24T01:42:16.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.843+0000 7f5c3d06a640 1 Processor -- start 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.843+0000 7f5c3d06a640 1 -- start start 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.843+0000 7f5c3d06a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5c3811aaf0 0x7f5c3811cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.843+0000 7f5c3d06a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3811d420 con 0x7f5c38116c40 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.843+0000 7f5c3d06a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3811e600 con 0x7f5c3811aaf0 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.844+0000 7f5c3659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5c3811aaf0 0x7f5c3811cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.844+0000 7f5c3659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5c3811aaf0 0x7f5c3811cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43192/0 (socket says 172.21.15.131:43192) 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.844+0000 7f5c3659c640 1 -- 172.21.15.131:0/3350108295 learned_addr learned my addr 172.21.15.131:0/3350108295 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.844+0000 7f5c3659c640 1 -- 172.21.15.131:0/3350108295 >> v1:172.21.15.107:6789/0 conn(0x7f5c38116c40 legacy=0x7f5c38117020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.844+0000 7f5c3659c640 1 -- 172.21.15.131:0/3350108295 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3811e7b0 con 0x7f5c3811aaf0 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c3659c640 1 --2- 172.21.15.131:0/3350108295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c3811aaf0 0x7f5c3811cee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5c280097f0 tx=0x7f5c2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f744d833b4924d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c35d9b640 1 -- 172.21.15.131:0/3350108295 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c28035020 con 0x7f5c3811aaf0 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c35d9b640 1 -- 172.21.15.131:0/3350108295 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c280317a0 con 0x7f5c3811aaf0 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c35d9b640 1 -- 172.21.15.131:0/3350108295 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c28031aa0 con 0x7f5c3811aaf0 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c3d06a640 1 -- 172.21.15.131:0/3350108295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c3811aaf0 msgr2=0x7f5c3811cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c3d06a640 1 --2- 172.21.15.131:0/3350108295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c3811aaf0 0x7f5c3811cee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5c280097f0 tx=0x7f5c2802b910 comp rx=0 tx=0).stop 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c3d06a640 1 -- 172.21.15.131:0/3350108295 shutdown_connections 2024-04-24T01:42:16.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c3d06a640 1 --2- 172.21.15.131:0/3350108295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c3811aaf0 0x7f5c3811cee0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.845+0000 7f5c3d06a640 1 -- 172.21.15.131:0/3350108295 >> 172.21.15.131:0/3350108295 conn(0x7f5c3806e700 msgr2=0x7f5c3810fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.846+0000 7f5c3d06a640 1 -- 172.21.15.131:0/3350108295 shutdown_connections 2024-04-24T01:42:16.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.846+0000 7f5c3d06a640 1 -- 172.21.15.131:0/3350108295 wait complete. 2024-04-24T01:42:16.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.846+0000 7f5c3d06a640 1 Processor -- start 2024-04-24T01:42:16.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c3d06a640 1 -- start start 2024-04-24T01:42:16.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c3d06a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c38116c40 0x7f5c381a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:16.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c3d06a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3811dad0 con 0x7f5c38116c40 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c36d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c38116c40 0x7f5c381a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c36d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c38116c40 0x7f5c381a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43194/0 (socket says 172.21.15.131:43194) 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c36d9d640 1 -- 172.21.15.131:0/2073471895 learned_addr learned my addr 172.21.15.131:0/2073471895 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c36d9d640 1 -- 172.21.15.131:0/2073471895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c381a6ec0 con 0x7f5c38116c40 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.847+0000 7f5c36d9d640 1 --2- 172.21.15.131:0/2073471895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c38116c40 0x7f5c381a6980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00c450 tx=0x7f5c2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.848+0000 7f5c1f7fe640 1 -- 172.21.15.131:0/2073471895 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c2c017070 con 0x7f5c38116c40 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.848+0000 7f5c1f7fe640 1 -- 172.21.15.131:0/2073471895 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c005220 con 0x7f5c38116c40 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.848+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c381a71b0 con 0x7f5c38116c40 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.848+0000 7f5c1f7fe640 1 -- 172.21.15.131:0/2073471895 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c2c0035f0 con 0x7f5c38116c40 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.848+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c381ab260 con 0x7f5c38116c40 2024-04-24T01:42:16.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.848+0000 7f5c1f7fe640 1 -- 172.21.15.131:0/2073471895 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c2c01a070 con 0x7f5c38116c40 2024-04-24T01:42:16.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.848+0000 7f5c1f7fe640 1 -- 172.21.15.131:0/2073471895 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5c2c011590 con 0x7f5c38116c40 2024-04-24T01:42:16.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.849+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c38062da0 con 0x7f5c38116c40 2024-04-24T01:42:16.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.851+0000 7f5c1f7fe640 1 -- 172.21.15.131:0/2073471895 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5c2c021070 con 0x7f5c38116c40 2024-04-24T01:42:16.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.922+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d0b408a-aec1-4880-87b0-b1848ad9cbb6", "id": 3} v 0) -- 0x7f5c381a73e0 con 0x7f5c38116c40 2024-04-24T01:42:16.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.926+0000 7f5c1f7fe640 1 -- 172.21.15.131:0/2073471895 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d0b408a-aec1-4880-87b0-b1848ad9cbb6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5c2c011b30 con 0x7f5c38116c40 2024-04-24T01:42:16.928 INFO:teuthology.orchestra.run.smithi131.stdout:3 2024-04-24T01:42:16.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.927+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c38116c40 msgr2=0x7f5c381a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:16.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.927+0000 7f5c3d06a640 1 --2- 172.21.15.131:0/2073471895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c38116c40 0x7f5c381a6980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00c450 tx=0x7f5c2c00c910 comp rx=0 tx=0).stop 2024-04-24T01:42:16.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.927+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 shutdown_connections 2024-04-24T01:42:16.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.927+0000 7f5c3d06a640 1 --2- 172.21.15.131:0/2073471895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c38116c40 0x7f5c381a6980 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:16.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.927+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 >> 172.21.15.131:0/2073471895 conn(0x7f5c3806e700 msgr2=0x7f5c3811b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:16.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.927+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 shutdown_connections 2024-04-24T01:42:16.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:16.927+0000 7f5c3d06a640 1 -- 172.21.15.131:0/2073471895 wait complete. 2024-04-24T01:42:16.939 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T01:42:16.939 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T01:42:16.942 INFO:tasks.ceph.osd.0:Started 2024-04-24T01:42:16.942 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T01:42:16.942 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T01:42:16.944 INFO:tasks.ceph.osd.1:Started 2024-04-24T01:42:16.944 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T01:42:16.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T01:42:16.946 INFO:tasks.ceph.osd.2:Started 2024-04-24T01:42:16.946 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T01:42:16.947 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T01:42:16.948 INFO:tasks.ceph.osd.3:Started 2024-04-24T01:42:16.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:42:17.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.053+0000 7efc2e996640 1 Processor -- start 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc2e996640 1 -- start start 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc2e996640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc2806d7d0 0x7efc2806dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc2e996640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc280a08a0 con 0x7efc2806e0f0 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc2e996640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efc2806e560 con 0x7efc2806d7d0 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc27fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc2806d7d0 0x7efc2806dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc277fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efc2806e0f0 0x7efc2812e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:42384/0 (socket says 172.21.15.107:42384) 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc277fe640 1 -- 172.21.15.107:0/510103922 learned_addr learned my addr 172.21.15.107:0/510103922 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc27fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efc2806d7d0 0x7efc2806dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54542/0 (socket says 172.21.15.107:54542) 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc27fff640 1 -- 172.21.15.107:0/510103922 >> v1:172.21.15.107:6789/0 conn(0x7efc2806e0f0 legacy=0x7efc2812e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.054+0000 7efc27fff640 1 -- 172.21.15.107:0/510103922 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2806f6d0 con 0x7efc2806d7d0 2024-04-24T01:42:17.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.055+0000 7efc27fff640 1 --2- 172.21.15.107:0/510103922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc2806dbb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc18009750 tx=0x7efc1802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2767c540fdeff382 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:17.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.055+0000 7efc26ffd640 1 -- 172.21.15.107:0/510103922 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc18035020 con 0x7efc2806d7d0 2024-04-24T01:42:17.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.055+0000 7efc26ffd640 1 -- 172.21.15.107:0/510103922 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc18031760 con 0x7efc2806d7d0 2024-04-24T01:42:17.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.055+0000 7efc26ffd640 1 -- 172.21.15.107:0/510103922 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc18031a60 con 0x7efc2806d7d0 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.056+0000 7efc2e996640 1 -- 172.21.15.107:0/510103922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 msgr2=0x7efc2806dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.056+0000 7efc2e996640 1 --2- 172.21.15.107:0/510103922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc2806dbb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc18009750 tx=0x7efc1802b8d0 comp rx=0 tx=0).stop 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.056+0000 7efc2e996640 1 -- 172.21.15.107:0/510103922 shutdown_connections 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.056+0000 7efc2e996640 1 --2- 172.21.15.107:0/510103922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc2806dbb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.056+0000 7efc2e996640 1 -- 172.21.15.107:0/510103922 >> 172.21.15.107:0/510103922 conn(0x7efc2809ea70 msgr2=0x7efc2809ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.056+0000 7efc2e996640 1 -- 172.21.15.107:0/510103922 shutdown_connections 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.056+0000 7efc2e996640 1 -- 172.21.15.107:0/510103922 wait complete. 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc2e996640 1 Processor -- start 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc2e996640 1 -- start start 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc2e996640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc281c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc2e996640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efc2812ebb0 con 0x7efc2806d7d0 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc27fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc281c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc27fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc281c3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54546/0 (socket says 172.21.15.107:54546) 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc27fff640 1 -- 172.21.15.107:0/1245872896 learned_addr learned my addr 172.21.15.107:0/1245872896 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.057+0000 7efc27fff640 1 -- 172.21.15.107:0/1245872896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc28090c90 con 0x7efc2806d7d0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc27fff640 1 --2- 172.21.15.107:0/1245872896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc281c3310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc18009750 tx=0x7efc180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc24ff9640 1 -- 172.21.15.107:0/1245872896 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1803b980 con 0x7efc2806d7d0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc24ff9640 1 -- 172.21.15.107:0/1245872896 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1803bb40 con 0x7efc2806d7d0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc24ff9640 1 -- 172.21.15.107:0/1245872896 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1803be60 con 0x7efc2806d7d0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc28091460 con 0x7efc2806d7d0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc281c3850 con 0x7efc2806d7d0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc24ff9640 1 -- 172.21.15.107:0/1245872896 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc1804c060 con 0x7efc2806d7d0 2024-04-24T01:42:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.058+0000 7efc24ff9640 1 -- 172.21.15.107:0/1245872896 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7efc18045a90 con 0x7efc2806d7d0 2024-04-24T01:42:17.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.059+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc280923e0 con 0x7efc2806d7d0 2024-04-24T01:42:17.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.061+0000 7efc24ff9640 1 -- 172.21.15.107:0/1245872896 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efc18040070 con 0x7efc2806d7d0 2024-04-24T01:42:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.120+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc28062da0 con 0x7efc2806d7d0 2024-04-24T01:42:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.120+0000 7efc24ff9640 1 -- 172.21.15.107:0/1245872896 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7efc18045d30 con 0x7efc2806d7d0 2024-04-24T01:42:17.122 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:42:17.122 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":6,"fsid":"bbf4dd9c-0d50-4da0-921c-8b1690fa6e43","created":"2024-04-24T01:42:15.810458+0000","modified":"2024-04-24T01:42:16.924967+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T01:42:16.924967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3146761-e93e-4bdf-8311-10dc9fe86689","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55fbd99e-62cc-471f-bc45-7c8afd7708d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7d0b408a-aec1-4880-87b0-b1848ad9cbb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:42:17.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.121+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 msgr2=0x7efc281c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:17.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.121+0000 7efc2e996640 1 --2- 172.21.15.107:0/1245872896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc281c3310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc18009750 tx=0x7efc180046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:17.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.121+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 shutdown_connections 2024-04-24T01:42:17.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.121+0000 7efc2e996640 1 --2- 172.21.15.107:0/1245872896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc2806d7d0 0x7efc281c3310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:17.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.121+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 >> 172.21.15.107:0/1245872896 conn(0x7efc2809ea70 msgr2=0x7efc28125c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:17.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.121+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 shutdown_connections 2024-04-24T01:42:17.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:17.121+0000 7efc2e996640 1 -- 172.21.15.107:0/1245872896 wait complete. 2024-04-24T01:42:17.145 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T01:42:17.145 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T01:42:17.341 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:17.339+0000 7fe7a4e11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T01:42:17.427 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:17.426+0000 7fe7a4e11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T01:42:17.469 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:17.468+0000 7fe7a4e11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T01:42:17.534 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-24T01:42:17.533+0000 7f3630a16640 -1 Falling back to public interface 2024-04-24T01:42:17.537 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-24T01:42:17.535+0000 7f3977ca0640 -1 Falling back to public interface 2024-04-24T01:42:17.541 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-24T01:42:17.539+0000 7ff13a933640 -1 Falling back to public interface 2024-04-24T01:42:17.541 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-24T01:42:17.539+0000 7fc9d8e11640 -1 Falling back to public interface 2024-04-24T01:42:17.547 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:42:17.635 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb745f77640 1 Processor -- start 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb745f77640 1 -- start start 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb745f77640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb74006f1c0 0x7fb74006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb745f77640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb74009c5e0 con 0x7fb74006fae0 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb745f77640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb740070b50 con 0x7fb74006f1c0 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb73f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb74006f1c0 0x7fb74006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb737fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb74006fae0 0x7fb740096020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:42394/0 (socket says 172.21.15.107:42394) 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb737fff640 1 -- 172.21.15.107:0/3058107767 learned_addr learned my addr 172.21.15.107:0/3058107767 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb73f7fe640 1 -- 172.21.15.107:0/3058107767 >> v1:172.21.15.107:6789/0 conn(0x7fb74006fae0 legacy=0x7fb740096020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:17.636 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.634+0000 7fb73f7fe640 1 -- 172.21.15.107:0/3058107767 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7400727e0 con 0x7fb74006f1c0 2024-04-24T01:42:17.637 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.635+0000 7fb73f7fe640 1 --2- 172.21.15.107:0/3058107767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74006f5a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb730009720 tx=0x7fb73002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0b5355dceeec81 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.635+0000 7fb73effd640 1 -- 172.21.15.107:0/3058107767 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7300316d0 con 0x7fb74006f1c0 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.635+0000 7fb73effd640 1 -- 172.21.15.107:0/3058107767 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb730037070 con 0x7fb74006f1c0 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.635+0000 7fb73effd640 1 -- 172.21.15.107:0/3058107767 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7300319c0 con 0x7fb74006f1c0 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.636+0000 7fb745f77640 1 -- 172.21.15.107:0/3058107767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 msgr2=0x7fb74006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.636+0000 7fb745f77640 1 --2- 172.21.15.107:0/3058107767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74006f5a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb730009720 tx=0x7fb73002b840 comp rx=0 tx=0).stop 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.636+0000 7fb745f77640 1 -- 172.21.15.107:0/3058107767 shutdown_connections 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.636+0000 7fb745f77640 1 --2- 172.21.15.107:0/3058107767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74006f5a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.636+0000 7fb745f77640 1 -- 172.21.15.107:0/3058107767 >> 172.21.15.107:0/3058107767 conn(0x7fb74009a840 msgr2=0x7fb74009ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.636+0000 7fb745f77640 1 -- 172.21.15.107:0/3058107767 shutdown_connections 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.636+0000 7fb745f77640 1 -- 172.21.15.107:0/3058107767 wait complete. 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb745f77640 1 Processor -- start 2024-04-24T01:42:17.638 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb745f77640 1 -- start start 2024-04-24T01:42:17.639 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:17.636+0000 7fe7a4e11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T01:42:17.640 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb745f77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74008fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb745f77640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb740096730 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb73f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74008fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb73f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74008fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54560/0 (socket says 172.21.15.107:54560) 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb73f7fe640 1 -- 172.21.15.107:0/75409709 learned_addr learned my addr 172.21.15.107:0/75409709 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.637+0000 7fb73f7fe640 1 -- 172.21.15.107:0/75409709 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74008d260 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb73f7fe640 1 --2- 172.21.15.107:0/75409709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74008fbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb730009840 tx=0x7fb7300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb73cff9640 1 -- 172.21.15.107:0/75409709 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb730032770 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb73cff9640 1 -- 172.21.15.107:0/75409709 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb730032910 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74008d540 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb73cff9640 1 -- 172.21.15.107:0/75409709 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb730032c30 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74008e120 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb73cff9640 1 -- 172.21.15.107:0/75409709 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb730045780 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.638+0000 7fb73cff9640 1 -- 172.21.15.107:0/75409709 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb73002f050 con 0x7fb74006f1c0 2024-04-24T01:42:17.641 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.639+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7400737f0 con 0x7fb74006f1c0 2024-04-24T01:42:17.642 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.640+0000 7fb73cff9640 1 -- 172.21.15.107:0/75409709 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb730040070 con 0x7fb74006f1c0 2024-04-24T01:42:17.684 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:17.682+0000 7fe7a4e11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T01:42:17.700 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.699+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb740062da0 con 0x7fb74006f1c0 2024-04-24T01:42:17.700 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.699+0000 7fb73cff9640 1 -- 172.21.15.107:0/75409709 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fb730032dd0 con 0x7fb74006f1c0 2024-04-24T01:42:17.701 INFO:teuthology.misc.health.smithi107.stdout: 2024-04-24T01:42:17.701 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":6,"fsid":"bbf4dd9c-0d50-4da0-921c-8b1690fa6e43","created":"2024-04-24T01:42:15.810458+0000","modified":"2024-04-24T01:42:16.924967+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T01:42:16.924967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3146761-e93e-4bdf-8311-10dc9fe86689","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55fbd99e-62cc-471f-bc45-7c8afd7708d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7d0b408a-aec1-4880-87b0-b1848ad9cbb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:42:17.702 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.700+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 msgr2=0x7fb74008fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:17.702 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.700+0000 7fb745f77640 1 --2- 172.21.15.107:0/75409709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74008fbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb730009840 tx=0x7fb7300046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:17.702 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.700+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 shutdown_connections 2024-04-24T01:42:17.702 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.700+0000 7fb745f77640 1 --2- 172.21.15.107:0/75409709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb74006f1c0 0x7fb74008fbd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:17.702 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.700+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 >> 172.21.15.107:0/75409709 conn(0x7fb74009a840 msgr2=0x7fb740091710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:17.702 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.700+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 shutdown_connections 2024-04-24T01:42:17.702 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:17.700+0000 7fb745f77640 1 -- 172.21.15.107:0/75409709 wait complete. 2024-04-24T01:42:17.710 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-24T01:42:17.735 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:17.734+0000 7fe7a4e11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T01:42:17.847 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:17.846+0000 7fe7a4e11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T01:42:18.222 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:18.221+0000 7fe7a4e11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T01:42:18.479 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:18.477+0000 7fe7a4e11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T01:42:18.531 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:18.529+0000 7fe7a4e11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T01:42:18.645 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:18.643+0000 7fe7a4e11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T01:42:18.918 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:18.917+0000 7fe7a4e11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T01:42:18.966 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:18.965+0000 7fe7a4e11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T01:42:19.120 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:19.119+0000 7fe7a4e11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T01:42:19.254 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:19.253+0000 7fe7a4e11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T01:42:19.305 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:19.303+0000 7fe7a4e11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T01:42:19.373 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:19.371+0000 7fe7a4e11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T01:42:19.417 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:19.415+0000 7fe7a4e11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T01:42:19.886 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:19.885+0000 7fe7a4e11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T01:42:19.999 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:19.998+0000 7fe7a4e11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T01:42:20.974 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-24T01:42:20.973+0000 7f3630a16640 -1 osd.0 0 log_to_monitors true 2024-04-24T01:42:21.007 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-24T01:42:21.006+0000 7fe746254640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-24T01:42:21.177 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-24T01:42:21.176+0000 7f3977ca0640 -1 osd.3 0 log_to_monitors true 2024-04-24T01:42:21.177 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-24T01:42:21.176+0000 7ff13a933640 -1 osd.1 0 log_to_monitors true 2024-04-24T01:42:21.185 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-24T01:42:21.183+0000 7fc9d8e11640 -1 osd.2 0 log_to_monitors true 2024-04-24T01:42:22.931 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-24T01:42:22.930+0000 7f362bc36640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T01:42:22.947 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-24T01:42:22.946+0000 7f3624268640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:42:24.114 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:42:24.213 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.212+0000 7f861458a640 1 Processor -- start 2024-04-24T01:42:24.213 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.212+0000 7f861458a640 1 -- start start 2024-04-24T01:42:24.214 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.212+0000 7f861458a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f860c096350 0x7f860c096730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:24.214 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.212+0000 7f861458a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860c071e10 con 0x7f860c071570 2024-04-24T01:42:24.214 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.212+0000 7f861458a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f860c06ecf0 con 0x7f860c096350 2024-04-24T01:42:24.214 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.212+0000 7f8612326640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f860c096350 0x7f860c096730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:24.214 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.213+0000 7f8612326640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f860c096350 0x7f860c096730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43364/0 (socket says 172.21.15.107:43364) 2024-04-24T01:42:24.215 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.213+0000 7f8611b25640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f860c071570 0x7f860c12c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:34712/0 (socket says 172.21.15.107:34712) 2024-04-24T01:42:24.215 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.213+0000 7f8612326640 1 -- 172.21.15.107:0/4145574814 learned_addr learned my addr 172.21.15.107:0/4145574814 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:24.215 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.213+0000 7f8612326640 1 -- 172.21.15.107:0/4145574814 >> v1:172.21.15.107:6789/0 conn(0x7f860c071570 legacy=0x7f860c12c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:24.215 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.213+0000 7f8612326640 1 -- 172.21.15.107:0/4145574814 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c09c5e0 con 0x7f860c096350 2024-04-24T01:42:24.215 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f8612326640 1 --2- 172.21.15.107:0/4145574814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c096350 0x7f860c096730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0097f0 tx=0x7f85fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42709bbed467844 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:24.219 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f8611324640 1 -- 172.21.15.107:0/4145574814 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc035020 con 0x7f860c096350 2024-04-24T01:42:24.219 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f8611324640 1 -- 172.21.15.107:0/4145574814 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0317a0 con 0x7f860c096350 2024-04-24T01:42:24.219 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f8611324640 1 -- 172.21.15.107:0/4145574814 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc031aa0 con 0x7f860c096350 2024-04-24T01:42:24.219 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f861458a640 1 -- 172.21.15.107:0/4145574814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c096350 msgr2=0x7f860c096730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:24.219 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f861458a640 1 --2- 172.21.15.107:0/4145574814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c096350 0x7f860c096730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0097f0 tx=0x7f85fc02b910 comp rx=0 tx=0).stop 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f861458a640 1 -- 172.21.15.107:0/4145574814 shutdown_connections 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f861458a640 1 --2- 172.21.15.107:0/4145574814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c096350 0x7f860c096730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f861458a640 1 -- 172.21.15.107:0/4145574814 >> 172.21.15.107:0/4145574814 conn(0x7f860c09a840 msgr2=0x7f860c09ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f861458a640 1 -- 172.21.15.107:0/4145574814 shutdown_connections 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.214+0000 7f861458a640 1 -- 172.21.15.107:0/4145574814 wait complete. 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.215+0000 7f861458a640 1 Processor -- start 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.215+0000 7f861458a640 1 -- start start 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f861458a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c071570 0x7f860c1c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:24.220 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f861458a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f860c12c760 con 0x7f860c071570 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8612326640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c071570 0x7f860c1c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8612326640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c071570 0x7f860c1c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43370/0 (socket says 172.21.15.107:43370) 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8612326640 1 -- 172.21.15.107:0/4281360110 learned_addr learned my addr 172.21.15.107:0/4281360110 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8612326640 1 -- 172.21.15.107:0/4281360110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c070620 con 0x7f860c071570 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8612326640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c071570 0x7f860c1c2fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0097f0 tx=0x7f85fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8602ffd640 1 -- 172.21.15.107:0/4281360110 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc03ad00 con 0x7f860c071570 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8602ffd640 1 -- 172.21.15.107:0/4281360110 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0443f0 con 0x7f860c071570 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860c1291d0 con 0x7f860c071570 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f8602ffd640 1 -- 172.21.15.107:0/4281360110 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0446d0 con 0x7f860c071570 2024-04-24T01:42:24.221 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.216+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860c12bbc0 con 0x7f860c071570 2024-04-24T01:42:24.222 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.217+0000 7f8602ffd640 1 -- 172.21.15.107:0/4281360110 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f85fc04b060 con 0x7f860c071570 2024-04-24T01:42:24.222 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.217+0000 7f8602ffd640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f85f0037fd0 0x7f85f003a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:24.222 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.217+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860c0737f0 con 0x7f860c071570 2024-04-24T01:42:24.222 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.217+0000 7f8602ffd640 1 -- 172.21.15.107:0/4281360110 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7f85fc06c9d0 con 0x7f860c071570 2024-04-24T01:42:24.222 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.218+0000 7f8611b25640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f85f0037fd0 0x7f85f003a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:24.222 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.218+0000 7f8611b25640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f85f0037fd0 0x7f85f003a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f86080015f0 tx=0x7f8608007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:24.223 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.222+0000 7f8602ffd640 1 -- 172.21.15.107:0/4281360110 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f85fc03f070 con 0x7f860c071570 2024-04-24T01:42:24.395 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.394+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f860c062da0 con 0x7f860c071570 2024-04-24T01:42:24.395 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.394+0000 7f8602ffd640 1 -- 172.21.15.107:0/4281360110 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+4685 (secure 0 0 0) 0x7f85fc04dca0 con 0x7f860c071570 2024-04-24T01:42:24.395 INFO:teuthology.misc.health.smithi107.stdout: 2024-04-24T01:42:24.396 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":10,"fsid":"bbf4dd9c-0d50-4da0-921c-8b1690fa6e43","created":"2024-04-24T01:42:15.810458+0000","modified":"2024-04-24T01:42:24.065053+0000","last_up_change":"2024-04-24T01:42:23.061038+0000","last_in_change":"2024-04-24T01:42:16.924967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3146761-e93e-4bdf-8311-10dc9fe86689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6801","nonce":2413654117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6803","nonce":2413654117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6807","nonce":2413654117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6805","nonce":2413654117}]},"public_addr":"172.21.15.107:6801/2413654117","cluster_addr":"172.21.15.107:6803/2413654117","heartbeat_back_addr":"172.21.15.107:6807/2413654117","heartbeat_front_addr":"172.21.15.107:6805/2413654117","state":["exists","up"]},{"osd":1,"uuid":"3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55fbd99e-62cc-471f-bc45-7c8afd7708d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7d0b408a-aec1-4880-87b0-b1848ad9cbb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:21.943591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:42:24.397 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f85f0037fd0 msgr2=0x7f85f003a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:24.397 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f85f0037fd0 0x7f85f003a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f86080015f0 tx=0x7f8608007a40 comp rx=0 tx=0).stop 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c071570 msgr2=0x7f860c1c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c071570 0x7f860c1c2fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0097f0 tx=0x7f85fc0046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 shutdown_connections 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f85f0037fd0 0x7f85f003a490 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 --2- 172.21.15.107:0/4281360110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f860c071570 0x7f860c1c2fb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 >> 172.21.15.107:0/4281360110 conn(0x7f860c09a840 msgr2=0x7f860c12a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 shutdown_connections 2024-04-24T01:42:24.398 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:24.396+0000 7f861458a640 1 -- 172.21.15.107:0/4281360110 wait complete. 2024-04-24T01:42:24.409 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-04-24T01:42:24.690 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-24T01:42:24.690+0000 7f3973413640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T01:42:24.705 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-24T01:42:24.705+0000 7f396ba45640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:42:24.713 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-24T01:42:24.713+0000 7ff1360a6640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T01:42:24.724 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-24T01:42:24.724+0000 7ff12e6d8640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:42:24.743 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-24T01:42:24.742+0000 7fc9d3fff640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T01:42:24.752 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-24T01:42:24.752+0000 7fc9cc631640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:42:30.814 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd29d0f2640 1 Processor -- start 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd29d0f2640 1 -- start start 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd29d0f2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd298096350 0x7fd298096730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd29d0f2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd298071e10 con 0x7fd298071570 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd29d0f2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd29806ecf0 con 0x7fd298096350 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd296d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd298096350 0x7fd298096730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd29659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd298071570 0x7fd29812c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54748/0 (socket says 172.21.15.107:54748) 2024-04-24T01:42:30.915 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd29659c640 1 -- 172.21.15.107:0/2092922099 learned_addr learned my addr 172.21.15.107:0/2092922099 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:30.916 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd296d9d640 1 -- 172.21.15.107:0/2092922099 >> v1:172.21.15.107:6789/0 conn(0x7fd298071570 legacy=0x7fd29812c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:30.916 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd295d9b640 1 -- 172.21.15.107:0/2092922099 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715960024 0 0) 0x7fd298071e10 con 0x7fd298071570 2024-04-24T01:42:30.916 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.914+0000 7fd296d9d640 1 -- 172.21.15.107:0/2092922099 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29809c5e0 con 0x7fd298096350 2024-04-24T01:42:30.918 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.915+0000 7fd296d9d640 1 --2- 172.21.15.107:0/2092922099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298096350 0x7fd298096730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009720 tx=0x7fd28c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dd4a7c2718c612 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.915+0000 7fd295d9b640 1 -- 172.21.15.107:0/2092922099 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd28c0316d0 con 0x7fd298096350 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.915+0000 7fd295d9b640 1 -- 172.21.15.107:0/2092922099 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c037070 con 0x7fd298096350 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.915+0000 7fd295d9b640 1 -- 172.21.15.107:0/2092922099 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd28c0319c0 con 0x7fd298096350 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.916+0000 7fd29d0f2640 1 -- 172.21.15.107:0/2092922099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298096350 msgr2=0x7fd298096730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.916+0000 7fd29d0f2640 1 --2- 172.21.15.107:0/2092922099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298096350 0x7fd298096730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009720 tx=0x7fd28c02b840 comp rx=0 tx=0).stop 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.916+0000 7fd29d0f2640 1 -- 172.21.15.107:0/2092922099 shutdown_connections 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.916+0000 7fd29d0f2640 1 --2- 172.21.15.107:0/2092922099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298096350 0x7fd298096730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.916+0000 7fd29d0f2640 1 -- 172.21.15.107:0/2092922099 >> 172.21.15.107:0/2092922099 conn(0x7fd29809a840 msgr2=0x7fd29809ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.916+0000 7fd29d0f2640 1 -- 172.21.15.107:0/2092922099 shutdown_connections 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.916+0000 7fd29d0f2640 1 -- 172.21.15.107:0/2092922099 wait complete. 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.917+0000 7fd29d0f2640 1 Processor -- start 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.917+0000 7fd29d0f2640 1 -- start start 2024-04-24T01:42:30.919 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd29d0f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298071570 0x7fd298126030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd29d0f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd29812c760 con 0x7fd298071570 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd296d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298071570 0x7fd298126030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd296d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298071570 0x7fd298126030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38894/0 (socket says 172.21.15.107:38894) 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd296d9d640 1 -- 172.21.15.107:0/3553576440 learned_addr learned my addr 172.21.15.107:0/3553576440 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd296d9d640 1 -- 172.21.15.107:0/3553576440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29812b8d0 con 0x7fd298071570 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd296d9d640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298071570 0x7fd298126030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009720 tx=0x7fd28c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd27f7fe640 1 -- 172.21.15.107:0/3553576440 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd28c032770 con 0x7fd298071570 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd27f7fe640 1 -- 172.21.15.107:0/3553576440 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c032910 con 0x7fd298071570 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd298128050 con 0x7fd298071570 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd27f7fe640 1 -- 172.21.15.107:0/3553576440 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd28c032bf0 con 0x7fd298071570 2024-04-24T01:42:30.920 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.918+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd298128ce0 con 0x7fd298071570 2024-04-24T01:42:30.922 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.919+0000 7fd27f7fe640 1 -- 172.21.15.107:0/3553576440 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd28c04c060 con 0x7fd298071570 2024-04-24T01:42:30.922 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.919+0000 7fd27f7fe640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd284038060 0x7fd28403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:30.922 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.919+0000 7fd27f7fe640 1 -- 172.21.15.107:0/3553576440 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fd28c02f050 con 0x7fd298071570 2024-04-24T01:42:30.922 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.919+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2980737f0 con 0x7fd298071570 2024-04-24T01:42:30.922 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.920+0000 7fd29659c640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd284038060 0x7fd28403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:30.922 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.921+0000 7fd29659c640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd284038060 0x7fd28403a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd288000c00 tx=0x7fd288007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:30.924 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:30.924+0000 7fd27f7fe640 1 -- 172.21.15.107:0/3553576440 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fd29812b8d0 con 0x7fd298071570 2024-04-24T01:42:31.099 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.099+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2980990c0 con 0x7fd298071570 2024-04-24T01:42:31.099 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.099+0000 7fd27f7fe640 1 -- 172.21.15.107:0/3553576440 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8002 (secure 0 0 0) 0x7fd2980990c0 con 0x7fd298071570 2024-04-24T01:42:31.100 INFO:teuthology.misc.health.smithi107.stdout: 2024-04-24T01:42:31.100 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":14,"fsid":"bbf4dd9c-0d50-4da0-921c-8b1690fa6e43","created":"2024-04-24T01:42:15.810458+0000","modified":"2024-04-24T01:42:28.703229+0000","last_up_change":"2024-04-24T01:42:25.691893+0000","last_in_change":"2024-04-24T01:42:16.924967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:42:26.034973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3146761-e93e-4bdf-8311-10dc9fe86689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6801","nonce":2413654117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6803","nonce":2413654117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6807","nonce":2413654117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6805","nonce":2413654117}]},"public_addr":"172.21.15.107:6801/2413654117","cluster_addr":"172.21.15.107:6803/2413654117","heartbeat_back_addr":"172.21.15.107:6807/2413654117","heartbeat_front_addr":"172.21.15.107:6805/2413654117","state":["exists","up"]},{"osd":1,"uuid":"3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6810","nonce":2417718615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6814","nonce":2417718615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6819","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6821","nonce":2417718615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6817","nonce":2417718615}]},"public_addr":"172.21.15.131:6810/2417718615","cluster_addr":"172.21.15.131:6814/2417718615","heartbeat_back_addr":"172.21.15.131:6821/2417718615","heartbeat_front_addr":"172.21.15.131:6817/2417718615","state":["exists","up"]},{"osd":2,"uuid":"55fbd99e-62cc-471f-bc45-7c8afd7708d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6811","nonce":3673094383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6815","nonce":3673094383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6823","nonce":3673094383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6820","nonce":3673094383}]},"public_addr":"172.21.15.131:6811/3673094383","cluster_addr":"172.21.15.131:6815/3673094383","heartbeat_back_addr":"172.21.15.131:6823/3673094383","heartbeat_front_addr":"172.21.15.131:6820/3673094383","state":["exists","up"]},{"osd":3,"uuid":"7d0b408a-aec1-4880-87b0-b1848ad9cbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6801","nonce":3849831825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6803","nonce":3849831825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6807","nonce":3849831825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6805","nonce":3849831825}]},"public_addr":"172.21.15.131:6801/3849831825","cluster_addr":"172.21.15.131:6803/3849831825","heartbeat_back_addr":"172.21.15.131:6807/3849831825","heartbeat_front_addr":"172.21.15.131:6805/3849831825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:21.943591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.153669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.139045+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.228740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd284038060 msgr2=0x7fd28403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd284038060 0x7fd28403a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd288000c00 tx=0x7fd288007910 comp rx=0 tx=0).stop 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298071570 msgr2=0x7fd298126030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298071570 0x7fd298126030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009720 tx=0x7fd28c0046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 shutdown_connections 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd284038060 0x7fd28403a520 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 --2- 172.21.15.107:0/3553576440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd298071570 0x7fd298126030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 >> 172.21.15.107:0/3553576440 conn(0x7fd29809a840 msgr2=0x7fd2981b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 shutdown_connections 2024-04-24T01:42:31.102 INFO:teuthology.misc.health.smithi107.stderr:2024-04-24T01:42:31.101+0000 7fd29d0f2640 1 -- 172.21.15.107:0/3553576440 wait complete. 2024-04-24T01:42:31.111 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-24T01:42:31.111 INFO:tasks.ceph:Creating RBD pool 2024-04-24T01:42:31.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1e091ab640 1 Processor -- start 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1e091ab640 1 -- start start 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1e091ab640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1e0406d420 0x7f1e0406d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1e091ab640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e04072340 con 0x7f1e04098800 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1e091ab640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1e04070b50 con 0x7f1e0406d420 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1e02d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1e0406d420 0x7f1e0406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1dfbfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1e04098800 0x7f1e04096050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54764/0 (socket says 172.21.15.107:54764) 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.206+0000 7f1dfbfff640 1 -- 172.21.15.107:0/2783888548 learned_addr learned my addr 172.21.15.107:0/2783888548 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.207+0000 7f1e02d9d640 1 -- 172.21.15.107:0/2783888548 >> v1:172.21.15.107:6789/0 conn(0x7f1e04098800 legacy=0x7f1e04096050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.207+0000 7f1e02d9d640 1 -- 172.21.15.107:0/2783888548 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e040717c0 con 0x7f1e0406d420 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.207+0000 7f1e02d9d640 1 --2- 172.21.15.107:0/2783888548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406d800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009720 tx=0x7f1df402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01394de0ad9f7af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.207+0000 7f1e0259c640 1 -- 172.21.15.107:0/2783888548 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df40316d0 con 0x7f1e0406d420 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e0259c640 1 -- 172.21.15.107:0/2783888548 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df4037070 con 0x7f1e0406d420 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e0259c640 1 -- 172.21.15.107:0/2783888548 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df40319c0 con 0x7f1e0406d420 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e091ab640 1 -- 172.21.15.107:0/2783888548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 msgr2=0x7f1e0406d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e091ab640 1 --2- 172.21.15.107:0/2783888548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406d800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009720 tx=0x7f1df402b840 comp rx=0 tx=0).stop 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e091ab640 1 -- 172.21.15.107:0/2783888548 shutdown_connections 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e091ab640 1 --2- 172.21.15.107:0/2783888548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406d800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e091ab640 1 -- 172.21.15.107:0/2783888548 >> 172.21.15.107:0/2783888548 conn(0x7f1e04099680 msgr2=0x7f1e04099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:31.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e091ab640 1 -- 172.21.15.107:0/2783888548 shutdown_connections 2024-04-24T01:42:31.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.208+0000 7f1e091ab640 1 -- 172.21.15.107:0/2783888548 wait complete. 2024-04-24T01:42:31.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.209+0000 7f1e091ab640 1 Processor -- start 2024-04-24T01:42:31.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.209+0000 7f1e091ab640 1 -- start start 2024-04-24T01:42:31.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.209+0000 7f1e091ab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:31.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.209+0000 7f1e091ab640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0406dec0 con 0x7f1e0406d420 2024-04-24T01:42:31.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1e02d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:31.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1e02d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38914/0 (socket says 172.21.15.107:38914) 2024-04-24T01:42:31.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1e02d9d640 1 -- 172.21.15.107:0/1477745167 learned_addr learned my addr 172.21.15.107:0/1477745167 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:31.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1e02d9d640 1 -- 172.21.15.107:0/1477745167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e041284d0 con 0x7f1e0406d420 2024-04-24T01:42:31.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1e02d9d640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406e530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009720 tx=0x7f1df40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1dfb7fe640 1 -- 172.21.15.107:0/1477745167 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df4032770 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1dfb7fe640 1 -- 172.21.15.107:0/1477745167 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df4032910 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e04128090 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1dfb7fe640 1 -- 172.21.15.107:0/1477745167 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df4032bf0 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.210+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0406ec50 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.211+0000 7f1dfb7fe640 1 -- 172.21.15.107:0/1477745167 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1df404c060 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.211+0000 7f1dfb7fe640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1de4038060 0x7f1de403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.211+0000 7f1dfb7fe640 1 -- 172.21.15.107:0/1477745167 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f1df402f050 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.211+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e04062da0 con 0x7f1e0406d420 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.211+0000 7f1dfbfff640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1de4038060 0x7f1de403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:31.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.212+0000 7f1dfbfff640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1de4038060 0x7f1de403a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1dec007fd0 tx=0x7f1dec007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:31.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.216+0000 7f1dfb7fe640 1 -- 172.21.15.107:0/1477745167 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f1df4040070 con 0x7f1e0406d420 2024-04-24T01:42:31.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.389+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f1e0412c620 con 0x7f1e0406d420 2024-04-24T01:42:31.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.725+0000 7f1dfb7fe640 1 -- 172.21.15.107:0/1477745167 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f1df403a380 con 0x7f1e0406d420 2024-04-24T01:42:31.726 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'rbd' created 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1de4038060 msgr2=0x7f1de403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1de4038060 0x7f1de403a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1dec007fd0 tx=0x7f1dec007ac0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 msgr2=0x7f1e0406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406e530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009720 tx=0x7f1df40046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 shutdown_connections 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1de4038060 0x7f1de403a520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 --2- 172.21.15.107:0/1477745167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e0406d420 0x7f1e0406e530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 >> 172.21.15.107:0/1477745167 conn(0x7f1e04099680 msgr2=0x7f1e04129fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 shutdown_connections 2024-04-24T01:42:31.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.728+0000 7f1e091ab640 1 -- 172.21.15.107:0/1477745167 wait complete. 2024-04-24T01:42:31.740 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-24T01:42:31.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.837+0000 7f91cbe66640 1 Processor -- start 2024-04-24T01:42:31.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91cbe66640 1 -- start start 2024-04-24T01:42:31.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91cbe66640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f91c412da10 0x7f91c412fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:31.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91cbe66640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c40706f0 con 0x7f91c41276b0 2024-04-24T01:42:31.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91cbe66640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f91c4070ef0 con 0x7f91c412da10 2024-04-24T01:42:31.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91c9c02640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f91c41276b0 0x7f91c4127a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54778/0 (socket says 172.21.15.107:54778) 2024-04-24T01:42:31.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91c9c02640 1 -- 172.21.15.107:0/3264551985 learned_addr learned my addr 172.21.15.107:0/3264551985 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:31.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91c9401640 1 --2- 172.21.15.107:0/3264551985 >> v2:172.21.15.107:3300/0 conn(0x7f91c412da10 0x7f91c412fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:31.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.838+0000 7f91c9401640 1 -- 172.21.15.107:0/3264551985 >> v1:172.21.15.107:6789/0 conn(0x7f91c41276b0 legacy=0x7f91c4127a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.839+0000 7f91c9401640 1 -- 172.21.15.107:0/3264551985 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c4127430 con 0x7f91c412da10 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.839+0000 7f91c9401640 1 --2- 172.21.15.107:0/3264551985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c412da10 0x7f91c412fe00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009720 tx=0x7f91b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684915e00b53a5f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.839+0000 7f91c8c00640 1 -- 172.21.15.107:0/3264551985 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b40316d0 con 0x7f91c412da10 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.839+0000 7f91c8c00640 1 -- 172.21.15.107:0/3264551985 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b4037070 con 0x7f91c412da10 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.839+0000 7f91c8c00640 1 -- 172.21.15.107:0/3264551985 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b40319c0 con 0x7f91c412da10 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.840+0000 7f91cbe66640 1 -- 172.21.15.107:0/3264551985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c412da10 msgr2=0x7f91c412fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.840+0000 7f91cbe66640 1 --2- 172.21.15.107:0/3264551985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c412da10 0x7f91c412fe00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009720 tx=0x7f91b402b840 comp rx=0 tx=0).stop 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.840+0000 7f91cbe66640 1 -- 172.21.15.107:0/3264551985 shutdown_connections 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.840+0000 7f91cbe66640 1 --2- 172.21.15.107:0/3264551985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c412da10 0x7f91c412fe00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:31.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.840+0000 7f91cbe66640 1 -- 172.21.15.107:0/3264551985 >> 172.21.15.107:0/3264551985 conn(0x7f91c4099510 msgr2=0x7f91c4099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:31.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.840+0000 7f91cbe66640 1 -- 172.21.15.107:0/3264551985 shutdown_connections 2024-04-24T01:42:31.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.840+0000 7f91cbe66640 1 -- 172.21.15.107:0/3264551985 wait complete. 2024-04-24T01:42:31.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.841+0000 7f91cbe66640 1 Processor -- start 2024-04-24T01:42:31.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.841+0000 7f91cbe66640 1 -- start start 2024-04-24T01:42:31.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.841+0000 7f91cbe66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c41276b0 0x7f91c412f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:31.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.841+0000 7f91cbe66640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f91c40714d0 con 0x7f91c41276b0 2024-04-24T01:42:31.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.841+0000 7f91c9c02640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c41276b0 0x7f91c412f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:31.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.841+0000 7f91c9c02640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c41276b0 0x7f91c412f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38918/0 (socket says 172.21.15.107:38918) 2024-04-24T01:42:31.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.841+0000 7f91c9c02640 1 -- 172.21.15.107:0/245415396 learned_addr learned my addr 172.21.15.107:0/245415396 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:31.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.842+0000 7f91c9c02640 1 -- 172.21.15.107:0/245415396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c4131bb0 con 0x7f91c41276b0 2024-04-24T01:42:31.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.842+0000 7f91c9c02640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c41276b0 0x7f91c412f630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91c000ca90 tx=0x7f91c000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.842+0000 7f91ba7fc640 1 -- 172.21.15.107:0/245415396 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91c0018070 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.842+0000 7f91ba7fc640 1 -- 172.21.15.107:0/245415396 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0004c90 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.842+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c4132030 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.842+0000 7f91ba7fc640 1 -- 172.21.15.107:0/245415396 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91c000aa50 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.842+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c4112f90 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.843+0000 7f91ba7fc640 1 -- 172.21.15.107:0/245415396 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f91c001b070 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.843+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c4062da0 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.843+0000 7f91ba7fc640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91a8038060 0x7f91a803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.843+0000 7f91ba7fc640 1 -- 172.21.15.107:0/245415396 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f91c004ac60 con 0x7f91c41276b0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.844+0000 7f91c9401640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91a8038060 0x7f91a803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:31.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.844+0000 7f91c9401640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91a8038060 0x7f91a803a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f91b4036000 tx=0x7f91b4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:31.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:31.848+0000 7f91ba7fc640 1 -- 172.21.15.107:0/245415396 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f91c001cc50 con 0x7f91c41276b0 2024-04-24T01:42:32.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.019+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f91c406c170 con 0x7f91c41276b0 2024-04-24T01:42:32.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.728+0000 7f91ba7fc640 1 -- 172.21.15.107:0/245415396 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 173+0+0 (secure 0 0 0) 0x7f91c00113a0 con 0x7f91c41276b0 2024-04-24T01:42:32.728 INFO:teuthology.orchestra.run.smithi107.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-24T01:42:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.730+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91a8038060 msgr2=0x7f91a803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.730+0000 7f91cbe66640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91a8038060 0x7f91a803a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f91b4036000 tx=0x7f91b4008030 comp rx=0 tx=0).stop 2024-04-24T01:42:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.730+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c41276b0 msgr2=0x7f91c412f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.730+0000 7f91cbe66640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c41276b0 0x7f91c412f630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91c000ca90 tx=0x7f91c000cf50 comp rx=0 tx=0).stop 2024-04-24T01:42:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.730+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 shutdown_connections 2024-04-24T01:42:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.730+0000 7f91cbe66640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91a8038060 0x7f91a803a520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.730+0000 7f91cbe66640 1 --2- 172.21.15.107:0/245415396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c41276b0 0x7f91c412f630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:32.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.731+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 >> 172.21.15.107:0/245415396 conn(0x7f91c4099510 msgr2=0x7f91c4121da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:32.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.731+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 shutdown_connections 2024-04-24T01:42:32.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.731+0000 7f91cbe66640 1 -- 172.21.15.107:0/245415396 wait complete. 2024-04-24T01:42:32.743 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T01:42:32.744 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T01:42:32.744 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T01:42:32.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T01:42:32.745 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T01:42:32.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.840+0000 7f615c985640 1 Processor -- start 2024-04-24T01:42:32.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.840+0000 7f615c985640 1 -- start start 2024-04-24T01:42:32.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f615c985640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f615806e2c0 0x7f6158133640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:32.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f615c985640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61580a08a0 con 0x7f615806d7d0 2024-04-24T01:42:32.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f615c985640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f615806f6d0 con 0x7f615806e2c0 2024-04-24T01:42:32.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f6155d9b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f615806e2c0 0x7f6158133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:32.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f615659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f615806d7d0 0x7f615806dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54790/0 (socket says 172.21.15.107:54790) 2024-04-24T01:42:32.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f615659c640 1 -- 172.21.15.107:0/3631802622 learned_addr learned my addr 172.21.15.107:0/3631802622 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:32.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f6155d9b640 1 -- 172.21.15.107:0/3631802622 >> v1:172.21.15.107:6789/0 conn(0x7f615806d7d0 legacy=0x7f615806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:32.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.841+0000 7f6155d9b640 1 -- 172.21.15.107:0/3631802622 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615806faa0 con 0x7f615806e2c0 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f6155d9b640 1 --2- 172.21.15.107:0/3631802622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806e2c0 0x7f6158133640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6140009750 tx=0x7f614002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8772717eb75f30e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f615559a640 1 -- 172.21.15.107:0/3631802622 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140035020 con 0x7f615806e2c0 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f615559a640 1 -- 172.21.15.107:0/3631802622 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6140031760 con 0x7f615806e2c0 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f615559a640 1 -- 172.21.15.107:0/3631802622 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140031a60 con 0x7f615806e2c0 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f615c985640 1 -- 172.21.15.107:0/3631802622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806e2c0 msgr2=0x7f6158133640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f615c985640 1 --2- 172.21.15.107:0/3631802622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806e2c0 0x7f6158133640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6140009750 tx=0x7f614002b8d0 comp rx=0 tx=0).stop 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f615c985640 1 -- 172.21.15.107:0/3631802622 shutdown_connections 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.842+0000 7f615c985640 1 --2- 172.21.15.107:0/3631802622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806e2c0 0x7f6158133640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.843+0000 7f615c985640 1 -- 172.21.15.107:0/3631802622 >> 172.21.15.107:0/3631802622 conn(0x7f615809ea70 msgr2=0x7f615809ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.843+0000 7f615c985640 1 -- 172.21.15.107:0/3631802622 shutdown_connections 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.843+0000 7f615c985640 1 -- 172.21.15.107:0/3631802622 wait complete. 2024-04-24T01:42:32.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.843+0000 7f615c985640 1 Processor -- start 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.843+0000 7f615c985640 1 -- start start 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615c985640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806d7d0 0x7f615809a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615c985640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6158133f10 con 0x7f615806d7d0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806d7d0 0x7f615809a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806d7d0 0x7f615809a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38936/0 (socket says 172.21.15.107:38936) 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615659c640 1 -- 172.21.15.107:0/2695932325 learned_addr learned my addr 172.21.15.107:0/2695932325 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615659c640 1 -- 172.21.15.107:0/2695932325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6158129840 con 0x7f615806d7d0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615659c640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806d7d0 0x7f615809a6d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f615000c4a0 tx=0x7f615000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f614effd640 1 -- 172.21.15.107:0/2695932325 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150017070 con 0x7f615806d7d0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f614effd640 1 -- 172.21.15.107:0/2695932325 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6150005c10 con 0x7f615806d7d0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6158070890 con 0x7f615806d7d0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f614effd640 1 -- 172.21.15.107:0/2695932325 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150007070 con 0x7f615806d7d0 2024-04-24T01:42:32.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.844+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615812a4d0 con 0x7f615806d7d0 2024-04-24T01:42:32.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.845+0000 7f614effd640 1 -- 172.21.15.107:0/2695932325 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f615001a070 con 0x7f615806d7d0 2024-04-24T01:42:32.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.845+0000 7f614effd640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6138038060 0x7f613803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:32.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.845+0000 7f614effd640 1 -- 172.21.15.107:0/2695932325 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f615004a1e0 con 0x7f615806d7d0 2024-04-24T01:42:32.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.845+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6158062da0 con 0x7f615806d7d0 2024-04-24T01:42:32.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.846+0000 7f6155d9b640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6138038060 0x7f613803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:32.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.846+0000 7f6155d9b640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6138038060 0x7f613803a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6140036000 tx=0x7f6140008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:32.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:32.850+0000 7f614effd640 1 -- 172.21.15.107:0/2695932325 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f61500117a0 con 0x7f615806d7d0 2024-04-24T01:42:33.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.069+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f615812a010 con 0x7f615806d7d0 2024-04-24T01:42:33.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.071+0000 7f614effd640 1 -- 172.21.15.107:0/2695932325 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87207 (secure 0 0 0) 0x7f6150012400 con 0x7f615806d7d0 2024-04-24T01:42:33.072 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6138038060 msgr2=0x7f613803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6138038060 0x7f613803a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6140036000 tx=0x7f6140008030 comp rx=0 tx=0).stop 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806d7d0 msgr2=0x7f615809a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806d7d0 0x7f615809a6d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f615000c4a0 tx=0x7f615000c960 comp rx=0 tx=0).stop 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 shutdown_connections 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6138038060 0x7f613803a520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 --2- 172.21.15.107:0/2695932325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f615806d7d0 0x7f615809a6d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 >> 172.21.15.107:0/2695932325 conn(0x7f615809ea70 msgr2=0x7f615812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 shutdown_connections 2024-04-24T01:42:33.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.073+0000 7f615c985640 1 -- 172.21.15.107:0/2695932325 wait complete. 2024-04-24T01:42:33.084 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3835564877},{"type":"v1","addr":"172.21.15.131:6825","nonce":3835564877}]},"active_addr":"172.21.15.131:6825/3835564877","active_change":"2024-04-24T01:42:20.001679+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3321439254}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1504710002}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":2501700125}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":2703501449}]}]} 2024-04-24T01:42:33.086 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T01:42:33.086 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T01:42:33.087 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:42:33.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.182+0000 7f23ac68f640 1 Processor -- start 2024-04-24T01:42:33.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.182+0000 7f23ac68f640 1 -- start start 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23ac68f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f23a406fd50 0x7f23a4133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23ac68f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a4133da0 con 0x7f23a406f260 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23ac68f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f23a4070bc0 con 0x7f23a406fd50 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23aa42b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f23a406f260 0x7f23a406f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54794/0 (socket says 172.21.15.107:54794) 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23aa42b640 1 -- 172.21.15.107:0/2576339065 learned_addr learned my addr 172.21.15.107:0/2576339065 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23a9c2a640 1 --2- 172.21.15.107:0/2576339065 >> v2:172.21.15.107:3300/0 conn(0x7f23a406fd50 0x7f23a4133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23a9429640 1 -- 172.21.15.107:0/2576339065 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109174662 0 0) 0x7f23a4133da0 con 0x7f23a406f260 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23a9429640 1 -- 172.21.15.107:0/2576339065 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2390003520 con 0x7f23a406f260 2024-04-24T01:42:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23a9c2a640 1 -- 172.21.15.107:0/2576339065 >> v1:172.21.15.107:6789/0 conn(0x7f23a406f260 legacy=0x7f23a406f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.183+0000 7f23a9c2a640 1 -- 172.21.15.107:0/2576339065 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a4134f80 con 0x7f23a406fd50 2024-04-24T01:42:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.184+0000 7f23a9c2a640 1 --2- 172.21.15.107:0/2576339065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406fd50 0x7f23a4133860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009720 tx=0x7f23a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bad9671942a9378 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.184+0000 7f23a9429640 1 -- 172.21.15.107:0/2576339065 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a00316d0 con 0x7f23a406fd50 2024-04-24T01:42:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.184+0000 7f23a9429640 1 -- 172.21.15.107:0/2576339065 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a0037070 con 0x7f23a406fd50 2024-04-24T01:42:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.184+0000 7f23a9429640 1 -- 172.21.15.107:0/2576339065 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a00319a0 con 0x7f23a406fd50 2024-04-24T01:42:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 -- 172.21.15.107:0/2576339065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406fd50 msgr2=0x7f23a4133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 --2- 172.21.15.107:0/2576339065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406fd50 0x7f23a4133860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009720 tx=0x7f23a002b840 comp rx=0 tx=0).stop 2024-04-24T01:42:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 -- 172.21.15.107:0/2576339065 shutdown_connections 2024-04-24T01:42:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 --2- 172.21.15.107:0/2576339065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406fd50 0x7f23a4133860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 -- 172.21.15.107:0/2576339065 >> 172.21.15.107:0/2576339065 conn(0x7f23a409e170 msgr2=0x7f23a406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 -- 172.21.15.107:0/2576339065 shutdown_connections 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 -- 172.21.15.107:0/2576339065 wait complete. 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.185+0000 7f23ac68f640 1 Processor -- start 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23ac68f640 1 -- start start 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23ac68f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406f260 0x7f23a41247f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23ac68f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4134300 con 0x7f23a406f260 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23aa42b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406f260 0x7f23a41247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23aa42b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406f260 0x7f23a41247f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38954/0 (socket says 172.21.15.107:38954) 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23aa42b640 1 -- 172.21.15.107:0/3681863167 learned_addr learned my addr 172.21.15.107:0/3681863167 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23aa42b640 1 -- 172.21.15.107:0/3681863167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a4131cf0 con 0x7f23a406f260 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f23aa42b640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406f260 0x7f23a41247f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f239400c3b0 tx=0x7f239400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.186+0000 7f239affd640 1 -- 172.21.15.107:0/3681863167 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2394017070 con 0x7f23a406f260 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.187+0000 7f239affd640 1 -- 172.21.15.107:0/3681863167 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2394005c10 con 0x7f23a406f260 2024-04-24T01:42:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.187+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a4131610 con 0x7f23a406f260 2024-04-24T01:42:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.187+0000 7f239affd640 1 -- 172.21.15.107:0/3681863167 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23940070d0 con 0x7f23a406f260 2024-04-24T01:42:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.187+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a4132eb0 con 0x7f23a406f260 2024-04-24T01:42:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.188+0000 7f239affd640 1 -- 172.21.15.107:0/3681863167 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f239401a070 con 0x7f23a406f260 2024-04-24T01:42:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.188+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a4131ab0 con 0x7f23a406f260 2024-04-24T01:42:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.188+0000 7f239affd640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2388038060 0x7f238803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.188+0000 7f239affd640 1 -- 172.21.15.107:0/3681863167 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f239404a310 con 0x7f23a406f260 2024-04-24T01:42:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.188+0000 7f23a9c2a640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2388038060 0x7f238803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.189+0000 7f23a9c2a640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2388038060 0x7f238803a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009720 tx=0x7f23a0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.193+0000 7f239affd640 1 -- 172.21.15.107:0/3681863167 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f2394019e10 con 0x7f23a406f260 2024-04-24T01:42:33.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.365+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23a40a18a0 con 0x7f23a406f260 2024-04-24T01:42:33.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.365+0000 7f239affd640 1 -- 172.21.15.107:0/3681863167 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9783 (secure 0 0 0) 0x7f23a40a18a0 con 0x7f23a406f260 2024-04-24T01:42:33.365 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:42:33.366 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"fsid":"bbf4dd9c-0d50-4da0-921c-8b1690fa6e43","created":"2024-04-24T01:42:15.810458+0000","modified":"2024-04-24T01:42:32.726571+0000","last_up_change":"2024-04-24T01:42:25.691893+0000","last_in_change":"2024-04-24T01:42:16.924967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:42:26.034973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:42:31.407234+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3146761-e93e-4bdf-8311-10dc9fe86689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6801","nonce":2413654117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6803","nonce":2413654117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6807","nonce":2413654117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6805","nonce":2413654117}]},"public_addr":"172.21.15.107:6801/2413654117","cluster_addr":"172.21.15.107:6803/2413654117","heartbeat_back_addr":"172.21.15.107:6807/2413654117","heartbeat_front_addr":"172.21.15.107:6805/2413654117","state":["exists","up"]},{"osd":1,"uuid":"3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6810","nonce":2417718615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6814","nonce":2417718615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6819","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6821","nonce":2417718615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6817","nonce":2417718615}]},"public_addr":"172.21.15.131:6810/2417718615","cluster_addr":"172.21.15.131:6814/2417718615","heartbeat_back_addr":"172.21.15.131:6821/2417718615","heartbeat_front_addr":"172.21.15.131:6817/2417718615","state":["exists","up"]},{"osd":2,"uuid":"55fbd99e-62cc-471f-bc45-7c8afd7708d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6811","nonce":3673094383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6815","nonce":3673094383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6823","nonce":3673094383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6820","nonce":3673094383}]},"public_addr":"172.21.15.131:6811/3673094383","cluster_addr":"172.21.15.131:6815/3673094383","heartbeat_back_addr":"172.21.15.131:6823/3673094383","heartbeat_front_addr":"172.21.15.131:6820/3673094383","state":["exists","up"]},{"osd":3,"uuid":"7d0b408a-aec1-4880-87b0-b1848ad9cbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6801","nonce":3849831825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6803","nonce":3849831825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6807","nonce":3849831825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6805","nonce":3849831825}]},"public_addr":"172.21.15.131:6801/3849831825","cluster_addr":"172.21.15.131:6803/3849831825","heartbeat_back_addr":"172.21.15.131:6807/3849831825","heartbeat_front_addr":"172.21.15.131:6805/3849831825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:21.943591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.153669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.139045+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.228740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2388038060 msgr2=0x7f238803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2388038060 0x7f238803a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009720 tx=0x7f23a0008030 comp rx=0 tx=0).stop 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406f260 msgr2=0x7f23a41247f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406f260 0x7f23a41247f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f239400c3b0 tx=0x7f239400c870 comp rx=0 tx=0).stop 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 shutdown_connections 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2388038060 0x7f238803a520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 --2- 172.21.15.107:0/3681863167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a406f260 0x7f23a41247f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 >> 172.21.15.107:0/3681863167 conn(0x7f23a409e170 msgr2=0x7f23a409e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 shutdown_connections 2024-04-24T01:42:33.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.367+0000 7f23ac68f640 1 -- 172.21.15.107:0/3681863167 wait complete. 2024-04-24T01:42:33.378 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T01:42:33.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:42:33.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.474+0000 7ff4dd427640 1 Processor -- start 2024-04-24T01:42:33.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.474+0000 7ff4dd427640 1 -- start start 2024-04-24T01:42:33.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.474+0000 7ff4dd427640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff4d806ccd0 0x7ff4d806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.474+0000 7ff4dd427640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d806f7f0 con 0x7ff4d806d5f0 2024-04-24T01:42:33.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.474+0000 7ff4dd427640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d806eaf0 con 0x7ff4d806ccd0 2024-04-24T01:42:33.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.474+0000 7ff4d6ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff4d806ccd0 0x7ff4d806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.475+0000 7ff4cffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff4d806d5f0 0x7ff4d8132a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54798/0 (socket says 172.21.15.107:54798) 2024-04-24T01:42:33.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.475+0000 7ff4cffff640 1 -- 172.21.15.107:0/143966568 learned_addr learned my addr 172.21.15.107:0/143966568 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:33.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.475+0000 7ff4d6ffd640 1 -- 172.21.15.107:0/143966568 >> v1:172.21.15.107:6789/0 conn(0x7ff4d806d5f0 legacy=0x7ff4d8132a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.475+0000 7ff4d6ffd640 1 -- 172.21.15.107:0/143966568 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d80722f0 con 0x7ff4d806ccd0 2024-04-24T01:42:33.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.475+0000 7ff4d6ffd640 1 --2- 172.21.15.107:0/143966568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d806d0b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009720 tx=0x7ff4c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9372c2c3d8d8fb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4d67fc640 1 -- 172.21.15.107:0/143966568 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c80316d0 con 0x7ff4d806ccd0 2024-04-24T01:42:33.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4d67fc640 1 -- 172.21.15.107:0/143966568 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8037070 con 0x7ff4d806ccd0 2024-04-24T01:42:33.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4d67fc640 1 -- 172.21.15.107:0/143966568 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c80319c0 con 0x7ff4d806ccd0 2024-04-24T01:42:33.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4dd427640 1 -- 172.21.15.107:0/143966568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 msgr2=0x7ff4d806d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4dd427640 1 --2- 172.21.15.107:0/143966568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d806d0b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009720 tx=0x7ff4c802b840 comp rx=0 tx=0).stop 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4dd427640 1 -- 172.21.15.107:0/143966568 shutdown_connections 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4dd427640 1 --2- 172.21.15.107:0/143966568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d806d0b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4dd427640 1 -- 172.21.15.107:0/143966568 >> 172.21.15.107:0/143966568 conn(0x7ff4d809b780 msgr2=0x7ff4d809bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4dd427640 1 -- 172.21.15.107:0/143966568 shutdown_connections 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.476+0000 7ff4dd427640 1 -- 172.21.15.107:0/143966568 wait complete. 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.477+0000 7ff4dd427640 1 Processor -- start 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.477+0000 7ff4dd427640 1 -- start start 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.477+0000 7ff4dd427640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d81a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.477+0000 7ff4dd427640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d8097db0 con 0x7ff4d806ccd0 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.477+0000 7ff4d6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d81a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.477+0000 7ff4d6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d81a78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38984/0 (socket says 172.21.15.107:38984) 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.477+0000 7ff4d6ffd640 1 -- 172.21.15.107:0/1047419080 learned_addr learned my addr 172.21.15.107:0/1047419080 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.478+0000 7ff4d6ffd640 1 -- 172.21.15.107:0/1047419080 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d81a9ca0 con 0x7ff4d806ccd0 2024-04-24T01:42:33.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.478+0000 7ff4d6ffd640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d81a78c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009840 tx=0x7ff4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.478+0000 7ff4cf7fe640 1 -- 172.21.15.107:0/1047419080 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c8032770 con 0x7ff4d806ccd0 2024-04-24T01:42:33.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.478+0000 7ff4cf7fe640 1 -- 172.21.15.107:0/1047419080 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8032910 con 0x7ff4d806ccd0 2024-04-24T01:42:33.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.478+0000 7ff4cf7fe640 1 -- 172.21.15.107:0/1047419080 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c8032c30 con 0x7ff4d806ccd0 2024-04-24T01:42:33.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.478+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d81aa160 con 0x7ff4d806ccd0 2024-04-24T01:42:33.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.478+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d81a7e00 con 0x7ff4d806ccd0 2024-04-24T01:42:33.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.479+0000 7ff4cf7fe640 1 -- 172.21.15.107:0/1047419080 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4c804c060 con 0x7ff4d806ccd0 2024-04-24T01:42:33.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.479+0000 7ff4cf7fe640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff4b8038060 0x7ff4b803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.479+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d8062da0 con 0x7ff4d806ccd0 2024-04-24T01:42:33.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.479+0000 7ff4cf7fe640 1 -- 172.21.15.107:0/1047419080 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7ff4c802f050 con 0x7ff4d806ccd0 2024-04-24T01:42:33.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.479+0000 7ff4cffff640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff4b8038060 0x7ff4b803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.480+0000 7ff4cffff640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff4b8038060 0x7ff4b803a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0007fd0 tx=0x7ff4c0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.484+0000 7ff4cf7fe640 1 -- 172.21.15.107:0/1047419080 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7ff4c8040070 con 0x7ff4d806ccd0 2024-04-24T01:42:33.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.657+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4d8098a90 con 0x7ff4d806ccd0 2024-04-24T01:42:33.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.657+0000 7ff4cf7fe640 1 -- 172.21.15.107:0/1047419080 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9783 (secure 0 0 0) 0x7ff4c8039310 con 0x7ff4d806ccd0 2024-04-24T01:42:33.657 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:42:33.658 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"fsid":"bbf4dd9c-0d50-4da0-921c-8b1690fa6e43","created":"2024-04-24T01:42:15.810458+0000","modified":"2024-04-24T01:42:32.726571+0000","last_up_change":"2024-04-24T01:42:25.691893+0000","last_in_change":"2024-04-24T01:42:16.924967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:42:26.034973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:42:31.407234+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3146761-e93e-4bdf-8311-10dc9fe86689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6801","nonce":2413654117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6803","nonce":2413654117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6807","nonce":2413654117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6805","nonce":2413654117}]},"public_addr":"172.21.15.107:6801/2413654117","cluster_addr":"172.21.15.107:6803/2413654117","heartbeat_back_addr":"172.21.15.107:6807/2413654117","heartbeat_front_addr":"172.21.15.107:6805/2413654117","state":["exists","up"]},{"osd":1,"uuid":"3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6810","nonce":2417718615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6814","nonce":2417718615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6819","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6821","nonce":2417718615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6817","nonce":2417718615}]},"public_addr":"172.21.15.131:6810/2417718615","cluster_addr":"172.21.15.131:6814/2417718615","heartbeat_back_addr":"172.21.15.131:6821/2417718615","heartbeat_front_addr":"172.21.15.131:6817/2417718615","state":["exists","up"]},{"osd":2,"uuid":"55fbd99e-62cc-471f-bc45-7c8afd7708d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6811","nonce":3673094383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6815","nonce":3673094383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6823","nonce":3673094383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6820","nonce":3673094383}]},"public_addr":"172.21.15.131:6811/3673094383","cluster_addr":"172.21.15.131:6815/3673094383","heartbeat_back_addr":"172.21.15.131:6823/3673094383","heartbeat_front_addr":"172.21.15.131:6820/3673094383","state":["exists","up"]},{"osd":3,"uuid":"7d0b408a-aec1-4880-87b0-b1848ad9cbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6801","nonce":3849831825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6803","nonce":3849831825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6807","nonce":3849831825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6805","nonce":3849831825}]},"public_addr":"172.21.15.131:6801/3849831825","cluster_addr":"172.21.15.131:6803/3849831825","heartbeat_back_addr":"172.21.15.131:6807/3849831825","heartbeat_front_addr":"172.21.15.131:6805/3849831825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:21.943591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.153669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.139045+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.228740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff4b8038060 msgr2=0x7ff4b803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff4b8038060 0x7ff4b803a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0007fd0 tx=0x7ff4c0007ac0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 msgr2=0x7ff4d81a78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d81a78c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009840 tx=0x7ff4c80046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 shutdown_connections 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff4b8038060 0x7ff4b803a520 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 --2- 172.21.15.107:0/1047419080 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4d806ccd0 0x7ff4d81a78c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 >> 172.21.15.107:0/1047419080 conn(0x7ff4d809b780 msgr2=0x7ff4d80903b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 shutdown_connections 2024-04-24T01:42:33.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.659+0000 7ff4dd427640 1 -- 172.21.15.107:0/1047419080 wait complete. 2024-04-24T01:42:33.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T01:42:33.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T01:42:33.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T01:42:33.672 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T01:42:33.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f5a4388c640 1 Processor -- start 2024-04-24T01:42:33.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f60c2d1e640 1 Processor -- start 2024-04-24T01:42:33.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f1df127b640 1 Processor -- start 2024-04-24T01:42:33.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f2782184640 1 Processor -- start 2024-04-24T01:42:33.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f1df127b640 1 -- start start 2024-04-24T01:42:33.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f60c2d1e640 1 -- start start 2024-04-24T01:42:33.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f5a4388c640 1 -- start start 2024-04-24T01:42:33.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f2782184640 1 -- start start 2024-04-24T01:42:33.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f60c2d1e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f60bc06ccd0 0x7f60bc06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f5a4388c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5a3c071090 0x7f5a3c131430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f60c2d1e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc06f7f0 con 0x7f60bc06d5f0 2024-04-24T01:42:33.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f60c2d1e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f60bc06eaf0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f5a4388c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3c098800 con 0x7f5a3c096430 2024-04-24T01:42:33.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.774+0000 7f5a4388c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5a3c071930 con 0x7f5a3c071090 2024-04-24T01:42:33.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f2782184640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f277c096380 0x7f277c096760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1df127b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1dec12bac0 0x7f1dec130570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f5a40e27640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5a3c071090 0x7f5a3c131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f60c0aba640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f60bc06ccd0 0x7f60bc06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f5a40e27640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5a3c071090 0x7f5a3c131430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39006/0 (socket says 172.21.15.107:39006) 2024-04-24T01:42:33.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f5a40e27640 1 -- 172.21.15.107:0/1692718093 learned_addr learned my addr 172.21.15.107:0/1692718093 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f60c0aba640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f60bc06ccd0 0x7f60bc06d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38990/0 (socket says 172.21.15.107:38990) 2024-04-24T01:42:33.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f60c0aba640 1 -- 172.21.15.107:0/1730331473 learned_addr learned my addr 172.21.15.107:0/1730331473 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1df127b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dec09d1d0 con 0x7f1dec12afd0 2024-04-24T01:42:33.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1df127b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1dec071f10 con 0x7f1dec12bac0 2024-04-24T01:42:33.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f2782184640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277c098800 con 0x7f277c06d420 2024-04-24T01:42:33.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f2782184640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f277c070a20 con 0x7f277c096380 2024-04-24T01:42:33.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f277b7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f277c096380 0x7f277c096760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f277b7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f277c096380 0x7f277c096760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39020/0 (socket says 172.21.15.107:39020) 2024-04-24T01:42:33.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1deaffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1dec12afd0 0x7f1dec12b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54826/0 (socket says 172.21.15.107:54826) 2024-04-24T01:42:33.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1deaffd640 1 -- 172.21.15.107:0/3603130920 learned_addr learned my addr 172.21.15.107:0/3603130920 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:33.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f5a40e27640 1 -- 172.21.15.107:0/1692718093 >> v1:172.21.15.107:6789/0 conn(0x7f5a3c096430 legacy=0x7f5a3c096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f5a40e27640 1 -- 172.21.15.107:0/1692718093 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c071f50 con 0x7f5a3c071090 2024-04-24T01:42:33.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1dea7fc640 1 --2- 172.21.15.107:0/3603130920 >> v2:172.21.15.107:3300/0 conn(0x7f1dec12bac0 0x7f1dec130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f277b7fe640 1 -- 172.21.15.107:0/959691379 learned_addr learned my addr 172.21.15.107:0/959691379 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f277b7fe640 1 -- 172.21.15.107:0/959691379 >> v1:172.21.15.107:6789/0 conn(0x7f277c06d420 legacy=0x7f277c06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f277b7fe640 1 -- 172.21.15.107:0/959691379 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c071c20 con 0x7f277c096380 2024-04-24T01:42:33.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1dea7fc640 1 -- 172.21.15.107:0/3603130920 >> v1:172.21.15.107:6789/0 conn(0x7f1dec12afd0 legacy=0x7f1dec12b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f1dea7fc640 1 -- 172.21.15.107:0/3603130920 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec09ac80 con 0x7f1dec12bac0 2024-04-24T01:42:33.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f60c0aba640 1 -- 172.21.15.107:0/1730331473 >> v1:172.21.15.107:6789/0 conn(0x7f60bc06d5f0 legacy=0x7f60bc132a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.775+0000 7f60c0aba640 1 -- 172.21.15.107:0/1730331473 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc0722f0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.776+0000 7f60c0aba640 1 --2- 172.21.15.107:0/1730331473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc06d0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097f0 tx=0x7f60b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb29893cfb79bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.776+0000 7f1dea7fc640 1 --2- 172.21.15.107:0/3603130920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12bac0 0x7f1dec130570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009720 tx=0x7f1de002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ead5acd7395c5cc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.776+0000 7f60bb7fe640 1 -- 172.21.15.107:0/1730331473 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b0035020 con 0x7f60bc06ccd0 2024-04-24T01:42:33.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f60bb7fe640 1 -- 172.21.15.107:0/1730331473 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b00317a0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f277b7fe640 1 --2- 172.21.15.107:0/959691379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c096380 0x7f277c096760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f276c0097f0 tx=0x7f276c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217d4e68cd58c95b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f60bb7fe640 1 -- 172.21.15.107:0/1730331473 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b0031aa0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.776+0000 7f5a40e27640 1 --2- 172.21.15.107:0/1692718093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c131430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0097f0 tx=0x7f5a2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34bae00edee48ed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f277a7fc640 1 -- 172.21.15.107:0/959691379 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c034070 con 0x7f277c096380 2024-04-24T01:42:33.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f5a33fff640 1 -- 172.21.15.107:0/1692718093 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c035020 con 0x7f5a3c071090 2024-04-24T01:42:33.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f277a7fc640 1 -- 172.21.15.107:0/959691379 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c030790 con 0x7f277c096380 2024-04-24T01:42:33.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f1de9ffb640 1 -- 172.21.15.107:0/3603130920 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de00316d0 con 0x7f1dec12bac0 2024-04-24T01:42:33.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f277a7fc640 1 -- 172.21.15.107:0/959691379 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c030a90 con 0x7f277c096380 2024-04-24T01:42:33.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f1de9ffb640 1 -- 172.21.15.107:0/3603130920 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de0037070 con 0x7f1dec12bac0 2024-04-24T01:42:33.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f1de9ffb640 1 -- 172.21.15.107:0/3603130920 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de00319c0 con 0x7f1dec12bac0 2024-04-24T01:42:33.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1730331473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 msgr2=0x7f60bc06d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1730331473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc06d0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097f0 tx=0x7f60b002b910 comp rx=0 tx=0).stop 2024-04-24T01:42:33.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1730331473 shutdown_connections 2024-04-24T01:42:33.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1730331473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc06d0b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1730331473 >> 172.21.15.107:0/1730331473 conn(0x7f60bc09b780 msgr2=0x7f60bc09bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1730331473 shutdown_connections 2024-04-24T01:42:33.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f5a33fff640 1 -- 172.21.15.107:0/1692718093 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c0317a0 con 0x7f5a3c071090 2024-04-24T01:42:33.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1730331473 wait complete. 2024-04-24T01:42:33.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.777+0000 7f5a33fff640 1 -- 172.21.15.107:0/1692718093 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c031aa0 con 0x7f5a3c071090 2024-04-24T01:42:33.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f1df127b640 1 -- 172.21.15.107:0/3603130920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12bac0 msgr2=0x7f1dec130570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f1df127b640 1 --2- 172.21.15.107:0/3603130920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12bac0 0x7f1dec130570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009720 tx=0x7f1de002b840 comp rx=0 tx=0).stop 2024-04-24T01:42:33.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f1df127b640 1 -- 172.21.15.107:0/3603130920 shutdown_connections 2024-04-24T01:42:33.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f2782184640 1 -- 172.21.15.107:0/959691379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c096380 msgr2=0x7f277c096760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f2782184640 1 --2- 172.21.15.107:0/959691379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c096380 0x7f277c096760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f276c0097f0 tx=0x7f276c02b9a0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f1df127b640 1 --2- 172.21.15.107:0/3603130920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12bac0 0x7f1dec130570 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f1df127b640 1 -- 172.21.15.107:0/3603130920 >> 172.21.15.107:0/3603130920 conn(0x7f1dec09c360 msgr2=0x7f1dec09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f1df127b640 1 -- 172.21.15.107:0/3603130920 shutdown_connections 2024-04-24T01:42:33.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f1df127b640 1 -- 172.21.15.107:0/3603130920 wait complete. 2024-04-24T01:42:33.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f2782184640 1 -- 172.21.15.107:0/959691379 shutdown_connections 2024-04-24T01:42:33.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f2782184640 1 --2- 172.21.15.107:0/959691379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c096380 0x7f277c096760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f2782184640 1 -- 172.21.15.107:0/959691379 >> 172.21.15.107:0/959691379 conn(0x7f277c099680 msgr2=0x7f277c099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f2782184640 1 -- 172.21.15.107:0/959691379 shutdown_connections 2024-04-24T01:42:33.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.778+0000 7f2782184640 1 -- 172.21.15.107:0/959691379 wait complete. 2024-04-24T01:42:33.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f60c2d1e640 1 Processor -- start 2024-04-24T01:42:33.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f5a4388c640 1 -- 172.21.15.107:0/1692718093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 msgr2=0x7f5a3c131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f5a4388c640 1 --2- 172.21.15.107:0/1692718093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c131430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0097f0 tx=0x7f5a2c02b910 comp rx=0 tx=0).stop 2024-04-24T01:42:33.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f60c2d1e640 1 -- start start 2024-04-24T01:42:33.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f5a4388c640 1 -- 172.21.15.107:0/1692718093 shutdown_connections 2024-04-24T01:42:33.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f5a4388c640 1 --2- 172.21.15.107:0/1692718093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c131430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f5a4388c640 1 -- 172.21.15.107:0/1692718093 >> 172.21.15.107:0/1692718093 conn(0x7f5a3c099680 msgr2=0x7f5a3c099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f5a4388c640 1 -- 172.21.15.107:0/1692718093 shutdown_connections 2024-04-24T01:42:33.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f5a4388c640 1 -- 172.21.15.107:0/1692718093 wait complete. 2024-04-24T01:42:33.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f60c2d1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc1a7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f60c2d1e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc097db0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f1df127b640 1 Processor -- start 2024-04-24T01:42:33.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f1df127b640 1 -- start start 2024-04-24T01:42:33.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f60c0aba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc1a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f60c0aba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc1a7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39052/0 (socket says 172.21.15.107:39052) 2024-04-24T01:42:33.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f60c0aba640 1 -- 172.21.15.107:0/1774447723 learned_addr learned my addr 172.21.15.107:0/1774447723 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.779+0000 7f2782184640 1 Processor -- start 2024-04-24T01:42:33.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f60c0aba640 1 -- 172.21.15.107:0/1774447723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1a8f50 con 0x7f60bc06ccd0 2024-04-24T01:42:33.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f2782184640 1 -- start start 2024-04-24T01:42:33.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f5a4388c640 1 Processor -- start 2024-04-24T01:42:33.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f1df127b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12afd0 0x7f1dec131ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f5a4388c640 1 -- start start 2024-04-24T01:42:33.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f1df127b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec130ab0 con 0x7f1dec12afd0 2024-04-24T01:42:33.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f1deaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12afd0 0x7f1dec131ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f60c0aba640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc1a7830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097f0 tx=0x7f60b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f1deaffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12afd0 0x7f1dec131ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39062/0 (socket says 172.21.15.107:39062) 2024-04-24T01:42:33.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f1deaffd640 1 -- 172.21.15.107:0/1492641163 learned_addr learned my addr 172.21.15.107:0/1492641163 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f2782184640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c06d420 0x7f277c126890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b003acb0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f2782184640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f277c0713a0 con 0x7f277c06d420 2024-04-24T01:42:33.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f1deaffd640 1 -- 172.21.15.107:0/1492641163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec133620 con 0x7f1dec12afd0 2024-04-24T01:42:33.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc1aa7d0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f5a4388c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c1c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f277b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c06d420 0x7f277c126890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b003ae50 con 0x7f60bc06ccd0 2024-04-24T01:42:33.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc1a7d70 con 0x7f60bc06ccd0 2024-04-24T01:42:33.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f5a4388c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c131af0 con 0x7f5a3c071090 2024-04-24T01:42:33.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f277b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c06d420 0x7f277c126890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39078/0 (socket says 172.21.15.107:39078) 2024-04-24T01:42:33.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f277b7fe640 1 -- 172.21.15.107:0/2942642689 learned_addr learned my addr 172.21.15.107:0/2942642689 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b0044520 con 0x7f60bc06ccd0 2024-04-24T01:42:33.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.780+0000 7f5a41628640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c1c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f5a41628640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c1c2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39080/0 (socket says 172.21.15.107:39080) 2024-04-24T01:42:33.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f5a41628640 1 -- 172.21.15.107:0/287111652 learned_addr learned my addr 172.21.15.107:0/287111652 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f1deaffd640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12afd0 0x7f1dec131ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c4a0 tx=0x7f1ddc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f277b7fe640 1 -- 172.21.15.107:0/2942642689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c129370 con 0x7f277c06d420 2024-04-24T01:42:33.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ddc017070 con 0x7f1dec12afd0 2024-04-24T01:42:33.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dec11afd0 con 0x7f1dec12afd0 2024-04-24T01:42:33.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dec11b2e0 con 0x7f1dec12afd0 2024-04-24T01:42:33.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f277b7fe640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c06d420 0x7f277c126890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f276c02b9e0 tx=0x7f276c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc005c10 con 0x7f1dec12afd0 2024-04-24T01:42:33.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ddc007070 con 0x7f1dec12afd0 2024-04-24T01:42:33.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c047070 con 0x7f277c06d420 2024-04-24T01:42:33.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c12b920 con 0x7f277c06d420 2024-04-24T01:42:33.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c003bf0 con 0x7f277c06d420 2024-04-24T01:42:33.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c128a60 con 0x7f277c06d420 2024-04-24T01:42:33.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f609c000f80 con 0x7f60bc06ccd0 2024-04-24T01:42:33.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.781+0000 7f5a41628640 1 -- 172.21.15.107:0/287111652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c1307e0 con 0x7f5a3c071090 2024-04-24T01:42:33.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f5a41628640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c1c2fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c380 tx=0x7f5a3800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f60b004b060 con 0x7f60bc06ccd0 2024-04-24T01:42:33.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f277c09acb0 con 0x7f277c06d420 2024-04-24T01:42:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1dcc000f80 con 0x7f1dec12afd0 2024-04-24T01:42:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c047070 con 0x7f277c06d420 2024-04-24T01:42:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f5a31ffb640 1 -- 172.21.15.107:0/287111652 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a38005200 con 0x7f5a3c071090 2024-04-24T01:42:33.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1ddc01a070 con 0x7f1dec12afd0 2024-04-24T01:42:33.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c08a620 con 0x7f5a3c071090 2024-04-24T01:42:33.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f60b97fa640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f60a0038060 0x7f60a003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f60b006d1b0 con 0x7f60bc06ccd0 2024-04-24T01:42:33.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f60b97fa640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f60a003d7e0 0x7f60a003fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60b004ee50 con 0x7f60a003d7e0 2024-04-24T01:42:33.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f60b0074050 con 0x7f60bc06ccd0 2024-04-24T01:42:33.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1dd37fe640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1dd8038100 0x7f1dd803a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f1ddc04a280 con 0x7f1dec12afd0 2024-04-24T01:42:33.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f60bbfff640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f60a0038060 0x7f60a003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f60c12bb640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f60a003d7e0 0x7f60a003fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1dd37fe640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f1dd803d900 0x7f1dd803fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dd8040410 con 0x7f1dd803d900 2024-04-24T01:42:33.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1ddc051050 con 0x7f1dec12afd0 2024-04-24T01:42:33.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1dea7fc640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1dd8038100 0x7f1dd803a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f5a31ffb640 1 -- 172.21.15.107:0/287111652 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a380053c0 con 0x7f5a3c071090 2024-04-24T01:42:33.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.782+0000 7f5a31ffb640 1 -- 172.21.15.107:0/287111652 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a38007190 con 0x7f5a3c071090 2024-04-24T01:42:33.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1deb7fe640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f1dd803d900 0x7f1dd803fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f276c04a070 con 0x7f277c06d420 2024-04-24T01:42:33.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c131150 con 0x7f5a3c071090 2024-04-24T01:42:33.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f60c12bb640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f60a003d7e0 0x7f60a003fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f60bbfff640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f60a0038060 0x7f60a003a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f60a8000f60 tx=0x7f60a8007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f2763fff640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2768038220 0x7f276803a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f276c03f070 con 0x7f277c06d420 2024-04-24T01:42:33.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f2763fff640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f276803d9a0 0x7f276803fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f276c00af30 con 0x7f276803d9a0 2024-04-24T01:42:33.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f276c06d780 con 0x7f277c06d420 2024-04-24T01:42:33.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.783+0000 7f1dea7fc640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1dd8038100 0x7f1dd803a5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1de0036000 tx=0x7f1de0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f1deb7fe640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f1dd803d900 0x7f1dd803fd40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f5a31ffb640 1 -- 172.21.15.107:0/287111652 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5a38007330 con 0x7f5a3c071090 2024-04-24T01:42:33.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f5a31ffb640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20038060 0x7f5a2003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f5a31ffb640 1 -- 172.21.15.107:0/287111652 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f5a3804e120 con 0x7f5a3c071090 2024-04-24T01:42:33.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f5a40e27640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20038060 0x7f5a2003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f277bfff640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f276803d9a0 0x7f276803fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f277affd640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2768038220 0x7f276803a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f277bfff640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f276803d9a0 0x7f276803fde0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f277affd640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2768038220 0x7f276803a6e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2770001560 tx=0x7f2770007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60b004ee50 con 0x7f60a003d7e0 2024-04-24T01:42:33.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.784+0000 7f5a40e27640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20038060 0x7f5a2003a520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c036000 tx=0x7f5a2c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.785+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dd8040410 con 0x7f1dd803d900 2024-04-24T01:42:33.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.785+0000 7f5a4388c640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7f5a3c096430 0x7f5a3c1c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.785+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a3c130bd0 con 0x7f5a3c096430 2024-04-24T01:42:33.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.785+0000 7f5a41e29640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7f5a3c096430 0x7f5a3c1c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.785+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f276c00af30 con 0x7f276803d9a0 2024-04-24T01:42:33.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.785+0000 7f5a41e29640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7f5a3c096430 0x7f5a3c1c3510 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.786+0000 7f5a31ffb640 1 -- 172.21.15.107:0/287111652 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a3c130bd0 con 0x7f5a3c096430 2024-04-24T01:42:33.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.816+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1dcc002c70 con 0x7f1dd803d900 2024-04-24T01:42:33.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.816+0000 7f1dd37fe640 1 -- 172.21.15.107:0/1492641163 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1dcc002c70 con 0x7f1dd803d900 2024-04-24T01:42:33.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.816+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f609c002c70 con 0x7f60a003d7e0 2024-04-24T01:42:33.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f1dd803d900 msgr2=0x7f1dd803fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f1dd803d900 0x7f1dd803fd40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60b97fa640 1 -- 172.21.15.107:0/1774447723 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f609c002c70 con 0x7f60a003d7e0 2024-04-24T01:42:33.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a3c12fb70 con 0x7f5a3c096430 2024-04-24T01:42:33.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1dd8038100 msgr2=0x7f1dd803a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1dd8038100 0x7f1dd803a5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1de0036000 tx=0x7f1de0008030 comp rx=0 tx=0).stop 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12afd0 msgr2=0x7f1dec131ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12afd0 0x7f1dec131ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c4a0 tx=0x7f1ddc00c960 comp rx=0 tx=0).stop 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 shutdown_connections 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f1dd803d900 0x7f1dd803fd40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1dd8038100 0x7f1dd803a5c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 --2- 172.21.15.107:0/1492641163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dec12afd0 0x7f1dec131ca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 >> 172.21.15.107:0/1492641163 conn(0x7f1dec09c360 msgr2=0x7f1dec06f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 shutdown_connections 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f1df127b640 1 -- 172.21.15.107:0/1492641163 wait complete. 2024-04-24T01:42:33.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f60a003d7e0 msgr2=0x7f60a003fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f277c127dc0 con 0x7f276803d9a0 2024-04-24T01:42:33.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f60a003d7e0 0x7f60a003fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f5a31ffb640 1 -- 172.21.15.107:0/287111652 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5a3c12fb70 con 0x7f5a3c096430 2024-04-24T01:42:33.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f60a0038060 msgr2=0x7f60a003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f60a0038060 0x7f60a003a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f60a8000f60 tx=0x7f60a8007a30 comp rx=0 tx=0).stop 2024-04-24T01:42:33.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 msgr2=0x7f60bc1a7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc1a7830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60b00097f0 tx=0x7f60b00046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 shutdown_connections 2024-04-24T01:42:33.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f60a003d7e0 0x7f60a003fc20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7f5a3c096430 msgr2=0x7f5a3c1c3510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.817+0000 7f5a4388c640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7f5a3c096430 0x7f5a3c1c3510 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f60a0038060 0x7f60a003a520 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f60c2d1e640 1 --2- 172.21.15.107:0/1774447723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60bc06ccd0 0x7f60bc1a7830 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2763fff640 1 -- 172.21.15.107:0/2942642689 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f277400ad10 con 0x7f276803d9a0 2024-04-24T01:42:33.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 >> 172.21.15.107:0/1774447723 conn(0x7f60bc09b780 msgr2=0x7f60bc0903b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 shutdown_connections 2024-04-24T01:42:33.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20038060 msgr2=0x7f5a2003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20038060 0x7f5a2003a520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c036000 tx=0x7f5a2c008030 comp rx=0 tx=0).stop 2024-04-24T01:42:33.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 msgr2=0x7f5a3c1c2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c1c2fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c380 tx=0x7f5a3800c840 comp rx=0 tx=0).stop 2024-04-24T01:42:33.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f60c2d1e640 1 -- 172.21.15.107:0/1774447723 wait complete. 2024-04-24T01:42:33.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 shutdown_connections 2024-04-24T01:42:33.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7f5a3c096430 0x7f5a3c1c3510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20038060 0x7f5a2003a520 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 --2- 172.21.15.107:0/287111652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a3c071090 0x7f5a3c1c2fd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 >> 172.21.15.107:0/287111652 conn(0x7f5a3c099680 msgr2=0x7f5a3c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f276803d9a0 msgr2=0x7f276803fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 shutdown_connections 2024-04-24T01:42:33.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f276803d9a0 0x7f276803fde0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f5a4388c640 1 -- 172.21.15.107:0/287111652 wait complete. 2024-04-24T01:42:33.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2768038220 msgr2=0x7f276803a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2768038220 0x7f276803a6e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2770001560 tx=0x7f2770007a50 comp rx=0 tx=0).stop 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c06d420 msgr2=0x7f277c126890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c06d420 0x7f277c126890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f276c02b9e0 tx=0x7f276c0046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 shutdown_connections 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f276803d9a0 0x7f276803fde0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2768038220 0x7f276803a6e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 --2- 172.21.15.107:0/2942642689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f277c06d420 0x7f277c126890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 >> 172.21.15.107:0/2942642689 conn(0x7f277c099680 msgr2=0x7f277c12c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 shutdown_connections 2024-04-24T01:42:33.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.818+0000 7f2782184640 1 -- 172.21.15.107:0/2942642689 wait complete. 2024-04-24T01:42:33.832 INFO:teuthology.orchestra.run.smithi107.stdout:47244640261 2024-04-24T01:42:33.832 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T01:42:33.833 INFO:teuthology.orchestra.run.smithi107.stdout:47244640261 2024-04-24T01:42:33.833 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T01:42:33.836 INFO:teuthology.orchestra.run.smithi107.stdout:38654705669 2024-04-24T01:42:33.836 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T01:42:33.837 INFO:teuthology.orchestra.run.smithi107.stdout:47244640262 2024-04-24T01:42:33.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T01:42:33.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.934+0000 7fc83dd4b640 1 Processor -- start 2024-04-24T01:42:33.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.934+0000 7fc83dd4b640 1 -- start start 2024-04-24T01:42:33.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc83dd4b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc83806e850 0x7fc83806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc83dd4b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc838071220 con 0x7fc83806f170 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc83dd4b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc83806fb20 con 0x7fc83806e850 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc8377fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc83806e850 0x7fc83806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc836ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc83806f170 0x7fc83812e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54840/0 (socket says 172.21.15.107:54840) 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc836ffd640 1 -- 172.21.15.107:0/3597775749 learned_addr learned my addr 172.21.15.107:0/3597775749 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc8377fe640 1 -- 172.21.15.107:0/3597775749 >> v1:172.21.15.107:6789/0 conn(0x7fc83806f170 legacy=0x7fc83812e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc8377fe640 1 -- 172.21.15.107:0/3597775749 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83806f8b0 con 0x7fc83806e850 2024-04-24T01:42:33.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.935+0000 7fc8367fc640 1 -- 172.21.15.107:0/3597775749 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404018130 0 0) 0x7fc82c001110 con 0x7fc83806f170 2024-04-24T01:42:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.937+0000 7fc8377fe640 1 --2- 172.21.15.107:0/3597775749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc83806ec30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc828009720 tx=0x7fc82802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d02e4601dcf146 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.937+0000 7fc8367fc640 1 -- 172.21.15.107:0/3597775749 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8280316d0 con 0x7fc83806e850 2024-04-24T01:42:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.937+0000 7fc8367fc640 1 -- 172.21.15.107:0/3597775749 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828037070 con 0x7fc83806e850 2024-04-24T01:42:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.937+0000 7fc8367fc640 1 -- 172.21.15.107:0/3597775749 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8280319c0 con 0x7fc83806e850 2024-04-24T01:42:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.938+0000 7fc83dd4b640 1 -- 172.21.15.107:0/3597775749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 msgr2=0x7fc83806ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.938+0000 7fc83dd4b640 1 --2- 172.21.15.107:0/3597775749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc83806ec30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc828009720 tx=0x7fc82802b840 comp rx=0 tx=0).stop 2024-04-24T01:42:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.938+0000 7fc83dd4b640 1 -- 172.21.15.107:0/3597775749 shutdown_connections 2024-04-24T01:42:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.938+0000 7fc83dd4b640 1 --2- 172.21.15.107:0/3597775749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc83806ec30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.938+0000 7fc83dd4b640 1 -- 172.21.15.107:0/3597775749 >> 172.21.15.107:0/3597775749 conn(0x7fc83809d750 msgr2=0x7fc83809db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.938+0000 7fc83dd4b640 1 -- 172.21.15.107:0/3597775749 shutdown_connections 2024-04-24T01:42:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.938+0000 7fc83dd4b640 1 -- 172.21.15.107:0/3597775749 wait complete. 2024-04-24T01:42:33.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.939+0000 7fc83dd4b640 1 Processor -- start 2024-04-24T01:42:33.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.939+0000 7fc83dd4b640 1 -- start start 2024-04-24T01:42:33.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc83dd4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc8381c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc83dd4b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc838070b50 con 0x7fc83806e850 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc8381c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc8381c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39096/0 (socket says 172.21.15.107:39096) 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc8377fe640 1 -- 172.21.15.107:0/1593016314 learned_addr learned my addr 172.21.15.107:0/1593016314 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc8377fe640 1 -- 172.21.15.107:0/1593016314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381c3370 con 0x7fc83806e850 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc8377fe640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc8381c37b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc828034040 tx=0x7fc8280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.940+0000 7fc81ffff640 1 -- 172.21.15.107:0/1593016314 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828032770 con 0x7fc83806e850 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.941+0000 7fc81ffff640 1 -- 172.21.15.107:0/1593016314 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828032910 con 0x7fc83806e850 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.941+0000 7fc81ffff640 1 -- 172.21.15.107:0/1593016314 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828032c30 con 0x7fc83806e850 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.941+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc838123e70 con 0x7fc83806e850 2024-04-24T01:42:33.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.941+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83812c880 con 0x7fc83806e850 2024-04-24T01:42:33.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.942+0000 7fc81ffff640 1 -- 172.21.15.107:0/1593016314 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc82804c060 con 0x7fc83806e850 2024-04-24T01:42:33.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.942+0000 7fc81ffff640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc824038060 0x7fc82403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.942+0000 7fc81ffff640 1 -- 172.21.15.107:0/1593016314 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fc82802f050 con 0x7fc83806e850 2024-04-24T01:42:33.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.942+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc838062da0 con 0x7fc83806e850 2024-04-24T01:42:33.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.942+0000 7fc836ffd640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc824038060 0x7fc82403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.943+0000 7fc836ffd640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc824038060 0x7fc82403a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000c00 tx=0x7fc82c001250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.947+0000 7fc81ffff640 1 -- 172.21.15.107:0/1593016314 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fc828040070 con 0x7fc83806e850 2024-04-24T01:42:33.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.978+0000 7f1998a74640 1 Processor -- start 2024-04-24T01:42:33.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.978+0000 7f1998a74640 1 -- start start 2024-04-24T01:42:33.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.978+0000 7f2966f60640 1 Processor -- start 2024-04-24T01:42:33.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.978+0000 7f2966f60640 1 -- start start 2024-04-24T01:42:33.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f4313463640 1 Processor -- start 2024-04-24T01:42:33.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f2966f60640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f296012e4b0 0x7f29601308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f2966f60640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2960128b20 con 0x7f2960128030 2024-04-24T01:42:33.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f4313463640 1 -- start start 2024-04-24T01:42:33.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f2966f60640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2960127be0 con 0x7f296012e4b0 2024-04-24T01:42:33.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f295ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f296012e4b0 0x7f29601308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f1998a74640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1994070ae0 0x7f1994131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f199259c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f199406fff0 0x7f19940703d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54848/0 (socket says 172.21.15.107:54848) 2024-04-24T01:42:33.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f1998a74640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1994071f20 con 0x7f199406fff0 2024-04-24T01:42:33.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f295ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f296012e4b0 0x7f29601308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39098/0 (socket says 172.21.15.107:39098) 2024-04-24T01:42:33.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f1998a74640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1994072780 con 0x7f1994070ae0 2024-04-24T01:42:33.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f295ffff640 1 -- 172.21.15.107:0/1495259043 learned_addr learned my addr 172.21.15.107:0/1495259043 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f2964cfc640 1 --1- 172.21.15.107:0/1495259043 >> v1:172.21.15.107:6789/0 conn(0x7f2960128030 0x7f2960128410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54844/0 (socket says 172.21.15.107:54844) 2024-04-24T01:42:33.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f199259c640 1 -- 172.21.15.107:0/3589479538 learned_addr learned my addr 172.21.15.107:0/3589479538 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:33.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f295ffff640 1 -- 172.21.15.107:0/1495259043 >> v1:172.21.15.107:6789/0 conn(0x7f2960128030 legacy=0x7f2960128410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f1991d9b640 1 --2- 172.21.15.107:0/3589479538 >> v2:172.21.15.107:3300/0 conn(0x7f1994070ae0 0x7f1994131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f295ffff640 1 -- 172.21.15.107:0/1495259043 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2960098930 con 0x7f296012e4b0 2024-04-24T01:42:33.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.979+0000 7f295f7fe640 1 -- 172.21.15.107:0/1495259043 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233165733 0 0) 0x7f2960128b20 con 0x7f2960128030 2024-04-24T01:42:33.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f4313463640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f430c06fd50 0x7f430c133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f43111ff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f430c06f260 0x7f430c06f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54856/0 (socket says 172.21.15.107:54856) 2024-04-24T01:42:33.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f43111ff640 1 -- 172.21.15.107:0/367142888 learned_addr learned my addr 172.21.15.107:0/367142888 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:33.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f4313463640 1 -- 172.21.15.107:0/367142888 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430c133da0 con 0x7f430c06f260 2024-04-24T01:42:33.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f1991d9b640 1 -- 172.21.15.107:0/3589479538 >> v1:172.21.15.107:6789/0 conn(0x7f199406fff0 legacy=0x7f19940703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f1991d9b640 1 -- 172.21.15.107:0/3589479538 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19940714c0 con 0x7f1994070ae0 2024-04-24T01:42:33.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f4313463640 1 -- 172.21.15.107:0/367142888 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f430c070bc0 con 0x7f430c06fd50 2024-04-24T01:42:33.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f43109fe640 1 --2- 172.21.15.107:0/367142888 >> v2:172.21.15.107:3300/0 conn(0x7f430c06fd50 0x7f430c133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f43109fe640 1 -- 172.21.15.107:0/367142888 >> v1:172.21.15.107:6789/0 conn(0x7f430c06f260 legacy=0x7f430c06f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f43109fe640 1 -- 172.21.15.107:0/367142888 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c133f70 con 0x7f430c06fd50 2024-04-24T01:42:33.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f295ffff640 1 --2- 172.21.15.107:0/1495259043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f296012e4b0 0x7f29601308a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f294c0097f0 tx=0x7f294c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835b98afd79e4383 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.980+0000 7f1991d9b640 1 --2- 172.21.15.107:0/3589479538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1994070ae0 0x7f1994131860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1988009750 tx=0x7f198802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99b536fe29bde13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f295f7fe640 1 -- 172.21.15.107:0/1495259043 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f294c035020 con 0x7f296012e4b0 2024-04-24T01:42:33.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f199159a640 1 -- 172.21.15.107:0/3589479538 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19880316d0 con 0x7f1994070ae0 2024-04-24T01:42:33.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f199159a640 1 -- 172.21.15.107:0/3589479538 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1988037070 con 0x7f1994070ae0 2024-04-24T01:42:33.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f199159a640 1 -- 172.21.15.107:0/3589479538 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19880319c0 con 0x7f1994070ae0 2024-04-24T01:42:33.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f295f7fe640 1 -- 172.21.15.107:0/1495259043 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c0317a0 con 0x7f296012e4b0 2024-04-24T01:42:33.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f295f7fe640 1 -- 172.21.15.107:0/1495259043 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f294c031aa0 con 0x7f296012e4b0 2024-04-24T01:42:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f43109fe640 1 --2- 172.21.15.107:0/367142888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06fd50 0x7f430c133860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009720 tx=0x7f42fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e1827c24f6887b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f4303fff640 1 -- 172.21.15.107:0/367142888 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42fc0316d0 con 0x7f430c06fd50 2024-04-24T01:42:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f4303fff640 1 -- 172.21.15.107:0/367142888 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42fc037070 con 0x7f430c06fd50 2024-04-24T01:42:33.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f4303fff640 1 -- 172.21.15.107:0/367142888 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42fc0319c0 con 0x7f430c06fd50 2024-04-24T01:42:33.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f2966f60640 1 -- 172.21.15.107:0/1495259043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f296012e4b0 msgr2=0x7f29601308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f2966f60640 1 --2- 172.21.15.107:0/1495259043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f296012e4b0 0x7f29601308a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f294c0097f0 tx=0x7f294c02b910 comp rx=0 tx=0).stop 2024-04-24T01:42:33.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f1998a74640 1 -- 172.21.15.107:0/3589479538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1994070ae0 msgr2=0x7f1994131860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.981+0000 7f2966f60640 1 -- 172.21.15.107:0/1495259043 shutdown_connections 2024-04-24T01:42:33.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f2966f60640 1 --2- 172.21.15.107:0/1495259043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f296012e4b0 0x7f29601308a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f2966f60640 1 -- 172.21.15.107:0/1495259043 >> 172.21.15.107:0/1495259043 conn(0x7f2960099680 msgr2=0x7f2960099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f1998a74640 1 --2- 172.21.15.107:0/3589479538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1994070ae0 0x7f1994131860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1988009750 tx=0x7f198802b840 comp rx=0 tx=0).stop 2024-04-24T01:42:33.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f2966f60640 1 -- 172.21.15.107:0/1495259043 shutdown_connections 2024-04-24T01:42:33.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f2966f60640 1 -- 172.21.15.107:0/1495259043 wait complete. 2024-04-24T01:42:33.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f1998a74640 1 -- 172.21.15.107:0/3589479538 shutdown_connections 2024-04-24T01:42:33.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f1998a74640 1 --2- 172.21.15.107:0/3589479538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1994070ae0 0x7f1994131860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f1998a74640 1 -- 172.21.15.107:0/3589479538 >> 172.21.15.107:0/3589479538 conn(0x7f199409b840 msgr2=0x7f199409bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f1998a74640 1 -- 172.21.15.107:0/3589479538 shutdown_connections 2024-04-24T01:42:33.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f1998a74640 1 -- 172.21.15.107:0/3589479538 wait complete. 2024-04-24T01:42:33.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f4313463640 1 -- 172.21.15.107:0/367142888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06fd50 msgr2=0x7f430c133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:33.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f4313463640 1 --2- 172.21.15.107:0/367142888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06fd50 0x7f430c133860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009720 tx=0x7f42fc02b840 comp rx=0 tx=0).stop 2024-04-24T01:42:33.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f4313463640 1 -- 172.21.15.107:0/367142888 shutdown_connections 2024-04-24T01:42:33.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f4313463640 1 --2- 172.21.15.107:0/367142888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06fd50 0x7f430c133860 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:33.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f4313463640 1 -- 172.21.15.107:0/367142888 >> 172.21.15.107:0/367142888 conn(0x7f430c09e170 msgr2=0x7f430c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:33.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f4313463640 1 -- 172.21.15.107:0/367142888 shutdown_connections 2024-04-24T01:42:33.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.982+0000 7f4313463640 1 -- 172.21.15.107:0/367142888 wait complete. 2024-04-24T01:42:33.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f2966f60640 1 Processor -- start 2024-04-24T01:42:33.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f2966f60640 1 -- start start 2024-04-24T01:42:33.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f1998a74640 1 Processor -- start 2024-04-24T01:42:33.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f1998a74640 1 -- start start 2024-04-24T01:42:33.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f4313463640 1 Processor -- start 2024-04-24T01:42:33.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f4313463640 1 -- start start 2024-04-24T01:42:33.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f2966f60640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2960128030 0x7f29601bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f2966f60640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2960070130 con 0x7f2960128030 2024-04-24T01:42:33.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f2964cfc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2960128030 0x7f29601bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f2964cfc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2960128030 0x7f29601bfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39114/0 (socket says 172.21.15.107:39114) 2024-04-24T01:42:33.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.983+0000 7f2964cfc640 1 -- 172.21.15.107:0/2947587815 learned_addr learned my addr 172.21.15.107:0/2947587815 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f4313463640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06f260 0x7f430c131d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f4313463640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f430c1344d0 con 0x7f430c06f260 2024-04-24T01:42:33.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f1998a74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f199406fff0 0x7f199406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:33.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f43111ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06f260 0x7f430c131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f43111ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06f260 0x7f430c131d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39126/0 (socket says 172.21.15.107:39126) 2024-04-24T01:42:33.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f43111ff640 1 -- 172.21.15.107:0/2682875744 learned_addr learned my addr 172.21.15.107:0/2682875744 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f1998a74640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1994071a70 con 0x7f199406fff0 2024-04-24T01:42:33.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f199259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f199406fff0 0x7f199406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:33.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f2964cfc640 1 -- 172.21.15.107:0/2947587815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296008e800 con 0x7f2960128030 2024-04-24T01:42:33.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f199259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f199406fff0 0x7f199406dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39124/0 (socket says 172.21.15.107:39124) 2024-04-24T01:42:33.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f199259c640 1 -- 172.21.15.107:0/669496012 learned_addr learned my addr 172.21.15.107:0/669496012 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:33.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f43111ff640 1 -- 172.21.15.107:0/2682875744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c117550 con 0x7f430c06f260 2024-04-24T01:42:33.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f2964cfc640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2960128030 0x7f29601bfb50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29540011e0 tx=0x7f295400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f43111ff640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06f260 0x7f430c131d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f430800c380 tx=0x7f430800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:33.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f295d7fa640 1 -- 172.21.15.107:0/2947587815 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2954017070 con 0x7f2960128030 2024-04-24T01:42:33.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f199259c640 1 -- 172.21.15.107:0/669496012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19941acb40 con 0x7f199406fff0 2024-04-24T01:42:33.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29601264d0 con 0x7f2960128030 2024-04-24T01:42:33.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f295d7fa640 1 -- 172.21.15.107:0/2947587815 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29540063b0 con 0x7f2960128030 2024-04-24T01:42:33.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2960126990 con 0x7f2960128030 2024-04-24T01:42:34.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f4301ffb640 1 -- 172.21.15.107:0/2682875744 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308005c10 con 0x7f430c06f260 2024-04-24T01:42:34.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f4301ffb640 1 -- 172.21.15.107:0/2682875744 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308005db0 con 0x7f430c06f260 2024-04-24T01:42:34.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f4301ffb640 1 -- 172.21.15.107:0/2682875744 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308004930 con 0x7f430c06f260 2024-04-24T01:42:34.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.985+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c1181e0 con 0x7f430c06f260 2024-04-24T01:42:34.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.985+0000 7f199259c640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f199406fff0 0x7f199406dde0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f198400c4a0 tx=0x7f198400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:34.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.985+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c132250 con 0x7f430c06f260 2024-04-24T01:42:34.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.984+0000 7f295d7fa640 1 -- 172.21.15.107:0/2947587815 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29540047c0 con 0x7f2960128030 2024-04-24T01:42:34.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.985+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2960128620 con 0x7f2960128030 2024-04-24T01:42:34.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f1982ffd640 1 -- 172.21.15.107:0/669496012 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1984017070 con 0x7f199406fff0 2024-04-24T01:42:34.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199406f7d0 con 0x7f199406fff0 2024-04-24T01:42:34.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199406e320 con 0x7f199406fff0 2024-04-24T01:42:34.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f1982ffd640 1 -- 172.21.15.107:0/669496012 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1984005c10 con 0x7f199406fff0 2024-04-24T01:42:34.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f1982ffd640 1 -- 172.21.15.107:0/669496012 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1984021060 con 0x7f199406fff0 2024-04-24T01:42:34.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f4301ffb640 1 -- 172.21.15.107:0/2682875744 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f430801a020 con 0x7f430c06f260 2024-04-24T01:42:34.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f295d7fa640 1 -- 172.21.15.107:0/2947587815 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f295401a070 con 0x7f2960128030 2024-04-24T01:42:34.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f4301ffb640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f42f0038060 0x7f42f003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:34.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f4301ffb640 1 -- 172.21.15.107:0/2682875744 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f430804a7e0 con 0x7f430c06f260 2024-04-24T01:42:34.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430c0a18a0 con 0x7f430c06f260 2024-04-24T01:42:34.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f295d7fa640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2944038060 0x7f294403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:34.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f43109fe640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f42f0038060 0x7f42f003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:34.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f1982ffd640 1 -- 172.21.15.107:0/669496012 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f198401a070 con 0x7f199406fff0 2024-04-24T01:42:34.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f1982ffd640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1974038010 0x7f197403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:34.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.986+0000 7f295ffff640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2944038060 0x7f294403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:34.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f295d7fa640 1 -- 172.21.15.107:0/2947587815 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f29540119c0 con 0x7f2960128030 2024-04-24T01:42:34.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f43109fe640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f42f0038060 0x7f42f003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009720 tx=0x7f42fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:34.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f1982ffd640 1 -- 172.21.15.107:0/669496012 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f198404a270 con 0x7f199406fff0 2024-04-24T01:42:34.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f295ffff640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2944038060 0x7f294403a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f294c036000 tx=0x7f294c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:34.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f1991d9b640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1974038010 0x7f197403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:34.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.987+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1978005080 con 0x7f199406fff0 2024-04-24T01:42:34.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.988+0000 7f1991d9b640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1974038010 0x7f197403a4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1988036000 tx=0x7f1988008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:34.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.991+0000 7f295d7fa640 1 -- 172.21.15.107:0/2947587815 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f2960128620 con 0x7f2960128030 2024-04-24T01:42:34.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:33.996+0000 7f4301ffb640 1 -- 172.21.15.107:0/2682875744 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f430c0a18a0 con 0x7f430c06f260 2024-04-24T01:42:34.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.000+0000 7f1982ffd640 1 -- 172.21.15.107:0/669496012 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f19840117a0 con 0x7f199406fff0 2024-04-24T01:42:34.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.133+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc838121e10 con 0x7fc83806e850 2024-04-24T01:42:34.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.133+0000 7fc81ffff640 1 -- 172.21.15.107:0/1593016314 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc828052020 con 0x7fc83806e850 2024-04-24T01:42:34.134 INFO:teuthology.orchestra.run.smithi107.stdout:47244640260 2024-04-24T01:42:34.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc824038060 msgr2=0x7fc82403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc824038060 0x7fc82403a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000c00 tx=0x7fc82c001250 comp rx=0 tx=0).stop 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 msgr2=0x7fc8381c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc8381c37b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc828034040 tx=0x7fc8280046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 shutdown_connections 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc824038060 0x7fc82403a520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 --2- 172.21.15.107:0/1593016314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc83806e850 0x7fc8381c37b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 >> 172.21.15.107:0/1593016314 conn(0x7fc83809d750 msgr2=0x7fc83812ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 shutdown_connections 2024-04-24T01:42:34.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.136+0000 7fc83dd4b640 1 -- 172.21.15.107:0/1593016314 wait complete. 2024-04-24T01:42:34.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2024-04-24T01:42:34.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.177+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2960062da0 con 0x7f2960128030 2024-04-24T01:42:34.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.177+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f430c062da0 con 0x7f430c06f260 2024-04-24T01:42:34.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.177+0000 7f295d7fa640 1 -- 172.21.15.107:0/2947587815 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2954052070 con 0x7f2960128030 2024-04-24T01:42:34.178 INFO:teuthology.orchestra.run.smithi107.stdout:47244640260 2024-04-24T01:42:34.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.177+0000 7f4301ffb640 1 -- 172.21.15.107:0/2682875744 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43080127f0 con 0x7f430c06f260 2024-04-24T01:42:34.179 INFO:teuthology.orchestra.run.smithi107.stdout:47244640261 2024-04-24T01:42:34.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2944038060 msgr2=0x7f294403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2944038060 0x7f294403a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f294c036000 tx=0x7f294c008030 comp rx=0 tx=0).stop 2024-04-24T01:42:34.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2960128030 msgr2=0x7f29601bfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2960128030 0x7f29601bfb50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29540011e0 tx=0x7f295400c930 comp rx=0 tx=0).stop 2024-04-24T01:42:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 shutdown_connections 2024-04-24T01:42:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2944038060 0x7f294403a520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 --2- 172.21.15.107:0/2947587815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2960128030 0x7f29601bfb50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 >> 172.21.15.107:0/2947587815 conn(0x7f2960099680 msgr2=0x7f296012c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 shutdown_connections 2024-04-24T01:42:34.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.179+0000 7f2966f60640 1 -- 172.21.15.107:0/2947587815 wait complete. 2024-04-24T01:42:34.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f42f0038060 msgr2=0x7f42f003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f42f0038060 0x7f42f003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009720 tx=0x7f42fc008030 comp rx=0 tx=0).stop 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06f260 msgr2=0x7f430c131d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06f260 0x7f430c131d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f430800c380 tx=0x7f430800c840 comp rx=0 tx=0).stop 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 shutdown_connections 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f42f0038060 0x7f42f003a520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 --2- 172.21.15.107:0/2682875744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f430c06f260 0x7f430c131d10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 >> 172.21.15.107:0/2682875744 conn(0x7f430c09e170 msgr2=0x7f430c129270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 shutdown_connections 2024-04-24T01:42:34.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.180+0000 7f4313463640 1 -- 172.21.15.107:0/2682875744 wait complete. 2024-04-24T01:42:34.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-04-24T01:42:34.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-04-24T01:42:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.192+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1978005370 con 0x7f199406fff0 2024-04-24T01:42:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.192+0000 7f1982ffd640 1 -- 172.21.15.107:0/669496012 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f198401c440 con 0x7f199406fff0 2024-04-24T01:42:34.193 INFO:teuthology.orchestra.run.smithi107.stdout:38654705668 2024-04-24T01:42:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1974038010 msgr2=0x7f197403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1974038010 0x7f197403a4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1988036000 tx=0x7f1988008030 comp rx=0 tx=0).stop 2024-04-24T01:42:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f199406fff0 msgr2=0x7f199406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f199406fff0 0x7f199406dde0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f198400c4a0 tx=0x7f198400c960 comp rx=0 tx=0).stop 2024-04-24T01:42:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 shutdown_connections 2024-04-24T01:42:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1974038010 0x7f197403a4d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 --2- 172.21.15.107:0/669496012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f199406fff0 0x7f199406dde0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:34.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 >> 172.21.15.107:0/669496012 conn(0x7f199409b840 msgr2=0x7f19941b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:34.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 shutdown_connections 2024-04-24T01:42:34.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:34.194+0000 7f1998a74640 1 -- 172.21.15.107:0/669496012 wait complete. 2024-04-24T01:42:34.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-04-24T01:42:35.151 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T01:42:35.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T01:42:35.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T01:42:35.206 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T01:42:35.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.257+0000 7f163fbce640 1 Processor -- start 2024-04-24T01:42:35.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.257+0000 7f163fbce640 1 -- start start 2024-04-24T01:42:35.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.257+0000 7f163fbce640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f163806fd50 0x7f1638133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.257+0000 7f163fbce640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1638133da0 con 0x7f163806f260 2024-04-24T01:42:35.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.257+0000 7f163fbce640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1638070bc0 con 0x7f163806fd50 2024-04-24T01:42:35.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.258+0000 7f163d169640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f163806fd50 0x7f1638133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.258+0000 7f163d96a640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f163806f260 0x7f163806f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54864/0 (socket says 172.21.15.107:54864) 2024-04-24T01:42:35.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.258+0000 7f163d96a640 1 -- 172.21.15.107:0/1889972843 learned_addr learned my addr 172.21.15.107:0/1889972843 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:35.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.258+0000 7f163d169640 1 -- 172.21.15.107:0/1889972843 >> v1:172.21.15.107:6789/0 conn(0x7f163806f260 legacy=0x7f163806f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.258+0000 7f163d169640 1 -- 172.21.15.107:0/1889972843 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1638134f80 con 0x7f163806fd50 2024-04-24T01:42:35.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.259+0000 7f163d169640 1 --2- 172.21.15.107:0/1889972843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806fd50 0x7f1638133860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1628009720 tx=0x7f162802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc3d415bc22ee7e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.259+0000 7f163c968640 1 -- 172.21.15.107:0/1889972843 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16280316d0 con 0x7f163806fd50 2024-04-24T01:42:35.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.259+0000 7f163c968640 1 -- 172.21.15.107:0/1889972843 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1628037070 con 0x7f163806fd50 2024-04-24T01:42:35.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.259+0000 7f163c968640 1 -- 172.21.15.107:0/1889972843 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16280319c0 con 0x7f163806fd50 2024-04-24T01:42:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.260+0000 7f163fbce640 1 -- 172.21.15.107:0/1889972843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806fd50 msgr2=0x7f1638133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.260+0000 7f163fbce640 1 --2- 172.21.15.107:0/1889972843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806fd50 0x7f1638133860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1628009720 tx=0x7f162802b840 comp rx=0 tx=0).stop 2024-04-24T01:42:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.260+0000 7f163fbce640 1 -- 172.21.15.107:0/1889972843 shutdown_connections 2024-04-24T01:42:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.260+0000 7f163fbce640 1 --2- 172.21.15.107:0/1889972843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806fd50 0x7f1638133860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.260+0000 7f163fbce640 1 -- 172.21.15.107:0/1889972843 >> 172.21.15.107:0/1889972843 conn(0x7f163809e170 msgr2=0x7f163806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.260+0000 7f163fbce640 1 -- 172.21.15.107:0/1889972843 shutdown_connections 2024-04-24T01:42:35.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.260+0000 7f163fbce640 1 -- 172.21.15.107:0/1889972843 wait complete. 2024-04-24T01:42:35.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.261+0000 7f163fbce640 1 Processor -- start 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.261+0000 7f163fbce640 1 -- start start 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.261+0000 7f163fbce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806f260 0x7f1638119c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.261+0000 7f163fbce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1638134300 con 0x7f163806f260 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.261+0000 7f163d96a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806f260 0x7f1638119c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.261+0000 7f163d96a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806f260 0x7f1638119c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39146/0 (socket says 172.21.15.107:39146) 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.261+0000 7f163d96a640 1 -- 172.21.15.107:0/1472402182 learned_addr learned my addr 172.21.15.107:0/1472402182 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.262+0000 7f163d96a640 1 -- 172.21.15.107:0/1472402182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163811cb60 con 0x7f163806f260 2024-04-24T01:42:35.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.262+0000 7f163d96a640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806f260 0x7f1638119c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f163400c4a0 tx=0x7f163400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.262+0000 7f162e7fc640 1 -- 172.21.15.107:0/1472402182 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1634017070 con 0x7f163806f260 2024-04-24T01:42:35.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.262+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163811c3c0 con 0x7f163806f260 2024-04-24T01:42:35.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.262+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163811a160 con 0x7f163806f260 2024-04-24T01:42:35.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.262+0000 7f162e7fc640 1 -- 172.21.15.107:0/1472402182 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1634005c10 con 0x7f163806f260 2024-04-24T01:42:35.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.262+0000 7f162e7fc640 1 -- 172.21.15.107:0/1472402182 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1634007070 con 0x7f163806f260 2024-04-24T01:42:35.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.263+0000 7f162e7fc640 1 -- 172.21.15.107:0/1472402182 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f163401a070 con 0x7f163806f260 2024-04-24T01:42:35.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.263+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16380a18a0 con 0x7f163806f260 2024-04-24T01:42:35.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.263+0000 7f162e7fc640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c038010 0x7f161c03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.264+0000 7f162e7fc640 1 -- 172.21.15.107:0/1472402182 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f163404a1c0 con 0x7f163806f260 2024-04-24T01:42:35.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.264+0000 7f163d169640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c038010 0x7f161c03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.264+0000 7f163d169640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c038010 0x7f161c03a4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1628009720 tx=0x7f1628008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.272+0000 7f162e7fc640 1 -- 172.21.15.107:0/1472402182 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f16380a18a0 con 0x7f163806f260 2024-04-24T01:42:35.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.298+0000 7f6335245640 1 Processor -- start 2024-04-24T01:42:35.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.298+0000 7f6335245640 1 -- start start 2024-04-24T01:42:35.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.298+0000 7f6335245640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f633006f260 0x7f633006f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.298+0000 7f6335245640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633006fff0 con 0x7f633006fb80 2024-04-24T01:42:35.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.298+0000 7f6335245640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6330070bc0 con 0x7f633006f260 2024-04-24T01:42:35.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.299+0000 7f632ed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f633006f260 0x7f633006f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.299+0000 7f632ed9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f633006f260 0x7f633006f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39156/0 (socket says 172.21.15.107:39156) 2024-04-24T01:42:35.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.299+0000 7f632ed9d640 1 -- 172.21.15.107:0/876946676 learned_addr learned my addr 172.21.15.107:0/876946676 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:35.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.299+0000 7f632dd9b640 1 -- 172.21.15.107:0/876946676 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521359609 0 0) 0x7f633006fff0 con 0x7f633006fb80 2024-04-24T01:42:35.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.299+0000 7f632dd9b640 1 -- 172.21.15.107:0/876946676 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6318003520 con 0x7f633006fb80 2024-04-24T01:42:35.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.299+0000 7f632ed9d640 1 -- 172.21.15.107:0/876946676 >> v1:172.21.15.107:6789/0 conn(0x7f633006fb80 legacy=0x7f633012e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.299+0000 7f632ed9d640 1 -- 172.21.15.107:0/876946676 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633012ec50 con 0x7f633006f260 2024-04-24T01:42:35.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.300+0000 7f632ed9d640 1 --2- 172.21.15.107:0/876946676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f633006f640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63200097f0 tx=0x7f632002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57673919164aa7a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.300+0000 7f632dd9b640 1 -- 172.21.15.107:0/876946676 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6320035020 con 0x7f633006f260 2024-04-24T01:42:35.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.300+0000 7f632dd9b640 1 -- 172.21.15.107:0/876946676 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63200317a0 con 0x7f633006f260 2024-04-24T01:42:35.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.300+0000 7f632dd9b640 1 -- 172.21.15.107:0/876946676 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6320031aa0 con 0x7f633006f260 2024-04-24T01:42:35.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f6335245640 1 -- 172.21.15.107:0/876946676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 msgr2=0x7f633006f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f6335245640 1 --2- 172.21.15.107:0/876946676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f633006f640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63200097f0 tx=0x7f632002b910 comp rx=0 tx=0).stop 2024-04-24T01:42:35.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f6335245640 1 -- 172.21.15.107:0/876946676 shutdown_connections 2024-04-24T01:42:35.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f6335245640 1 --2- 172.21.15.107:0/876946676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f633006f640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f6335245640 1 -- 172.21.15.107:0/876946676 >> 172.21.15.107:0/876946676 conn(0x7f633009e170 msgr2=0x7f633006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f5eaa26a640 1 Processor -- start 2024-04-24T01:42:35.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f5eaa26a640 1 -- start start 2024-04-24T01:42:35.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f6335245640 1 -- 172.21.15.107:0/876946676 shutdown_connections 2024-04-24T01:42:35.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.301+0000 7f6335245640 1 -- 172.21.15.107:0/876946676 wait complete. 2024-04-24T01:42:35.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.302+0000 7f5eaa26a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5ea412e810 0x7f5ea412ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.302+0000 7f5eaa26a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea406f970 con 0x7f5ea412f130 2024-04-24T01:42:35.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.302+0000 7f5eaa26a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea4070bc0 con 0x7f5ea412e810 2024-04-24T01:42:35.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.302+0000 7f5ea3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5ea412e810 0x7f5ea412ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.302+0000 7f5ea37fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5ea412f130 0x7f5ea406f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54890/0 (socket says 172.21.15.107:54890) 2024-04-24T01:42:35.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.302+0000 7f5ea37fe640 1 -- 172.21.15.107:0/1154946794 learned_addr learned my addr 172.21.15.107:0/1154946794 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:35.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f5ea3fff640 1 -- 172.21.15.107:0/1154946794 >> v1:172.21.15.107:6789/0 conn(0x7f5ea412f130 legacy=0x7f5ea406f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f5ea2ffd640 1 -- 172.21.15.107:0/1154946794 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279377723 0 0) 0x7f5ea406f970 con 0x7f5ea412f130 2024-04-24T01:42:35.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f5ea3fff640 1 -- 172.21.15.107:0/1154946794 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea406fb40 con 0x7f5ea412e810 2024-04-24T01:42:35.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f6335245640 1 Processor -- start 2024-04-24T01:42:35.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f6335245640 1 -- start start 2024-04-24T01:42:35.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f6335245640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f6330118520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f6335245640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f633012f400 con 0x7f633006f260 2024-04-24T01:42:35.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f5ea3fff640 1 --2- 172.21.15.107:0/1154946794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea412ebf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009720 tx=0x7f5e9402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34301323afe473b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f632ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f6330118520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f632ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f6330118520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39172/0 (socket says 172.21.15.107:39172) 2024-04-24T01:42:35.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.303+0000 7f632ed9d640 1 -- 172.21.15.107:0/4008053850 learned_addr learned my addr 172.21.15.107:0/4008053850 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:35.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f5ea2ffd640 1 -- 172.21.15.107:0/1154946794 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e940316f0 con 0x7f5ea412e810 2024-04-24T01:42:35.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f5ea2ffd640 1 -- 172.21.15.107:0/1154946794 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e94037070 con 0x7f5ea412e810 2024-04-24T01:42:35.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f5ea2ffd640 1 -- 172.21.15.107:0/1154946794 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e940319e0 con 0x7f5ea412e810 2024-04-24T01:42:35.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f632ed9d640 1 -- 172.21.15.107:0/4008053850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633011a280 con 0x7f633006f260 2024-04-24T01:42:35.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f632ed9d640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f6330118520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63200090b0 tx=0x7f63200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f63177fe640 1 -- 172.21.15.107:0/4008053850 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6320040070 con 0x7f633006f260 2024-04-24T01:42:35.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f63177fe640 1 -- 172.21.15.107:0/4008053850 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6320030a50 con 0x7f633006f260 2024-04-24T01:42:35.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6330072cd0 con 0x7f633006f260 2024-04-24T01:42:35.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f63177fe640 1 -- 172.21.15.107:0/4008053850 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6320035040 con 0x7f633006f260 2024-04-24T01:42:35.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.304+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6330118a60 con 0x7f633006f260 2024-04-24T01:42:35.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1154946794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 msgr2=0x7f5ea412ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f5eaa26a640 1 --2- 172.21.15.107:0/1154946794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea412ebf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009720 tx=0x7f5e9402b860 comp rx=0 tx=0).stop 2024-04-24T01:42:35.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1154946794 shutdown_connections 2024-04-24T01:42:35.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f5eaa26a640 1 --2- 172.21.15.107:0/1154946794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea412ebf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1154946794 >> 172.21.15.107:0/1154946794 conn(0x7f5ea409e170 msgr2=0x7f5ea406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1154946794 shutdown_connections 2024-04-24T01:42:35.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1154946794 wait complete. 2024-04-24T01:42:35.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6310005080 con 0x7f633006f260 2024-04-24T01:42:35.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.305+0000 7f63177fe640 1 -- 172.21.15.107:0/4008053850 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f632004b060 con 0x7f633006f260 2024-04-24T01:42:35.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.306+0000 7f63177fe640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f631c038060 0x7f631c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.306+0000 7f63177fe640 1 -- 172.21.15.107:0/4008053850 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f632004be10 con 0x7f633006f260 2024-04-24T01:42:35.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.306+0000 7f632e59c640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f631c038060 0x7f631c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.306+0000 7f5eaa26a640 1 Processor -- start 2024-04-24T01:42:35.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.306+0000 7f632e59c640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f631c038060 0x7f631c03a520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6324007fd0 tx=0x7f6324007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.307+0000 7f5eaa26a640 1 -- start start 2024-04-24T01:42:35.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.307+0000 7f5eaa26a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea411aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.307+0000 7f5eaa26a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40702f0 con 0x7f5ea412e810 2024-04-24T01:42:35.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.307+0000 7f5ea3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea411aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.307+0000 7f5ea3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea411aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39176/0 (socket says 172.21.15.107:39176) 2024-04-24T01:42:35.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.307+0000 7f5ea3fff640 1 -- 172.21.15.107:0/1809120650 learned_addr learned my addr 172.21.15.107:0/1809120650 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:35.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.307+0000 7f5ea3fff640 1 -- 172.21.15.107:0/1809120650 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea411cf10 con 0x7f5ea412e810 2024-04-24T01:42:35.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.308+0000 7f5ea3fff640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea411aef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009840 tx=0x7f5e940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.315+0000 7f5ea0ff9640 1 -- 172.21.15.107:0/1809120650 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e94004020 con 0x7f5ea412e810 2024-04-24T01:42:35.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.315+0000 7f5ea0ff9640 1 -- 172.21.15.107:0/1809120650 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e940041c0 con 0x7f5ea412e810 2024-04-24T01:42:35.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.315+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea412e000 con 0x7f5ea412e810 2024-04-24T01:42:35.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.315+0000 7f5ea0ff9640 1 -- 172.21.15.107:0/1809120650 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e94003610 con 0x7f5ea412e810 2024-04-24T01:42:35.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.315+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea411e310 con 0x7f5ea412e810 2024-04-24T01:42:35.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.315+0000 7f63177fe640 1 -- 172.21.15.107:0/4008053850 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f6320030d30 con 0x7f633006f260 2024-04-24T01:42:35.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.316+0000 7f5ea0ff9640 1 -- 172.21.15.107:0/1809120650 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e940037b0 con 0x7f5ea412e810 2024-04-24T01:42:35.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.316+0000 7f5ea0ff9640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5e90038060 0x7f5e9003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.316+0000 7f5ea0ff9640 1 -- 172.21.15.107:0/1809120650 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f5e9406d250 con 0x7f5ea412e810 2024-04-24T01:42:35.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.316+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea40a18a0 con 0x7f5ea412e810 2024-04-24T01:42:35.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.316+0000 7f5ea37fe640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5e90038060 0x7f5e9003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.317+0000 7f5ea37fe640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5e90038060 0x7f5e9003a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e98000c00 tx=0x7f5e98007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.325+0000 7f5ea0ff9640 1 -- 172.21.15.107:0/1809120650 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f5ea40a18a0 con 0x7f5ea412e810 2024-04-24T01:42:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cceec1640 1 Processor -- start 2024-04-24T01:42:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cceec1640 1 -- start start 2024-04-24T01:42:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cceec1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9cc806e2c0 0x7f9cc8133640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cceec1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc80a08a0 con 0x7f9cc806d7d0 2024-04-24T01:42:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cceec1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc806f6d0 con 0x7f9cc806e2c0 2024-04-24T01:42:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cccc5d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9cc806d7d0 0x7f9cc806dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54898/0 (socket says 172.21.15.107:54898) 2024-04-24T01:42:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cc7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9cc806e2c0 0x7f9cc8133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.357+0000 7f9cccc5d640 1 -- 172.21.15.107:0/1857137186 learned_addr learned my addr 172.21.15.107:0/1857137186 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.358+0000 7f9cc7fff640 1 -- 172.21.15.107:0/1857137186 >> v1:172.21.15.107:6789/0 conn(0x7f9cc806d7d0 legacy=0x7f9cc806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.358+0000 7f9cc7fff640 1 -- 172.21.15.107:0/1857137186 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc806faa0 con 0x7f9cc806e2c0 2024-04-24T01:42:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.358+0000 7f9cc7fff640 1 --2- 172.21.15.107:0/1857137186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806e2c0 0x7f9cc8133640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009750 tx=0x7f9cb402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facf6ee7a5ba9a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cc77fe640 1 -- 172.21.15.107:0/1857137186 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb4035020 con 0x7f9cc806e2c0 2024-04-24T01:42:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cc77fe640 1 -- 172.21.15.107:0/1857137186 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb4031760 con 0x7f9cc806e2c0 2024-04-24T01:42:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cc77fe640 1 -- 172.21.15.107:0/1857137186 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb4031a60 con 0x7f9cc806e2c0 2024-04-24T01:42:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cceec1640 1 -- 172.21.15.107:0/1857137186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806e2c0 msgr2=0x7f9cc8133640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cceec1640 1 --2- 172.21.15.107:0/1857137186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806e2c0 0x7f9cc8133640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009750 tx=0x7f9cb402b8d0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cceec1640 1 -- 172.21.15.107:0/1857137186 shutdown_connections 2024-04-24T01:42:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cceec1640 1 --2- 172.21.15.107:0/1857137186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806e2c0 0x7f9cc8133640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cceec1640 1 -- 172.21.15.107:0/1857137186 >> 172.21.15.107:0/1857137186 conn(0x7f9cc809ea70 msgr2=0x7f9cc809ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cceec1640 1 -- 172.21.15.107:0/1857137186 shutdown_connections 2024-04-24T01:42:35.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.359+0000 7f9cceec1640 1 -- 172.21.15.107:0/1857137186 wait complete. 2024-04-24T01:42:35.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.360+0000 7f9cceec1640 1 Processor -- start 2024-04-24T01:42:35.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.360+0000 7f9cceec1640 1 -- start start 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cceec1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806d7d0 0x7f9cc809a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cceec1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc8133f10 con 0x7f9cc806d7d0 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cccc5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806d7d0 0x7f9cc809a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cccc5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806d7d0 0x7f9cc809a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39194/0 (socket says 172.21.15.107:39194) 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cccc5d640 1 -- 172.21.15.107:0/3122070831 learned_addr learned my addr 172.21.15.107:0/3122070831 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cccc5d640 1 -- 172.21.15.107:0/3122070831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc8129840 con 0x7f9cc806d7d0 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cccc5d640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806d7d0 0x7f9cc809a6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c4a0 tx=0x7f9cbc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cc57fa640 1 -- 172.21.15.107:0/3122070831 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cbc017070 con 0x7f9cc806d7d0 2024-04-24T01:42:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc8070890 con 0x7f9cc806d7d0 2024-04-24T01:42:35.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cc57fa640 1 -- 172.21.15.107:0/3122070831 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc005c10 con 0x7f9cc806d7d0 2024-04-24T01:42:35.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.361+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc812a4d0 con 0x7f9cc806d7d0 2024-04-24T01:42:35.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.362+0000 7f9cc57fa640 1 -- 172.21.15.107:0/3122070831 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cbc007070 con 0x7f9cc806d7d0 2024-04-24T01:42:35.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.362+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc8062da0 con 0x7f9cc806d7d0 2024-04-24T01:42:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.363+0000 7f9cc57fa640 1 -- 172.21.15.107:0/3122070831 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9cbc01a070 con 0x7f9cc806d7d0 2024-04-24T01:42:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.363+0000 7f9cc57fa640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9cac038010 0x7f9cac03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.364+0000 7f9cc57fa640 1 -- 172.21.15.107:0/3122070831 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f9cbc04aae0 con 0x7f9cc806d7d0 2024-04-24T01:42:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.364+0000 7f9cc7fff640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9cac038010 0x7f9cac03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.364+0000 7f9cc7fff640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9cac038010 0x7f9cac03a4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4036000 tx=0x7f9cb4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.372+0000 7f9cc57fa640 1 -- 172.21.15.107:0/3122070831 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9cbc048ac0 con 0x7f9cc806d7d0 2024-04-24T01:42:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.473+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1638062da0 con 0x7f163806f260 2024-04-24T01:42:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.473+0000 7f162e7fc640 1 -- 172.21.15.107:0/1472402182 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f163401b3b0 con 0x7f163806f260 2024-04-24T01:42:35.474 INFO:teuthology.orchestra.run.smithi107.stdout:47244640261 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c038010 msgr2=0x7f161c03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c038010 0x7f161c03a4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1628009720 tx=0x7f1628008030 comp rx=0 tx=0).stop 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806f260 msgr2=0x7f1638119c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806f260 0x7f1638119c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f163400c4a0 tx=0x7f163400c960 comp rx=0 tx=0).stop 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 shutdown_connections 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c038010 0x7f161c03a4d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 --2- 172.21.15.107:0/1472402182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f163806f260 0x7f1638119c20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 >> 172.21.15.107:0/1472402182 conn(0x7f163809e170 msgr2=0x7f163812edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 shutdown_connections 2024-04-24T01:42:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.476+0000 7f163fbce640 1 -- 172.21.15.107:0/1472402182 wait complete. 2024-04-24T01:42:35.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2024-04-24T01:42:35.488 DEBUG:teuthology.parallel:result is None 2024-04-24T01:42:35.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.514+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6310005640 con 0x7f633006f260 2024-04-24T01:42:35.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.514+0000 7f63177fe640 1 -- 172.21.15.107:0/4008053850 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6320030d30 con 0x7f633006f260 2024-04-24T01:42:35.515 INFO:teuthology.orchestra.run.smithi107.stdout:47244640262 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.516+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f631c038060 msgr2=0x7f631c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.516+0000 7f6335245640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f631c038060 0x7f631c03a520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6324007fd0 tx=0x7f6324007920 comp rx=0 tx=0).stop 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.516+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 msgr2=0x7f6330118520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.516+0000 7f6335245640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f6330118520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63200090b0 tx=0x7f63200046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.516+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 shutdown_connections 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.517+0000 7f6335245640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f631c038060 0x7f631c03a520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.517+0000 7f6335245640 1 --2- 172.21.15.107:0/4008053850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f633006f260 0x7f6330118520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.517+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 >> 172.21.15.107:0/4008053850 conn(0x7f633009e170 msgr2=0x7f633009e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.517+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 shutdown_connections 2024-04-24T01:42:35.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.517+0000 7f6335245640 1 -- 172.21.15.107:0/4008053850 wait complete. 2024-04-24T01:42:35.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.519+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5ea411d700 con 0x7f5ea412e810 2024-04-24T01:42:35.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.520+0000 7f5ea0ff9640 1 -- 172.21.15.107:0/1809120650 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e94053080 con 0x7f5ea412e810 2024-04-24T01:42:35.520 INFO:teuthology.orchestra.run.smithi107.stdout:47244640261 2024-04-24T01:42:35.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5e90038060 msgr2=0x7f5e9003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5e90038060 0x7f5e9003a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e98000c00 tx=0x7f5e98007970 comp rx=0 tx=0).stop 2024-04-24T01:42:35.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 msgr2=0x7f5ea411aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea411aef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009840 tx=0x7f5e940046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 shutdown_connections 2024-04-24T01:42:35.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5e90038060 0x7f5e9003a520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 --2- 172.21.15.107:0/1809120650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea412e810 0x7f5ea411aef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 >> 172.21.15.107:0/1809120650 conn(0x7f5ea409e170 msgr2=0x7f5ea409e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 shutdown_connections 2024-04-24T01:42:35.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.522+0000 7f5eaa26a640 1 -- 172.21.15.107:0/1809120650 wait complete. 2024-04-24T01:42:35.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.2 2024-04-24T01:42:35.528 DEBUG:teuthology.parallel:result is None 2024-04-24T01:42:35.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2024-04-24T01:42:35.533 DEBUG:teuthology.parallel:result is None 2024-04-24T01:42:35.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.557+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9cc812a010 con 0x7f9cc806d7d0 2024-04-24T01:42:35.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.558+0000 7f9cc57fa640 1 -- 172.21.15.107:0/3122070831 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9cbc048e40 con 0x7f9cc806d7d0 2024-04-24T01:42:35.558 INFO:teuthology.orchestra.run.smithi107.stdout:38654705669 2024-04-24T01:42:35.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9cac038010 msgr2=0x7f9cac03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9cac038010 0x7f9cac03a4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4036000 tx=0x7f9cb4008030 comp rx=0 tx=0).stop 2024-04-24T01:42:35.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806d7d0 msgr2=0x7f9cc809a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806d7d0 0x7f9cc809a6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c4a0 tx=0x7f9cbc00c960 comp rx=0 tx=0).stop 2024-04-24T01:42:35.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 shutdown_connections 2024-04-24T01:42:35.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9cac038010 0x7f9cac03a4d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 --2- 172.21.15.107:0/3122070831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cc806d7d0 0x7f9cc809a6d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 >> 172.21.15.107:0/3122070831 conn(0x7f9cc809ea70 msgr2=0x7f9cc812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 shutdown_connections 2024-04-24T01:42:35.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.560+0000 7f9cceec1640 1 -- 172.21.15.107:0/3122070831 wait complete. 2024-04-24T01:42:35.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-04-24T01:42:35.571 DEBUG:teuthology.parallel:result is None 2024-04-24T01:42:35.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T01:42:35.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:42:35.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.708+0000 7f56776ac640 1 Processor -- start 2024-04-24T01:42:35.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.708+0000 7f56776ac640 1 -- start start 2024-04-24T01:42:35.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.708+0000 7f56776ac640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5670096430 0x7f5670096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f56776ac640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5670098800 con 0x7f5670071090 2024-04-24T01:42:35.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f56776ac640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5670071930 con 0x7f5670096430 2024-04-24T01:42:35.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f5675448640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5670096430 0x7f5670096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f5674c47640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5670071090 0x7f567006d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54904/0 (socket says 172.21.15.107:54904) 2024-04-24T01:42:35.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f5674c47640 1 -- 172.21.15.107:0/3640945275 learned_addr learned my addr 172.21.15.107:0/3640945275 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:35.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f5675448640 1 -- 172.21.15.107:0/3640945275 >> v1:172.21.15.107:6789/0 conn(0x7f5670071090 legacy=0x7f567006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f5667fff640 1 -- 172.21.15.107:0/3640945275 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235879343 0 0) 0x7f5670098800 con 0x7f5670071090 2024-04-24T01:42:35.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.709+0000 7f5675448640 1 -- 172.21.15.107:0/3640945275 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5670071f50 con 0x7f5670096430 2024-04-24T01:42:35.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f5675448640 1 --2- 172.21.15.107:0/3640945275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670096430 0x7f5670096810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f566c009720 tx=0x7f566c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9d464b2a7171f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f5667fff640 1 -- 172.21.15.107:0/3640945275 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c0316d0 con 0x7f5670096430 2024-04-24T01:42:35.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f5667fff640 1 -- 172.21.15.107:0/3640945275 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c037070 con 0x7f5670096430 2024-04-24T01:42:35.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f5667fff640 1 -- 172.21.15.107:0/3640945275 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c0319c0 con 0x7f5670096430 2024-04-24T01:42:35.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f56776ac640 1 -- 172.21.15.107:0/3640945275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670096430 msgr2=0x7f5670096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f56776ac640 1 --2- 172.21.15.107:0/3640945275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670096430 0x7f5670096810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f566c009720 tx=0x7f566c02b840 comp rx=0 tx=0).stop 2024-04-24T01:42:35.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f56776ac640 1 -- 172.21.15.107:0/3640945275 shutdown_connections 2024-04-24T01:42:35.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f56776ac640 1 --2- 172.21.15.107:0/3640945275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670096430 0x7f5670096810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f56776ac640 1 -- 172.21.15.107:0/3640945275 >> 172.21.15.107:0/3640945275 conn(0x7f5670099680 msgr2=0x7f5670099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f56776ac640 1 -- 172.21.15.107:0/3640945275 shutdown_connections 2024-04-24T01:42:35.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.710+0000 7f56776ac640 1 -- 172.21.15.107:0/3640945275 wait complete. 2024-04-24T01:42:35.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.711+0000 7f56776ac640 1 Processor -- start 2024-04-24T01:42:35.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.711+0000 7f56776ac640 1 -- start start 2024-04-24T01:42:35.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f56776ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670071090 0x7f567006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f56776ac640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5670096d50 con 0x7f5670071090 2024-04-24T01:42:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5675448640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670071090 0x7f567006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5675448640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670071090 0x7f567006e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39208/0 (socket says 172.21.15.107:39208) 2024-04-24T01:42:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5675448640 1 -- 172.21.15.107:0/3411143713 learned_addr learned my addr 172.21.15.107:0/3411143713 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5675448640 1 -- 172.21.15.107:0/3411143713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5670126320 con 0x7f5670071090 2024-04-24T01:42:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5675448640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670071090 0x7f567006e530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f566c02b880 tx=0x7f566c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5665ffb640 1 -- 172.21.15.107:0/3411143713 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c004030 con 0x7f5670071090 2024-04-24T01:42:35.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5665ffb640 1 -- 172.21.15.107:0/3411143713 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c0041d0 con 0x7f5670071090 2024-04-24T01:42:35.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5670128f60 con 0x7f5670071090 2024-04-24T01:42:35.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f5665ffb640 1 -- 172.21.15.107:0/3411143713 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c032640 con 0x7f5670071090 2024-04-24T01:42:35.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.712+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567006ff80 con 0x7f5670071090 2024-04-24T01:42:35.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.713+0000 7f5665ffb640 1 -- 172.21.15.107:0/3411143713 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f566c0327e0 con 0x7f5670071090 2024-04-24T01:42:35.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.713+0000 7f5665ffb640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5654038060 0x7f565403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:35.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.713+0000 7f5665ffb640 1 -- 172.21.15.107:0/3411143713 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f566c02f050 con 0x7f5670071090 2024-04-24T01:42:35.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.713+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56700701b0 con 0x7f5670071090 2024-04-24T01:42:35.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.714+0000 7f5674c47640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5654038060 0x7f565403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:35.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.714+0000 7f5674c47640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5654038060 0x7f565403a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5660000c00 tx=0x7f5660007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:35.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.718+0000 7f5665ffb640 1 -- 172.21.15.107:0/3411143713 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f566c041070 con 0x7f5670071090 2024-04-24T01:42:35.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.890+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56700703c0 con 0x7f5654038060 2024-04-24T01:42:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.892+0000 7f5665ffb640 1 -- 172.21.15.107:0/3411143713 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31865 (secure 0 0 0) 0x7f56600070d0 con 0x7f5654038060 2024-04-24T01:42:35.892 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:42:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:42:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.893+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5654038060 msgr2=0x7f565403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.893+0000 7f56776ac640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5654038060 0x7f565403a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5660000c00 tx=0x7f5660007910 comp rx=0 tx=0).stop 2024-04-24T01:42:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.893+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670071090 msgr2=0x7f567006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.893+0000 7f56776ac640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670071090 0x7f567006e530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f566c02b880 tx=0x7f566c0046c0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.893+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 shutdown_connections 2024-04-24T01:42:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.893+0000 7f56776ac640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5654038060 0x7f565403a520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.894+0000 7f56776ac640 1 --2- 172.21.15.107:0/3411143713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5670071090 0x7f567006e530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.894+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 >> 172.21.15.107:0/3411143713 conn(0x7f5670099680 msgr2=0x7f5670128680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.894+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 shutdown_connections 2024-04-24T01:42:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:35.894+0000 7f56776ac640 1 -- 172.21.15.107:0/3411143713 wait complete. 2024-04-24T01:42:35.904 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-24T01:42:34.007590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110348,"kb_used_data":1696,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377012,"statfs":{"total":386547056640,"available":386434060288,"internally_reserved":0,"allocated":1736704,"data_stored":1343012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.280802"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.181121+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:42:33.181121+0000","last_peered":"2024-04-24T01:42:33.181121+0000","last_clean":"2024-04-24T01:42:33.181121+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:42:33.181121+0000","last_undegraded":"2024-04-24T01:42:33.181121+0000","last_fullsized":"2024-04-24T01:42:33.181121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:05.255625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.778671+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:42:33.778671+0000","last_peered":"2024-04-24T01:42:33.778671+0000","last_clean":"2024-04-24T01:42:33.778671+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:42:33.778671+0000","last_undegraded":"2024-04-24T01:42:33.778671+0000","last_fullsized":"2024-04-24T01:42:33.778671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:49.159738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743312+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:42:32.743312+0000","last_peered":"2024-04-24T01:42:32.743312+0000","last_clean":"2024-04-24T01:42:32.743312+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:42:32.743312+0000","last_undegraded":"2024-04-24T01:42:32.743312+0000","last_fullsized":"2024-04-24T01:42:32.743312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.270545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.778608+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:42:33.778608+0000","last_peered":"2024-04-24T01:42:33.778608+0000","last_clean":"2024-04-24T01:42:33.778608+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:42:33.778608+0000","last_undegraded":"2024-04-24T01:42:33.778608+0000","last_fullsized":"2024-04-24T01:42:33.778608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:38.785738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743337+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:42:32.743337+0000","last_peered":"2024-04-24T01:42:32.743337+0000","last_clean":"2024-04-24T01:42:32.743337+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:42:32.743337+0000","last_undegraded":"2024-04-24T01:42:32.743337+0000","last_fullsized":"2024-04-24T01:42:32.743337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:39.012880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743209+0000","last_change":"2024-04-24T01:42:32.739720+0000","last_active":"2024-04-24T01:42:32.743209+0000","last_peered":"2024-04-24T01:42:32.743209+0000","last_clean":"2024-04-24T01:42:32.743209+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:42:32.743209+0000","last_undegraded":"2024-04-24T01:42:32.743209+0000","last_fullsized":"2024-04-24T01:42:32.743209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:20.872819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743320+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:42:32.743320+0000","last_peered":"2024-04-24T01:42:32.743320+0000","last_clean":"2024-04-24T01:42:32.743320+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:42:32.743320+0000","last_undegraded":"2024-04-24T01:42:32.743320+0000","last_fullsized":"2024-04-24T01:42:32.743320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:15:54.667128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.738213+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:42:32.738213+0000","last_peered":"2024-04-24T01:42:32.738213+0000","last_clean":"2024-04-24T01:42:32.738213+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:42:32.738213+0000","last_undegraded":"2024-04-24T01:42:32.738213+0000","last_fullsized":"2024-04-24T01:42:32.738213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:59.995919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.733989+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:42:33.733989+0000","last_peered":"2024-04-24T01:42:33.733989+0000","last_clean":"2024-04-24T01:42:33.733989+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:42:33.733989+0000","last_undegraded":"2024-04-24T01:42:33.733989+0000","last_fullsized":"2024-04-24T01:42:33.733989+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:54.970096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":724992,"data_stored":627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:42:35.905 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:42:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33b481a640 1 Processor -- start 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33b481a640 1 -- start start 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33b481a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f33b01287d0 0x7f33b0130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33b481a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b0127b00 con 0x7f33b0127ce0 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33b481a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f33b00708e0 con 0x7f33b01287d0 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33ae59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f33b0127ce0 0x7f33b01280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54918/0 (socket says 172.21.15.107:54918) 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33ae59c640 1 -- 172.21.15.107:0/3746077011 learned_addr learned my addr 172.21.15.107:0/3746077011 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33add9b640 1 --2- 172.21.15.107:0/3746077011 >> v2:172.21.15.107:3300/0 conn(0x7f33b01287d0 0x7f33b0130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33ad59a640 1 -- 172.21.15.107:0/3746077011 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827510837 0 0) 0x7f33a8001110 con 0x7f33b0127ce0 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.000+0000 7f33ad59a640 1 -- 172.21.15.107:0/3746077011 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3398003520 con 0x7f33b0127ce0 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.001+0000 7f33add9b640 1 -- 172.21.15.107:0/3746077011 >> v1:172.21.15.107:6789/0 conn(0x7f33b0127ce0 legacy=0x7f33b01280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.001+0000 7f33add9b640 1 -- 172.21.15.107:0/3746077011 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b0098800 con 0x7f33b01287d0 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.001+0000 7f33add9b640 1 --2- 172.21.15.107:0/3746077011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b01287d0 0x7f33b0130360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009750 tx=0x7f33a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f3144c47aa7dec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.001+0000 7f33ad59a640 1 -- 172.21.15.107:0/3746077011 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a40316d0 con 0x7f33b01287d0 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.001+0000 7f33ad59a640 1 -- 172.21.15.107:0/3746077011 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a4037070 con 0x7f33b01287d0 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.001+0000 7f33ad59a640 1 -- 172.21.15.107:0/3746077011 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a40319a0 con 0x7f33b01287d0 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.002+0000 7f33b481a640 1 -- 172.21.15.107:0/3746077011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b01287d0 msgr2=0x7f33b0130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.002+0000 7f33b481a640 1 --2- 172.21.15.107:0/3746077011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b01287d0 0x7f33b0130360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009750 tx=0x7f33a402b840 comp rx=0 tx=0).stop 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.002+0000 7f33b481a640 1 -- 172.21.15.107:0/3746077011 shutdown_connections 2024-04-24T01:42:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.002+0000 7f33b481a640 1 --2- 172.21.15.107:0/3746077011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b01287d0 0x7f33b0130360 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.002+0000 7f33b481a640 1 -- 172.21.15.107:0/3746077011 >> 172.21.15.107:0/3746077011 conn(0x7f33b0099680 msgr2=0x7f33b0099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.002+0000 7f33b481a640 1 -- 172.21.15.107:0/3746077011 shutdown_connections 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.002+0000 7f33b481a640 1 -- 172.21.15.107:0/3746077011 wait complete. 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.003+0000 7f33b481a640 1 Processor -- start 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.003+0000 7f33b481a640 1 -- start start 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.003+0000 7f33b481a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b0127ce0 0x7f33b0122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.003+0000 7f33b481a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f33b006faa0 con 0x7f33b0127ce0 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.003+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b0127ce0 0x7f33b0122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.003+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b0127ce0 0x7f33b0122ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39220/0 (socket says 172.21.15.107:39220) 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.003+0000 7f33ae59c640 1 -- 172.21.15.107:0/2760778179 learned_addr learned my addr 172.21.15.107:0/2760778179 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.004+0000 7f33ae59c640 1 -- 172.21.15.107:0/2760778179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b01301c0 con 0x7f33b0127ce0 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.004+0000 7f33ae59c640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b0127ce0 0x7f33b0122ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c6b0 tx=0x7f33a800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.004+0000 7f339effd640 1 -- 172.21.15.107:0/2760778179 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a8017070 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.004+0000 7f339effd640 1 -- 172.21.15.107:0/2760778179 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a8007e40 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.004+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b01258a0 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.004+0000 7f339effd640 1 -- 172.21.15.107:0/2760778179 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80059e0 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.004+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b008a250 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.005+0000 7f339effd640 1 -- 172.21.15.107:0/2760778179 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f33a801a070 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.005+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b0062da0 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.005+0000 7f339effd640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3390038040 0x7f339003a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.005+0000 7f339effd640 1 -- 172.21.15.107:0/2760778179 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f33a804a280 con 0x7f33b0127ce0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.005+0000 7f33add9b640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3390038040 0x7f339003a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.006+0000 7f33add9b640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3390038040 0x7f339003a500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f33a4036000 tx=0x7f33a4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.010+0000 7f339effd640 1 -- 172.21.15.107:0/2760778179 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f33b0127b00 con 0x7f33b0127ce0 2024-04-24T01:42:36.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.179+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33b0123d70 con 0x7f3390038040 2024-04-24T01:42:36.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.181+0000 7f339effd640 1 -- 172.21.15.107:0/2760778179 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31853 (secure 0 0 0) 0x7f33b0123d70 con 0x7f3390038040 2024-04-24T01:42:36.181 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:42:36.182 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:42:36.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3390038040 msgr2=0x7f339003a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3390038040 0x7f339003a500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f33a4036000 tx=0x7f33a4008030 comp rx=0 tx=0).stop 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b0127ce0 msgr2=0x7f33b0122ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b0127ce0 0x7f33b0122ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c6b0 tx=0x7f33a800cb70 comp rx=0 tx=0).stop 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 shutdown_connections 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3390038040 0x7f339003a500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 --2- 172.21.15.107:0/2760778179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33b0127ce0 0x7f33b0122ca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 >> 172.21.15.107:0/2760778179 conn(0x7f33b0099680 msgr2=0x7f33b009a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 shutdown_connections 2024-04-24T01:42:36.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.183+0000 7f33b481a640 1 -- 172.21.15.107:0/2760778179 wait complete. 2024-04-24T01:42:36.194 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-24T01:42:36.007869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110360,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377000,"statfs":{"total":386547056640,"available":386434048000,"internally_reserved":0,"allocated":1744896,"data_stored":1347032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.281081"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.181121+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:42:33.181121+0000","last_peered":"2024-04-24T01:42:33.181121+0000","last_clean":"2024-04-24T01:42:33.181121+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:42:33.181121+0000","last_undegraded":"2024-04-24T01:42:33.181121+0000","last_fullsized":"2024-04-24T01:42:33.181121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:05.255625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.778671+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:42:33.778671+0000","last_peered":"2024-04-24T01:42:33.778671+0000","last_clean":"2024-04-24T01:42:33.778671+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:42:33.778671+0000","last_undegraded":"2024-04-24T01:42:33.778671+0000","last_fullsized":"2024-04-24T01:42:33.778671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:49.159738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743312+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:42:32.743312+0000","last_peered":"2024-04-24T01:42:32.743312+0000","last_clean":"2024-04-24T01:42:32.743312+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:42:32.743312+0000","last_undegraded":"2024-04-24T01:42:32.743312+0000","last_fullsized":"2024-04-24T01:42:32.743312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.270545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.778608+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:42:33.778608+0000","last_peered":"2024-04-24T01:42:33.778608+0000","last_clean":"2024-04-24T01:42:33.778608+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:42:33.778608+0000","last_undegraded":"2024-04-24T01:42:33.778608+0000","last_fullsized":"2024-04-24T01:42:33.778608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:38.785738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743337+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:42:32.743337+0000","last_peered":"2024-04-24T01:42:32.743337+0000","last_clean":"2024-04-24T01:42:32.743337+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:42:32.743337+0000","last_undegraded":"2024-04-24T01:42:32.743337+0000","last_fullsized":"2024-04-24T01:42:32.743337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:39.012880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743209+0000","last_change":"2024-04-24T01:42:32.739720+0000","last_active":"2024-04-24T01:42:32.743209+0000","last_peered":"2024-04-24T01:42:32.743209+0000","last_clean":"2024-04-24T01:42:32.743209+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:42:32.743209+0000","last_undegraded":"2024-04-24T01:42:32.743209+0000","last_fullsized":"2024-04-24T01:42:32.743209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:20.872819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.743320+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:42:32.743320+0000","last_peered":"2024-04-24T01:42:32.743320+0000","last_clean":"2024-04-24T01:42:32.743320+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:42:32.743320+0000","last_undegraded":"2024-04-24T01:42:32.743320+0000","last_fullsized":"2024-04-24T01:42:32.743320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:15:54.667128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:42:32.738213+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:42:32.738213+0000","last_peered":"2024-04-24T01:42:32.738213+0000","last_clean":"2024-04-24T01:42:32.738213+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:42:32.738213+0000","last_undegraded":"2024-04-24T01:42:32.738213+0000","last_fullsized":"2024-04-24T01:42:32.738213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:59.995919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:42:33.733989+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:42:33.733989+0000","last_peered":"2024-04-24T01:42:33.733989+0000","last_clean":"2024-04-24T01:42:33.733989+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:42:33.733989+0000","last_undegraded":"2024-04-24T01:42:33.733989+0000","last_fullsized":"2024-04-24T01:42:33.733989+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:54.970096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":724992,"data_stored":627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":45600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:42:36.194 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T01:42:36.195 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T01:42:36.195 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T01:42:36.195 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T01:42:36.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.288+0000 7f614a11e640 1 Processor -- start 2024-04-24T01:42:36.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.288+0000 7f614a11e640 1 -- start start 2024-04-24T01:42:36.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.288+0000 7f614a11e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f61441287d0 0x7f6144130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.288+0000 7f614a11e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6144127b00 con 0x7f6144127ce0 2024-04-24T01:42:36.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.288+0000 7f614a11e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f61440708e0 con 0x7f61441287d0 2024-04-24T01:42:36.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.289+0000 7f6142ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f61441287d0 0x7f6144130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.289+0000 7f61437fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6144127ce0 0x7f61441280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54928/0 (socket says 172.21.15.107:54928) 2024-04-24T01:42:36.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.289+0000 7f61437fe640 1 -- 172.21.15.107:0/4109032409 learned_addr learned my addr 172.21.15.107:0/4109032409 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:42:36.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.289+0000 7f6142ffd640 1 -- 172.21.15.107:0/4109032409 >> v1:172.21.15.107:6789/0 conn(0x7f6144127ce0 legacy=0x7f61441280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.289+0000 7f6142ffd640 1 -- 172.21.15.107:0/4109032409 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6144098800 con 0x7f61441287d0 2024-04-24T01:42:36.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.289+0000 7f6142ffd640 1 --2- 172.21.15.107:0/4109032409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61441287d0 0x7f6144130360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6138009750 tx=0x7f613802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8c597cbe60a845 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f61427fc640 1 -- 172.21.15.107:0/4109032409 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61380316d0 con 0x7f61441287d0 2024-04-24T01:42:36.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f61427fc640 1 -- 172.21.15.107:0/4109032409 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6138037070 con 0x7f61441287d0 2024-04-24T01:42:36.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f61427fc640 1 -- 172.21.15.107:0/4109032409 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61380319c0 con 0x7f61441287d0 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f614a11e640 1 -- 172.21.15.107:0/4109032409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61441287d0 msgr2=0x7f6144130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f614a11e640 1 --2- 172.21.15.107:0/4109032409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61441287d0 0x7f6144130360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6138009750 tx=0x7f613802b840 comp rx=0 tx=0).stop 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f614a11e640 1 -- 172.21.15.107:0/4109032409 shutdown_connections 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f614a11e640 1 --2- 172.21.15.107:0/4109032409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61441287d0 0x7f6144130360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f614a11e640 1 -- 172.21.15.107:0/4109032409 >> 172.21.15.107:0/4109032409 conn(0x7f6144099680 msgr2=0x7f6144099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f614a11e640 1 -- 172.21.15.107:0/4109032409 shutdown_connections 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.290+0000 7f614a11e640 1 -- 172.21.15.107:0/4109032409 wait complete. 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.291+0000 7f614a11e640 1 Processor -- start 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.291+0000 7f614a11e640 1 -- start start 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.291+0000 7f614a11e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6144127ce0 0x7f61441bf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f614a11e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6144070280 con 0x7f6144127ce0 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f61437fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6144127ce0 0x7f61441bf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f61437fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6144127ce0 0x7f61441bf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39242/0 (socket says 172.21.15.107:39242) 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f61437fe640 1 -- 172.21.15.107:0/526165031 learned_addr learned my addr 172.21.15.107:0/526165031 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f61437fe640 1 -- 172.21.15.107:0/526165031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614408af60 con 0x7f6144127ce0 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f61437fe640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6144127ce0 0x7f61441bf150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f613400c380 tx=0x7f613400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f612bfff640 1 -- 172.21.15.107:0/526165031 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6134005c10 con 0x7f6144127ce0 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f612bfff640 1 -- 172.21.15.107:0/526165031 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6134005db0 con 0x7f6144127ce0 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614408a9d0 con 0x7f6144127ce0 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f612bfff640 1 -- 172.21.15.107:0/526165031 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6134004930 con 0x7f6144127ce0 2024-04-24T01:42:36.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.292+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61441bf690 con 0x7f6144127ce0 2024-04-24T01:42:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.293+0000 7f612bfff640 1 -- 172.21.15.107:0/526165031 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f613401a020 con 0x7f6144127ce0 2024-04-24T01:42:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.293+0000 7f612bfff640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6130038090 0x7f613003a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.293+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614406e7f0 con 0x7f6144127ce0 2024-04-24T01:42:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.293+0000 7f612bfff640 1 -- 172.21.15.107:0/526165031 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f613404a710 con 0x7f6144127ce0 2024-04-24T01:42:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.293+0000 7f6142ffd640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6130038090 0x7f613003a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.294+0000 7f6142ffd640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6130038090 0x7f613003a550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6138036000 tx=0x7f6138008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.298+0000 7f612bfff640 1 -- 172.21.15.107:0/526165031 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f614406e7f0 con 0x7f6144127ce0 2024-04-24T01:42:36.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.512+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f614408a310 con 0x7f6144127ce0 2024-04-24T01:42:36.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.512+0000 7f612bfff640 1 -- 172.21.15.107:0/526165031 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6144127b00 con 0x7f6144127ce0 2024-04-24T01:42:36.512 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:42:36.513 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T01:42:36.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6130038090 msgr2=0x7f613003a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6130038090 0x7f613003a550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6138036000 tx=0x7f6138008030 comp rx=0 tx=0).stop 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6144127ce0 msgr2=0x7f61441bf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6144127ce0 0x7f61441bf150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f613400c380 tx=0x7f613400c840 comp rx=0 tx=0).stop 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 shutdown_connections 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6130038090 0x7f613003a550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 --2- 172.21.15.107:0/526165031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6144127ce0 0x7f61441bf150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 >> 172.21.15.107:0/526165031 conn(0x7f6144099680 msgr2=0x7f61440966b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 shutdown_connections 2024-04-24T01:42:36.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:42:36.514+0000 7f614a11e640 1 -- 172.21.15.107:0/526165031 wait complete. 2024-04-24T01:42:36.525 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T01:42:36.525 INFO:teuthology.run_tasks:Running task rgw... 2024-04-24T01:42:36.541 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-24T01:42:36.541 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-24T01:42:36.542 INFO:tasks.rgw:Creating data pools 2024-04-24T01:42:36.542 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-24T01:42:36.542 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.651+0000 7f3ac5e0e640 1 Processor -- start 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.651+0000 7f3ac5e0e640 1 -- start start 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3ac5e0e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3ac011a990 0x7f3ac011cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3ac5e0e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac011d2c0 con 0x7f3ac0111d10 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3ac5e0e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac011e4c0 con 0x7f3ac011a990 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3abeffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3ac011a990 0x7f3ac011cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3abf7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3ac0111d10 0x7f3ac01120f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:42906/0 (socket says 172.21.15.131:42906) 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3abf7fe640 1 -- 172.21.15.131:0/1181822775 learned_addr learned my addr 172.21.15.131:0/1181822775 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3abeffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3ac011a990 0x7f3ac011cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:34158/0 (socket says 172.21.15.131:34158) 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3abeffd640 1 -- 172.21.15.131:0/1181822775 >> v1:172.21.15.107:6789/0 conn(0x7f3ac0111d10 legacy=0x7f3ac01120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.652+0000 7f3abeffd640 1 -- 172.21.15.131:0/1181822775 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac011e670 con 0x7f3ac011a990 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.653+0000 7f3abeffd640 1 --2- 172.21.15.131:0/1181822775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac011a990 0x7f3ac011cd80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009720 tx=0x7f3ab402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8ce7e83b6a235e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.653+0000 7f3abe7fc640 1 -- 172.21.15.131:0/1181822775 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ab40316d0 con 0x7f3ac011a990 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.653+0000 7f3abe7fc640 1 -- 172.21.15.131:0/1181822775 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab4037070 con 0x7f3ac011a990 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.653+0000 7f3abe7fc640 1 -- 172.21.15.131:0/1181822775 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ab40319c0 con 0x7f3ac011a990 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.654+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/1181822775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac011a990 msgr2=0x7f3ac011cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.654+0000 7f3ac5e0e640 1 --2- 172.21.15.131:0/1181822775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac011a990 0x7f3ac011cd80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009720 tx=0x7f3ab402b840 comp rx=0 tx=0).stop 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.654+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/1181822775 shutdown_connections 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.654+0000 7f3ac5e0e640 1 --2- 172.21.15.131:0/1181822775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac011a990 0x7f3ac011cd80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:36.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.654+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/1181822775 >> 172.21.15.131:0/1181822775 conn(0x7f3ac006e680 msgr2=0x7f3ac010fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:36.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.654+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/1181822775 shutdown_connections 2024-04-24T01:42:36.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.654+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/1181822775 wait complete. 2024-04-24T01:42:36.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3ac5e0e640 1 Processor -- start 2024-04-24T01:42:36.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3ac5e0e640 1 -- start start 2024-04-24T01:42:36.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3ac5e0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac0111d10 0x7f3ac01ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3ac5e0e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac011d970 con 0x7f3ac0111d10 2024-04-24T01:42:36.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3abf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac0111d10 0x7f3ac01ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3abf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac0111d10 0x7f3ac01ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:34168/0 (socket says 172.21.15.131:34168) 2024-04-24T01:42:36.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3abf7fe640 1 -- 172.21.15.131:0/2464605408 learned_addr learned my addr 172.21.15.131:0/2464605408 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:36.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.655+0000 7f3abf7fe640 1 -- 172.21.15.131:0/2464605408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac01ac9e0 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.656+0000 7f3abf7fe640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac0111d10 0x7f3ac01ac410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000c4a0 tx=0x7f3ab000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.656+0000 7f3aa7fff640 1 -- 172.21.15.131:0/2464605408 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ab0017070 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.656+0000 7f3aa7fff640 1 -- 172.21.15.131:0/2464605408 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab0005c10 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.656+0000 7f3aa7fff640 1 -- 172.21.15.131:0/2464605408 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ab0007070 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.656+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac01acc70 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.656+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac01a6700 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.657+0000 7f3aa7fff640 1 -- 172.21.15.131:0/2464605408 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ab001a070 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.657+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac0062da0 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.657+0000 7f3aa7fff640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3aac038060 0x7f3aac03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.657+0000 7f3aa7fff640 1 -- 172.21.15.131:0/2464605408 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f3ab004a260 con 0x7f3ac0111d10 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.657+0000 7f3abeffd640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3aac038060 0x7f3aac03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:36.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.657+0000 7f3abeffd640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3aac038060 0x7f3aac03a520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4036000 tx=0x7f3ab4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:36.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.662+0000 7f3aa7fff640 1 -- 172.21.15.131:0/2464605408 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f3ab001b3b0 con 0x7f3ac0111d10 2024-04-24T01:42:36.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:36.842+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7f3ac01acea0 con 0x7f3ac0111d10 2024-04-24T01:42:37.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.740+0000 7f3aa7fff640 1 -- 172.21.15.131:0/2464605408 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v18) ==== 151+0+0 (secure 0 0 0) 0x7f3ab0010300 con 0x7f3ac0111d10 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3aac038060 msgr2=0x7f3aac03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3aac038060 0x7f3aac03a520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4036000 tx=0x7f3ab4008030 comp rx=0 tx=0).stop 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac0111d10 msgr2=0x7f3ac01ac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac0111d10 0x7f3ac01ac410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000c4a0 tx=0x7f3ab000c960 comp rx=0 tx=0).stop 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 shutdown_connections 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3aac038060 0x7f3aac03a520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 --2- 172.21.15.131:0/2464605408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ac0111d10 0x7f3ac01ac410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 >> 172.21.15.131:0/2464605408 conn(0x7f3ac006e680 msgr2=0x7f3ac010fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 shutdown_connections 2024-04-24T01:42:37.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.743+0000 7f3ac5e0e640 1 -- 172.21.15.131:0/2464605408 wait complete. 2024-04-24T01:42:37.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.860+0000 7fb8e3700640 1 Processor -- start 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.860+0000 7fb8e3700640 1 -- start start 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.860+0000 7fb8e3700640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb8dc115a70 0x7fb8dc115e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e3700640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8dc116510 con 0x7fb8dc10dd50 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e3700640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb8dc10e910 con 0x7fb8dc115a70 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e149c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb8dc115a70 0x7fb8dc115e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e0c9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb8dc10dd50 0x7fb8dc10e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:42920/0 (socket says 172.21.15.131:42920) 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e149c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb8dc115a70 0x7fb8dc115e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:34180/0 (socket says 172.21.15.131:34180) 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e0c9b640 1 -- 172.21.15.131:0/1614851156 learned_addr learned my addr 172.21.15.131:0/1614851156 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:37.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e149c640 1 -- 172.21.15.131:0/1614851156 >> v1:172.21.15.107:6789/0 conn(0x7fb8dc10dd50 legacy=0x7fb8dc10e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:37.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.861+0000 7fb8e149c640 1 -- 172.21.15.131:0/1614851156 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8dc10ea90 con 0x7fb8dc115a70 2024-04-24T01:42:37.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.862+0000 7fb8e149c640 1 --2- 172.21.15.131:0/1614851156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc115a70 0x7fb8dc115e50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009d90 tx=0x7fb8cc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2b4273bd86654e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:37.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.862+0000 7fb8dbfff640 1 -- 172.21.15.131:0/1614851156 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc039070 con 0x7fb8dc115a70 2024-04-24T01:42:37.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.862+0000 7fb8dbfff640 1 -- 172.21.15.131:0/1614851156 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc02cb10 con 0x7fb8dc115a70 2024-04-24T01:42:37.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.862+0000 7fb8dbfff640 1 -- 172.21.15.131:0/1614851156 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc02ce10 con 0x7fb8dc115a70 2024-04-24T01:42:37.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.863+0000 7fb8e3700640 1 -- 172.21.15.131:0/1614851156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc115a70 msgr2=0x7fb8dc115e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:37.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.863+0000 7fb8e3700640 1 --2- 172.21.15.131:0/1614851156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc115a70 0x7fb8dc115e50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009d90 tx=0x7fb8cc02beb0 comp rx=0 tx=0).stop 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.863+0000 7fb8e3700640 1 -- 172.21.15.131:0/1614851156 shutdown_connections 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.863+0000 7fb8e3700640 1 --2- 172.21.15.131:0/1614851156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc115a70 0x7fb8dc115e50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.863+0000 7fb8e3700640 1 -- 172.21.15.131:0/1614851156 >> 172.21.15.131:0/1614851156 conn(0x7fb8dc06f7a0 msgr2=0x7fb8dc071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.863+0000 7fb8e3700640 1 -- 172.21.15.131:0/1614851156 shutdown_connections 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.863+0000 7fb8e3700640 1 -- 172.21.15.131:0/1614851156 wait complete. 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e3700640 1 Processor -- start 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e3700640 1 -- start start 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e3700640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc10dd50 0x7fb8dc1aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e3700640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc11bc70 con 0x7fb8dc10dd50 2024-04-24T01:42:37.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e149c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc10dd50 0x7fb8dc1aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:37.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e149c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc10dd50 0x7fb8dc1aa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:34196/0 (socket says 172.21.15.131:34196) 2024-04-24T01:42:37.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e149c640 1 -- 172.21.15.131:0/1010066024 learned_addr learned my addr 172.21.15.131:0/1010066024 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:37.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.864+0000 7fb8e149c640 1 -- 172.21.15.131:0/1010066024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8dc1aa770 con 0x7fb8dc10dd50 2024-04-24T01:42:37.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.865+0000 7fb8e149c640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc10dd50 0x7fb8dc1aa1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc037040 tx=0x7fb8cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:37.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.865+0000 7fb8d9ffb640 1 -- 172.21.15.131:0/1010066024 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc044020 con 0x7fb8dc10dd50 2024-04-24T01:42:37.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.865+0000 7fb8d9ffb640 1 -- 172.21.15.131:0/1010066024 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc03f5a0 con 0x7fb8dc10dd50 2024-04-24T01:42:37.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.865+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8dc1aa9a0 con 0x7fb8dc10dd50 2024-04-24T01:42:37.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.865+0000 7fb8d9ffb640 1 -- 172.21.15.131:0/1010066024 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc039040 con 0x7fb8dc10dd50 2024-04-24T01:42:37.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.865+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8dc1a42b0 con 0x7fb8dc10dd50 2024-04-24T01:42:37.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.866+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8dc062da0 con 0x7fb8dc10dd50 2024-04-24T01:42:37.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.866+0000 7fb8d9ffb640 1 -- 172.21.15.131:0/1010066024 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb8cc047020 con 0x7fb8dc10dd50 2024-04-24T01:42:37.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.866+0000 7fb8d9ffb640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8c8038010 0x7fb8c803a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:37.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.866+0000 7fb8d9ffb640 1 -- 172.21.15.131:0/1010066024 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3774+0+0 (secure 0 0 0) 0x7fb8cc06df90 con 0x7fb8dc10dd50 2024-04-24T01:42:37.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.866+0000 7fb8e0c9b640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8c8038010 0x7fb8c803a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:37.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.867+0000 7fb8e0c9b640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8c8038010 0x7fb8c803a4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0000f60 tx=0x7fb8d0007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:37.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:37.871+0000 7fb8d9ffb640 1 -- 172.21.15.131:0/1010066024 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fb8cc04e030 con 0x7fb8dc10dd50 2024-04-24T01:42:38.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:38.044+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fb8dc115a70 con 0x7fb8dc10dd50 2024-04-24T01:42:39.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.745+0000 7fb8d9ffb640 1 -- 172.21.15.131:0/1010066024 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7fb8cc048c80 con 0x7fb8dc10dd50 2024-04-24T01:42:39.746 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'default.rgw.buckets.data' created 2024-04-24T01:42:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.748+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8c8038010 msgr2=0x7fb8c803a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.748+0000 7fb8e3700640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8c8038010 0x7fb8c803a4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0000f60 tx=0x7fb8d0007a80 comp rx=0 tx=0).stop 2024-04-24T01:42:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc10dd50 msgr2=0x7fb8dc1aa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc10dd50 0x7fb8dc1aa1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc037040 tx=0x7fb8cc004a40 comp rx=0 tx=0).stop 2024-04-24T01:42:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 shutdown_connections 2024-04-24T01:42:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8c8038010 0x7fb8c803a4d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 --2- 172.21.15.131:0/1010066024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8dc10dd50 0x7fb8dc1aa1a0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc037040 tx=0x7fb8cc004a40 comp rx=0 tx=0).stop 2024-04-24T01:42:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 >> 172.21.15.131:0/1010066024 conn(0x7fb8dc06f7a0 msgr2=0x7fb8dc111a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 shutdown_connections 2024-04-24T01:42:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.749+0000 7fb8e3700640 1 -- 172.21.15.131:0/1010066024 wait complete. 2024-04-24T01:42:39.769 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-24T01:42:39.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.870+0000 7f0221804640 1 Processor -- start 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.870+0000 7f0221804640 1 -- start start 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f0221804640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f021c10e930 0x7f021c11a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f0221804640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f021c11af40 con 0x7f021c10dd50 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f0221804640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f021c11c120 con 0x7f021c10e930 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f021a7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f021c10e930 0x7f021c11a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f021affd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f021c10dd50 0x7f021c10e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:42932/0 (socket says 172.21.15.131:42932) 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f021a7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f021c10e930 0x7f021c11a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:34206/0 (socket says 172.21.15.131:34206) 2024-04-24T01:42:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f021affd640 1 -- 172.21.15.131:0/2274625293 learned_addr learned my addr 172.21.15.131:0/2274625293 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:39.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f021a7fc640 1 -- 172.21.15.131:0/2274625293 >> v1:172.21.15.107:6789/0 conn(0x7f021c10dd50 legacy=0x7f021c10e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:39.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.871+0000 7f021a7fc640 1 -- 172.21.15.131:0/2274625293 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021c11c2a0 con 0x7f021c10e930 2024-04-24T01:42:39.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.872+0000 7f021a7fc640 1 --2- 172.21.15.131:0/2274625293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10e930 0x7f021c11a970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0210009720 tx=0x7f021002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e63aea84b321da0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:39.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.872+0000 7f0219ffb640 1 -- 172.21.15.131:0/2274625293 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02100316d0 con 0x7f021c10e930 2024-04-24T01:42:39.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.872+0000 7f0219ffb640 1 -- 172.21.15.131:0/2274625293 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0210037070 con 0x7f021c10e930 2024-04-24T01:42:39.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.872+0000 7f0219ffb640 1 -- 172.21.15.131:0/2274625293 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02100319c0 con 0x7f021c10e930 2024-04-24T01:42:39.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.873+0000 7f0221804640 1 -- 172.21.15.131:0/2274625293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10e930 msgr2=0x7f021c11a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:39.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.873+0000 7f0221804640 1 --2- 172.21.15.131:0/2274625293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10e930 0x7f021c11a970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0210009720 tx=0x7f021002b840 comp rx=0 tx=0).stop 2024-04-24T01:42:39.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.873+0000 7f0221804640 1 -- 172.21.15.131:0/2274625293 shutdown_connections 2024-04-24T01:42:39.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.873+0000 7f0221804640 1 --2- 172.21.15.131:0/2274625293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10e930 0x7f021c11a970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.873+0000 7f0221804640 1 -- 172.21.15.131:0/2274625293 >> 172.21.15.131:0/2274625293 conn(0x7f021c06f420 msgr2=0x7f021c071840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.873+0000 7f0221804640 1 -- 172.21.15.131:0/2274625293 shutdown_connections 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.873+0000 7f0221804640 1 -- 172.21.15.131:0/2274625293 wait complete. 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.874+0000 7f0221804640 1 Processor -- start 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.874+0000 7f0221804640 1 -- start start 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.874+0000 7f0221804640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10dd50 0x7f021c1aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.874+0000 7f0221804640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f021c11b630 con 0x7f021c10dd50 2024-04-24T01:42:39.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.874+0000 7f021affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10dd50 0x7f021c1aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.874+0000 7f021affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10dd50 0x7f021c1aa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:34220/0 (socket says 172.21.15.131:34220) 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.874+0000 7f021affd640 1 -- 172.21.15.131:0/1743246372 learned_addr learned my addr 172.21.15.131:0/1743246372 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.875+0000 7f021affd640 1 -- 172.21.15.131:0/1743246372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021c1aa5f0 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.875+0000 7f021affd640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10dd50 0x7f021c1aa020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f020c00c340 tx=0x7f020c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.875+0000 7f0203fff640 1 -- 172.21.15.131:0/1743246372 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020c005c10 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.875+0000 7f0203fff640 1 -- 172.21.15.131:0/1743246372 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020c005db0 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.875+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021c1aa820 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.875+0000 7f0203fff640 1 -- 172.21.15.131:0/1743246372 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020c004930 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.875+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021c1a4130 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.876+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021c062da0 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.876+0000 7f0203fff640 1 -- 172.21.15.131:0/1743246372 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f020c01a020 con 0x7f021c10dd50 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.876+0000 7f0203fff640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0208038060 0x7f020803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:39.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.876+0000 7f0203fff640 1 -- 172.21.15.131:0/1743246372 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4249+0+0 (secure 0 0 0) 0x7f020c04aa80 con 0x7f021c10dd50 2024-04-24T01:42:39.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.876+0000 7f021a7fc640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0208038060 0x7f020803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:39.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.877+0000 7f021a7fc640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0208038060 0x7f020803a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0210036000 tx=0x7f0210008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:39.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:39.881+0000 7f0203fff640 1 -- 172.21.15.131:0/1743246372 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f020c0127f0 con 0x7f021c10dd50 2024-04-24T01:42:40.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.055+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f021c10e930 con 0x7f021c10dd50 2024-04-24T01:42:40.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.750+0000 7f0203fff640 1 -- 172.21.15.131:0/1743246372 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7f020c012a50 con 0x7f021c10dd50 2024-04-24T01:42:40.751 INFO:teuthology.orchestra.run.smithi131.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-24T01:42:40.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.754+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0208038060 msgr2=0x7f020803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:40.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.754+0000 7f0221804640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0208038060 0x7f020803a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0210036000 tx=0x7f0210008030 comp rx=0 tx=0).stop 2024-04-24T01:42:40.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.754+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10dd50 msgr2=0x7f021c1aa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:40.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.754+0000 7f0221804640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10dd50 0x7f021c1aa020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f020c00c340 tx=0x7f020c001e70 comp rx=0 tx=0).stop 2024-04-24T01:42:40.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.755+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 shutdown_connections 2024-04-24T01:42:40.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.755+0000 7f0221804640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0208038060 0x7f020803a520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:40.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.755+0000 7f0221804640 1 --2- 172.21.15.131:0/1743246372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f021c10dd50 0x7f021c1aa020 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:40.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.755+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 >> 172.21.15.131:0/1743246372 conn(0x7f021c06f420 msgr2=0x7f021c11a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:40.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.755+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 shutdown_connections 2024-04-24T01:42:40.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.755+0000 7f0221804640 1 -- 172.21.15.131:0/1743246372 wait complete. 2024-04-24T01:42:40.783 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-24T01:42:40.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf2eea5640 1 Processor -- start 2024-04-24T01:42:40.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf2eea5640 1 -- start start 2024-04-24T01:42:40.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf2eea5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbf28118960 0x7fbf2811ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:40.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf2eea5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2810eb40 con 0x7fbf2810dfc0 2024-04-24T01:42:40.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf2eea5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2811c2a0 con 0x7fbf28118960 2024-04-24T01:42:40.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf27fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbf28118960 0x7fbf2811ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:40.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf2cc41640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbf2810dfc0 0x7fbf2810e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:42940/0 (socket says 172.21.15.131:42940) 2024-04-24T01:42:40.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.886+0000 7fbf2cc41640 1 -- 172.21.15.131:0/800757986 learned_addr learned my addr 172.21.15.131:0/800757986 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:40.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.887+0000 7fbf27fff640 1 -- 172.21.15.131:0/800757986 >> v1:172.21.15.107:6789/0 conn(0x7fbf2810dfc0 legacy=0x7fbf2810e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:40.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.887+0000 7fbf27fff640 1 -- 172.21.15.131:0/800757986 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2811c420 con 0x7fbf28118960 2024-04-24T01:42:40.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.887+0000 7fbf27fff640 1 --2- 172.21.15.131:0/800757986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf28118960 0x7fbf2811ad50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009720 tx=0x7fbf1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e7cc82d2a93386 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:40.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.887+0000 7fbf277fe640 1 -- 172.21.15.131:0/800757986 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf140316d0 con 0x7fbf28118960 2024-04-24T01:42:40.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.887+0000 7fbf277fe640 1 -- 172.21.15.131:0/800757986 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf14037070 con 0x7fbf28118960 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.887+0000 7fbf277fe640 1 -- 172.21.15.131:0/800757986 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf140319c0 con 0x7fbf28118960 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.888+0000 7fbf2eea5640 1 -- 172.21.15.131:0/800757986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf28118960 msgr2=0x7fbf2811ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.888+0000 7fbf2eea5640 1 --2- 172.21.15.131:0/800757986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf28118960 0x7fbf2811ad50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009720 tx=0x7fbf1402b840 comp rx=0 tx=0).stop 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.888+0000 7fbf2eea5640 1 -- 172.21.15.131:0/800757986 shutdown_connections 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.888+0000 7fbf2eea5640 1 --2- 172.21.15.131:0/800757986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf28118960 0x7fbf2811ad50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.888+0000 7fbf2eea5640 1 -- 172.21.15.131:0/800757986 >> 172.21.15.131:0/800757986 conn(0x7fbf2806f2b0 msgr2=0x7fbf280716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.888+0000 7fbf2eea5640 1 -- 172.21.15.131:0/800757986 shutdown_connections 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.888+0000 7fbf2eea5640 1 -- 172.21.15.131:0/800757986 wait complete. 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2eea5640 1 Processor -- start 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2eea5640 1 -- start start 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2eea5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2810dfc0 0x7fbf2810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2eea5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2811b7b0 con 0x7fbf2810dfc0 2024-04-24T01:42:40.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2cc41640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2810dfc0 0x7fbf2810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:40.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2cc41640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2810dfc0 0x7fbf2810f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:34234/0 (socket says 172.21.15.131:34234) 2024-04-24T01:42:40.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2cc41640 1 -- 172.21.15.131:0/4233587928 learned_addr learned my addr 172.21.15.131:0/4233587928 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:40.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.889+0000 7fbf2cc41640 1 -- 172.21.15.131:0/4233587928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2810fd00 con 0x7fbf2810dfc0 2024-04-24T01:42:40.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.890+0000 7fbf2cc41640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2810dfc0 0x7fbf2810f7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c480 tx=0x7fbf1c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:40.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.890+0000 7fbf257fa640 1 -- 172.21.15.131:0/4233587928 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c017070 con 0x7fbf2810dfc0 2024-04-24T01:42:40.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.890+0000 7fbf257fa640 1 -- 172.21.15.131:0/4233587928 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c005c10 con 0x7fbf2810dfc0 2024-04-24T01:42:40.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.890+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2810ff90 con 0x7fbf2810dfc0 2024-04-24T01:42:40.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.890+0000 7fbf257fa640 1 -- 172.21.15.131:0/4233587928 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c0070d0 con 0x7fbf2810dfc0 2024-04-24T01:42:40.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.890+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf28110460 con 0x7fbf2810dfc0 2024-04-24T01:42:40.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.891+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf28062da0 con 0x7fbf2810dfc0 2024-04-24T01:42:40.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.891+0000 7fbf257fa640 1 -- 172.21.15.131:0/4233587928 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbf1c01a070 con 0x7fbf2810dfc0 2024-04-24T01:42:40.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.891+0000 7fbf257fa640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbf0c038010 0x7fbf0c03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:40.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.891+0000 7fbf257fa640 1 -- 172.21.15.131:0/4233587928 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4260+0+0 (secure 0 0 0) 0x7fbf1c04a5b0 con 0x7fbf2810dfc0 2024-04-24T01:42:40.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.891+0000 7fbf27fff640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbf0c038010 0x7fbf0c03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:40.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.891+0000 7fbf27fff640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbf0c038010 0x7fbf0c03a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf14036000 tx=0x7fbf14008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:40.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:40.896+0000 7fbf257fa640 1 -- 172.21.15.131:0/4233587928 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fbf1c010940 con 0x7fbf2810dfc0 2024-04-24T01:42:41.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.068+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fbf28118960 con 0x7fbf2810dfc0 2024-04-24T01:42:41.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.752+0000 7fbf257fa640 1 -- 172.21.15.131:0/4233587928 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7fbf1c04a280 con 0x7fbf2810dfc0 2024-04-24T01:42:41.753 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'default.rgw.buckets.index' created 2024-04-24T01:42:41.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbf0c038010 msgr2=0x7fbf0c03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbf0c038010 0x7fbf0c03a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf14036000 tx=0x7fbf14008030 comp rx=0 tx=0).stop 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2810dfc0 msgr2=0x7fbf2810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2810dfc0 0x7fbf2810f7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c480 tx=0x7fbf1c00c940 comp rx=0 tx=0).stop 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 shutdown_connections 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbf0c038010 0x7fbf0c03a4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 --2- 172.21.15.131:0/4233587928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf2810dfc0 0x7fbf2810f7c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 >> 172.21.15.131:0/4233587928 conn(0x7fbf2806f2b0 msgr2=0x7fbf2806fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.755+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 shutdown_connections 2024-04-24T01:42:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.756+0000 7fbf2eea5640 1 -- 172.21.15.131:0/4233587928 wait complete. 2024-04-24T01:42:41.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-24T01:42:41.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.872+0000 7f96c17c7640 1 Processor -- start 2024-04-24T01:42:41.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.872+0000 7f96c17c7640 1 -- start start 2024-04-24T01:42:41.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.872+0000 7f96c17c7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f96bc117760 0x7f96bc119b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:41.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.872+0000 7f96c17c7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96bc11a090 con 0x7f96bc10f960 2024-04-24T01:42:41.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.872+0000 7f96c17c7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc11b270 con 0x7f96bc117760 2024-04-24T01:42:41.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.873+0000 7f96b3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f96bc117760 0x7f96bc119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:41.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.873+0000 7f96baffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f96bc10f960 0x7f96bc10fd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:57526/0 (socket says 172.21.15.131:57526) 2024-04-24T01:42:41.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.873+0000 7f96b3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f96bc117760 0x7f96bc119b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:56890/0 (socket says 172.21.15.131:56890) 2024-04-24T01:42:41.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.873+0000 7f96baffd640 1 -- 172.21.15.131:0/1807585036 learned_addr learned my addr 172.21.15.131:0/1807585036 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:41.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.873+0000 7f96b3fff640 1 -- 172.21.15.131:0/1807585036 >> v1:172.21.15.107:6789/0 conn(0x7f96bc10f960 legacy=0x7f96bc10fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:41.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.873+0000 7f96b3fff640 1 -- 172.21.15.131:0/1807585036 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc11b3f0 con 0x7f96bc117760 2024-04-24T01:42:41.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96b3fff640 1 --2- 172.21.15.131:0/1807585036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc117760 0x7f96bc119b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009720 tx=0x7f96a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d894556e029b6a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:41.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96ba7fc640 1 -- 172.21.15.131:0/1807585036 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a40316d0 con 0x7f96bc117760 2024-04-24T01:42:41.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96ba7fc640 1 -- 172.21.15.131:0/1807585036 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a4037070 con 0x7f96bc117760 2024-04-24T01:42:41.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96ba7fc640 1 -- 172.21.15.131:0/1807585036 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a40319c0 con 0x7f96bc117760 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96c17c7640 1 -- 172.21.15.131:0/1807585036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc117760 msgr2=0x7f96bc119b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96c17c7640 1 --2- 172.21.15.131:0/1807585036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc117760 0x7f96bc119b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009720 tx=0x7f96a402b840 comp rx=0 tx=0).stop 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96c17c7640 1 -- 172.21.15.131:0/1807585036 shutdown_connections 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96c17c7640 1 --2- 172.21.15.131:0/1807585036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc117760 0x7f96bc119b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96c17c7640 1 -- 172.21.15.131:0/1807585036 >> 172.21.15.131:0/1807585036 conn(0x7f96bc06f2b0 msgr2=0x7f96bc0716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96c17c7640 1 -- 172.21.15.131:0/1807585036 shutdown_connections 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.874+0000 7f96c17c7640 1 -- 172.21.15.131:0/1807585036 wait complete. 2024-04-24T01:42:41.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.875+0000 7f96c17c7640 1 Processor -- start 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.875+0000 7f96c17c7640 1 -- start start 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.875+0000 7f96c17c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc10f960 0x7f96bc06fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.875+0000 7f96c17c7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc11a740 con 0x7f96bc10f960 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.875+0000 7f96baffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc10f960 0x7f96bc06fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96baffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc10f960 0x7f96bc06fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:56894/0 (socket says 172.21.15.131:56894) 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96baffd640 1 -- 172.21.15.131:0/2025562895 learned_addr learned my addr 172.21.15.131:0/2025562895 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96baffd640 1 -- 172.21.15.131:0/2025562895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc070370 con 0x7f96bc10f960 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96baffd640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc10f960 0x7f96bc06fe30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00c340 tx=0x7f96ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96b37fe640 1 -- 172.21.15.131:0/2025562895 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ac005c10 con 0x7f96bc10f960 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96b37fe640 1 -- 172.21.15.131:0/2025562895 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac005db0 con 0x7f96bc10f960 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96bc0705a0 con 0x7f96bc10f960 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96b37fe640 1 -- 172.21.15.131:0/2025562895 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ac004930 con 0x7f96bc10f960 2024-04-24T01:42:41.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.876+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96bc070af0 con 0x7f96bc10f960 2024-04-24T01:42:41.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.877+0000 7f96b37fe640 1 -- 172.21.15.131:0/2025562895 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f96ac01a020 con 0x7f96bc10f960 2024-04-24T01:42:41.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.877+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96bc062da0 con 0x7f96bc10f960 2024-04-24T01:42:41.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.877+0000 7f96b37fe640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f969c038040 0x7f969c03a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:41.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.877+0000 7f96b37fe640 1 -- 172.21.15.131:0/2025562895 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4624+0+0 (secure 0 0 0) 0x7f96ac04ab60 con 0x7f96bc10f960 2024-04-24T01:42:41.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.877+0000 7f96b3fff640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f969c038040 0x7f969c03a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:41.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.878+0000 7f96b3fff640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f969c038040 0x7f969c03a500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96a4036000 tx=0x7f96a4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:41.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:41.883+0000 7f96b37fe640 1 -- 172.21.15.131:0/2025562895 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f96ac0127f0 con 0x7f96bc10f960 2024-04-24T01:42:42.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.055+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f96bc115540 con 0x7f96bc10f960 2024-04-24T01:42:42.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.758+0000 7f96b37fe640 1 -- 172.21.15.131:0/2025562895 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7f96ac012a50 con 0x7f96bc10f960 2024-04-24T01:42:42.759 INFO:teuthology.orchestra.run.smithi131.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-24T01:42:42.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f969c038040 msgr2=0x7f969c03a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:42.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f969c038040 0x7f969c03a500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96a4036000 tx=0x7f96a4008030 comp rx=0 tx=0).stop 2024-04-24T01:42:42.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc10f960 msgr2=0x7f96bc06fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:42.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc10f960 0x7f96bc06fe30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00c340 tx=0x7f96ac001e70 comp rx=0 tx=0).stop 2024-04-24T01:42:42.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 shutdown_connections 2024-04-24T01:42:42.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f969c038040 0x7f969c03a500 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:42.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 --2- 172.21.15.131:0/2025562895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96bc10f960 0x7f96bc06fe30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:42.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.760+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 >> 172.21.15.131:0/2025562895 conn(0x7f96bc06f2b0 msgr2=0x7f96bc112710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:42.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.761+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 shutdown_connections 2024-04-24T01:42:42.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:42.761+0000 7f96c17c7640 1 -- 172.21.15.131:0/2025562895 wait complete. 2024-04-24T01:42:42.780 DEBUG:tasks.rgw:Pools created 2024-04-24T01:42:42.780 INFO:tasks.rgw:Starting rgw... 2024-04-24T01:42:42.780 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-24T01:42:42.781 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-24T01:42:42.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo echo -n http://smithi131.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-24T01:42:42.810 INFO:teuthology.orchestra.run.smithi131.stdout:http://smithi131.front.sepia.ceph.com:80 2024-04-24T01:42:42.811 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-24T01:42:42.875 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-24T01:42:42.876 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-24T01:42:42.918 INFO:tasks.rgw.client.0:Started 2024-04-24T01:42:42.918 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi131.front.sepia.ceph.com:80/ 2024-04-24T01:42:42.919 DEBUG:teuthology.orchestra.run.smithi131:> curl http://smithi131.front.sepia.ceph.com:80/ 2024-04-24T01:42:42.959 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:42:42.960 INFO:teuthology.orchestra.run.smithi131.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:42:42.960 INFO:teuthology.orchestra.run.smithi131.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:42:42.960 INFO:teuthology.orchestra.run.smithi131.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:42:42.960 INFO:teuthology.orchestra.run.smithi131.stderr:curl: (7) Failed to connect to smithi131.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:42:43.961 DEBUG:teuthology.orchestra.run.smithi131:> curl http://smithi131.front.sepia.ceph.com:80/ 2024-04-24T01:42:43.984 INFO:teuthology.orchestra.run.smithi131.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:42:43.984 INFO:teuthology.orchestra.run.smithi131.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:42:43.984 INFO:teuthology.orchestra.run.smithi131.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:42:43.985 INFO:teuthology.orchestra.run.smithi131.stderr:curl: (7) Failed to connect to smithi131.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:42:43.985 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:42:45.986 DEBUG:teuthology.orchestra.run.smithi131:> curl http://smithi131.front.sepia.ceph.com:80/ 2024-04-24T01:42:46.009 INFO:teuthology.orchestra.run.smithi131.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:42:46.009 INFO:teuthology.orchestra.run.smithi131.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:42:46.010 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:42:46.011 INFO:teuthology.orchestra.run.smithi131.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:42:46.011 INFO:teuthology.orchestra.run.smithi131.stderr:curl: (7) Failed to connect to smithi131.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:42:50.012 DEBUG:teuthology.orchestra.run.smithi131:> curl http://smithi131.front.sepia.ceph.com:80/ 2024-04-24T01:42:50.035 INFO:teuthology.orchestra.run.smithi131.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:42:50.035 INFO:teuthology.orchestra.run.smithi131.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:42:50.037 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:42:50.038 INFO:teuthology.orchestra.run.smithi131.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:42:50.038 INFO:teuthology.orchestra.run.smithi131.stderr:curl: (7) Failed to connect to smithi131.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:42:51.857 INFO:tasks.rgw.client.0.smithi131.stdout:2024-04-24T01:42:51.857+0000 7ffa0f91f880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-24T01:42:58.040 DEBUG:teuthology.orchestra.run.smithi131:> curl http://smithi131.front.sepia.ceph.com:80/ 2024-04-24T01:42:58.062 INFO:teuthology.orchestra.run.smithi131.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:42:58.062 INFO:teuthology.orchestra.run.smithi131.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:42:58.064 INFO:teuthology.orchestra.run.smithi131.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-04-24T01:42:58.065 INFO:teuthology.orchestra.run.smithi131.stdout:anonymous 2024-04-24T01:42:58.065 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-24T01:42:58.146 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-24T01:42:58.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-24T01:42:58.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-24T01:42:58.147 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-24T01:42:58.197 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:58.197 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.197+0000 7f4e46728800 1 Processor -- start 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.197+0000 7f4e46728800 1 -- start start 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.197+0000 7f4e46728800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b900d481e0 0x55b900d4a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.197+0000 7f4e46728800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b900c03d40 con 0x55b900d43d50 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.197+0000 7f4e46728800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55b900bd64d0 con 0x55b900d481e0 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.198+0000 7f4e41c5f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b900d481e0 0x55b900d4a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.198+0000 7f4e41c5f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b900d481e0 0x55b900d4a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:35992/0 (socket says 172.21.15.131:35992) 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.198+0000 7f4e41c5f640 1 -- 172.21.15.131:0/2315815865 learned_addr learned my addr 172.21.15.131:0/2315815865 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.198+0000 7f4e42460640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55b900d43d50 0x55b900d44170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45662/0 (socket says 172.21.15.131:45662) 2024-04-24T01:42:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.198+0000 7f4e41c5f640 1 -- 172.21.15.131:0/2315815865 >> v1:172.21.15.107:6789/0 conn(0x55b900d43d50 legacy=0x55b900d44170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.198+0000 7f4e4145e640 1 -- 172.21.15.131:0/2315815865 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787744487 0 0) 0x55b900c03d40 con 0x55b900d43d50 2024-04-24T01:42:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.198+0000 7f4e41c5f640 1 -- 172.21.15.131:0/2315815865 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b900c02590 con 0x55b900d481e0 2024-04-24T01:42:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.200+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/2315815865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900d4a5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00a520 tx=0x7f4e2c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f1a7450273f436 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.200+0000 7f4e4145e640 1 -- 172.21.15.131:0/2315815865 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c057070 con 0x55b900d481e0 2024-04-24T01:42:58.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.200+0000 7f4e4145e640 1 -- 172.21.15.131:0/2315815865 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c052570 con 0x55b900d481e0 2024-04-24T01:42:58.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.200+0000 7f4e4145e640 1 -- 172.21.15.131:0/2315815865 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c04ae60 con 0x55b900d481e0 2024-04-24T01:42:58.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.201+0000 7f4e46728800 1 -- 172.21.15.131:0/2315815865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 msgr2=0x55b900d4a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.201+0000 7f4e46728800 1 --2- 172.21.15.131:0/2315815865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900d4a5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00a520 tx=0x7f4e2c01d010 comp rx=0 tx=0).stop 2024-04-24T01:42:58.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.201+0000 7f4e46728800 1 -- 172.21.15.131:0/2315815865 shutdown_connections 2024-04-24T01:42:58.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.201+0000 7f4e46728800 1 --2- 172.21.15.131:0/2315815865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900d4a5d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.201+0000 7f4e46728800 1 -- 172.21.15.131:0/2315815865 >> 172.21.15.131:0/2315815865 conn(0x55b900d3f2f0 msgr2=0x55b900d41710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.201+0000 7f4e46728800 1 -- 172.21.15.131:0/2315815865 shutdown_connections 2024-04-24T01:42:58.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.201+0000 7f4e46728800 1 -- 172.21.15.131:0/2315815865 wait complete. 2024-04-24T01:42:58.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.214+0000 7f4e46728800 1 Processor -- start 2024-04-24T01:42:58.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.214+0000 7f4e46728800 1 -- start start 2024-04-24T01:42:58.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.215+0000 7f4e46728800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d43d50 0x55b900cb8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.215+0000 7f4e46728800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b900c903b0 con 0x55b900d43d50 2024-04-24T01:42:58.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.215+0000 7f4e42460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d43d50 0x55b900cb8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.215+0000 7f4e42460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d43d50 0x55b900cb8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:35996/0 (socket says 172.21.15.131:35996) 2024-04-24T01:42:58.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.215+0000 7f4e42460640 1 -- 172.21.15.131:0/513721182 learned_addr learned my addr 172.21.15.131:0/513721182 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.215+0000 7f4e42460640 1 -- 172.21.15.131:0/513721182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b900e38c60 con 0x55b900d43d50 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.215+0000 7f4e42460640 1 --2- 172.21.15.131:0/513721182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d43d50 0x55b900cb8870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00b240 tx=0x7f4e3c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ce69fb21e8ccdf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4d30608640 1 -- 172.21.15.131:0/513721182 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c008070 con 0x55b900d43d50 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4d30608640 1 -- 172.21.15.131:0/513721182 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c00d500 con 0x55b900d43d50 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4d30608640 1 -- 172.21.15.131:0/513721182 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c00d860 con 0x55b900d43d50 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4e46728800 1 -- 172.21.15.131:0/513721182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d43d50 msgr2=0x55b900cb8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4e46728800 1 --2- 172.21.15.131:0/513721182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d43d50 0x55b900cb8870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00b240 tx=0x7f4e3c00b700 comp rx=0 tx=0).stop 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4e46728800 1 -- 172.21.15.131:0/513721182 shutdown_connections 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4e46728800 1 --2- 172.21.15.131:0/513721182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d43d50 0x55b900cb8870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.216+0000 7f4e46728800 1 -- 172.21.15.131:0/513721182 >> 172.21.15.131:0/513721182 conn(0x55b900d3f2f0 msgr2=0x55b900e30750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e46728800 1 -- 172.21.15.131:0/513721182 shutdown_connections 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e46728800 1 -- 172.21.15.131:0/513721182 wait complete. 2024-04-24T01:42:58.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e46728800 1 Processor -- start 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e46728800 1 -- start start 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e46728800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900e3dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e46728800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b900d4aea0 con 0x55b900d481e0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e42460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900e3dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e42460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900e3dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36002/0 (socket says 172.21.15.131:36002) 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.217+0000 7f4e42460640 1 -- 172.21.15.131:0/508657645 learned_addr learned my addr 172.21.15.131:0/508657645 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.218+0000 7f4e42460640 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b900e3e280 con 0x55b900d481e0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.218+0000 7f4e42460640 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900e3dd40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55b900cb7ea0 tx=0x7f4e3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.218+0000 7f4d2ee05640 1 -- 172.21.15.131:0/508657645 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c0197b0 con 0x55b900d481e0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.218+0000 7f4d2ee05640 1 -- 172.21.15.131:0/508657645 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c019950 con 0x55b900d481e0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.218+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b900e3e510 con 0x55b900d481e0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.218+0000 7f4d2ee05640 1 -- 172.21.15.131:0/508657645 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c019c30 con 0x55b900d481e0 2024-04-24T01:42:58.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.218+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b900e411c0 con 0x55b900d481e0 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.219+0000 7f4d2ee05640 1 -- 172.21.15.131:0/508657645 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4e3c017040 con 0x55b900d481e0 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.219+0000 7f4d2ee05640 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d28036900 0x7f4d28038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.219+0000 7f4d2ee05640 1 -- 172.21.15.131:0/508657645 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4e3c015020 con 0x55b900d481e0 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d28036900 0x7f4d28038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e46728800 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e42f70 0x55b900e45360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e458a0 con 0x55b900e42f70 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e42c61640 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e42f70 0x55b900e45360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d28036900 0x7f4d28038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c054000 tx=0x7f4e2c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e42c61640 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e42f70 0x55b900e45360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e42c61640 1 -- 172.21.15.131:0/508657645 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e3400a4a0 con 0x55b900e42f70 2024-04-24T01:42:58.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.220+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e42530 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.221+0000 7f4e42c61640 1 -- 172.21.15.131:0/508657645 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e3400a4a0 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.221+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e476c0 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.221+0000 7f4e42c61640 1 -- 172.21.15.131:0/508657645 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4e3400a4a0 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.221+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e46a00 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.221+0000 7f4e42c61640 1 -- 172.21.15.131:0/508657645 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e3400a4a0 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.221+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e46e20 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e42c61640 1 -- 172.21.15.131:0/508657645 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e3400a4a0 con 0x55b900e42f70 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e46728800 1 Processor -- start 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e46728800 1 -- start start 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e46728800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e56510 0x55b900e56930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e46728800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b900c366b0 con 0x55b900e56510 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e41c5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e56510 0x55b900e56930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e41c5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e56510 0x55b900e56930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36014/0 (socket says 172.21.15.131:36014) 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.222+0000 7f4e41c5f640 1 -- 172.21.15.131:0/340842857 learned_addr learned my addr 172.21.15.131:0/340842857 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.223+0000 7f4e41c5f640 1 -- 172.21.15.131:0/340842857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b900e56e70 con 0x55b900e56510 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.223+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e56510 0x55b900e56930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c005930 tx=0x7f4e2c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.223+0000 7f4d27fff640 1 -- 172.21.15.131:0/340842857 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c057040 con 0x55b900e56510 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.223+0000 7f4d27fff640 1 -- 172.21.15.131:0/340842857 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c05d650 con 0x55b900e56510 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.223+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b900e578e0 con 0x55b900e56510 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.223+0000 7f4d27fff640 1 -- 172.21.15.131:0/340842857 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c05d950 con 0x55b900e56510 2024-04-24T01:42:58.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.223+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b900e57d80 con 0x55b900e56510 2024-04-24T01:42:58.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.224+0000 7f4d27fff640 1 -- 172.21.15.131:0/340842857 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4e2c067070 con 0x55b900e56510 2024-04-24T01:42:58.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.224+0000 7f4d27fff640 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d1c036950 0x7f4d1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.224+0000 7f4d27fff640 1 -- 172.21.15.131:0/340842857 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4e2c08f660 con 0x55b900e56510 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.224+0000 7f4e42c61640 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d1c036950 0x7f4d1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e46728800 1 Processor -- start 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e46728800 1 -- start start 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e42c61640 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d1c036950 0x7f4d1c038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55b900e45d10 tx=0x7f4e34005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e46728800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e63bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e46728800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b900e38fb0 con 0x55b900e63790 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e41c5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e63bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e41c5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e63bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36022/0 (socket says 172.21.15.131:36022) 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e41c5f640 1 -- 172.21.15.131:0/2154643426 learned_addr learned my addr 172.21.15.131:0/2154643426 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.225+0000 7f4e41c5f640 1 -- 172.21.15.131:0/2154643426 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b900e64180 con 0x55b900e63790 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/2154643426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e63bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c08d9b0 tx=0x7f4e2c067b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d35c70d96849b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4d25ffb640 1 -- 172.21.15.131:0/2154643426 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c071920 con 0x55b900e63790 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4d25ffb640 1 -- 172.21.15.131:0/2154643426 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c071400 con 0x55b900e63790 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4d25ffb640 1 -- 172.21.15.131:0/2154643426 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c071ac0 con 0x55b900e63790 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e46728800 1 -- 172.21.15.131:0/2154643426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 msgr2=0x55b900e63bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e46728800 1 --2- 172.21.15.131:0/2154643426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e63bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c08d9b0 tx=0x7f4e2c067b60 comp rx=0 tx=0).stop 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e46728800 1 -- 172.21.15.131:0/2154643426 shutdown_connections 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e46728800 1 --2- 172.21.15.131:0/2154643426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e63bb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e46728800 1 -- 172.21.15.131:0/2154643426 >> 172.21.15.131:0/2154643426 conn(0x55b900e5faf0 msgr2=0x55b900e5db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e46728800 1 -- 172.21.15.131:0/2154643426 shutdown_connections 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.226+0000 7f4e46728800 1 -- 172.21.15.131:0/2154643426 wait complete. 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e46728800 1 Processor -- start 2024-04-24T01:42:58.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e46728800 1 -- start start 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e46728800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e6add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e46728800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b900e648f0 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e41c5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e41c5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e6add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36024/0 (socket says 172.21.15.131:36024) 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 learned_addr learned my addr 172.21.15.131:0/1158923328 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.227+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b900e6b310 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.228+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e6add0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55b900e601f0 tx=0x7f4e2c08d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.228+0000 7f4d13fff640 1 -- 172.21.15.131:0/1158923328 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c08f280 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.228+0000 7f4d13fff640 1 -- 172.21.15.131:0/1158923328 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c08f420 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.228+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b900e6b5a0 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.228+0000 7f4d13fff640 1 -- 172.21.15.131:0/1158923328 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2c05ea50 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.228+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b900e6e250 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4d13fff640 1 -- 172.21.15.131:0/1158923328 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4e2c05ebf0 con 0x55b900e63790 2024-04-24T01:42:58.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4d13fff640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d0c036900 0x7f4d0c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4d13fff640 1 -- 172.21.15.131:0/1158923328 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4e2c09ac40 con 0x55b900e63790 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4e42c61640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d0c036900 0x7f4d0c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e76870 0x55b900e78d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e79480 con 0x55b900e76870 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.229+0000 7f4e42460640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e76870 0x55b900e78d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e42c61640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d0c036900 0x7f4d0c038dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55b900e45d40 tx=0x7f4e3401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e42460640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e76870 0x55b900e78d30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 20 realm 2024-04-24T01:42:58.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e79890 con 0x55b900e76870 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7a160 con 0x55b900e76870 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.230+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7a500 con 0x55b900e76870 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e46728800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7a960 con 0x55b900e76870 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e46728800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e46728800 20 searching for the correct realm 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b900e7c9b0 0x55b900e7eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b900e7c9b0 0x55b900e7eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.231+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b900e7c9b0 0x55b900e7eda0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.232+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.232+0000 7f4e41c5f640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4e2c099020 0x7f4e2c0568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.232+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e2c099020 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.232+0000 7f4e42c61640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4e2c099020 0x7f4e2c0568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.232+0000 7f4e42c61640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4e2c099020 0x7f4e2c0568d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.232+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3401f070 con 0x7f4e2c099020 2024-04-24T01:42:58.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.233+0000 7f4e42c61640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4e34031040 0x7f4e34032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.233+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.233+0000 7f4e42460640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4e34031040 0x7f4e34032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.233+0000 7f4e42460640 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4e34031040 0x7f4e34032940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.233+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x7f4e34031040 2024-04-24T01:42:58.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.233+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.234+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.234+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.234+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.234+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.234+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x7f4e34031040 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.234+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.234+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x7f4e34031040 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.235+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e2c099020 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.235+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3401f070 con 0x7f4e2c099020 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.235+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.235+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.235+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.235+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.235+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x7f4e34031040 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e2c099020 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4e3401f070 con 0x7f4e2c099020 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.236+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c02d070 con 0x7f4e34031040 2024-04-24T01:42:58.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.237+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.238+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4e3c02d070 con 0x55b900e76870 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.238+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.238+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.238+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.238+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.238+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.239+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.239+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e2c099020 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.239+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3401f070 con 0x7f4e2c099020 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.239+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.239+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.239+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e2c099020 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3401f070 con 0x7f4e2c099020 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.240+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e7c9b0 2024-04-24T01:42:58.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.241+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.241+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e34031040 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.241+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.241+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x55b900e76870 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.241+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.241+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f450 con 0x7f4e2c099020 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3401f070 con 0x7f4e2c099020 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:58.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7b3d0 con 0x55b900e76870 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7b010 con 0x55b900e76870 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7bd30 con 0x55b900e76870 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 zone default found 2024-04-24T01:42:58.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 4 Realm: () 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 zonegroup default 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.242+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7f8b0 con 0x7f4e34031040 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e81740 con 0x55b900e7c9b0 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e81ae0 con 0x55b900e7c9b0 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 20 started sync module instance, tier type = 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.243+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e2c099020 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.245+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.245+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253072519072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e82330 con 0x7f4e2c099020 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.245+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e82b80 con 0x55b900e76870 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.246+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94253072519072] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.246+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.246+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94253072522880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e82790 con 0x55b900e76870 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.246+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e832a0 con 0x55b900e7c9b0 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.247+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94253072522880] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.247+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.248+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94253072526672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e83690 con 0x55b900e7c9b0 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.248+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e84090 con 0x7f4e2c099020 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.249+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94253072526672] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.249+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.249+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94253072523936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e84480 con 0x7f4e2c099020 2024-04-24T01:42:58.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.249+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e84ee0 con 0x55b900e76870 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.250+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.250+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94253072523936] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.250+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94253072533952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e84ee0 con 0x55b900e76870 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.250+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e83ba0 con 0x7f4e34031040 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.251+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.251+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253072537936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e84ee0 con 0x7f4e34031040 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.251+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e86880 con 0x7f4e34031040 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.251+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94253072533952] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.252+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94253072537936] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.253+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.253+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94253072538992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e86390 con 0x7f4e34031040 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.253+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e86d50 con 0x7f4e34031040 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94253072538992] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94253072536224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e86d50 con 0x7f4e34031040 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 20 add_watcher() i=0 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 20 add_watcher() i=1 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 20 add_watcher() i=2 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 20 add_watcher() i=3 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 20 add_watcher() i=4 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 20 add_watcher() i=5 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.254+0000 7f4e46728800 20 add_watcher() i=6 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.255+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94253072536224] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.255+0000 7f4e46728800 20 add_watcher() i=7 2024-04-24T01:42:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.255+0000 7f4e46728800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.255+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b900e8a180 con 0x55b900e76870 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.255+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.256+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94253072542320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e87670 con 0x55b900e76870 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94253072542320] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4cf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4e46728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4e46728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4e46728800 5 note: GC not initialized 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4c737fe640 20 reqs_thread_entry: start 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4e46728800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4e46728800 20 Filter name: none 2024-04-24T01:42:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4c717fa640 20 reqs_thread_entry: start 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.257+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900ebcc40 con 0x55b900e7c9b0 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900ebcc40 con 0x55b900e7c9b0 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900ebcc40 con 0x55b900e76870 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7b010 con 0x55b900e76870 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.258+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7b010 con 0x7f4e2c099020 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e76870 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.259+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e2c099020 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.260+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.260+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.260+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.260+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e76870 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.260+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.260+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.261+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.261+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.261+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.261+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.261+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.261+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.262+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.262+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.262+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.262+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.262+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.262+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e2c099020 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e76870 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e76870 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.263+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e2c099020 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e76870 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.264+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.265+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.265+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.265+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.265+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e2c099020 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.265+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.265+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e34031040 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.266+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.266+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e76870 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.266+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.266+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x55b900e7c9b0 2024-04-24T01:42:58.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.266+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.266+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80b80 con 0x7f4e2c099020 2024-04-24T01:42:58.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.266+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.267+0000 7f4cf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.267+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94253072542320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e7b010 con 0x55b900e76870 2024-04-24T01:42:58.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.268+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94253072542320] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.268+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94253072519072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900ebcc00 con 0x7f4e2c099020 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.269+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94253072519072] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.269+0000 7f4e46728800 20 remove_watcher() i=0 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.269+0000 7f4e46728800 2 removed watcher, disabling cache 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.269+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94253072522880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80fa0 con 0x55b900e76870 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.270+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94253072522880] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.270+0000 7f4e46728800 20 remove_watcher() i=1 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.270+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94253072526672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e80fa0 con 0x55b900e7c9b0 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.272+0000 7f4e41c5f640 1 -- 172.21.15.131:0/1158923328 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94253072526672] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2c0a0070 con 0x55b900e7c9b0 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.272+0000 7f4e46728800 20 remove_watcher() i=2 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.272+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94253072523936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e82d50 con 0x7f4e2c099020 2024-04-24T01:42:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.273+0000 7f4e42c61640 1 -- 172.21.15.131:0/1158923328 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94253072523936] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e34040040 con 0x7f4e2c099020 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.273+0000 7f4e46728800 20 remove_watcher() i=3 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.273+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94253072533952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900ebcc00 con 0x55b900e76870 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.274+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94253072533952] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x55b900e76870 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.274+0000 7f4e46728800 20 remove_watcher() i=4 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.274+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94253072537936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900ebcc00 con 0x7f4e34031040 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.275+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94253072537936] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.275+0000 7f4e46728800 20 remove_watcher() i=5 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.275+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94253072538992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900e85950 con 0x7f4e34031040 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.276+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94253072538992] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.276+0000 7f4e46728800 20 remove_watcher() i=6 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.276+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94253072536224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b900ebcc00 con 0x7f4e34031040 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94253072536224] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e3c055060 con 0x7f4e34031040 2024-04-24T01:42:58.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 20 remove_watcher() i=7 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4e34031040 msgr2=0x7f4e34032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4e34031040 0x7f4e34032940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e76870 msgr2=0x55b900e78d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e76870 0x55b900e78d30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4e2c099020 msgr2=0x7f4e2c0568d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4e2c099020 0x7f4e2c0568d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b900e7c9b0 msgr2=0x55b900e7eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b900e7c9b0 0x55b900e7eda0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d0c036900 msgr2=0x7f4d0c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d0c036900 0x7f4d0c038dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55b900e45d40 tx=0x7f4e3401f000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 msgr2=0x55b900e6add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e6add0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55b900e601f0 tx=0x7f4e2c08d940 comp rx=0 tx=0).stop 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e42460640 1 -- 172.21.15.131:0/1158923328 reap_dead start 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 shutdown_connections 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 --2- 172.21.15.131:0/1158923328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e63790 0x55b900e6add0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 >> 172.21.15.131:0/1158923328 conn(0x55b900e5faf0 msgr2=0x55b900e5d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 shutdown_connections 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.277+0000 7f4e46728800 1 -- 172.21.15.131:0/1158923328 wait complete. 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d1c036950 msgr2=0x7f4d1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d1c036950 0x7f4d1c038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55b900e45d10 tx=0x7f4e34005840 comp rx=0 tx=0).stop 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e56510 msgr2=0x55b900e56930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e56510 0x55b900e56930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c005930 tx=0x7f4e2c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 shutdown_connections 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d1c036950 0x7f4d1c038e10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/340842857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900e56510 0x55b900e56930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 >> 172.21.15.131:0/340842857 conn(0x55b900e4a5b0 msgr2=0x55b900e4a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 shutdown_connections 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/340842857 wait complete. 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e42f70 msgr2=0x55b900e45360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e42f70 0x55b900e45360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d28036900 msgr2=0x7f4d28038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d28036900 0x7f4d28038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c054000 tx=0x7f4e2c04e000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 msgr2=0x55b900e3dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900e3dd40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55b900cb7ea0 tx=0x7f4e3c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 shutdown_connections 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b900e42f70 0x55b900e45360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4d28036900 0x7f4d28038dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 --2- 172.21.15.131:0/508657645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b900d481e0 0x55b900e3dd40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 >> 172.21.15.131:0/508657645 conn(0x55b900d3f2f0 msgr2=0x55b900e2ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 shutdown_connections 2024-04-24T01:42:58.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.278+0000 7f4e46728800 1 -- 172.21.15.131:0/508657645 wait complete. 2024-04-24T01:42:58.298 INFO:teuthology.orchestra.run.smithi131.stdout:[] 2024-04-24T01:42:58.298 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:42:58.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-24T01:42:58.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-24T01:42:58.299 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-24T01:42:58.341 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:58.342 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12d919800 1 Processor -- start 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12d919800 1 -- start start 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12d919800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5577f08d2330 0x5577f08d4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12d919800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577f078cd40 con 0x5577f08cdf90 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12d919800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5577f075f4d0 con 0x5577f08d2330 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12ac17640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5577f08d2330 0x5577f08d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12ac17640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5577f08d2330 0x5577f08d4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36030/0 (socket says 172.21.15.131:36030) 2024-04-24T01:42:58.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12b418640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5577f08cdf90 0x5577f08ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45664/0 (socket says 172.21.15.131:45664) 2024-04-24T01:42:58.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12ac17640 1 -- 172.21.15.131:0/43990203 learned_addr learned my addr 172.21.15.131:0/43990203 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12ac17640 1 -- 172.21.15.131:0/43990203 >> v1:172.21.15.107:6789/0 conn(0x5577f08cdf90 legacy=0x5577f08ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.342+0000 7ff12ac17640 1 -- 172.21.15.131:0/43990203 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f078b590 con 0x5577f08d2330 2024-04-24T01:42:58.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.344+0000 7ff12ac17640 1 --2- 172.21.15.131:0/43990203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08d2330 0x5577f08d4720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff12000a520 tx=0x7ff12001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a36856f7a0c03dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.344+0000 7ff12a416640 1 -- 172.21.15.131:0/43990203 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff120057070 con 0x5577f08d2330 2024-04-24T01:42:58.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12a416640 1 -- 172.21.15.131:0/43990203 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff120052570 con 0x5577f08d2330 2024-04-24T01:42:58.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12a416640 1 -- 172.21.15.131:0/43990203 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12004ae60 con 0x5577f08d2330 2024-04-24T01:42:58.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12d919800 1 -- 172.21.15.131:0/43990203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08d2330 msgr2=0x5577f08d4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12d919800 1 --2- 172.21.15.131:0/43990203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08d2330 0x5577f08d4720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff12000a520 tx=0x7ff12001d010 comp rx=0 tx=0).stop 2024-04-24T01:42:58.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12d919800 1 -- 172.21.15.131:0/43990203 shutdown_connections 2024-04-24T01:42:58.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12d919800 1 --2- 172.21.15.131:0/43990203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08d2330 0x5577f08d4720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12d919800 1 -- 172.21.15.131:0/43990203 >> 172.21.15.131:0/43990203 conn(0x5577f08c9530 msgr2=0x5577f08cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12d919800 1 -- 172.21.15.131:0/43990203 shutdown_connections 2024-04-24T01:42:58.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.345+0000 7ff12d919800 1 -- 172.21.15.131:0/43990203 wait complete. 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.356+0000 7ff12d919800 1 Processor -- start 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.357+0000 7ff12d919800 1 -- start start 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.357+0000 7ff12d919800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.357+0000 7ff12d919800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5577f08193c0 con 0x5577f08cdf90 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.357+0000 7ff12b418640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.357+0000 7ff12b418640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36044/0 (socket says 172.21.15.131:36044) 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.357+0000 7ff12b418640 1 -- 172.21.15.131:0/4198731471 learned_addr learned my addr 172.21.15.131:0/4198731471 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.357+0000 7ff12b418640 1 -- 172.21.15.131:0/4198731471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f09bf6c0 con 0x5577f08cdf90 2024-04-24T01:42:58.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff12b418640 1 --2- 172.21.15.131:0/4198731471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09bf0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00b230 tx=0x7ff11c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472588a845c8c823 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff01960a640 1 -- 172.21.15.131:0/4198731471 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff11c00e5c0 con 0x5577f08cdf90 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff01960a640 1 -- 172.21.15.131:0/4198731471 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11c006070 con 0x5577f08cdf90 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff01960a640 1 -- 172.21.15.131:0/4198731471 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff11c00e890 con 0x5577f08cdf90 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff12d919800 1 -- 172.21.15.131:0/4198731471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 msgr2=0x5577f09bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff12d919800 1 --2- 172.21.15.131:0/4198731471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09bf0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00b230 tx=0x7ff11c00b6f0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff12d919800 1 -- 172.21.15.131:0/4198731471 shutdown_connections 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff12d919800 1 --2- 172.21.15.131:0/4198731471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09bf0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff12d919800 1 -- 172.21.15.131:0/4198731471 >> 172.21.15.131:0/4198731471 conn(0x5577f08c9530 msgr2=0x5577f09baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.358+0000 7ff12d919800 1 -- 172.21.15.131:0/4198731471 shutdown_connections 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12d919800 1 -- 172.21.15.131:0/4198731471 wait complete. 2024-04-24T01:42:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12d919800 1 Processor -- start 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12d919800 1 -- start start 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12d919800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12d919800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5577f08d4ff0 con 0x5577f08cdf90 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12b418640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12b418640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36054/0 (socket says 172.21.15.131:36054) 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12b418640 1 -- 172.21.15.131:0/1859067274 learned_addr learned my addr 172.21.15.131:0/1859067274 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.359+0000 7ff12b418640 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f09c7230 con 0x5577f08cdf90 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.360+0000 7ff12b418640 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09c6cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff11c000c00 tx=0x7ff11c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.360+0000 7ff017e07640 1 -- 172.21.15.131:0/1859067274 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff11c00f8d0 con 0x5577f08cdf90 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.360+0000 7ff017e07640 1 -- 172.21.15.131:0/1859067274 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11c00fa90 con 0x5577f08cdf90 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.360+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577f09c74c0 con 0x5577f08cdf90 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.360+0000 7ff017e07640 1 -- 172.21.15.131:0/1859067274 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff11c00fdb0 con 0x5577f08cdf90 2024-04-24T01:42:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.360+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577f09ca120 con 0x5577f08cdf90 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff017e07640 1 -- 172.21.15.131:0/1859067274 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff11c017070 con 0x5577f08cdf90 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff017e07640 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff010036900 0x7ff010038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff017e07640 1 -- 172.21.15.131:0/1859067274 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff11c015020 con 0x5577f08cdf90 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff12ac17640 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff010036900 0x7ff010038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff12d919800 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f08d2330 0x5577f09cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f09ce460 con 0x5577f08d2330 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff12bc19640 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f08d2330 0x5577f09cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.361+0000 7ff12ac17640 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff010036900 0x7ff010038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff120054000 tx=0x7ff12004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.362+0000 7ff12bc19640 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f08d2330 0x5577f09cdee0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.362+0000 7ff12bc19640 1 -- 172.21.15.131:0/1859067274 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff12400a4a0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.362+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f09cb4b0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.362+0000 7ff12bc19640 1 -- 172.21.15.131:0/1859067274 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff12400a4a0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.362+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f09d02a0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.362+0000 7ff12bc19640 1 -- 172.21.15.131:0/1859067274 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff12400a4a0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.362+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f09cf5e0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.363+0000 7ff12bc19640 1 -- 172.21.15.131:0/1859067274 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff12400a4a0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.363+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f09cfa00 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.363+0000 7ff12bc19640 1 -- 172.21.15.131:0/1859067274 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff12400a4a0 con 0x5577f08d2330 2024-04-24T01:42:58.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.363+0000 7ff12d919800 1 Processor -- start 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.363+0000 7ff12d919800 1 -- start start 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.363+0000 7ff12d919800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09df0b0 0x5577f09df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.363+0000 7ff12d919800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5577f07bf6b0 con 0x5577f09df0b0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff12ac17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09df0b0 0x5577f09df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff12ac17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09df0b0 0x5577f09df4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36064/0 (socket says 172.21.15.131:36064) 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff12ac17640 1 -- 172.21.15.131:0/4288436581 learned_addr learned my addr 172.21.15.131:0/4288436581 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff12ac17640 1 -- 172.21.15.131:0/4288436581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f09dfa10 con 0x5577f09df0b0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff12ac17640 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09df0b0 0x5577f09df4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff120005930 tx=0x7ff120002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff015602640 1 -- 172.21.15.131:0/4288436581 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff120057040 con 0x5577f09df0b0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff015602640 1 -- 172.21.15.131:0/4288436581 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12005d650 con 0x5577f09df0b0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577f09e0480 con 0x5577f09df0b0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff015602640 1 -- 172.21.15.131:0/4288436581 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12005d950 con 0x5577f09df0b0 2024-04-24T01:42:58.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.364+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577f09e0920 con 0x5577f09df0b0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.365+0000 7ff015602640 1 -- 172.21.15.131:0/4288436581 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff120067070 con 0x5577f09df0b0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.365+0000 7ff015602640 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff004036900 0x7ff004038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.365+0000 7ff015602640 1 -- 172.21.15.131:0/4288436581 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff12008f6f0 con 0x5577f09df0b0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.365+0000 7ff12bc19640 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff004036900 0x7ff004038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12d919800 1 Processor -- start 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12bc19640 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff004036900 0x7ff004038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5577f09cf980 tx=0x7ff124005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12d919800 1 -- start start 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12d919800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12d919800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5577f09bfa40 con 0x5577f09ec2c0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12ac17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12ac17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09ec6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36078/0 (socket says 172.21.15.131:36078) 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12ac17640 1 -- 172.21.15.131:0/976308632 learned_addr learned my addr 172.21.15.131:0/976308632 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.366+0000 7ff12ac17640 1 -- 172.21.15.131:0/976308632 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f09eccb0 con 0x5577f09ec2c0 2024-04-24T01:42:58.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12ac17640 1 --2- 172.21.15.131:0/976308632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09ec6e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff12008da40 tx=0x7ff12005df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43746b62129b7c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff00effd640 1 -- 172.21.15.131:0/976308632 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff120082070 con 0x5577f09ec2c0 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff00effd640 1 -- 172.21.15.131:0/976308632 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12008de50 con 0x5577f09ec2c0 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff00effd640 1 -- 172.21.15.131:0/976308632 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12008b070 con 0x5577f09ec2c0 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 -- 172.21.15.131:0/976308632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 msgr2=0x5577f09ec6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 --2- 172.21.15.131:0/976308632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09ec6e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff12008da40 tx=0x7ff12005df50 comp rx=0 tx=0).stop 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 -- 172.21.15.131:0/976308632 shutdown_connections 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 --2- 172.21.15.131:0/976308632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09ec6e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 -- 172.21.15.131:0/976308632 >> 172.21.15.131:0/976308632 conn(0x5577f09e8620 msgr2=0x5577f09e6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 -- 172.21.15.131:0/976308632 shutdown_connections 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 -- 172.21.15.131:0/976308632 wait complete. 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 Processor -- start 2024-04-24T01:42:58.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.367+0000 7ff12d919800 1 -- start start 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12d919800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12d919800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5577f09ed420 con 0x5577f09ec2c0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12ac17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12ac17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09f3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36084/0 (socket says 172.21.15.131:36084) 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 learned_addr learned my addr 172.21.15.131:0/3529827964 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f09f3e70 con 0x5577f09ec2c0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12ac17640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09f3930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff120080040 tx=0x7ff12008d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff00d7fa640 1 -- 172.21.15.131:0/3529827964 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff120093070 con 0x5577f09ec2c0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577f09f4100 con 0x5577f09ec2c0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.368+0000 7ff00d7fa640 1 -- 172.21.15.131:0/3529827964 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff120083040 con 0x5577f09ec2c0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.369+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577f09f6db0 con 0x5577f09ec2c0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.369+0000 7ff00d7fa640 1 -- 172.21.15.131:0/3529827964 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12009d060 con 0x5577f09ec2c0 2024-04-24T01:42:58.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.369+0000 7ff00d7fa640 1 -- 172.21.15.131:0/3529827964 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff120096070 con 0x5577f09ec2c0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.369+0000 7ff00d7fa640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7feff40368b0 0x7feff4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.369+0000 7ff00d7fa640 1 -- 172.21.15.131:0/3529827964 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff12006b120 con 0x5577f09ec2c0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.369+0000 7ff12bc19640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7feff40368b0 0x7feff4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.370+0000 7ff12bc19640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7feff40368b0 0x7feff4038d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5577f09cf100 tx=0x7ff12401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.370+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.370+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f09ff480 0x5577f0a01940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.370+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a02090 con 0x5577f09ff480 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.370+0000 7ff12b418640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f09ff480 0x5577f0a01940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.370+0000 7ff12b418640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f09ff480 0x5577f0a01940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 realm 2024-04-24T01:42:58.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a024a0 con 0x5577f09ff480 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a02d70 con 0x5577f09ff480 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a03110 con 0x5577f09ff480 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.371+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a03960 con 0x5577f09ff480 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12d919800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12d919800 20 searching for the correct realm 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5577f0a056d0 0x5577f0a07ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12ac17640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5577f0a056d0 0x5577f0a07ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12ac17640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5577f0a056d0 0x5577f0a07ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12ac17640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff120098070 0x7ff12005c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff120098070 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.372+0000 7ff12bc19640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff120098070 0x7ff12005c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.373+0000 7ff12bc19640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff120098070 0x7ff12005c770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.373+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12401f070 con 0x7ff120098070 2024-04-24T01:42:58.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.373+0000 7ff12bc19640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff124031040 0x7ff124032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.373+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.373+0000 7ff12b418640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff124031040 0x7ff124032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.374+0000 7ff12b418640 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff124031040 0x7ff124032940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.374+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.374+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.374+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.374+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.374+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.374+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff120098070 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12401f070 con 0x7ff120098070 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.375+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff120098070 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff12401f070 con 0x7ff120098070 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.376+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.377+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.378+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff120098070 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12401f070 con 0x7ff120098070 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.379+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff120098070 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12401f070 con 0x7ff120098070 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f0a056d0 2024-04-24T01:42:58.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.380+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff124031040 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff11c02e070 con 0x7ff124031040 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x5577f09ff480 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a080f0 con 0x7ff120098070 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12401f070 con 0x7ff120098070 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:58.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a042e0 con 0x5577f09ff480 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff11c02e070 con 0x5577f09ff480 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.381+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a04b80 con 0x5577f09ff480 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a08570 con 0x5577f09ff480 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 zone default found 2024-04-24T01:42:58.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 4 Realm: () 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 zonegroup default 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a047e0 con 0x7ff124031040 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.382+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0a450 con 0x5577f0a056d0 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0a7f0 con 0x5577f0a056d0 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12d919800 20 started sync module instance, tier type = 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12d919800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.383+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a098f0 con 0x7ff120098070 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.384+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.384+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93973626526944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a09550 con 0x7ff120098070 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.384+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0b640 con 0x5577f09ff480 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.385+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93973626526944] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.385+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.385+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93973626530944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a09550 con 0x5577f09ff480 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.385+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0c0d0 con 0x5577f0a056d0 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.387+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.387+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93973626530944] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.387+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93973626534816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0c4c0 con 0x5577f0a056d0 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.387+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0cec0 con 0x7ff120098070 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.388+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.388+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93973626538448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0d760 con 0x7ff120098070 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.388+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0e260 con 0x5577f09ff480 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.388+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93973626534816] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.389+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.389+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93973626543440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0e220 con 0x5577f09ff480 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.389+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0ecc0 con 0x7ff124031040 2024-04-24T01:42:58.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.389+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93973626538448] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.390+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.390+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93973626546160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0ecc0 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.390+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0f6d0 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.390+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93973626543440] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.391+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93973626546160] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.391+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.391+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93973626540720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0f220 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.391+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0fbe0 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93973626550064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a10000 con 0x7ff124031040 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 20 add_watcher() i=0 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 20 add_watcher() i=1 2024-04-24T01:42:58.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 20 add_watcher() i=2 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 20 add_watcher() i=3 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 20 add_watcher() i=4 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 20 add_watcher() i=5 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93973626540720] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.392+0000 7ff12d919800 20 add_watcher() i=6 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.393+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93973626550064] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.393+0000 7ff12d919800 20 add_watcher() i=7 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.393+0000 7ff12d919800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.393+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a10000 con 0x5577f09ff480 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.394+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.394+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93973626551120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0ff70 con 0x5577f09ff480 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.395+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93973626551120] v32'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.395+0000 7fefe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.395+0000 7ff12d919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:58.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.395+0000 7ff12d919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:58.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.395+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1b980 con 0x5577f09ff480 2024-04-24T01:42:58.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.397+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'42 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.397+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1c050 con 0x7ff124031040 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.398+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.398+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1c050 con 0x5577f0a056d0 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.399+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.399+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1c8a0 con 0x5577f09ff480 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.400+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.400+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1c8a0 con 0x7ff120098070 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.401+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.401+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a19700 con 0x5577f0a056d0 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.402+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.402+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1d400 con 0x5577f09ff480 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.403+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.403+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1d400 con 0x7ff124031040 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.404+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.404+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1d400 con 0x7ff120098070 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.405+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.405+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1d8b0 con 0x5577f0a056d0 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.407+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.407+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1dc50 con 0x7ff120098070 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.408+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.408+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff124031040 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.409+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.409+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff120098070 2024-04-24T01:42:58.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.410+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.410+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff124031040 2024-04-24T01:42:58.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.411+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.411+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f09ff480 2024-04-24T01:42:58.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.412+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.412+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.413+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.413+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff120098070 2024-04-24T01:42:58.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.414+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.414+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.415+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.415+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f09ff480 2024-04-24T01:42:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.417+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.417+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f09ff480 2024-04-24T01:42:58.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.418+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'35 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.418+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.419+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.419+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff120098070 2024-04-24T01:42:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.420+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.420+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.421+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.421+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.422+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.422+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.423+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.423+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.425+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.426+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff124031040 2024-04-24T01:42:58.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.427+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.427+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.428+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.428+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff124031040 2024-04-24T01:42:58.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.429+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.429+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x5577f0a056d0 2024-04-24T01:42:58.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.430+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.430+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff124031040 2024-04-24T01:42:58.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.431+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.431+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a1e100 con 0x7ff120098070 2024-04-24T01:42:58.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.432+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7fefe0fe1640 20 reqs_thread_entry: start 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 20 Filter name: none 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7fef5a7fc640 20 reqs_thread_entry: start 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a49120 con 0x7ff120098070 2024-04-24T01:42:58.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-24T01:42:58.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.433+0000 7ff12d919800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:42:58.435 INFO:teuthology.orchestra.run.smithi131.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:42:58.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.434+0000 7fefe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.434+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93973626551120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a18410 con 0x5577f09ff480 2024-04-24T01:42:58.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.435+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93973626551120] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.435+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93973626526944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0fb50 con 0x7ff120098070 2024-04-24T01:42:58.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.438+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93973626526944] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.438+0000 7ff12d919800 20 remove_watcher() i=0 2024-04-24T01:42:58.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.438+0000 7ff12d919800 2 removed watcher, disabling cache 2024-04-24T01:42:58.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.438+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93973626530944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0fb50 con 0x5577f09ff480 2024-04-24T01:42:58.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.439+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93973626530944] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.439+0000 7ff12d919800 20 remove_watcher() i=1 2024-04-24T01:42:58.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.439+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93973626534816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0fb50 con 0x5577f0a056d0 2024-04-24T01:42:58.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.440+0000 7ff12ac17640 1 -- 172.21.15.131:0/3529827964 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93973626534816] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff120095030 con 0x5577f0a056d0 2024-04-24T01:42:58.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.440+0000 7ff12d919800 20 remove_watcher() i=2 2024-04-24T01:42:58.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.440+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93973626538448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0bba0 con 0x7ff120098070 2024-04-24T01:42:58.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.441+0000 7ff12bc19640 1 -- 172.21.15.131:0/3529827964 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93973626538448] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff124040040 con 0x7ff120098070 2024-04-24T01:42:58.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.441+0000 7ff12d919800 20 remove_watcher() i=3 2024-04-24T01:42:58.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.441+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93973626543440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0fb50 con 0x5577f09ff480 2024-04-24T01:42:58.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.443+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93973626543440] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x5577f09ff480 2024-04-24T01:42:58.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.443+0000 7ff12d919800 20 remove_watcher() i=4 2024-04-24T01:42:58.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.443+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93973626546160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0bba0 con 0x7ff124031040 2024-04-24T01:42:58.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.444+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93973626546160] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.444+0000 7ff12d919800 20 remove_watcher() i=5 2024-04-24T01:42:58.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.444+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93973626540720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0dd50 con 0x7ff124031040 2024-04-24T01:42:58.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.445+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93973626540720] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.445+0000 7ff12d919800 20 remove_watcher() i=6 2024-04-24T01:42:58.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.445+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93973626550064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5577f0a0dd50 con 0x7ff124031040 2024-04-24T01:42:58.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93973626550064] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff11c05f040 con 0x7ff124031040 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 20 remove_watcher() i=7 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff124031040 msgr2=0x7ff124032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff124031040 0x7ff124032940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f09ff480 msgr2=0x5577f0a01940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f09ff480 0x5577f0a01940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff120098070 msgr2=0x7ff12005c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff120098070 0x7ff12005c770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5577f0a056d0 msgr2=0x5577f0a07ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5577f0a056d0 0x5577f0a07ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7feff40368b0 msgr2=0x7feff4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7feff40368b0 0x7feff4038d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5577f09cf100 tx=0x7ff12401f000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12b418640 1 -- 172.21.15.131:0/3529827964 reap_dead start 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 msgr2=0x5577f09f3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09f3930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff120080040 tx=0x7ff12008d9d0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 shutdown_connections 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 --2- 172.21.15.131:0/3529827964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09ec2c0 0x5577f09f3930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 >> 172.21.15.131:0/3529827964 conn(0x5577f09e8620 msgr2=0x5577f09e5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 shutdown_connections 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.446+0000 7ff12d919800 1 -- 172.21.15.131:0/3529827964 wait complete. 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff004036900 msgr2=0x7ff004038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff004036900 0x7ff004038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5577f09cf980 tx=0x7ff124005840 comp rx=0 tx=0).stop 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09df0b0 msgr2=0x5577f09df4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09df0b0 0x5577f09df4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff120005930 tx=0x7ff120002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 shutdown_connections 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff004036900 0x7ff004038dc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/4288436581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f09df0b0 0x5577f09df4d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 >> 172.21.15.131:0/4288436581 conn(0x5577f09d3150 msgr2=0x5577f09d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 shutdown_connections 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/4288436581 wait complete. 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f08d2330 msgr2=0x5577f09cdee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f08d2330 0x5577f09cdee0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff010036900 msgr2=0x7ff010038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff010036900 0x7ff010038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff120054000 tx=0x7ff12004e000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 msgr2=0x5577f09c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09c6cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff11c000c00 tx=0x7ff11c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 shutdown_connections 2024-04-24T01:42:58.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5577f08d2330 0x5577f09cdee0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff010036900 0x7ff010038dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 --2- 172.21.15.131:0/1859067274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5577f08cdf90 0x5577f09c6cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 >> 172.21.15.131:0/1859067274 conn(0x5577f08c9530 msgr2=0x5577f09b9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 shutdown_connections 2024-04-24T01:42:58.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.447+0000 7ff12d919800 1 -- 172.21.15.131:0/1859067274 wait complete. 2024-04-24T01:42:58.455 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:42:58.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-24T01:42:58.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-24T01:42:58.456 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-24T01:42:58.541 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:58.541 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:58.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.541+0000 7f1609213800 1 Processor -- start 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.541+0000 7f1609213800 1 -- start start 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.541+0000 7f1609213800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560c08c76970 0x560c08c78d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.541+0000 7f1609213800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c08b34d40 con 0x560c08c792a0 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.541+0000 7f1609213800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x560c08b074d0 con 0x560c08c76970 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.542+0000 7f1604821640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560c08c76970 0x560c08c78d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.542+0000 7f1604821640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560c08c76970 0x560c08c78d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36086/0 (socket says 172.21.15.131:36086) 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.542+0000 7f15fffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x560c08c792a0 0x560c08c7b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45670/0 (socket says 172.21.15.131:45670) 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.542+0000 7f1604821640 1 -- 172.21.15.131:0/851081434 learned_addr learned my addr 172.21.15.131:0/851081434 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.542+0000 7f1604821640 1 -- 172.21.15.131:0/851081434 >> v1:172.21.15.107:6789/0 conn(0x560c08c792a0 legacy=0x560c08c7b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.542+0000 7f1604821640 1 -- 172.21.15.131:0/851081434 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c08b33590 con 0x560c08c76970 2024-04-24T01:42:58.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.544+0000 7f1604821640 1 --2- 172.21.15.131:0/851081434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08c78d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15f800a520 tx=0x7f15f801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835c2bf62325e965 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.544+0000 7f15ff7fe640 1 -- 172.21.15.131:0/851081434 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f8057070 con 0x560c08c76970 2024-04-24T01:42:58.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.544+0000 7f15ff7fe640 1 -- 172.21.15.131:0/851081434 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8052570 con 0x560c08c76970 2024-04-24T01:42:58.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.544+0000 7f15ff7fe640 1 -- 172.21.15.131:0/851081434 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f804ae60 con 0x560c08c76970 2024-04-24T01:42:58.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.545+0000 7f1609213800 1 -- 172.21.15.131:0/851081434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 msgr2=0x560c08c78d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.545+0000 7f1609213800 1 --2- 172.21.15.131:0/851081434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08c78d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15f800a520 tx=0x7f15f801d010 comp rx=0 tx=0).stop 2024-04-24T01:42:58.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.545+0000 7f1609213800 1 -- 172.21.15.131:0/851081434 shutdown_connections 2024-04-24T01:42:58.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.545+0000 7f1609213800 1 --2- 172.21.15.131:0/851081434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08c78d60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.545+0000 7f1609213800 1 -- 172.21.15.131:0/851081434 >> 172.21.15.131:0/851081434 conn(0x560c08c70320 msgr2=0x560c08c72740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.545+0000 7f1609213800 1 -- 172.21.15.131:0/851081434 shutdown_connections 2024-04-24T01:42:58.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.545+0000 7f1609213800 1 -- 172.21.15.131:0/851081434 wait complete. 2024-04-24T01:42:58.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.556+0000 7f1609213800 1 Processor -- start 2024-04-24T01:42:58.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.556+0000 7f1609213800 1 -- start start 2024-04-24T01:42:58.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.557+0000 7f1609213800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08d67110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.557+0000 7f1609213800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560c08bc13c0 con 0x560c08c76970 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.557+0000 7f1604821640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08d67110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.557+0000 7f1604821640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08d67110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36102/0 (socket says 172.21.15.131:36102) 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.557+0000 7f1604821640 1 -- 172.21.15.131:0/706332551 learned_addr learned my addr 172.21.15.131:0/706332551 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.557+0000 7f1604821640 1 -- 172.21.15.131:0/706332551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c08d676e0 con 0x560c08c76970 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.557+0000 7f1604821640 1 --2- 172.21.15.131:0/706332551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08d67110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15f8055040 tx=0x7f15f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9db8f55b3ef00 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f14f2e05640 1 -- 172.21.15.131:0/706332551 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f8057040 con 0x560c08c76970 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f14f2e05640 1 -- 172.21.15.131:0/706332551 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8052720 con 0x560c08c76970 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f14f2e05640 1 -- 172.21.15.131:0/706332551 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f8052a40 con 0x560c08c76970 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f1609213800 1 -- 172.21.15.131:0/706332551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 msgr2=0x560c08d67110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f1609213800 1 --2- 172.21.15.131:0/706332551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08d67110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15f8055040 tx=0x7f15f804c000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f1609213800 1 -- 172.21.15.131:0/706332551 shutdown_connections 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f1609213800 1 --2- 172.21.15.131:0/706332551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c76970 0x560c08d67110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f1609213800 1 -- 172.21.15.131:0/706332551 >> 172.21.15.131:0/706332551 conn(0x560c08c70320 msgr2=0x560c08d62a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f1609213800 1 -- 172.21.15.131:0/706332551 shutdown_connections 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.558+0000 7f1609213800 1 -- 172.21.15.131:0/706332551 wait complete. 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1609213800 1 Processor -- start 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1609213800 1 -- start start 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1609213800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c792a0 0x560c08d6eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1609213800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560c08c7f0c0 con 0x560c08c792a0 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1604821640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c792a0 0x560c08d6eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1604821640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c792a0 0x560c08d6eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36110/0 (socket says 172.21.15.131:36110) 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1604821640 1 -- 172.21.15.131:0/947287054 learned_addr learned my addr 172.21.15.131:0/947287054 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1604821640 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c08d6f2e0 con 0x560c08c792a0 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f1604821640 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c792a0 0x560c08d6eda0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15f8052540 tx=0x7f15f8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.559+0000 7f14f1602640 1 -- 172.21.15.131:0/947287054 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f8073070 con 0x560c08c792a0 2024-04-24T01:42:58.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.560+0000 7f14f1602640 1 -- 172.21.15.131:0/947287054 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8052e00 con 0x560c08c792a0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.560+0000 7f14f1602640 1 -- 172.21.15.131:0/947287054 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f8057070 con 0x560c08c792a0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.560+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c08d6f570 con 0x560c08c792a0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.560+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c08d72220 con 0x560c08c792a0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.560+0000 7f14f1602640 1 -- 172.21.15.131:0/947287054 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f15f8076070 con 0x560c08c792a0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.560+0000 7f14f1602640 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14ec036950 0x7f14ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f14f1602640 1 -- 172.21.15.131:0/947287054 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f15f808da30 con 0x560c08c792a0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f15fffff640 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14ec036950 0x7f14ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f1609213800 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08d73fd0 0x560c08d763c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08d76900 con 0x560c08d73fd0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f1605022640 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08d73fd0 0x560c08d763c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f15fffff640 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14ec036950 0x7f14ec038e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15f0001e40 tx=0x7f15f00013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f1605022640 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08d73fd0 0x560c08d763c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f1605022640 1 -- 172.21.15.131:0/947287054 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f160000a4a0 con 0x560c08d73fd0 2024-04-24T01:42:58.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.561+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08d735a0 con 0x560c08d73fd0 2024-04-24T01:42:58.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.562+0000 7f1605022640 1 -- 172.21.15.131:0/947287054 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f160000a4a0 con 0x560c08d73fd0 2024-04-24T01:42:58.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.562+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08d786b0 con 0x560c08d73fd0 2024-04-24T01:42:58.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.562+0000 7f1605022640 1 -- 172.21.15.131:0/947287054 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f160000a4a0 con 0x560c08d73fd0 2024-04-24T01:42:58.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.562+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08d77a20 con 0x560c08d73fd0 2024-04-24T01:42:58.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.562+0000 7f1605022640 1 -- 172.21.15.131:0/947287054 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f160000a4a0 con 0x560c08d73fd0 2024-04-24T01:42:58.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.562+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08d77e40 con 0x560c08d73fd0 2024-04-24T01:42:58.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.562+0000 7f1605022640 1 -- 172.21.15.131:0/947287054 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f160000a4a0 con 0x560c08d73fd0 2024-04-24T01:42:58.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f1609213800 1 Processor -- start 2024-04-24T01:42:58.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f1609213800 1 -- start start 2024-04-24T01:42:58.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f1609213800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c764f0 0x560c08c74960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f1609213800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560c08b676b0 con 0x560c08c764f0 2024-04-24T01:42:58.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f15fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c764f0 0x560c08c74960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f15fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c764f0 0x560c08c74960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36114/0 (socket says 172.21.15.131:36114) 2024-04-24T01:42:58.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f15fffff640 1 -- 172.21.15.131:0/772270739 learned_addr learned my addr 172.21.15.131:0/772270739 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.563+0000 7f15fffff640 1 -- 172.21.15.131:0/772270739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c08c74ea0 con 0x560c08c764f0 2024-04-24T01:42:58.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.564+0000 7f15fffff640 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c764f0 0x560c08c74960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15f000e630 tx=0x7f15f000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.564+0000 7f14ea7fc640 1 -- 172.21.15.131:0/772270739 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0022070 con 0x560c08c764f0 2024-04-24T01:42:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.564+0000 7f14ea7fc640 1 -- 172.21.15.131:0/772270739 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f000d520 con 0x560c08c764f0 2024-04-24T01:42:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.564+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c08c750d0 con 0x560c08c764f0 2024-04-24T01:42:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.564+0000 7f14ea7fc640 1 -- 172.21.15.131:0/772270739 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f000d840 con 0x560c08c764f0 2024-04-24T01:42:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.564+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c08c755d0 con 0x560c08c764f0 2024-04-24T01:42:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f14ea7fc640 1 -- 172.21.15.131:0/772270739 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f15f0025070 con 0x560c08c764f0 2024-04-24T01:42:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f14ea7fc640 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14dc036950 0x7f14dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f14ea7fc640 1 -- 172.21.15.131:0/772270739 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f15f004dd90 con 0x560c08c764f0 2024-04-24T01:42:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f1605022640 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14dc036950 0x7f14dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f1609213800 1 Processor -- start 2024-04-24T01:42:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f1609213800 1 -- start start 2024-04-24T01:42:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f1605022640 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14dc036950 0x7f14dc038e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x560c08d77dc0 tx=0x7f1600005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f1609213800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d96d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.565+0000 7f1609213800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560c08d679a0 con 0x560c08d96940 2024-04-24T01:42:58.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f15fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d96d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f15fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d96d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36126/0 (socket says 172.21.15.131:36126) 2024-04-24T01:42:58.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f15fffff640 1 -- 172.21.15.131:0/2050161725 learned_addr learned my addr 172.21.15.131:0/2050161725 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f15fffff640 1 -- 172.21.15.131:0/2050161725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c08d97330 con 0x560c08d96940 2024-04-24T01:42:58.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f15fffff640 1 --2- 172.21.15.131:0/2050161725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d96d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15f004c1a0 tx=0x7f15f0025f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c705ad8371c16b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f14dbfff640 1 -- 172.21.15.131:0/2050161725 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0040130 con 0x560c08d96940 2024-04-24T01:42:58.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f14dbfff640 1 -- 172.21.15.131:0/2050161725 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00402d0 con 0x560c08d96940 2024-04-24T01:42:58.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.566+0000 7f14dbfff640 1 -- 172.21.15.131:0/2050161725 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00404a0 con 0x560c08d96940 2024-04-24T01:42:58.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 -- 172.21.15.131:0/2050161725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 msgr2=0x560c08d96d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 --2- 172.21.15.131:0/2050161725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d96d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15f004c1a0 tx=0x7f15f0025f90 comp rx=0 tx=0).stop 2024-04-24T01:42:58.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 -- 172.21.15.131:0/2050161725 shutdown_connections 2024-04-24T01:42:58.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 --2- 172.21.15.131:0/2050161725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d96d60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 -- 172.21.15.131:0/2050161725 >> 172.21.15.131:0/2050161725 conn(0x560c08d92ca0 msgr2=0x560c08d90d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 -- 172.21.15.131:0/2050161725 shutdown_connections 2024-04-24T01:42:58.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 -- 172.21.15.131:0/2050161725 wait complete. 2024-04-24T01:42:58.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 Processor -- start 2024-04-24T01:42:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 -- start start 2024-04-24T01:42:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d9e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f1609213800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560c08d97aa0 con 0x560c08d96940 2024-04-24T01:42:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f15fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d9e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f15fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d9e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36136/0 (socket says 172.21.15.131:36136) 2024-04-24T01:42:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 learned_addr learned my addr 172.21.15.131:0/3229244485 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.567+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c08d9e570 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.568+0000 7f15fffff640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d9e030 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15f004c1a0 tx=0x7f15f004c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.568+0000 7f14da7fc640 1 -- 172.21.15.131:0/3229244485 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f0036070 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.568+0000 7f14da7fc640 1 -- 172.21.15.131:0/3229244485 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00244d0 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.568+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c08d9e570 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.568+0000 7f14da7fc640 1 -- 172.21.15.131:0/3229244485 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f000d9e0 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.568+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c08d9e570 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f14da7fc640 1 -- 172.21.15.131:0/3229244485 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f15f001a320 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f14da7fc640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14d0036900 0x7f14d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f14da7fc640 1 -- 172.21.15.131:0/3229244485 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f15f0032c70 con 0x560c08d96940 2024-04-24T01:42:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f1605022640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14d0036900 0x7f14d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08da9820 0x560c08dabcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08dac410 con 0x560c08da9820 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.569+0000 7f1604821640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08da9820 0x560c08dabcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1605022640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14d0036900 0x7f14d0038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x560c08d77540 tx=0x7f160001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1604821640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08da9820 0x560c08dabcc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 20 realm 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08dac820 con 0x560c08da9820 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08dad0c0 con 0x560c08da9820 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.570+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08dad460 con 0x560c08da9820 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1609213800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08dadcb0 con 0x560c08da9820 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1609213800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1609213800 20 searching for the correct realm 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560c08dafa20 0x560c08db1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f15fffff640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560c08dafa20 0x560c08db1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.571+0000 7f15fffff640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560c08dafa20 0x560c08db1e10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f15fffff640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f15f005a040 0x7f15f001c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f15f005a040 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f1605022640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f15f005a040 0x7f15f001c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f1605022640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f15f005a040 0x7f15f001c420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f160001f070 con 0x7f15f005a040 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f1605022640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1600031040 0x7f1600032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.572+0000 7f1604821640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1600031040 0x7f1600032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.573+0000 7f1604821640 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1600031040 0x7f1600032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.573+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.573+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.573+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.573+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f15f005a040 2024-04-24T01:42:58.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f160001f070 con 0x7f15f005a040 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.574+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.575+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f15f005a040 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f160001f070 con 0x7f15f005a040 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.576+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.577+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f15f005a040 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f160001f070 con 0x7f15f005a040 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.578+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f15f005a040 2024-04-24T01:42:58.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f160001f070 con 0x7f15f005a040 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.579+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08dafa20 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f1600031040 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x560c08da9820 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2440 con 0x7f15f005a040 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f160001f070 con 0x7f15f005a040 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:58.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.580+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08dae630 con 0x560c08da9820 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08daeed0 con 0x560c08da9820 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08db28a0 con 0x560c08da9820 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 zone default found 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 4 Realm: () 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 zonegroup default 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08db2d50 con 0x7f1600031040 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.581+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08db4730 con 0x560c08dafa20 2024-04-24T01:42:58.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08db4b50 con 0x560c08dafa20 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 20 started sync module instance, tier type = 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.582+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db3bc0 con 0x7f15f005a040 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.583+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.583+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94609688182704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db5460 con 0x7f15f005a040 2024-04-24T01:42:58.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.583+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db5cb0 con 0x560c08da9820 2024-04-24T01:42:58.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.584+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94609688182704] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.584+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.584+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94609688186800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db5cf0 con 0x560c08da9820 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.585+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db67b0 con 0x560c08dafa20 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.586+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94609688186800] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.586+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.586+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94609688191616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db6ba0 con 0x560c08dafa20 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.586+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db75a0 con 0x7f15f005a040 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.587+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94609688191616] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.587+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.587+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94609688188928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db79c0 con 0x7f15f005a040 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.587+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db8400 con 0x560c08da9820 2024-04-24T01:42:58.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.588+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.588+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94609688198864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db83c0 con 0x560c08da9820 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.588+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db93a0 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.589+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94609688188928] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.589+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94609688198864] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.590+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.590+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94609688195248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db8ef0 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.590+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db9c70 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.591+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94609688195248] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.593+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.593+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94609688200608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db9960 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.593+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dba1f0 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.596+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94609688200608] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94609688204944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dba0e0 con 0x7f1600031040 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 20 add_watcher() i=0 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 20 add_watcher() i=1 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 20 add_watcher() i=2 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 20 add_watcher() i=3 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 20 add_watcher() i=4 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 20 add_watcher() i=5 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.599+0000 7f1609213800 20 add_watcher() i=6 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.602+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94609688204944] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.602+0000 7f1609213800 20 add_watcher() i=7 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.602+0000 7f1609213800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.602+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08dbd620 con 0x560c08da9820 2024-04-24T01:42:58.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.602+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.602+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94609688206192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dbaae0 con 0x560c08da9820 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.603+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94609688206192] v32'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.603+0000 7f14bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.603+0000 7f1609213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.603+0000 7f1609213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.603+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dbd3d0 con 0x560c08da9820 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.605+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'43 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.605+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc6690 con 0x7f1600031040 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.607+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.607+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc6690 con 0x560c08dafa20 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.608+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.608+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc6a30 con 0x560c08da9820 2024-04-24T01:42:58.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.609+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.609+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc6a70 con 0x7f15f005a040 2024-04-24T01:42:58.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.610+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.610+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc71b0 con 0x560c08dafa20 2024-04-24T01:42:58.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.611+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.611+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc75e0 con 0x560c08da9820 2024-04-24T01:42:58.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.612+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.612+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc75e0 con 0x7f1600031040 2024-04-24T01:42:58.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.614+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.614+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc75e0 con 0x7f15f005a040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.615+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.615+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc7bf0 con 0x560c08dafa20 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.616+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.616+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc7f90 con 0x7f15f005a040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.617+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.617+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc8500 con 0x7f1600031040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.618+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.618+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc8500 con 0x7f15f005a040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.619+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.619+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x7f1600031040 2024-04-24T01:42:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.621+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.621+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08da9820 2024-04-24T01:42:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.622+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.622+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.623+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.623+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x7f15f005a040 2024-04-24T01:42:58.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.624+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.624+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.625+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.625+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08da9820 2024-04-24T01:42:58.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.627+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.627+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08da9820 2024-04-24T01:42:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.627+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'40 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.628+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.629+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.629+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x7f15f005a040 2024-04-24T01:42:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.630+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.630+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.631+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.631+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.632+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.632+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.633+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.633+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.633+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.634+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x7f1600031040 2024-04-24T01:42:58.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.635+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.635+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.635+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.635+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x7f1600031040 2024-04-24T01:42:58.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.637+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.637+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x560c08dafa20 2024-04-24T01:42:58.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.638+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.638+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x7f1600031040 2024-04-24T01:42:58.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.639+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.639+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc89b0 con 0x7f15f005a040 2024-04-24T01:42:58.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f14b9fe3640 20 reqs_thread_entry: start 2024-04-24T01:42:58.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f1609213800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:58.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f1609213800 20 Filter name: none 2024-04-24T01:42:58.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f142b7fe640 20 reqs_thread_entry: start 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f1609213800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f1609213800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.640+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c08df36a0 con 0x7f1600031040 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.641+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.641+0000 7f1609213800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.641+0000 7f1609213800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.641+0000 7f1609213800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:42:58.643 INFO:teuthology.orchestra.run.smithi131.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:42:58.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.642+0000 7f14bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.642+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94609688206192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08dc5a80 con 0x560c08da9820 2024-04-24T01:42:58.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.643+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94609688206192] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.643+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94609688182704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db9b30 con 0x7f15f005a040 2024-04-24T01:42:58.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.644+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94609688182704] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.644+0000 7f1609213800 20 remove_watcher() i=0 2024-04-24T01:42:58.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.644+0000 7f1609213800 2 removed watcher, disabling cache 2024-04-24T01:42:58.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.644+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94609688186800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db3fb0 con 0x560c08da9820 2024-04-24T01:42:58.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.645+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94609688186800] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.645+0000 7f1609213800 20 remove_watcher() i=1 2024-04-24T01:42:58.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.645+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94609688191616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db3fb0 con 0x560c08dafa20 2024-04-24T01:42:58.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.646+0000 7f15fffff640 1 -- 172.21.15.131:0/3229244485 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94609688191616] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f0024030 con 0x560c08dafa20 2024-04-24T01:42:58.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.646+0000 7f1609213800 20 remove_watcher() i=2 2024-04-24T01:42:58.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.646+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94609688188928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db3fb0 con 0x7f15f005a040 2024-04-24T01:42:58.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.647+0000 7f1605022640 1 -- 172.21.15.131:0/3229244485 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94609688188928] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1600040040 con 0x7f15f005a040 2024-04-24T01:42:58.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.647+0000 7f1609213800 20 remove_watcher() i=3 2024-04-24T01:42:58.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.647+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94609688198864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db5800 con 0x560c08da9820 2024-04-24T01:42:58.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.648+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94609688198864] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x560c08da9820 2024-04-24T01:42:58.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.648+0000 7f1609213800 20 remove_watcher() i=4 2024-04-24T01:42:58.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.648+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94609688195248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db3fb0 con 0x7f1600031040 2024-04-24T01:42:58.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.649+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94609688195248] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.649+0000 7f1609213800 20 remove_watcher() i=5 2024-04-24T01:42:58.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.649+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94609688200608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db5800 con 0x7f1600031040 2024-04-24T01:42:58.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.652+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94609688200608] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.652+0000 7f1609213800 20 remove_watcher() i=6 2024-04-24T01:42:58.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.652+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94609688204944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c08db3fb0 con 0x7f1600031040 2024-04-24T01:42:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94609688204944] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8075030 con 0x7f1600031040 2024-04-24T01:42:58.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 20 remove_watcher() i=7 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1600031040 msgr2=0x7f1600032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1600031040 0x7f1600032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08da9820 msgr2=0x560c08dabcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08da9820 0x560c08dabcc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f15f005a040 msgr2=0x7f15f001c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f15f005a040 0x7f15f001c420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560c08dafa20 msgr2=0x560c08db1e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560c08dafa20 0x560c08db1e10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14d0036900 msgr2=0x7f14d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14d0036900 0x7f14d0038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x560c08d77540 tx=0x7f160001f000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 msgr2=0x560c08d9e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/3229244485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08d96940 0x560c08d9e030 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15f004c1a0 tx=0x7f15f004c130 comp rx=0 tx=0).stop 2024-04-24T01:42:58.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 reap_dead start 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1604821640 1 -- 172.21.15.131:0/3229244485 reap_dead start 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 shutdown_connections 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 >> 172.21.15.131:0/3229244485 conn(0x560c08d92ca0 msgr2=0x560c08d90300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 shutdown_connections 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/3229244485 wait complete. 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14dc036950 msgr2=0x7f14dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14dc036950 0x7f14dc038e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x560c08d77dc0 tx=0x7f1600005840 comp rx=0 tx=0).stop 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c764f0 msgr2=0x560c08c74960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c764f0 0x560c08c74960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15f000e630 tx=0x7f15f000ea30 comp rx=0 tx=0).stop 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 shutdown_connections 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14dc036950 0x7f14dc038e10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 --2- 172.21.15.131:0/772270739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c764f0 0x560c08c74960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.653+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 >> 172.21.15.131:0/772270739 conn(0x560c08d7b500 msgr2=0x560c08d7b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 shutdown_connections 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/772270739 wait complete. 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08d73fd0 msgr2=0x560c08d763c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08d73fd0 0x560c08d763c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14ec036950 msgr2=0x7f14ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14ec036950 0x7f14ec038e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15f0001e40 tx=0x7f15f00013a0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c792a0 msgr2=0x560c08d6eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c792a0 0x560c08d6eda0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15f8052540 tx=0x7f15f8003020 comp rx=0 tx=0).stop 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 shutdown_connections 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560c08d73fd0 0x560c08d763c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f14ec036950 0x7f14ec038e10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 --2- 172.21.15.131:0/947287054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c08c792a0 0x560c08d6eda0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 >> 172.21.15.131:0/947287054 conn(0x560c08c70320 msgr2=0x560c08d61230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 shutdown_connections 2024-04-24T01:42:58.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.654+0000 7f1609213800 1 -- 172.21.15.131:0/947287054 wait complete. 2024-04-24T01:42:58.662 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:42:58.663 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T01:42:58.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T01:42:58.663 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T01:42:58.705 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:58.706 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c6834800 1 Processor -- start 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c6834800 1 -- start start 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c6834800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555f33fbe970 0x555f33fc0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c6834800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f33e7cd40 con 0x555f33fc12a0 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c6834800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x555f33e4f4d0 con 0x555f33fbe970 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c1bc0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555f33fbe970 0x555f33fc0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52bbfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x555f33fc12a0 0x555f33fc3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45672/0 (socket says 172.21.15.131:45672) 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52bbfff640 1 -- 172.21.15.131:0/40007134 learned_addr learned my addr 172.21.15.131:0/40007134 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:58.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c1bc0640 1 -- 172.21.15.131:0/40007134 >> v1:172.21.15.107:6789/0 conn(0x555f33fc12a0 legacy=0x555f33fc3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.706+0000 7f52c1bc0640 1 -- 172.21.15.131:0/40007134 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f33e7b590 con 0x555f33fbe970 2024-04-24T01:42:58.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.708+0000 7f52c1bc0640 1 --2- 172.21.15.131:0/40007134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f33fc0d60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52b400a470 tx=0x7f52b401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3447b1274c6124d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.708+0000 7f52c13bf640 1 -- 172.21.15.131:0/40007134 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b4057070 con 0x555f33fbe970 2024-04-24T01:42:58.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.708+0000 7f52c13bf640 1 -- 172.21.15.131:0/40007134 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4052570 con 0x555f33fbe970 2024-04-24T01:42:58.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.708+0000 7f52c13bf640 1 -- 172.21.15.131:0/40007134 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b4052870 con 0x555f33fbe970 2024-04-24T01:42:58.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.709+0000 7f52c6834800 1 -- 172.21.15.131:0/40007134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 msgr2=0x555f33fc0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.709+0000 7f52c6834800 1 --2- 172.21.15.131:0/40007134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f33fc0d60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52b400a470 tx=0x7f52b401ce90 comp rx=0 tx=0).stop 2024-04-24T01:42:58.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.709+0000 7f52c6834800 1 -- 172.21.15.131:0/40007134 shutdown_connections 2024-04-24T01:42:58.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.709+0000 7f52c6834800 1 --2- 172.21.15.131:0/40007134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f33fc0d60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.709+0000 7f52c6834800 1 -- 172.21.15.131:0/40007134 >> 172.21.15.131:0/40007134 conn(0x555f33fb8320 msgr2=0x555f33fba740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.709+0000 7f52c6834800 1 -- 172.21.15.131:0/40007134 shutdown_connections 2024-04-24T01:42:58.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.709+0000 7f52c6834800 1 -- 172.21.15.131:0/40007134 wait complete. 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c6834800 1 Processor -- start 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c6834800 1 -- start start 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c6834800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c6834800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f33f093c0 con 0x555f33fbe970 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c1bc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c1bc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36150/0 (socket says 172.21.15.131:36150) 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1857485792 learned_addr learned my addr 172.21.15.131:0/1857485792 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.721+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1857485792 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f340af6e0 con 0x555f33fbe970 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c1bc0640 1 --2- 172.21.15.131:0/1857485792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340af110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f52b4055040 tx=0x7f52b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4544601a82f2a4cf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f51afe07640 1 -- 172.21.15.131:0/1857485792 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b4057070 con 0x555f33fbe970 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f51afe07640 1 -- 172.21.15.131:0/1857485792 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4063070 con 0x555f33fbe970 2024-04-24T01:42:58.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f51afe07640 1 -- 172.21.15.131:0/1857485792 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b4052720 con 0x555f33fbe970 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c6834800 1 -- 172.21.15.131:0/1857485792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 msgr2=0x555f340af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c6834800 1 --2- 172.21.15.131:0/1857485792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340af110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f52b4055040 tx=0x7f52b404c000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c6834800 1 -- 172.21.15.131:0/1857485792 shutdown_connections 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c6834800 1 --2- 172.21.15.131:0/1857485792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340af110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c6834800 1 -- 172.21.15.131:0/1857485792 >> 172.21.15.131:0/1857485792 conn(0x555f33fb8320 msgr2=0x555f340aaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c6834800 1 -- 172.21.15.131:0/1857485792 shutdown_connections 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.722+0000 7f52c6834800 1 -- 172.21.15.131:0/1857485792 wait complete. 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c6834800 1 Processor -- start 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c6834800 1 -- start start 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c6834800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c6834800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f33fc70c0 con 0x555f33fbe970 2024-04-24T01:42:58.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c1bc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c1bc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36164/0 (socket says 172.21.15.131:36164) 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c1bc0640 1 -- 172.21.15.131:0/2873104348 learned_addr learned my addr 172.21.15.131:0/2873104348 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.723+0000 7f52c1bc0640 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f340b7100 con 0x555f33fbe970 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.724+0000 7f52c1bc0640 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340b6bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f52b4060040 tx=0x7f52b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.724+0000 7f51ae604640 1 -- 172.21.15.131:0/2873104348 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b4052e30 con 0x555f33fbe970 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.724+0000 7f51ae604640 1 -- 172.21.15.131:0/2873104348 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b406c070 con 0x555f33fbe970 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.724+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f340b7390 con 0x555f33fbe970 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.724+0000 7f51ae604640 1 -- 172.21.15.131:0/2873104348 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b405e5d0 con 0x555f33fbe970 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.724+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f340ba040 con 0x555f33fbe970 2024-04-24T01:42:58.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.724+0000 7f51ae604640 1 -- 172.21.15.131:0/2873104348 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f52b405e770 con 0x555f33fbe970 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f51ae604640 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f51a8036950 0x7f51a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f51ae604640 1 -- 172.21.15.131:0/2873104348 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f52b408e8a0 con 0x555f33fbe970 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f52bbfff640 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f51a8036950 0x7f51a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f52c6834800 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f33fc12a0 0x555f340bde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340be380 con 0x555f33fc12a0 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f52c23c1640 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f33fc12a0 0x555f340bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f52bbfff640 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f51a8036950 0x7f51a8038e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52ac000f60 tx=0x7f52ac0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f52c23c1640 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f33fc12a0 0x555f340bde00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.725+0000 7f52c23c1640 1 -- 172.21.15.131:0/2873104348 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52bc00a4a0 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.726+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340bb3d0 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.726+0000 7f52c23c1640 1 -- 172.21.15.131:0/2873104348 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52bc00a4a0 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.726+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340c01f0 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.726+0000 7f52c23c1640 1 -- 172.21.15.131:0/2873104348 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f52bc00a4a0 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.726+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340bf530 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.726+0000 7f52c23c1640 1 -- 172.21.15.131:0/2873104348 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52bc00a4a0 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.726+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340bf980 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52c23c1640 1 -- 172.21.15.131:0/2873104348 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f52bc00a4a0 con 0x555f33fc12a0 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52c6834800 1 Processor -- start 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52c6834800 1 -- start start 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52c6834800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340cefc0 0x555f340cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52c6834800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f33eaf6b0 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340cefc0 0x555f340cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340cefc0 0x555f340cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36168/0 (socket says 172.21.15.131:36168) 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.727+0000 7f52bbfff640 1 -- 172.21.15.131:0/507688840 learned_addr learned my addr 172.21.15.131:0/507688840 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.728+0000 7f52bbfff640 1 -- 172.21.15.131:0/507688840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f340cf920 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.728+0000 7f52bbfff640 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340cefc0 0x555f340cf3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52ac001ed0 tx=0x7f52ac00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.728+0000 7f51a77fe640 1 -- 172.21.15.131:0/507688840 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac01b550 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.728+0000 7f51a77fe640 1 -- 172.21.15.131:0/507688840 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac01b6f0 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.728+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f340d0390 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.728+0000 7f51a77fe640 1 -- 172.21.15.131:0/507688840 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac01b9d0 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.728+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f340d0890 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.729+0000 7f51a77fe640 1 -- 172.21.15.131:0/507688840 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f52ac023020 con 0x555f340cefc0 2024-04-24T01:42:58.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.729+0000 7f51a77fe640 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f519c036950 0x7f519c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.729+0000 7f51a77fe640 1 -- 172.21.15.131:0/507688840 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f52ac021020 con 0x555f340cefc0 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.729+0000 7f52c23c1640 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f519c036950 0x7f519c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.729+0000 7f52c6834800 1 Processor -- start 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.729+0000 7f52c6834800 1 -- start start 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.729+0000 7f52c23c1640 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f519c036950 0x7f519c038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x555f340bf050 tx=0x7f52bc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f52c6834800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340dc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f52c6834800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f340af9a0 con 0x555f340dc300 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340dc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340dc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36176/0 (socket says 172.21.15.131:36176) 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f52bbfff640 1 -- 172.21.15.131:0/2124700449 learned_addr learned my addr 172.21.15.131:0/2124700449 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f52bbfff640 1 -- 172.21.15.131:0/2124700449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f340dccf0 con 0x555f340dc300 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f52bbfff640 1 --2- 172.21.15.131:0/2124700449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340dc720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f52ac04ce10 tx=0x7f52ac019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ab26036fef8af2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f51a57fa640 1 -- 172.21.15.131:0/2124700449 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac041070 con 0x555f340dc300 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f51a57fa640 1 -- 172.21.15.131:0/2124700449 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac0258e0 con 0x555f340dc300 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.730+0000 7f51a57fa640 1 -- 172.21.15.131:0/2124700449 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac025410 con 0x555f340dc300 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 -- 172.21.15.131:0/2124700449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 msgr2=0x555f340dc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 --2- 172.21.15.131:0/2124700449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340dc720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f52ac04ce10 tx=0x7f52ac019ce0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 -- 172.21.15.131:0/2124700449 shutdown_connections 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 --2- 172.21.15.131:0/2124700449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340dc720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 -- 172.21.15.131:0/2124700449 >> 172.21.15.131:0/2124700449 conn(0x555f340d8660 msgr2=0x555f340d66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 -- 172.21.15.131:0/2124700449 shutdown_connections 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 -- 172.21.15.131:0/2124700449 wait complete. 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 Processor -- start 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 -- start start 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340e3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.731+0000 7f52c6834800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f340dd460 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340e3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340e3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36184/0 (socket says 172.21.15.131:36184) 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 learned_addr learned my addr 172.21.15.131:0/1067160 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f340e3eb0 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f52bbfff640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340e3970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f52ac019d20 tx=0x7f52ac04cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f51937fe640 1 -- 172.21.15.131:0/1067160 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac041070 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f51937fe640 1 -- 172.21.15.131:0/1067160 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac00cc60 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f340e4140 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f51937fe640 1 -- 172.21.15.131:0/1067160 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac00ce50 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.732+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f340e4140 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.733+0000 7f51937fe640 1 -- 172.21.15.131:0/1067160 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f52ac04eb10 con 0x555f340dc300 2024-04-24T01:42:58.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.733+0000 7f51937fe640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f518c036aa0 0x7f518c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.733+0000 7f51937fe640 1 -- 172.21.15.131:0/1067160 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f52ac00f070 con 0x555f340dc300 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.733+0000 7f52c23c1640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f518c036aa0 0x7f518c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f340ef270 0x555f340f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c23c1640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f518c036aa0 0x7f518c038f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x555f340bb320 tx=0x7f52bc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f1e80 con 0x555f340ef270 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c1bc0640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f340ef270 0x555f340f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c1bc0640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f340ef270 0x555f340f1730 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c6834800 20 realm 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f2290 con 0x555f340ef270 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.734+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f2b60 con 0x555f340ef270 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f2f00 con 0x555f340ef270 2024-04-24T01:42:58.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f3750 con 0x555f340ef270 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 20 searching for the correct realm 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f340f54c0 0x555f340f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.735+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.736+0000 7f52bbfff640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f340f54c0 0x555f340f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.736+0000 7f52bbfff640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f340f54c0 0x555f340f78b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.736+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.736+0000 7f52bbfff640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f52ac048b50 0x7f52ac030640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.736+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52ac048b50 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.736+0000 7f52c23c1640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f52ac048b50 0x7f52ac030640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.736+0000 7f52c23c1640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f52ac048b50 0x7f52ac030640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.737+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc01f070 con 0x7f52ac048b50 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.737+0000 7f52c23c1640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f52bc031040 0x7f52bc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.737+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.737+0000 7f52c1bc0640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f52bc031040 0x7f52bc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.737+0000 7f52c1bc0640 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f52bc031040 0x7f52bc032430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.737+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.737+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.738+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52ac048b50 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc01f070 con 0x7f52ac048b50 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.739+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52ac048b50 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f52bc01f070 con 0x7f52ac048b50 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.740+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.741+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52ac048b50 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc01f070 con 0x7f52ac048b50 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.742+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.743+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.743+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.743+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.743+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.743+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.743+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52ac048b50 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc01f070 con 0x7f52ac048b50 2024-04-24T01:42:58.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340f54c0 2024-04-24T01:42:58.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52bc031040 2024-04-24T01:42:58.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x555f340ef270 2024-04-24T01:42:58.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.744+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555f340f7e90 con 0x7f52ac048b50 2024-04-24T01:42:58.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc01f070 con 0x7f52ac048b50 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f40d0 con 0x555f340ef270 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f4970 con 0x555f340ef270 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f4970 con 0x555f340ef270 2024-04-24T01:42:58.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:58.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 zone default found 2024-04-24T01:42:58.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 4 Realm: () 2024-04-24T01:42:58.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:58.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:58.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:58.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 zonegroup default 2024-04-24T01:42:58.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.745+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f8310 con 0x7f52bc031040 2024-04-24T01:42:58.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340f9d20 con 0x555f340f54c0 2024-04-24T01:42:58.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f340fa260 con 0x555f340f54c0 2024-04-24T01:42:58.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 20 started sync module instance, tier type = 2024-04-24T01:42:58.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:58.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.746+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340f9190 con 0x7f52ac048b50 2024-04-24T01:42:58.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.747+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.747+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93867383690624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340f8df0 con 0x7f52ac048b50 2024-04-24T01:42:58.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.747+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fb190 con 0x555f340ef270 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.750+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.750+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93867383696608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fb5b0 con 0x555f340ef270 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.750+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fc0d0 con 0x555f340f54c0 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.750+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93867383690624] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.753+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93867383696608] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.753+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.753+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93867383695040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fb5b0 con 0x555f340f54c0 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.753+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fc970 con 0x7f52ac048b50 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.755+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93867383695040] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.755+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.756+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93867383702720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fc8e0 con 0x7f52ac048b50 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.756+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fd830 con 0x555f340ef270 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.758+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.758+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93867383706496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fd7a0 con 0x555f340ef270 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.758+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fe7e0 con 0x7f52bc031040 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.761+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93867383702720] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.761+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.761+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93867383704928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fe7a0 con 0x7f52bc031040 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.761+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340ff1f0 con 0x7f52bc031040 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.763+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93867383706496] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.764+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93867383704928] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.764+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.764+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93867383710448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fe710 con 0x7f52bc031040 2024-04-24T01:42:58.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.764+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340ff6a0 con 0x7f52bc031040 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93867383710448] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93867383713088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340ff610 con 0x7f52bc031040 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 20 add_watcher() i=0 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 20 add_watcher() i=1 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 20 add_watcher() i=2 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 20 add_watcher() i=3 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 20 add_watcher() i=4 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 20 add_watcher() i=5 2024-04-24T01:42:58.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.765+0000 7f52c6834800 20 add_watcher() i=6 2024-04-24T01:42:58.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.766+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93867383713088] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.766+0000 7f52c6834800 20 add_watcher() i=7 2024-04-24T01:42:58.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.766+0000 7f52c6834800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:58.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.766+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f34102a10 con 0x555f340ef270 2024-04-24T01:42:58.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.766+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.766+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93867383714608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340ffed0 con 0x555f340ef270 2024-04-24T01:42:58.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.767+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93867383714608] v32'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.767+0000 7f51737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.767+0000 7f52c6834800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.767+0000 7f52c6834800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.768+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f341026f0 con 0x555f340ef270 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.769+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'44 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.769+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410ba80 con 0x7f52bc031040 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.770+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.770+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410ba80 con 0x555f340f54c0 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.773+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.773+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410be20 con 0x555f340ef270 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.776+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.776+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410be20 con 0x7f52ac048b50 2024-04-24T01:42:58.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.778+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.778+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410c320 con 0x555f340f54c0 2024-04-24T01:42:58.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.781+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.781+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410c6c0 con 0x555f340ef270 2024-04-24T01:42:58.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.784+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.784+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410c6c0 con 0x7f52bc031040 2024-04-24T01:42:58.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.785+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.785+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410c6c0 con 0x7f52ac048b50 2024-04-24T01:42:58.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.788+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.788+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410cc30 con 0x555f340f54c0 2024-04-24T01:42:58.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.790+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.790+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410ccc0 con 0x7f52ac048b50 2024-04-24T01:42:58.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.793+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.793+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d230 con 0x7f52bc031040 2024-04-24T01:42:58.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.794+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.794+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d230 con 0x7f52ac048b50 2024-04-24T01:42:58.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.795+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.795+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x7f52bc031040 2024-04-24T01:42:58.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.798+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.798+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340ef270 2024-04-24T01:42:58.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.799+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.799+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.800+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.800+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x7f52ac048b50 2024-04-24T01:42:58.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.801+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.801+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.802+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.802+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340ef270 2024-04-24T01:42:58.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.803+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.803+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340ef270 2024-04-24T01:42:58.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.805+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.805+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.806+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.806+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x7f52ac048b50 2024-04-24T01:42:58.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.807+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.807+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.808+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.808+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.810+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.810+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.813+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.813+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.814+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.814+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x7f52bc031040 2024-04-24T01:42:58.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.815+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.815+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.816+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.816+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x7f52bc031040 2024-04-24T01:42:58.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.817+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.817+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x555f340f54c0 2024-04-24T01:42:58.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.819+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.819+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x7f52bc031040 2024-04-24T01:42:58.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.820+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.820+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410d6e0 con 0x7f52ac048b50 2024-04-24T01:42:58.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f51727fc640 20 reqs_thread_entry: start 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f52c6834800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f52c6834800 20 Filter name: none 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f50e3fff640 20 reqs_thread_entry: start 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f52c6834800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f52c6834800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.821+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f34138410 con 0x7f52bc031040 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.822+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.822+0000 7f52c6834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.822+0000 7f52c6834800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:42:58.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.822+0000 7f52c6834800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:42:58.824 INFO:teuthology.orchestra.run.smithi131.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:42:58.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.823+0000 7f51737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.823+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93867383714608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f3410acf0 con 0x555f340ef270 2024-04-24T01:42:58.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.824+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93867383714608] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.824+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93867383690624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340ff300 con 0x7f52ac048b50 2024-04-24T01:42:58.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.827+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93867383690624] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.827+0000 7f52c6834800 20 remove_watcher() i=0 2024-04-24T01:42:58.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.827+0000 7f52c6834800 2 removed watcher, disabling cache 2024-04-24T01:42:58.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.827+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93867383696608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340f9580 con 0x555f340ef270 2024-04-24T01:42:58.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.828+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93867383696608] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.828+0000 7f52c6834800 20 remove_watcher() i=1 2024-04-24T01:42:58.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.828+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93867383695040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340f9580 con 0x555f340f54c0 2024-04-24T01:42:58.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.830+0000 7f52bbfff640 1 -- 172.21.15.131:0/1067160 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93867383695040] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52ac009050 con 0x555f340f54c0 2024-04-24T01:42:58.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.830+0000 7f52c6834800 20 remove_watcher() i=2 2024-04-24T01:42:58.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.830+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93867383702720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fa6c0 con 0x7f52ac048b50 2024-04-24T01:42:58.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.831+0000 7f52c23c1640 1 -- 172.21.15.131:0/1067160 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93867383702720] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc040040 con 0x7f52ac048b50 2024-04-24T01:42:58.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.831+0000 7f52c6834800 20 remove_watcher() i=3 2024-04-24T01:42:58.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.831+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93867383706496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340f9580 con 0x555f340ef270 2024-04-24T01:42:58.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.832+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93867383706496] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x555f340ef270 2024-04-24T01:42:58.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.832+0000 7f52c6834800 20 remove_watcher() i=4 2024-04-24T01:42:58.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.832+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93867383704928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fc4c0 con 0x7f52bc031040 2024-04-24T01:42:58.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.833+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93867383704928] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.833+0000 7f52c6834800 20 remove_watcher() i=5 2024-04-24T01:42:58.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.833+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93867383710448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340fd380 con 0x7f52bc031040 2024-04-24T01:42:58.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.833+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93867383710448] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.833+0000 7f52c6834800 20 remove_watcher() i=6 2024-04-24T01:42:58.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.833+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93867383713088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555f340f9580 con 0x7f52bc031040 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.834+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93867383713088] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b4009d10 con 0x7f52bc031040 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.834+0000 7f52c6834800 20 remove_watcher() i=7 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f52bc031040 msgr2=0x7f52bc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f52bc031040 0x7f52bc032430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f340ef270 msgr2=0x555f340f1730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f340ef270 0x555f340f1730 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f52ac048b50 msgr2=0x7f52ac030640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f52ac048b50 0x7f52ac030640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f340f54c0 msgr2=0x555f340f78b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f340f54c0 0x555f340f78b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f518c036aa0 msgr2=0x7f518c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f518c036aa0 0x7f518c038f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x555f340bb320 tx=0x7f52bc01f000 comp rx=0 tx=0).stop 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 msgr2=0x555f340e3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340e3970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f52ac019d20 tx=0x7f52ac04cda0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c1bc0640 1 -- 172.21.15.131:0/1067160 reap_dead start 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 shutdown_connections 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/1067160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340dc300 0x555f340e3970 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 >> 172.21.15.131:0/1067160 conn(0x555f340d8660 msgr2=0x555f340d5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 shutdown_connections 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/1067160 wait complete. 2024-04-24T01:42:58.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f519c036950 msgr2=0x7f519c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f519c036950 0x7f519c038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x555f340bf050 tx=0x7f52bc005840 comp rx=0 tx=0).stop 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340cefc0 msgr2=0x555f340cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340cefc0 0x555f340cf3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52ac001ed0 tx=0x7f52ac00d7a0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 shutdown_connections 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f519c036950 0x7f519c038e10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 --2- 172.21.15.131:0/507688840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f340cefc0 0x555f340cf3e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 >> 172.21.15.131:0/507688840 conn(0x555f340c3060 msgr2=0x555f340c3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 shutdown_connections 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.835+0000 7f52c6834800 1 -- 172.21.15.131:0/507688840 wait complete. 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f33fc12a0 msgr2=0x555f340bde00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f33fc12a0 0x555f340bde00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f51a8036950 msgr2=0x7f51a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f51a8036950 0x7f51a8038e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52ac000f60 tx=0x7f52ac0012b0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 msgr2=0x555f340b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340b6bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f52b4060040 tx=0x7f52b4002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 shutdown_connections 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f33fc12a0 0x555f340bde00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f51a8036950 0x7f51a8038e10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 --2- 172.21.15.131:0/2873104348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f33fbe970 0x555f340b6bc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 >> 172.21.15.131:0/2873104348 conn(0x555f33fb8320 msgr2=0x555f340a9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 shutdown_connections 2024-04-24T01:42:58.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.836+0000 7f52c6834800 1 -- 172.21.15.131:0/2873104348 wait complete. 2024-04-24T01:42:58.844 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:42:58.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T01:42:58.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T01:42:58.845 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T01:42:58.927 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:58.927 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:58.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.927+0000 7f251a014800 1 Processor -- start 2024-04-24T01:42:58.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.927+0000 7f251a014800 1 -- start start 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.927+0000 7f251a014800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f3e5cd11b0 0x55f3e5cd35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.927+0000 7f251a014800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3e5b8cd40 con 0x55f3e5cccd20 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.927+0000 7f251a014800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55f3e5b5f4d0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.928+0000 7f250cf5b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f3e5cd11b0 0x55f3e5cd35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.928+0000 7f251575c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f3e5cccd20 0x55f3e5ccd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45686/0 (socket says 172.21.15.131:45686) 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.928+0000 7f251575c640 1 -- 172.21.15.131:0/2466863090 learned_addr learned my addr 172.21.15.131:0/2466863090 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.928+0000 7f250cf5b640 1 -- 172.21.15.131:0/2466863090 >> v1:172.21.15.107:6789/0 conn(0x55f3e5cccd20 legacy=0x55f3e5ccd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.928+0000 7f250cf5b640 1 -- 172.21.15.131:0/2466863090 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e5b8b590 con 0x55f3e5cd11b0 2024-04-24T01:42:58.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.928+0000 7f2514f5b640 1 -- 172.21.15.131:0/2466863090 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166726396 0 0) 0x55f3e5b8cd40 con 0x55f3e5cccd20 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f250cf5b640 1 --2- 172.21.15.131:0/2466863090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cd11b0 0x55f3e5cd35a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f250000a600 tx=0x7f250001ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12f0dd9ebb3a404 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f2514f5b640 1 -- 172.21.15.131:0/2466863090 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250000a200 con 0x55f3e5cd11b0 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f2514f5b640 1 -- 172.21.15.131:0/2466863090 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250000a3a0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f2514f5b640 1 -- 172.21.15.131:0/2466863090 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000086e0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f251a014800 1 -- 172.21.15.131:0/2466863090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cd11b0 msgr2=0x55f3e5cd35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f251a014800 1 --2- 172.21.15.131:0/2466863090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cd11b0 0x55f3e5cd35a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f250000a600 tx=0x7f250001ed70 comp rx=0 tx=0).stop 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f251a014800 1 -- 172.21.15.131:0/2466863090 shutdown_connections 2024-04-24T01:42:58.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f251a014800 1 --2- 172.21.15.131:0/2466863090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cd11b0 0x55f3e5cd35a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.930+0000 7f251a014800 1 -- 172.21.15.131:0/2466863090 >> 172.21.15.131:0/2466863090 conn(0x55f3e5cc8380 msgr2=0x55f3e5cca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.931+0000 7f251a014800 1 -- 172.21.15.131:0/2466863090 shutdown_connections 2024-04-24T01:42:58.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.931+0000 7f251a014800 1 -- 172.21.15.131:0/2466863090 wait complete. 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.942+0000 7f251a014800 1 Processor -- start 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.942+0000 7f251a014800 1 -- start start 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.942+0000 7f251a014800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.942+0000 7f251a014800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f3e5c193c0 con 0x55f3e5cccd20 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f251575c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f251575c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36190/0 (socket says 172.21.15.131:36190) 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f251575c640 1 -- 172.21.15.131:0/852236013 learned_addr learned my addr 172.21.15.131:0/852236013 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f251575c640 1 -- 172.21.15.131:0/852236013 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e5dc15b0 con 0x55f3e5cccd20 2024-04-24T01:42:58.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f251575c640 1 --2- 172.21.15.131:0/852236013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc0fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f250800b240 tx=0x7f250800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba2daeb731c87e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f2403606640 1 -- 172.21.15.131:0/852236013 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2508008070 con 0x55f3e5cccd20 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f2403606640 1 -- 172.21.15.131:0/852236013 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250800d500 con 0x55f3e5cccd20 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.943+0000 7f2403606640 1 -- 172.21.15.131:0/852236013 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250800d860 con 0x55f3e5cccd20 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 -- 172.21.15.131:0/852236013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 msgr2=0x55f3e5dc0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 --2- 172.21.15.131:0/852236013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc0fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f250800b240 tx=0x7f250800b700 comp rx=0 tx=0).stop 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 -- 172.21.15.131:0/852236013 shutdown_connections 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 --2- 172.21.15.131:0/852236013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc0fe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 -- 172.21.15.131:0/852236013 >> 172.21.15.131:0/852236013 conn(0x55f3e5cc8380 msgr2=0x55f3e5db84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 -- 172.21.15.131:0/852236013 shutdown_connections 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 -- 172.21.15.131:0/852236013 wait complete. 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 Processor -- start 2024-04-24T01:42:58.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 -- start start 2024-04-24T01:42:58.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.944+0000 7f251a014800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f3e5cd3e10 con 0x55f3e5cccd20 2024-04-24T01:42:58.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f251575c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f251575c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36194/0 (socket says 172.21.15.131:36194) 2024-04-24T01:42:58.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f251575c640 1 -- 172.21.15.131:0/1407554402 learned_addr learned my addr 172.21.15.131:0/1407554402 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f251575c640 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e5dc91b0 con 0x55f3e5cccd20 2024-04-24T01:42:58.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f251575c640 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc8c70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f3e5dc1d70 tx=0x7f2508000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f2401e03640 1 -- 172.21.15.131:0/1407554402 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2508019870 con 0x55f3e5cccd20 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f2401e03640 1 -- 172.21.15.131:0/1407554402 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2508019a10 con 0x55f3e5cccd20 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3e5dc9440 con 0x55f3e5cccd20 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f2401e03640 1 -- 172.21.15.131:0/1407554402 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2508019d30 con 0x55f3e5cccd20 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.945+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3e5dcc0f0 con 0x55f3e5cccd20 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.946+0000 7f2401e03640 1 -- 172.21.15.131:0/1407554402 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2508017040 con 0x55f3e5cccd20 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.946+0000 7f2401e03640 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc0369a0 0x7f23fc038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.946+0000 7f2401e03640 1 -- 172.21.15.131:0/1407554402 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2508015020 con 0x55f3e5cccd20 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f250cf5b640 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc0369a0 0x7f23fc038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f251a014800 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5cd11b0 0x55f3e5dcfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5dd0430 con 0x55f3e5cd11b0 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f2515f5d640 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5cd11b0 0x55f3e5dcfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f250cf5b640 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc0369a0 0x7f23fc038e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2500055000 tx=0x7f2500050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f2515f5d640 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5cd11b0 0x55f3e5dcfeb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f2515f5d640 1 -- 172.21.15.131:0/1407554402 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f251000a4a0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.947+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5dcd480 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.948+0000 7f2515f5d640 1 -- 172.21.15.131:0/1407554402 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f251000a4a0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.948+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5dd2250 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.948+0000 7f2515f5d640 1 -- 172.21.15.131:0/1407554402 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f251000a4a0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.948+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5dd1590 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.948+0000 7f2515f5d640 1 -- 172.21.15.131:0/1407554402 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f251000a4a0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.948+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5dd19e0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.948+0000 7f2515f5d640 1 -- 172.21.15.131:0/1407554402 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f251000a4a0 con 0x55f3e5cd11b0 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.949+0000 7f251a014800 1 Processor -- start 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.949+0000 7f251a014800 1 -- start start 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.949+0000 7f251a014800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5de0fc0 0x55f3e5de13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.949+0000 7f251a014800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f3e5bbf6b0 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.949+0000 7f250cf5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5de0fc0 0x55f3e5de13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.949+0000 7f250cf5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5de0fc0 0x55f3e5de13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36200/0 (socket says 172.21.15.131:36200) 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.949+0000 7f250cf5b640 1 -- 172.21.15.131:0/1400633324 learned_addr learned my addr 172.21.15.131:0/1400633324 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.950+0000 7f250cf5b640 1 -- 172.21.15.131:0/1400633324 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e5de1920 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.950+0000 7f250cf5b640 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5de0fc0 0x55f3e5de13e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2500000c00 tx=0x7f2500002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.950+0000 7f23faffd640 1 -- 172.21.15.131:0/1400633324 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250006d020 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.950+0000 7f23faffd640 1 -- 172.21.15.131:0/1400633324 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250005f470 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.950+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3e5de2390 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.950+0000 7f23faffd640 1 -- 172.21.15.131:0/1400633324 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250005f750 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.950+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3e5de2830 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f23faffd640 1 -- 172.21.15.131:0/1400633324 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f250005f8f0 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f23faffd640 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036950 0x7f23ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f23faffd640 1 -- 172.21.15.131:0/1400633324 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f250008fff0 con 0x55f3e5de0fc0 2024-04-24T01:42:58.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f2515f5d640 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036950 0x7f23ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f251a014800 1 Processor -- start 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f2515f5d640 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036950 0x7f23ec038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55f3e5dd10b0 tx=0x7f2510005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f251a014800 1 -- start start 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f251a014800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5dee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.951+0000 7f251a014800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f3e5dc1930 con 0x55f3e5dee240 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f250cf5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5dee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f250cf5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5dee660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36208/0 (socket says 172.21.15.131:36208) 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f250cf5b640 1 -- 172.21.15.131:0/421255576 learned_addr learned my addr 172.21.15.131:0/421255576 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f250cf5b640 1 -- 172.21.15.131:0/421255576 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e5deec30 con 0x55f3e5dee240 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f250cf5b640 1 --2- 172.21.15.131:0/421255576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5dee660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f250008e3d0 tx=0x7f2500071d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e175c9f2753225 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f23f8ff9640 1 -- 172.21.15.131:0/421255576 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2500054cf0 con 0x55f3e5dee240 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f23f8ff9640 1 -- 172.21.15.131:0/421255576 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500080070 con 0x55f3e5dee240 2024-04-24T01:42:58.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.952+0000 7f23f8ff9640 1 -- 172.21.15.131:0/421255576 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250005d910 con 0x55f3e5dee240 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 -- 172.21.15.131:0/421255576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 msgr2=0x55f3e5dee660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 --2- 172.21.15.131:0/421255576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5dee660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f250008e3d0 tx=0x7f2500071d70 comp rx=0 tx=0).stop 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 -- 172.21.15.131:0/421255576 shutdown_connections 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 --2- 172.21.15.131:0/421255576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5dee660 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 -- 172.21.15.131:0/421255576 >> 172.21.15.131:0/421255576 conn(0x55f3e5dea5a0 msgr2=0x55f3e5de8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 -- 172.21.15.131:0/421255576 shutdown_connections 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 -- 172.21.15.131:0/421255576 wait complete. 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 Processor -- start 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 -- start start 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5df58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f251a014800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f3e5def3a0 con 0x55f3e5dee240 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f250cf5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5df58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f250cf5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5df58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36220/0 (socket says 172.21.15.131:36220) 2024-04-24T01:42:58.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.953+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 learned_addr learned my addr 172.21.15.131:0/3173402628 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:58.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.954+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e5df5e20 con 0x55f3e5dee240 2024-04-24T01:42:58.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.954+0000 7f250cf5b640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5df58e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f250005ffd0 tx=0x7f250008e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.954+0000 7f23eaffd640 1 -- 172.21.15.131:0/3173402628 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2500097020 con 0x55f3e5dee240 2024-04-24T01:42:58.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.954+0000 7f23eaffd640 1 -- 172.21.15.131:0/3173402628 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250005d910 con 0x55f3e5dee240 2024-04-24T01:42:58.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.954+0000 7f23eaffd640 1 -- 172.21.15.131:0/3173402628 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2500087420 con 0x55f3e5dee240 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.954+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3e5df60b0 con 0x55f3e5dee240 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.954+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3e5df8d60 con 0x55f3e5dee240 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f23eaffd640 1 -- 172.21.15.131:0/3173402628 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f250009a020 con 0x55f3e5dee240 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f23eaffd640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e0036950 0x7f23e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f23eaffd640 1 -- 172.21.15.131:0/3173402628 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f250009dc40 con 0x55f3e5dee240 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f2515f5d640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e0036950 0x7f23e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f2515f5d640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e0036950 0x7f23e0038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55f3e5dcd3d0 tx=0x7f251001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5e01400 0x55f3e5e038c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.955+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e04010 con 0x55f3e5e01400 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251575c640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5e01400 0x55f3e5e038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251575c640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5e01400 0x55f3e5e038c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 20 realm 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e04420 con 0x55f3e5e01400 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e04cf0 con 0x55f3e5e01400 2024-04-24T01:42:58.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.956+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e05090 con 0x55f3e5e01400 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251a014800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e058e0 con 0x55f3e5e01400 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251a014800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251a014800 20 searching for the correct realm 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f3e5e07650 0x55f3e5e09a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f250cf5b640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f3e5e07650 0x55f3e5e09a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.957+0000 7f250cf5b640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f3e5e07650 0x55f3e5e09a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f250cf5b640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f250009c020 0x7f25000693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f250009c020 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f2515f5d640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f250009c020 0x7f25000693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f2515f5d640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f250009c020 0x7f25000693f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251001f070 con 0x7f250009c020 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f2515f5d640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2510031040 0x7f2510032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.958+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.959+0000 7f251575c640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2510031040 0x7f2510032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.959+0000 7f251575c640 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2510031040 0x7f2510032940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.959+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.959+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.959+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.959+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f250009c020 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251001f070 con 0x7f250009c020 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.960+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f250009c020 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f251001f070 con 0x7f250009c020 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.961+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.962+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.962+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.962+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.962+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.962+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.962+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.963+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f250009c020 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251001f070 con 0x7f250009c020 2024-04-24T01:42:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.964+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.965+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.965+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.965+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.965+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f250009c020 2024-04-24T01:42:58.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251001f070 con 0x7f250009c020 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e07650 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f2510031040 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.966+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x55f3e5e01400 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a050 con 0x7f250009c020 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251001f070 con 0x7f250009c020 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:58.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e06290 con 0x55f3e5e01400 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e06b30 con 0x55f3e5e01400 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.967+0000 7f251a014800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a4d0 con 0x55f3e5e01400 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 20 zone default found 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 4 Realm: () 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 20 zonegroup default 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0a980 con 0x7f2510031040 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.968+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0c360 con 0x55f3e5e07650 2024-04-24T01:42:58.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0c7c0 con 0x55f3e5e07650 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f251a014800 20 started sync module instance, tier type = 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f251a014800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.969+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0b7f0 con 0x7f250009c020 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.970+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.970+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94506022124512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0b450 con 0x7f250009c020 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.970+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0d6f0 con 0x55f3e5e01400 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.971+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.971+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94506022130240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0db50 con 0x55f3e5e01400 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.971+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0e630 con 0x55f3e5e07650 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.972+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94506022124512] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.972+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.972+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94506022128672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0ea50 con 0x55f3e5e07650 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.972+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0f470 con 0x7f250009c020 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.973+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94506022130240] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.973+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94506022128672] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.973+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.973+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94506022134080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0d660 con 0x7f250009c020 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.973+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0fd80 con 0x55f3e5e01400 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.974+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.974+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94506022134080] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.974+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94506022137696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0fd40 con 0x55f3e5e01400 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.974+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e107b0 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.975+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.975+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94506022142688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e107b0 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.975+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94506022137696] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.975+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e116f0 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.977+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.977+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94506022146496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e116b0 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.977+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e12130 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.977+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94506022142688] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94506022146496] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94506022140048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e11c80 con 0x7f2510031040 2024-04-24T01:42:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 20 add_watcher() i=0 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 20 add_watcher() i=1 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 20 add_watcher() i=2 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 20 add_watcher() i=3 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 20 add_watcher() i=4 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 20 add_watcher() i=5 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.978+0000 7f251a014800 20 add_watcher() i=6 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.979+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94506022140048] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.979+0000 7f251a014800 20 add_watcher() i=7 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.979+0000 7f251a014800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.979+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e15160 con 0x55f3e5e01400 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.979+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.979+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94506022149248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e12550 con 0x55f3e5e01400 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.980+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94506022149248] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.980+0000 7f23cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.980+0000 7f251a014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.980+0000 7f251a014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.981+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1d900 con 0x55f3e5e01400 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.982+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'45 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.982+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1dfd0 con 0x7f2510031040 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.983+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.983+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1dfd0 con 0x55f3e5e07650 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.984+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.984+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1e370 con 0x55f3e5e01400 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.985+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.985+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1e470 con 0x7f250009c020 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.986+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.986+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1eaf0 con 0x55f3e5e07650 2024-04-24T01:42:58.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.987+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:58.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.987+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1eaf0 con 0x55f3e5e01400 2024-04-24T01:42:58.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.988+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:58.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.988+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1d330 con 0x7f2510031040 2024-04-24T01:42:58.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.989+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:58.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.989+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1d330 con 0x7f250009c020 2024-04-24T01:42:58.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.990+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.990+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1f250 con 0x55f3e5e07650 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.991+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.991+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1f250 con 0x7f250009c020 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.992+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.992+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1f7c0 con 0x7f2510031040 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.993+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.993+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1f7c0 con 0x7f250009c020 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.994+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.994+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x7f2510031040 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.995+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.995+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e01400 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.996+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.996+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.997+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.997+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x7f250009c020 2024-04-24T01:42:59.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.998+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.998+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.999+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:58.999+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e01400 2024-04-24T01:42:59.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.000+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:59.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.000+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e01400 2024-04-24T01:42:59.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.001+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'50 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:59.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.001+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.002+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.002+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x7f250009c020 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.003+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.003+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.004+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.004+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.005+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.005+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.006+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.006+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.007+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.007+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x7f2510031040 2024-04-24T01:42:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.008+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.008+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.010+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.010+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x7f2510031040 2024-04-24T01:42:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.011+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.011+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x55f3e5e07650 2024-04-24T01:42:59.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.012+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.012+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x7f2510031040 2024-04-24T01:42:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.014+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.014+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1fc70 con 0x7f250009c020 2024-04-24T01:42:59.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.015+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f23ca7e4640 20 reqs_thread_entry: start 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 20 Filter name: none 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f233bfff640 20 reqs_thread_entry: start 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e4a8b0 con 0x55f3e5e01400 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.016+0000 7f251a014800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:42:59.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.017+0000 7f23cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.017+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94506022149248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1bc80 con 0x55f3e5e01400 2024-04-24T01:42:59.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.018+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94506022149248] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:59.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.018+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94506022124512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1bc80 con 0x7f250009c020 2024-04-24T01:42:59.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.021+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94506022124512] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.021+0000 7f251a014800 20 remove_watcher() i=0 2024-04-24T01:42:59.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.021+0000 7f251a014800 2 removed watcher, disabling cache 2024-04-24T01:42:59.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.021+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94506022130240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1bc80 con 0x55f3e5e01400 2024-04-24T01:42:59.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.022+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94506022130240] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:59.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.022+0000 7f251a014800 20 remove_watcher() i=1 2024-04-24T01:42:59.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.022+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94506022128672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0d240 con 0x55f3e5e07650 2024-04-24T01:42:59.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.023+0000 7f250cf5b640 1 -- 172.21.15.131:0/3173402628 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94506022128672] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250006f020 con 0x55f3e5e07650 2024-04-24T01:42:59.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.023+0000 7f251a014800 20 remove_watcher() i=2 2024-04-24T01:42:59.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.023+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94506022134080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1bc80 con 0x7f250009c020 2024-04-24T01:42:59.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.024+0000 7f2515f5d640 1 -- 172.21.15.131:0/3173402628 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94506022134080] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2510040040 con 0x7f250009c020 2024-04-24T01:42:59.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.024+0000 7f251a014800 20 remove_watcher() i=3 2024-04-24T01:42:59.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.024+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94506022137696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0cc20 con 0x55f3e5e01400 2024-04-24T01:42:59.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.025+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94506022137696] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x55f3e5e01400 2024-04-24T01:42:59.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.025+0000 7f251a014800 20 remove_watcher() i=4 2024-04-24T01:42:59.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.025+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94506022142688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0d240 con 0x7f2510031040 2024-04-24T01:42:59.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.026+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94506022142688] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.026+0000 7f251a014800 20 remove_watcher() i=5 2024-04-24T01:42:59.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.026+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94506022146496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e1bc80 con 0x7f2510031040 2024-04-24T01:42:59.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.027+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94506022146496] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.027+0000 7f251a014800 20 remove_watcher() i=6 2024-04-24T01:42:59.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.027+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94506022140048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3e5e0ef60 con 0x7f2510031040 2024-04-24T01:42:59.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94506022140048] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250802d070 con 0x7f2510031040 2024-04-24T01:42:59.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 20 remove_watcher() i=7 2024-04-24T01:42:59.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2510031040 msgr2=0x7f2510032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2510031040 0x7f2510032940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5e01400 msgr2=0x55f3e5e038c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5e01400 0x55f3e5e038c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f250009c020 msgr2=0x7f25000693f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f250009c020 0x7f25000693f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f3e5e07650 msgr2=0x55f3e5e09a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f3e5e07650 0x55f3e5e09a40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e0036950 msgr2=0x7f23e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e0036950 0x7f23e0038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55f3e5dcd3d0 tx=0x7f251001f000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 msgr2=0x55f3e5df58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5df58e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f250005ffd0 tx=0x7f250008e330 comp rx=0 tx=0).stop 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.028+0000 7f251575c640 1 -- 172.21.15.131:0/3173402628 reap_dead start 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 shutdown_connections 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/3173402628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5dee240 0x55f3e5df58e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 >> 172.21.15.131:0/3173402628 conn(0x55f3e5dea5a0 msgr2=0x55f3e5de7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 shutdown_connections 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/3173402628 wait complete. 2024-04-24T01:42:59.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036950 msgr2=0x7f23ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036950 0x7f23ec038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55f3e5dd10b0 tx=0x7f2510005840 comp rx=0 tx=0).stop 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5de0fc0 msgr2=0x55f3e5de13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5de0fc0 0x55f3e5de13e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2500000c00 tx=0x7f2500002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 shutdown_connections 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036950 0x7f23ec038e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1400633324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5de0fc0 0x55f3e5de13e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 >> 172.21.15.131:0/1400633324 conn(0x55f3e5dd5060 msgr2=0x55f3e5dd5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 shutdown_connections 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1400633324 wait complete. 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5cd11b0 msgr2=0x55f3e5dcfeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5cd11b0 0x55f3e5dcfeb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc0369a0 msgr2=0x7f23fc038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc0369a0 0x7f23fc038e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2500055000 tx=0x7f2500050000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 msgr2=0x55f3e5dc8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc8c70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f3e5dc1d70 tx=0x7f2508000ed0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 shutdown_connections 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f3e5cd11b0 0x55f3e5dcfeb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc0369a0 0x7f23fc038e60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 --2- 172.21.15.131:0/1407554402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3e5cccd20 0x55f3e5dc8c70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.029+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 >> 172.21.15.131:0/1407554402 conn(0x55f3e5cc8380 msgr2=0x55f3e5db6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.030+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 shutdown_connections 2024-04-24T01:42:59.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.030+0000 7f251a014800 1 -- 172.21.15.131:0/1407554402 wait complete. 2024-04-24T01:42:59.037 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:42:59.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:42:59.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:42:59.040 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-24T01:42:59.123 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:59.123 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.123+0000 7fbef060e800 1 Processor -- start 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.123+0000 7fbef060e800 1 -- start start 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.123+0000 7fbef060e800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562b723ddc90 0x562b723dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.123+0000 7fbef060e800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b72326d40 con 0x562b723dc6e0 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.123+0000 7fbef060e800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x562b722f94d0 con 0x562b723ddc90 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.124+0000 7fbeee10d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562b723ddc90 0x562b723dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.124+0000 7fbee7fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x562b723dc6e0 0x562b7246fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45694/0 (socket says 172.21.15.131:45694) 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.124+0000 7fbee7fff640 1 -- 172.21.15.131:0/2308672500 learned_addr learned my addr 172.21.15.131:0/2308672500 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.124+0000 7fbeee10d640 1 --2- 172.21.15.131:0/2308672500 >> v2:172.21.15.107:3300/0 conn(0x562b723ddc90 0x562b723dc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36236/0 (socket says 172.21.15.131:36236) 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.124+0000 7fbeee10d640 1 -- 172.21.15.131:0/2308672500 >> v1:172.21.15.107:6789/0 conn(0x562b723dc6e0 legacy=0x562b7246fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.124+0000 7fbeee10d640 1 -- 172.21.15.131:0/2308672500 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b72325590 con 0x562b723ddc90 2024-04-24T01:42:59.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.126+0000 7fbeee10d640 1 --2- 172.21.15.131:0/2308672500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723ddc90 0x562b723dc1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbee000a470 tx=0x7fbee001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f709504b2cf1189 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.126+0000 7fbeed90c640 1 -- 172.21.15.131:0/2308672500 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0057070 con 0x562b723ddc90 2024-04-24T01:42:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.126+0000 7fbeed90c640 1 -- 172.21.15.131:0/2308672500 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee0052570 con 0x562b723ddc90 2024-04-24T01:42:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.126+0000 7fbeed90c640 1 -- 172.21.15.131:0/2308672500 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0052870 con 0x562b723ddc90 2024-04-24T01:42:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.126+0000 7fbef060e800 1 -- 172.21.15.131:0/2308672500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723ddc90 msgr2=0x562b723dc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.126+0000 7fbef060e800 1 --2- 172.21.15.131:0/2308672500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723ddc90 0x562b723dc1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbee000a470 tx=0x7fbee001ce90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.127+0000 7fbef060e800 1 -- 172.21.15.131:0/2308672500 shutdown_connections 2024-04-24T01:42:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.127+0000 7fbef060e800 1 --2- 172.21.15.131:0/2308672500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723ddc90 0x562b723dc1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.127+0000 7fbef060e800 1 -- 172.21.15.131:0/2308672500 >> 172.21.15.131:0/2308672500 conn(0x562b72463510 msgr2=0x562b72465930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.127+0000 7fbef060e800 1 -- 172.21.15.131:0/2308672500 shutdown_connections 2024-04-24T01:42:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.127+0000 7fbef060e800 1 -- 172.21.15.131:0/2308672500 wait complete. 2024-04-24T01:42:59.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.138+0000 7fbef060e800 1 Processor -- start 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.138+0000 7fbef060e800 1 -- start start 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.138+0000 7fbef060e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b7255b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.138+0000 7fbef060e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562b723b33e0 con 0x562b723dc6e0 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbeee10d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b7255b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbeee10d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b7255b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36250/0 (socket says 172.21.15.131:36250) 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbeee10d640 1 -- 172.21.15.131:0/1442423787 learned_addr learned my addr 172.21.15.131:0/1442423787 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbeee10d640 1 -- 172.21.15.131:0/1442423787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7255be20 con 0x562b723dc6e0 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbeee10d640 1 --2- 172.21.15.131:0/1442423787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b7255b850 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbee0000c00 tx=0x7fbee004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df9d60642befad8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbddc608640 1 -- 172.21.15.131:0/1442423787 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0057070 con 0x562b723dc6e0 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbddc608640 1 -- 172.21.15.131:0/1442423787 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee0063070 con 0x562b723dc6e0 2024-04-24T01:42:59.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.139+0000 7fbddc608640 1 -- 172.21.15.131:0/1442423787 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0052720 con 0x562b723dc6e0 2024-04-24T01:42:59.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 -- 172.21.15.131:0/1442423787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 msgr2=0x562b7255b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 --2- 172.21.15.131:0/1442423787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b7255b850 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbee0000c00 tx=0x7fbee004c000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 -- 172.21.15.131:0/1442423787 shutdown_connections 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 --2- 172.21.15.131:0/1442423787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b7255b850 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 -- 172.21.15.131:0/1442423787 >> 172.21.15.131:0/1442423787 conn(0x562b72463510 msgr2=0x562b72557170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 -- 172.21.15.131:0/1442423787 shutdown_connections 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 -- 172.21.15.131:0/1442423787 wait complete. 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 Processor -- start 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 -- start start 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b725632f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.140+0000 7fbef060e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562b72473790 con 0x562b723dc6e0 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbeee10d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b725632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbeee10d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b725632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36262/0 (socket says 172.21.15.131:36262) 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbeee10d640 1 -- 172.21.15.131:0/2106650929 learned_addr learned my addr 172.21.15.131:0/2106650929 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbeee10d640 1 -- 172.21.15.131:0/2106650929 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b72563830 con 0x562b723dc6e0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbeee10d640 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b725632f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbee0000c00 tx=0x7fbee0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbddae05640 1 -- 172.21.15.131:0/2106650929 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0052c70 con 0x562b723dc6e0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbddae05640 1 -- 172.21.15.131:0/2106650929 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee006c070 con 0x562b723dc6e0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b72563ac0 con 0x562b723dc6e0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbddae05640 1 -- 172.21.15.131:0/2106650929 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee005e480 con 0x562b723dc6e0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.141+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b72566770 con 0x562b723dc6e0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbef060e800 1 Processor -- start 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbef060e800 1 -- start start 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbddae05640 1 -- 172.21.15.131:0/2106650929 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbee006e030 con 0x562b723dc6e0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbef060e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72570fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbef060e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562b723596b0 con 0x562b72570ba0 2024-04-24T01:42:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbddae05640 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdd4036950 0x7fbdd4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbddae05640 1 -- 172.21.15.131:0/2106650929 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fbee008e1d0 con 0x562b723dc6e0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbeee90e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72570fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbeee90e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72570fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36266/0 (socket says 172.21.15.131:36266) 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbeee90e640 1 -- 172.21.15.131:0/1487551411 learned_addr learned my addr 172.21.15.131:0/1487551411 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbeee10d640 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdd4036950 0x7fbdd4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.142+0000 7fbeee90e640 1 -- 172.21.15.131:0/1487551411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b72571500 con 0x562b72570ba0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbeee10d640 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdd4036950 0x7fbdd4038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbee0070fd0 tx=0x7fbee005ee70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbeee90e640 1 --2- 172.21.15.131:0/1487551411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72570fc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbee800a430 tx=0x7fbee800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a953f476e873445 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbdd8e01640 1 -- 172.21.15.131:0/1487551411 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8015070 con 0x562b72570ba0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbdd8e01640 1 -- 172.21.15.131:0/1487551411 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8001670 con 0x562b72570ba0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbdd8e01640 1 -- 172.21.15.131:0/1487551411 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8001990 con 0x562b72570ba0 2024-04-24T01:42:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbef060e800 1 -- 172.21.15.131:0/1487551411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 msgr2=0x562b72570fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbef060e800 1 --2- 172.21.15.131:0/1487551411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72570fc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbee800a430 tx=0x7fbee800a8f0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbef060e800 1 -- 172.21.15.131:0/1487551411 shutdown_connections 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbef060e800 1 --2- 172.21.15.131:0/1487551411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72570fc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbef060e800 1 -- 172.21.15.131:0/1487551411 >> 172.21.15.131:0/1487551411 conn(0x562b723ddc90 msgr2=0x562b7256d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbef060e800 1 -- 172.21.15.131:0/1487551411 shutdown_connections 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.143+0000 7fbef060e800 1 -- 172.21.15.131:0/1487551411 wait complete. 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbef060e800 1 Processor -- start 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbef060e800 1 -- start start 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbef060e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72578100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbef060e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562b72571e90 con 0x562b72570ba0 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbeee90e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72578100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbeee90e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72578100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36280/0 (socket says 172.21.15.131:36280) 2024-04-24T01:42:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbeee90e640 1 -- 172.21.15.131:0/900594382 learned_addr learned my addr 172.21.15.131:0/900594382 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbeee90e640 1 -- 172.21.15.131:0/900594382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b72578640 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbeee90e640 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72578100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbee800a930 tx=0x7fbee8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.144+0000 7fbdd2ffd640 1 -- 172.21.15.131:0/900594382 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8020020 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.145+0000 7fbdd2ffd640 1 -- 172.21.15.131:0/900594382 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee80108b0 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.145+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b725788d0 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.145+0000 7fbdd2ffd640 1 -- 172.21.15.131:0/900594382 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8015040 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.145+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b7257b580 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.145+0000 7fbdd2ffd640 1 -- 172.21.15.131:0/900594382 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbee8023020 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbef060e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbef060e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbdd2ffd640 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdc8036900 0x7fbdc8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbdd2ffd640 1 -- 172.21.15.131:0/900594382 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fbee804bf90 con 0x562b72570ba0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbee7fff640 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdc8036900 0x7fbdc8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbef060e800 1 Processor -- start 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbef060e800 1 -- start start 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbee7fff640 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdc8036900 0x7fbdc8038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbed8000f60 tx=0x7fbed8001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbef060e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72592810 0x562b72592c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.146+0000 7fbef060e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562b7255c0e0 con 0x562b72592810 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbeee10d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72592810 0x562b72592c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbeee10d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72592810 0x562b72592c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36290/0 (socket says 172.21.15.131:36290) 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbeee10d640 1 -- 172.21.15.131:0/3579718209 learned_addr learned my addr 172.21.15.131:0/3579718209 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbeee10d640 1 -- 172.21.15.131:0/3579718209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b72593170 con 0x562b72592810 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbeee10d640 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72592810 0x562b72592c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbee0044810 tx=0x7fbee0067bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbdb2fe5640 1 -- 172.21.15.131:0/3579718209 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0092030 con 0x562b72592810 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbdb2fe5640 1 -- 172.21.15.131:0/3579718209 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee0058040 con 0x562b72592810 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b72593be0 con 0x562b72592810 2024-04-24T01:42:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbdb2fe5640 1 -- 172.21.15.131:0/3579718209 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0068950 con 0x562b72592810 2024-04-24T01:42:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.147+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b725940e0 con 0x562b72592810 2024-04-24T01:42:59.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbdb2fe5640 1 -- 172.21.15.131:0/3579718209 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbee0095030 con 0x562b72592810 2024-04-24T01:42:59.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbdb2fe5640 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbd30036950 0x7fbd30038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbdb2fe5640 1 -- 172.21.15.131:0/3579718209 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fbee0093070 con 0x562b72592810 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbee7fff640 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbd30036950 0x7fbd30038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbdb0fe1640 20 reqs_thread_entry: start 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbef060e800 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562b725a0210 0x562b725a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbee7fff640 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbd30036950 0x7fbd30038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbed8001ed0 tx=0x7fbed800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b725a2d50 con 0x562b725a0210 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.148+0000 7fbeee90e640 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562b725a0210 0x562b725a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.149+0000 7fbeee90e640 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562b725a0210 0x562b725a2680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.149+0000 7fbeee90e640 1 -- 172.21.15.131:0/2106650929 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbee800e070 con 0x562b725a0210 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.149+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b725a4610 con 0x562b725a0210 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.149+0000 7fbeee90e640 1 -- 172.21.15.131:0/2106650929 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbee800e070 con 0x562b725a0210 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.149+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b725a9190 con 0x562b725a0210 2024-04-24T01:42:59.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbeee90e640 1 -- 172.21.15.131:0/2106650929 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fbee800e070 con 0x562b725a0210 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdc8036900 msgr2=0x7fbdc8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdc8036900 0x7fbdc8038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbed8000f60 tx=0x7fbed8001230 comp rx=0 tx=0).stop 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 msgr2=0x562b72578100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72578100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbee800a930 tx=0x7fbee8003370 comp rx=0 tx=0).stop 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 shutdown_connections 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdc8036900 0x7fbdc8038dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 --2- 172.21.15.131:0/900594382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72570ba0 0x562b72578100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 >> 172.21.15.131:0/900594382 conn(0x562b723ddc90 msgr2=0x562b7256ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 shutdown_connections 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.151+0000 7fbef060e800 1 -- 172.21.15.131:0/900594382 wait complete. 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbd30036950 msgr2=0x7fbd30038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbd30036950 0x7fbd30038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbed8001ed0 tx=0x7fbed800f000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72592810 msgr2=0x562b72592c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72592810 0x562b72592c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbee0044810 tx=0x7fbee0067bb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 shutdown_connections 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbd30036950 0x7fbd30038e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/3579718209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b72592810 0x562b72592c30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 >> 172.21.15.131:0/3579718209 conn(0x562b72587380 msgr2=0x562b72587d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 shutdown_connections 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/3579718209 wait complete. 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562b725a0210 msgr2=0x562b725a2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562b725a0210 0x562b725a2680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdd4036950 msgr2=0x7fbdd4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdd4036950 0x7fbdd4038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbee0070fd0 tx=0x7fbee005ee70 comp rx=0 tx=0).stop 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 msgr2=0x562b725632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b725632f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbee0000c00 tx=0x7fbee0002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 shutdown_connections 2024-04-24T01:42:59.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562b725a0210 0x562b725a2680 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fbdd4036950 0x7fbdd4038e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 --2- 172.21.15.131:0/2106650929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562b723dc6e0 0x562b725632f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 >> 172.21.15.131:0/2106650929 conn(0x562b72463510 msgr2=0x562b72555970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 shutdown_connections 2024-04-24T01:42:59.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.152+0000 7fbef060e800 1 -- 172.21.15.131:0/2106650929 wait complete. 2024-04-24T01:42:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T01:42:59.162 DEBUG:tasks.util.rgw: json result: {'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T01:42:59.164 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-24T01:42:59.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-24T01:42:59.164 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-24T01:42:59.206 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:59.206 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:59.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56b190a800 1 Processor -- start 2024-04-24T01:42:59.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56b190a800 1 -- start start 2024-04-24T01:42:59.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56b190a800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561386e7c2b0 0x561386e84db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56b190a800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561386d3ad40 con 0x561386e7a770 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56b190a800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x561386d0d4d0 con 0x561386e7c2b0 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56a7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561386e7c2b0 0x561386e84db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56af409640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x561386e7a770 0x561386e7ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45700/0 (socket says 172.21.15.131:45700) 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56af409640 1 -- 172.21.15.131:0/994789436 learned_addr learned my addr 172.21.15.131:0/994789436 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56a7fff640 1 -- 172.21.15.131:0/994789436 >> v1:172.21.15.107:6789/0 conn(0x561386e7a770 legacy=0x561386e7ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56aec08640 1 -- 172.21.15.131:0/994789436 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068278896 0 0) 0x561386d3ad40 con 0x561386e7a770 2024-04-24T01:42:59.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.205+0000 7f56a7fff640 1 -- 172.21.15.131:0/994789436 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561386d39590 con 0x561386e7c2b0 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.207+0000 7f56a7fff640 1 --2- 172.21.15.131:0/994789436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386e84db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f569800a470 tx=0x7f569801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebce6ecb4c61abb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.207+0000 7f56aec08640 1 -- 172.21.15.131:0/994789436 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698057070 con 0x561386e7c2b0 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.207+0000 7f56aec08640 1 -- 172.21.15.131:0/994789436 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569804adc0 con 0x561386e7c2b0 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.207+0000 7f56aec08640 1 -- 172.21.15.131:0/994789436 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698052590 con 0x561386e7c2b0 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.208+0000 7f56b190a800 1 -- 172.21.15.131:0/994789436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 msgr2=0x561386e84db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.208+0000 7f56b190a800 1 --2- 172.21.15.131:0/994789436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386e84db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f569800a470 tx=0x7f569801ce90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.208+0000 7f56b190a800 1 -- 172.21.15.131:0/994789436 shutdown_connections 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.208+0000 7f56b190a800 1 --2- 172.21.15.131:0/994789436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386e84db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.208+0000 7f56b190a800 1 -- 172.21.15.131:0/994789436 >> 172.21.15.131:0/994789436 conn(0x561386e76310 msgr2=0x561386e78730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.208+0000 7f56b190a800 1 -- 172.21.15.131:0/994789436 shutdown_connections 2024-04-24T01:42:59.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.208+0000 7f56b190a800 1 -- 172.21.15.131:0/994789436 wait complete. 2024-04-24T01:42:59.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.219+0000 7f56b190a800 1 Processor -- start 2024-04-24T01:42:59.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.219+0000 7f56b190a800 1 -- start start 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.219+0000 7f56b190a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7a770 0x561386f6f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.219+0000 7f56b190a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561386dc73b0 con 0x561386e7a770 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f56af409640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7a770 0x561386f6f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f56af409640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7a770 0x561386f6f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36310/0 (socket says 172.21.15.131:36310) 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f56af409640 1 -- 172.21.15.131:0/3279140482 learned_addr learned my addr 172.21.15.131:0/3279140482 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f56af409640 1 -- 172.21.15.131:0/3279140482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561386f6f960 con 0x561386e7a770 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f56af409640 1 --2- 172.21.15.131:0/3279140482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7a770 0x561386f6f390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b210 tx=0x7f56a000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bb5f22b208aa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f559d60a640 1 -- 172.21.15.131:0/3279140482 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a0008070 con 0x561386e7a770 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f559d60a640 1 -- 172.21.15.131:0/3279140482 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a000d500 con 0x561386e7a770 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.220+0000 7f559d60a640 1 -- 172.21.15.131:0/3279140482 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a000d840 con 0x561386e7a770 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 -- 172.21.15.131:0/3279140482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7a770 msgr2=0x561386f6f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 --2- 172.21.15.131:0/3279140482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7a770 0x561386f6f390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b210 tx=0x7f56a000b6d0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 -- 172.21.15.131:0/3279140482 shutdown_connections 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 --2- 172.21.15.131:0/3279140482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7a770 0x561386f6f390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 -- 172.21.15.131:0/3279140482 >> 172.21.15.131:0/3279140482 conn(0x561386e76310 msgr2=0x561386f6acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 -- 172.21.15.131:0/3279140482 shutdown_connections 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 -- 172.21.15.131:0/3279140482 wait complete. 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 Processor -- start 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.221+0000 7f56b190a800 1 -- start start 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56b190a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386f771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56b190a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561386e875d0 con 0x561386e7c2b0 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56af409640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386f771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56af409640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386f771a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36316/0 (socket says 172.21.15.131:36316) 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56af409640 1 -- 172.21.15.131:0/2962548145 learned_addr learned my addr 172.21.15.131:0/2962548145 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56af409640 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561386f776e0 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56af409640 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386f771a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b210 tx=0x7f56a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f559be07640 1 -- 172.21.15.131:0/2962548145 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a000f8b0 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f559be07640 1 -- 172.21.15.131:0/2962548145 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a000fa50 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561386f77970 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f559be07640 1 -- 172.21.15.131:0/2962548145 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56a000fd90 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.222+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561386f7a620 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.223+0000 7f559be07640 1 -- 172.21.15.131:0/2962548145 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f56a0017040 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.223+0000 7f559be07640 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5594036900 0x7f5594038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.223+0000 7f559be07640 1 -- 172.21.15.131:0/2962548145 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f56a0015020 con 0x561386e7c2b0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.223+0000 7f56a7fff640 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5594036900 0x7f5594038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.223+0000 7f56b190a800 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386f7c3d0 0x561386f7e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.223+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386f7ed00 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.223+0000 7f56afc0a640 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386f7c3d0 0x561386f7e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.224+0000 7f56a7fff640 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5594036900 0x7f5594038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5698054000 tx=0x7f569804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.224+0000 7f56afc0a640 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386f7c3d0 0x561386f7e7c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.224+0000 7f56afc0a640 1 -- 172.21.15.131:0/2962548145 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56a800a4a0 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.224+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386f7b9b0 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.224+0000 7f56afc0a640 1 -- 172.21.15.131:0/2962548145 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56a800a4a0 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.224+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386f80b20 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.225+0000 7f56afc0a640 1 -- 172.21.15.131:0/2962548145 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56a800a4a0 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.225+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386f7fe60 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.225+0000 7f56afc0a640 1 -- 172.21.15.131:0/2962548145 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56a800a4a0 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.225+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386f802b0 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.225+0000 7f56afc0a640 1 -- 172.21.15.131:0/2962548145 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56a800a4a0 con 0x561386f7c3d0 2024-04-24T01:42:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.225+0000 7f56b190a800 1 Processor -- start 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56b190a800 1 -- start start 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56b190a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f8f8f0 0x561386f8fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56b190a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561386d6d6b0 con 0x561386f8f8f0 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f8f8f0 0x561386f8fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f8f8f0 0x561386f8fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36318/0 (socket says 172.21.15.131:36318) 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56a7fff640 1 -- 172.21.15.131:0/91372232 learned_addr learned my addr 172.21.15.131:0/91372232 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56a7fff640 1 -- 172.21.15.131:0/91372232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561386f90250 con 0x561386f8f8f0 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.226+0000 7f56a7fff640 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f8f8f0 0x561386f8fd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5698044730 tx=0x7f5698002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f5599602640 1 -- 172.21.15.131:0/91372232 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f569806e070 con 0x561386f8f8f0 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f5599602640 1 -- 172.21.15.131:0/91372232 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569805dc70 con 0x561386f8f8f0 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f5599602640 1 -- 172.21.15.131:0/91372232 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698057040 con 0x561386f8f8f0 2024-04-24T01:42:59.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561386f90cc0 con 0x561386f8f8f0 2024-04-24T01:42:59.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561386f91160 con 0x561386f8f8f0 2024-04-24T01:42:59.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f5599602640 1 -- 172.21.15.131:0/91372232 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5698071070 con 0x561386f8f8f0 2024-04-24T01:42:59.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f5599602640 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5588036950 0x7f5588038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f5599602640 1 -- 172.21.15.131:0/91372232 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5698066070 con 0x561386f8f8f0 2024-04-24T01:42:59.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.227+0000 7f56afc0a640 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5588036950 0x7f5588038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56b190a800 1 Processor -- start 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56b190a800 1 -- start start 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56afc0a640 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5588036950 0x7f5588038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561386f7f980 tx=0x7f56a8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56b190a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386f9cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56b190a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561386f6fce0 con 0x561386f9cad0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386f9cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386f9cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36334/0 (socket says 172.21.15.131:36334) 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56a7fff640 1 -- 172.21.15.131:0/2623290469 learned_addr learned my addr 172.21.15.131:0/2623290469 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56a7fff640 1 -- 172.21.15.131:0/2623290469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561386f9d4c0 con 0x561386f9cad0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.228+0000 7f56a7fff640 1 --2- 172.21.15.131:0/2623290469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386f9cef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f569805d970 tx=0x7f569805be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38777b7cf6bb665a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f5592ffd640 1 -- 172.21.15.131:0/2623290469 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698052c90 con 0x561386f9cad0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f5592ffd640 1 -- 172.21.15.131:0/2623290469 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5698002950 con 0x561386f9cad0 2024-04-24T01:42:59.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f5592ffd640 1 -- 172.21.15.131:0/2623290469 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698052e30 con 0x561386f9cad0 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 -- 172.21.15.131:0/2623290469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 msgr2=0x561386f9cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 --2- 172.21.15.131:0/2623290469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386f9cef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f569805d970 tx=0x7f569805be90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 -- 172.21.15.131:0/2623290469 shutdown_connections 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 --2- 172.21.15.131:0/2623290469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386f9cef0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 -- 172.21.15.131:0/2623290469 >> 172.21.15.131:0/2623290469 conn(0x561386f98e30 msgr2=0x561386f96e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 -- 172.21.15.131:0/2623290469 shutdown_connections 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 -- 172.21.15.131:0/2623290469 wait complete. 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 Processor -- start 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.229+0000 7f56b190a800 1 -- start start 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56b190a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386fa41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56b190a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561386f9dc30 con 0x561386f9cad0 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386fa41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386fa41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36348/0 (socket says 172.21.15.131:36348) 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 learned_addr learned my addr 172.21.15.131:0/1937460436 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561386fa4720 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56a7fff640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386fa41e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56980714d0 tx=0x7f569808d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f55917fa640 1 -- 172.21.15.131:0/1937460436 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698052900 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f55917fa640 1 -- 172.21.15.131:0/1937460436 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5698071970 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561386fa49b0 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f55917fa640 1 -- 172.21.15.131:0/1937460436 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698071cb0 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.230+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561386fa49b0 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.231+0000 7f55917fa640 1 -- 172.21.15.131:0/1937460436 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f569809b060 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.231+0000 7f55917fa640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5578036af0 0x7f5578038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.231+0000 7f55917fa640 1 -- 172.21.15.131:0/1937460436 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5698095c30 con 0x561386f9cad0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.231+0000 7f56afc0a640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5578036af0 0x7f5578038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.231+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.231+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386fafae0 0x561386fb1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.231+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb26f0 con 0x561386fafae0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56af409640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386fafae0 0x561386fb1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56afc0a640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5578036af0 0x7f5578038fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x561386f77fc0 tx=0x7f56a801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56af409640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386fafae0 0x561386fb1fa0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 20 realm 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb2b00 con 0x561386fafae0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.232+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb33a0 con 0x561386fafae0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb3740 con 0x561386fafae0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb2ff0 con 0x561386fafae0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 20 searching for the correct realm 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561386fb5bf0 0x561386fb8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56a7fff640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561386fb5bf0 0x561386fb8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.233+0000 7f56a7fff640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561386fb5bf0 0x561386fb8000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56a7fff640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f569809d070 0x7f5698001f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f569809d070 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56afc0a640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f569809d070 0x7f5698001f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56afc0a640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f569809d070 0x7f5698001f00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a801f070 con 0x7f569809d070 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56afc0a640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f56a8031040 0x7f56a8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.234+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.235+0000 7f56af409640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f56a8031040 0x7f56a8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.235+0000 7f56af409640 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f56a8031040 0x7f56a8032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.235+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.235+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.235+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f569809d070 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a801f070 con 0x7f569809d070 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.236+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.237+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f569809d070 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56a801f070 con 0x7f569809d070 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.238+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.239+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f569809d070 2024-04-24T01:42:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a801f070 con 0x7f569809d070 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.240+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.241+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.241+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.241+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.241+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f569809d070 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a801f070 con 0x7f569809d070 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fb5bf0 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f56a8031040 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x561386fafae0 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.242+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561386fb86d0 con 0x7f569809d070 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56a801f070 con 0x7f569809d070 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb4690 con 0x561386fafae0 2024-04-24T01:42:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb4f30 con 0x561386fafae0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb42d0 con 0x561386fafae0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 zone default found 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 4 Realm: () 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 zonegroup default 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.243+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fb9000 con 0x7f56a8031040 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56b190a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fbaa10 con 0x561386fb5bf0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56b190a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56b190a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.244+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fbaf00 con 0x561386fb5bf0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.245+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.245+0000 7f56b190a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.245+0000 7f56b190a800 20 started sync module instance, tier type = 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.245+0000 7f56b190a800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.245+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fb9e70 con 0x7f569809d070 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.246+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.246+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94641869005408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fb9ad0 con 0x7f569809d070 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.246+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbbe70 con 0x561386fafae0 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.247+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94641869005408] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.247+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.247+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94641869009760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbbe30 con 0x561386fafae0 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.247+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbc8d0 con 0x561386fb5bf0 2024-04-24T01:42:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.248+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94641869009760] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.248+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.248+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94641869011328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbbda0 con 0x561386fb5bf0 2024-04-24T01:42:59.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.248+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbd790 con 0x7f569809d070 2024-04-24T01:42:59.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.249+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.249+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94641869018304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbdef0 con 0x7f569809d070 2024-04-24T01:42:59.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.249+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbea10 con 0x561386fafae0 2024-04-24T01:42:59.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.250+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94641869011328] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.250+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94641869018304] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.251+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.251+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94641869022432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbe9d0 con 0x561386fafae0 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.251+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbf2b0 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.252+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.252+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94641869023696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbf340 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.252+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbfe60 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.252+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94641869022432] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.253+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94641869023696] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.253+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.253+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94641869024752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbfe20 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.253+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fc0700 con 0x7f56a8031040 2024-04-24T01:42:59.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94641869024752] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94641869027632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fbfe20 con 0x7f56a8031040 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 20 add_watcher() i=0 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 20 add_watcher() i=1 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 20 add_watcher() i=2 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 20 add_watcher() i=3 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 20 add_watcher() i=4 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 20 add_watcher() i=5 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.254+0000 7f56b190a800 20 add_watcher() i=6 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.255+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94641869027632] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.255+0000 7f56b190a800 20 add_watcher() i=7 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.255+0000 7f56b190a800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.255+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386fc36e0 con 0x561386fafae0 2024-04-24T01:42:59.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.255+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.255+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94641869029888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386fc0be0 con 0x561386fafae0 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.257+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94641869029888] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.257+0000 7f5565fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.257+0000 7f56b190a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.257+0000 7f56b190a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.257+0000 7f56b190a800 5 note: GC not initialized 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.257+0000 7f5564fe1640 20 reqs_thread_entry: start 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56b190a800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56b190a800 20 Filter name: none 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f54de7fc640 20 reqs_thread_entry: start 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff6fd0 con 0x561386fafae0 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff6fd0 con 0x7f569809d070 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff6f90 con 0x561386fafae0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.258+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff6f90 con 0x561386fb5bf0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff74f0 con 0x561386fb5bf0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff74f0 con 0x561386fb5bf0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff74f0 con 0x561386fafae0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.259+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff74f0 con 0x561386fafae0 2024-04-24T01:42:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.260+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f569809d070 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.261+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.262+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f569809d070 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.263+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.264+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.265+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.265+0000 7f5565fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.265+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94641869029888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.266+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94641869029888] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.266+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94641869005408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f569809d070 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.267+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94641869005408] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.267+0000 7f56b190a800 20 remove_watcher() i=0 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.267+0000 7f56b190a800 2 removed watcher, disabling cache 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.267+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94641869009760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.269+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94641869009760] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.269+0000 7f56b190a800 20 remove_watcher() i=1 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.269+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94641869011328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fb5bf0 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.270+0000 7f56a7fff640 1 -- 172.21.15.131:0/1937460436 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94641869011328] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5698070030 con 0x561386fb5bf0 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.270+0000 7f56b190a800 20 remove_watcher() i=2 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.270+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94641869018304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f569809d070 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.270+0000 7f56afc0a640 1 -- 172.21.15.131:0/1937460436 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94641869018304] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a8040040 con 0x7f569809d070 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.270+0000 7f56b190a800 20 remove_watcher() i=3 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.270+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94641869022432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x561386fafae0 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.271+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94641869022432] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x561386fafae0 2024-04-24T01:42:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.271+0000 7f56b190a800 20 remove_watcher() i=4 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.271+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94641869023696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.272+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94641869023696] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.272+0000 7f56b190a800 20 remove_watcher() i=5 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.272+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94641869024752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.273+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94641869024752] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.273+0000 7f56b190a800 20 remove_watcher() i=6 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.273+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94641869027632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561386ff7450 con 0x7f56a8031040 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94641869027632] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56a002d070 con 0x7f56a8031040 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 20 remove_watcher() i=7 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f56a8031040 msgr2=0x7f56a8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f56a8031040 0x7f56a8032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386fafae0 msgr2=0x561386fb1fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386fafae0 0x561386fb1fa0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f569809d070 msgr2=0x7f5698001f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f569809d070 0x7f5698001f00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561386fb5bf0 msgr2=0x561386fb8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561386fb5bf0 0x561386fb8000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5578036af0 msgr2=0x7f5578038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5578036af0 0x7f5578038fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x561386f77fc0 tx=0x7f56a801f000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 msgr2=0x561386fa41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56af409640 1 -- 172.21.15.131:0/1937460436 reap_dead start 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386fa41e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56980714d0 tx=0x7f569808d430 comp rx=0 tx=0).stop 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 shutdown_connections 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 --2- 172.21.15.131:0/1937460436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f9cad0 0x561386fa41e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.274+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 >> 172.21.15.131:0/1937460436 conn(0x561386f98e30 msgr2=0x561386f96490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 shutdown_connections 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/1937460436 wait complete. 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5588036950 msgr2=0x7f5588038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5588036950 0x7f5588038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561386f7f980 tx=0x7f56a8005840 comp rx=0 tx=0).stop 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f8f8f0 msgr2=0x561386f8fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f8f8f0 0x561386f8fd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5698044730 tx=0x7f5698002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 shutdown_connections 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5588036950 0x7f5588038e10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/91372232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386f8f8f0 0x561386f8fd10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 >> 172.21.15.131:0/91372232 conn(0x561386f83990 msgr2=0x561386f83d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 shutdown_connections 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/91372232 wait complete. 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386f7c3d0 msgr2=0x561386f7e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386f7c3d0 0x561386f7e7c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5594036900 msgr2=0x7f5594038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5594036900 0x7f5594038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5698054000 tx=0x7f569804e000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 msgr2=0x561386f771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386f771a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b210 tx=0x7f56a0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 shutdown_connections 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561386f7c3d0 0x561386f7e7c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5594036900 0x7f5594038dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 --2- 172.21.15.131:0/2962548145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561386e7c2b0 0x561386f771a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 >> 172.21.15.131:0/2962548145 conn(0x561386e76310 msgr2=0x561386f694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.275+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 shutdown_connections 2024-04-24T01:42:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.276+0000 7f56b190a800 1 -- 172.21.15.131:0/2962548145 wait complete. 2024-04-24T01:42:59.291 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[],"summary":[]} 2024-04-24T01:42:59.292 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-24T01:42:59.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:42:59.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:42:59.292 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:42:59.375 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:59.375 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:59.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.375+0000 7fa778d19800 1 Processor -- start 2024-04-24T01:42:59.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.375+0000 7fa778d19800 1 -- start start 2024-04-24T01:42:59.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.375+0000 7fa778d19800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5601cb7a0970 0x5601cb7a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.375+0000 7fa778d19800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601cb65ed40 con 0x5601cb7a32a0 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.375+0000 7fa778d19800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5601cb6314d0 con 0x5601cb7a0970 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.376+0000 7fa776818640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5601cb7a0970 0x5601cb7a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.376+0000 7fa76e017640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5601cb7a32a0 0x5601cb7a5690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45716/0 (socket says 172.21.15.131:45716) 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.376+0000 7fa76e017640 1 -- 172.21.15.131:0/164898547 learned_addr learned my addr 172.21.15.131:0/164898547 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.376+0000 7fa776818640 1 -- 172.21.15.131:0/164898547 >> v1:172.21.15.107:6789/0 conn(0x5601cb7a32a0 legacy=0x5601cb7a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.376+0000 7fa776818640 1 -- 172.21.15.131:0/164898547 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601cb65d590 con 0x5601cb7a0970 2024-04-24T01:42:59.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.376+0000 7fa776017640 1 -- 172.21.15.131:0/164898547 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4263183470 0 0) 0x5601cb65ed40 con 0x5601cb7a32a0 2024-04-24T01:42:59.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa776818640 1 --2- 172.21.15.131:0/164898547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a2d60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa76800a470 tx=0x7fa76801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d2f3bcc9b7497f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa776017640 1 -- 172.21.15.131:0/164898547 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768057070 con 0x5601cb7a0970 2024-04-24T01:42:59.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa776017640 1 -- 172.21.15.131:0/164898547 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa768052570 con 0x5601cb7a0970 2024-04-24T01:42:59.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa776017640 1 -- 172.21.15.131:0/164898547 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768052870 con 0x5601cb7a0970 2024-04-24T01:42:59.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa778d19800 1 -- 172.21.15.131:0/164898547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 msgr2=0x5601cb7a2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa778d19800 1 --2- 172.21.15.131:0/164898547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a2d60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa76800a470 tx=0x7fa76801ce90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa778d19800 1 -- 172.21.15.131:0/164898547 shutdown_connections 2024-04-24T01:42:59.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa778d19800 1 --2- 172.21.15.131:0/164898547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a2d60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa778d19800 1 -- 172.21.15.131:0/164898547 >> 172.21.15.131:0/164898547 conn(0x5601cb79a300 msgr2=0x5601cb79c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.378+0000 7fa778d19800 1 -- 172.21.15.131:0/164898547 shutdown_connections 2024-04-24T01:42:59.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.379+0000 7fa778d19800 1 -- 172.21.15.131:0/164898547 wait complete. 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.390+0000 7fa778d19800 1 Processor -- start 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.390+0000 7fa778d19800 1 -- start start 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.390+0000 7fa778d19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.390+0000 7fa778d19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5601cb6eb3c0 con 0x5601cb7a0970 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa776818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa776818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36364/0 (socket says 172.21.15.131:36364) 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa776818640 1 -- 172.21.15.131:0/2532687696 learned_addr learned my addr 172.21.15.131:0/2532687696 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa776818640 1 -- 172.21.15.131:0/2532687696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601cb79e870 con 0x5601cb7a0970 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa776818640 1 --2- 172.21.15.131:0/2532687696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a02b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa768055040 tx=0x7fa76804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1b2a57d085a4f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa664e09640 1 -- 172.21.15.131:0/2532687696 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768057070 con 0x5601cb7a0970 2024-04-24T01:42:59.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa664e09640 1 -- 172.21.15.131:0/2532687696 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa768063070 con 0x5601cb7a0970 2024-04-24T01:42:59.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.391+0000 7fa664e09640 1 -- 172.21.15.131:0/2532687696 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768052720 con 0x5601cb7a0970 2024-04-24T01:42:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 -- 172.21.15.131:0/2532687696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 msgr2=0x5601cb7a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 --2- 172.21.15.131:0/2532687696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a02b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa768055040 tx=0x7fa76804c000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 -- 172.21.15.131:0/2532687696 shutdown_connections 2024-04-24T01:42:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 --2- 172.21.15.131:0/2532687696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb7a02b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 -- 172.21.15.131:0/2532687696 >> 172.21.15.131:0/2532687696 conn(0x5601cb79a300 msgr2=0x5601cb88c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 -- 172.21.15.131:0/2532687696 shutdown_connections 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 -- 172.21.15.131:0/2532687696 wait complete. 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 Processor -- start 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 -- start start 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb89ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.392+0000 7fa778d19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5601cb7a90c0 con 0x5601cb7a0970 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa776818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb89ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa776818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb89ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36370/0 (socket says 172.21.15.131:36370) 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa776818640 1 -- 172.21.15.131:0/3505777831 learned_addr learned my addr 172.21.15.131:0/3505777831 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa776818640 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601cb89b0a0 con 0x5601cb7a0970 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa776818640 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb89ab60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa768060040 tx=0x7fa768002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa663606640 1 -- 172.21.15.131:0/3505777831 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa768052e30 con 0x5601cb7a0970 2024-04-24T01:42:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa663606640 1 -- 172.21.15.131:0/3505777831 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76806c070 con 0x5601cb7a0970 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601cb89b330 con 0x5601cb7a0970 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa663606640 1 -- 172.21.15.131:0/3505777831 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76805e5f0 con 0x5601cb7a0970 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.393+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601cb89dfe0 con 0x5601cb7a0970 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.394+0000 7fa663606640 1 -- 172.21.15.131:0/3505777831 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa76805e790 con 0x5601cb7a0970 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.394+0000 7fa663606640 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa65c036950 0x7fa65c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.394+0000 7fa663606640 1 -- 172.21.15.131:0/3505777831 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa76808e880 con 0x5601cb7a0970 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.394+0000 7fa76e017640 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa65c036950 0x7fa65c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.394+0000 7fa778d19800 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb7a32a0 0x5601cb8a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.394+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8a22e0 con 0x5601cb7a32a0 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.394+0000 7fa777019640 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb7a32a0 0x5601cb8a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.395+0000 7fa76e017640 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa65c036950 0x7fa65c038e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa760000c00 tx=0x7fa7600013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.395+0000 7fa777019640 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb7a32a0 0x5601cb8a1da0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.395+0000 7fa777019640 1 -- 172.21.15.131:0/3505777831 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa77000a4a0 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.395+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb89f350 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.395+0000 7fa777019640 1 -- 172.21.15.131:0/3505777831 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa77000a4a0 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.395+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8a40c0 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.396+0000 7fa777019640 1 -- 172.21.15.131:0/3505777831 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa77000a4a0 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.396+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8a3400 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.396+0000 7fa777019640 1 -- 172.21.15.131:0/3505777831 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa77000a4a0 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.396+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8a3850 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.396+0000 7fa777019640 1 -- 172.21.15.131:0/3505777831 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa77000a4a0 con 0x5601cb7a32a0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.396+0000 7fa778d19800 1 Processor -- start 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa778d19800 1 -- start start 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa778d19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8b2eb0 0x5601cb8b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa778d19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5601cb6916b0 con 0x5601cb8b2eb0 2024-04-24T01:42:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa76e017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8b2eb0 0x5601cb8b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa76e017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8b2eb0 0x5601cb8b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36382/0 (socket says 172.21.15.131:36382) 2024-04-24T01:42:59.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa76e017640 1 -- 172.21.15.131:0/4019289911 learned_addr learned my addr 172.21.15.131:0/4019289911 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa76e017640 1 -- 172.21.15.131:0/4019289911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601cb8b3810 con 0x5601cb8b2eb0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa76e017640 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8b2eb0 0x5601cb8b32d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e610 tx=0x7fa76000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.397+0000 7fa660e01640 1 -- 172.21.15.131:0/4019289911 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa760022070 con 0x5601cb8b2eb0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.398+0000 7fa660e01640 1 -- 172.21.15.131:0/4019289911 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760009050 con 0x5601cb8b2eb0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.398+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601cb8b4280 con 0x5601cb8b2eb0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.398+0000 7fa660e01640 1 -- 172.21.15.131:0/4019289911 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76000d500 con 0x5601cb8b2eb0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.398+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601cb8b4780 con 0x5601cb8b2eb0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.398+0000 7fa660e01640 1 -- 172.21.15.131:0/4019289911 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa760025070 con 0x5601cb8b2eb0 2024-04-24T01:42:59.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.398+0000 7fa660e01640 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa650036950 0x7fa650038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.398+0000 7fa660e01640 1 -- 172.21.15.131:0/4019289911 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa76004db70 con 0x5601cb8b2eb0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa777019640 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa650036950 0x7fa650038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa778d19800 1 Processor -- start 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa778d19800 1 -- start start 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa777019640 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa650036950 0x7fa650038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5601cb8a2f20 tx=0x7fa770005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa778d19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa778d19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5601cb79eb30 con 0x5601cb8c01f0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa76e017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa76e017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36386/0 (socket says 172.21.15.131:36386) 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa76e017640 1 -- 172.21.15.131:0/3529973031 learned_addr learned my addr 172.21.15.131:0/3529973031 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.399+0000 7fa76e017640 1 -- 172.21.15.131:0/3529973031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601cb8c0be0 con 0x5601cb8c01f0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa76e017640 1 --2- 172.21.15.131:0/3529973031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c0610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa760026fd0 tx=0x7fa760024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992d2900630b844f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa65a7fc640 1 -- 172.21.15.131:0/3529973031 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76004a030 con 0x5601cb8c01f0 2024-04-24T01:42:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa65a7fc640 1 -- 172.21.15.131:0/3529973031 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760025e30 con 0x5601cb8c01f0 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa65a7fc640 1 -- 172.21.15.131:0/3529973031 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76001ad50 con 0x5601cb8c01f0 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa778d19800 1 -- 172.21.15.131:0/3529973031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 msgr2=0x5601cb8c0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa778d19800 1 --2- 172.21.15.131:0/3529973031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c0610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa760026fd0 tx=0x7fa760024eb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa778d19800 1 -- 172.21.15.131:0/3529973031 shutdown_connections 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa778d19800 1 --2- 172.21.15.131:0/3529973031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c0610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa778d19800 1 -- 172.21.15.131:0/3529973031 >> 172.21.15.131:0/3529973031 conn(0x5601cb8bc550 msgr2=0x5601cb8ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa778d19800 1 -- 172.21.15.131:0/3529973031 shutdown_connections 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.400+0000 7fa778d19800 1 -- 172.21.15.131:0/3529973031 wait complete. 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa778d19800 1 Processor -- start 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa778d19800 1 -- start start 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa778d19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa778d19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5601cb8c1350 con 0x5601cb8c01f0 2024-04-24T01:42:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa76e017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa76e017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36398/0 (socket says 172.21.15.131:36398) 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 learned_addr learned my addr 172.21.15.131:0/3724300642 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601cb8c7da0 con 0x5601cb8c01f0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa76e017640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c7860 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa760026fd0 tx=0x7fa76004be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa658ff9640 1 -- 172.21.15.131:0/3724300642 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76004a050 con 0x5601cb8c01f0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa658ff9640 1 -- 172.21.15.131:0/3724300642 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76000d6a0 con 0x5601cb8c01f0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601cb8c8030 con 0x5601cb8c01f0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa658ff9640 1 -- 172.21.15.131:0/3724300642 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76000d9e0 con 0x5601cb8c01f0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.401+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601cb8cace0 con 0x5601cb8c01f0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.402+0000 7fa658ff9640 1 -- 172.21.15.131:0/3724300642 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa76004d370 con 0x5601cb8c01f0 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.402+0000 7fa658ff9640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa640036900 0x7fa640038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.402+0000 7fa658ff9640 1 -- 172.21.15.131:0/3724300642 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa760045880 con 0x5601cb8c01f0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa777019640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa640036900 0x7fa640038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb8d3370 0x5601cb8d5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d5f80 con 0x5601cb8d3370 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa776818640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb8d3370 0x5601cb8d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa777019640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa640036900 0x7fa640038dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5601cb89f2c0 tx=0x7fa77001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa776818640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb8d3370 0x5601cb8d5830 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa778d19800 20 realm 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.403+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d6390 con 0x5601cb8d3370 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d6c60 con 0x5601cb8d3370 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7000 con 0x5601cb8d3370 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 20 searching for the correct realm 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5601cb8d94b0 0x5601cb8db8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8dbf50 con 0x5601cb8d94b0 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.404+0000 7fa76e017640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5601cb8d94b0 0x5601cb8db8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.405+0000 7fa76e017640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5601cb8d94b0 0x5601cb8db8a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.405+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.405+0000 7fa76e017640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa760027060 0x7fa7600467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.405+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8dbf50 con 0x7fa760027060 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.405+0000 7fa777019640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa760027060 0x7fa7600467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.405+0000 7fa777019640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa760027060 0x7fa7600467d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.406+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa77001f070 con 0x7fa760027060 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.406+0000 7fa777019640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa770031040 0x7fa770032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.406+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8dbf50 con 0x7fa770031040 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.406+0000 7fa776818640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa770031040 0x7fa770032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.406+0000 7fa776818640 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa770031040 0x7fa770032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.406+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.406+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.407+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa760027060 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa77001f070 con 0x7fa760027060 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.408+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa760027060 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa77001f070 con 0x7fa760027060 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.409+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.410+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa760027060 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa77001f070 con 0x7fa760027060 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.411+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa760027060 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa77001f070 con 0x7fa760027060 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d94b0 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.412+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa770031040 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x5601cb8d3370 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7460 con 0x7fa760027060 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa77001f070 con 0x7fa760027060 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.413+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d7dd0 con 0x5601cb8d3370 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d81c0 con 0x5601cb8d3370 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d81c0 con 0x5601cb8d3370 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 zone default found 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 4 Realm: () 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 zonegroup default 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d85e0 con 0x7fa770031040 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.414+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8d8a00 con 0x5601cb8d94b0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8ddd90 con 0x5601cb8d94b0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa778d19800 20 started sync module instance, tier type = 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa778d19800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.415+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8dd230 con 0x7fa760027060 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.416+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa770040040 con 0x7fa760027060 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.416+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94565710026272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8de670 con 0x7fa760027060 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.416+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8deec0 con 0x5601cb8d3370 2024-04-24T01:42:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.417+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94565710026272] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa770040040 con 0x7fa760027060 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.417+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.417+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94565710029248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8deaf0 con 0x5601cb8d3370 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.417+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8df600 con 0x5601cb8d94b0 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.418+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94565710029248] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.418+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.418+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94565710033072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8df9f0 con 0x5601cb8d94b0 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.418+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e03f0 con 0x7fa760027060 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.419+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94565710033072] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.419+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa770040040 con 0x7fa760027060 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.419+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94565710030304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e0810 con 0x7fa760027060 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.419+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e1260 con 0x5601cb8d3370 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.420+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94565710030304] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa770040040 con 0x7fa760027060 2024-04-24T01:42:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.420+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.420+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94565710040400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e1220 con 0x5601cb8d3370 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.420+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e1d10 con 0x7fa770031040 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.421+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.421+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94565710043120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e1d10 con 0x7fa770031040 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.421+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e2c30 con 0x7fa770031040 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.421+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94565710040400] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.422+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94565710043120] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.422+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.422+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94565710047008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e1ef0 con 0x7fa770031040 2024-04-24T01:42:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.422+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e34d0 con 0x7fa770031040 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94565710047008] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94565710036736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e30c0 con 0x7fa770031040 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 20 add_watcher() i=0 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 20 add_watcher() i=1 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 20 add_watcher() i=2 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 20 add_watcher() i=3 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 20 add_watcher() i=4 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 20 add_watcher() i=5 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.423+0000 7fa778d19800 20 add_watcher() i=6 2024-04-24T01:42:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.424+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94565710036736] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.424+0000 7fa778d19800 20 add_watcher() i=7 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.424+0000 7fa778d19800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.424+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e64c0 con 0x5601cb8d3370 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.425+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.425+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94565710048736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e39e0 con 0x5601cb8d3370 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.427+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94565710048736] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.427+0000 7fa62d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.427+0000 7fa778d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.427+0000 7fa778d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.427+0000 7fa778d19800 5 note: GC not initialized 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.427+0000 7fa5a7fff640 20 reqs_thread_entry: start 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.427+0000 7fa778d19800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.428+0000 7fa778d19800 20 Filter name: none 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.428+0000 7fa5a5ffb640 20 reqs_thread_entry: start 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.428+0000 7fa778d19800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.428+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601cb919320 con 0x5601cb8d3370 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.428+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.428+0000 7fa778d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:could not fetch user info: no user info saved 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.429+0000 7fa62d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.429+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94565710048736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb9192e0 con 0x5601cb8d3370 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.430+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94565710048736] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.430+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94565710026272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb9192e0 con 0x7fa760027060 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.431+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94565710026272] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa770040040 con 0x7fa760027060 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.431+0000 7fa778d19800 20 remove_watcher() i=0 2024-04-24T01:42:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.431+0000 7fa778d19800 2 removed watcher, disabling cache 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.431+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94565710029248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb9192e0 con 0x5601cb8d3370 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.432+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94565710029248] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.432+0000 7fa778d19800 20 remove_watcher() i=1 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.432+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94565710033072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb9192e0 con 0x5601cb8d94b0 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.433+0000 7fa76e017640 1 -- 172.21.15.131:0/3724300642 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94565710033072] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa760024030 con 0x5601cb8d94b0 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.433+0000 7fa778d19800 20 remove_watcher() i=2 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.433+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94565710030304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8de1c0 con 0x7fa760027060 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.434+0000 7fa777019640 1 -- 172.21.15.131:0/3724300642 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94565710030304] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa770040040 con 0x7fa760027060 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.434+0000 7fa778d19800 20 remove_watcher() i=3 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.434+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94565710040400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8dd620 con 0x5601cb8d3370 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.435+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94565710040400] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x5601cb8d3370 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.435+0000 7fa778d19800 20 remove_watcher() i=4 2024-04-24T01:42:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.435+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94565710043120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8dd620 con 0x7fa770031040 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.436+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94565710043120] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.436+0000 7fa778d19800 20 remove_watcher() i=5 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.436+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94565710047008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8e17f0 con 0x7fa770031040 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.437+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94565710047008] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.437+0000 7fa778d19800 20 remove_watcher() i=6 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.437+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94565710036736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601cb8dd620 con 0x7fa770031040 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94565710036736] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa768071990 con 0x7fa770031040 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 20 remove_watcher() i=7 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa770031040 msgr2=0x7fa770032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa770031040 0x7fa770032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb8d3370 msgr2=0x5601cb8d5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb8d3370 0x5601cb8d5830 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa760027060 msgr2=0x7fa7600467d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa760027060 0x7fa7600467d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5601cb8d94b0 msgr2=0x5601cb8db8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.438+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5601cb8d94b0 0x5601cb8db8a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa640036900 msgr2=0x7fa640038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa640036900 0x7fa640038dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5601cb89f2c0 tx=0x7fa77001f000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 msgr2=0x5601cb8c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa776818640 1 -- 172.21.15.131:0/3724300642 reap_dead start 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c7860 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa760026fd0 tx=0x7fa76004be50 comp rx=0 tx=0).stop 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 shutdown_connections 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/3724300642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8c01f0 0x5601cb8c7860 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 >> 172.21.15.131:0/3724300642 conn(0x5601cb8bc550 msgr2=0x5601cb8b9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 shutdown_connections 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3724300642 wait complete. 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa650036950 msgr2=0x7fa650038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa650036950 0x7fa650038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5601cb8a2f20 tx=0x7fa770005840 comp rx=0 tx=0).stop 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8b2eb0 msgr2=0x5601cb8b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8b2eb0 0x5601cb8b32d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e610 tx=0x7fa76000ff90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 shutdown_connections 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa650036950 0x7fa650038e10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/4019289911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb8b2eb0 0x5601cb8b32d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 >> 172.21.15.131:0/4019289911 conn(0x5601cb8a6f50 msgr2=0x5601cb8a7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 shutdown_connections 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/4019289911 wait complete. 2024-04-24T01:42:59.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb7a32a0 msgr2=0x5601cb8a1da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb7a32a0 0x5601cb8a1da0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa65c036950 msgr2=0x7fa65c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa65c036950 0x7fa65c038e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa760000c00 tx=0x7fa7600013b0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 msgr2=0x5601cb89ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.439+0000 7fa778d19800 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb89ab60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa768060040 tx=0x7fa768002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.440+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 shutdown_connections 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.440+0000 7fa778d19800 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5601cb7a32a0 0x5601cb8a1da0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.440+0000 7fa778d19800 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa65c036950 0x7fa65c038e10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.440+0000 7fa778d19800 1 --2- 172.21.15.131:0/3505777831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cb7a0970 0x5601cb89ab60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.440+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 >> 172.21.15.131:0/3505777831 conn(0x5601cb79a300 msgr2=0x5601cb88c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.440+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 shutdown_connections 2024-04-24T01:42:59.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.440+0000 7fa778d19800 1 -- 172.21.15.131:0/3505777831 wait complete. 2024-04-24T01:42:59.455 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-24T01:42:59.455 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-24T01:42:59.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-24T01:42:59.456 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-24T01:42:59.549 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:59.549 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:59.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe69080e800 1 Processor -- start 2024-04-24T01:42:59.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe69080e800 1 -- start start 2024-04-24T01:42:59.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe69080e800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564be5905280 0x564be590dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe69080e800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564be57c3d40 con 0x564be5903740 2024-04-24T01:42:59.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe69080e800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x564be57964d0 con 0x564be5905280 2024-04-24T01:42:59.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe68db0c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564be5905280 0x564be590dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe68e30d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x564be5903740 0x564be5903b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45730/0 (socket says 172.21.15.131:45730) 2024-04-24T01:42:59.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.549+0000 7fe68e30d640 1 -- 172.21.15.131:0/3257300154 learned_addr learned my addr 172.21.15.131:0/3257300154 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:59.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.550+0000 7fe68db0c640 1 -- 172.21.15.131:0/3257300154 >> v1:172.21.15.107:6789/0 conn(0x564be5903740 legacy=0x564be5903b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.550+0000 7fe68d30b640 1 -- 172.21.15.131:0/3257300154 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594682259 0 0) 0x564be57c3d40 con 0x564be5903740 2024-04-24T01:42:59.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.550+0000 7fe68db0c640 1 -- 172.21.15.131:0/3257300154 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be57c2590 con 0x564be5905280 2024-04-24T01:42:59.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.551+0000 7fe68db0c640 1 --2- 172.21.15.131:0/3257300154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5905280 0x564be590dd80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe68000a470 tx=0x7fe68001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cee436d6983113 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe68d30b640 1 -- 172.21.15.131:0/3257300154 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680057070 con 0x564be5905280 2024-04-24T01:42:59.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe68d30b640 1 -- 172.21.15.131:0/3257300154 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680052440 con 0x564be5905280 2024-04-24T01:42:59.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe68d30b640 1 -- 172.21.15.131:0/3257300154 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680052740 con 0x564be5905280 2024-04-24T01:42:59.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe69080e800 1 -- 172.21.15.131:0/3257300154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5905280 msgr2=0x564be590dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe69080e800 1 --2- 172.21.15.131:0/3257300154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5905280 0x564be590dd80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe68000a470 tx=0x7fe68001ce90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe69080e800 1 -- 172.21.15.131:0/3257300154 shutdown_connections 2024-04-24T01:42:59.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe69080e800 1 --2- 172.21.15.131:0/3257300154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5905280 0x564be590dd80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe69080e800 1 -- 172.21.15.131:0/3257300154 >> 172.21.15.131:0/3257300154 conn(0x564be58ff2c0 msgr2=0x564be59016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe69080e800 1 -- 172.21.15.131:0/3257300154 shutdown_connections 2024-04-24T01:42:59.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.552+0000 7fe69080e800 1 -- 172.21.15.131:0/3257300154 wait complete. 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.564+0000 7fe69080e800 1 Processor -- start 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.564+0000 7fe69080e800 1 -- start start 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.564+0000 7fe69080e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59f8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.564+0000 7fe69080e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564be5850360 con 0x564be5903740 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.564+0000 7fe68e30d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.564+0000 7fe68e30d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59f8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36422/0 (socket says 172.21.15.131:36422) 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.564+0000 7fe68e30d640 1 -- 172.21.15.131:0/3850541539 learned_addr learned my addr 172.21.15.131:0/3850541539 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.565+0000 7fe68e30d640 1 -- 172.21.15.131:0/3850541539 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be59f88d0 con 0x564be5903740 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.565+0000 7fe68e30d640 1 --2- 172.21.15.131:0/3850541539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59f8300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe68400b210 tx=0x7fe68400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6a2b5174dbebf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.565+0000 7fe57c608640 1 -- 172.21.15.131:0/3850541539 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe684008070 con 0x564be5903740 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.565+0000 7fe57c608640 1 -- 172.21.15.131:0/3850541539 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68400d500 con 0x564be5903740 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.565+0000 7fe57c608640 1 -- 172.21.15.131:0/3850541539 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68400d840 con 0x564be5903740 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 -- 172.21.15.131:0/3850541539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 msgr2=0x564be59f8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 --2- 172.21.15.131:0/3850541539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59f8300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe68400b210 tx=0x7fe68400b6d0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 -- 172.21.15.131:0/3850541539 shutdown_connections 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 --2- 172.21.15.131:0/3850541539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59f8300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 -- 172.21.15.131:0/3850541539 >> 172.21.15.131:0/3850541539 conn(0x564be58ff2c0 msgr2=0x564be59f3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 -- 172.21.15.131:0/3850541539 shutdown_connections 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 -- 172.21.15.131:0/3850541539 wait complete. 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 Processor -- start 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 -- start start 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe69080e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564be59105a0 con 0x564be5903740 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe68e30d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe68e30d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59ffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36428/0 (socket says 172.21.15.131:36428) 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.566+0000 7fe68e30d640 1 -- 172.21.15.131:0/2483804342 learned_addr learned my addr 172.21.15.131:0/2483804342 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.567+0000 7fe68e30d640 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be5a00410 con 0x564be5903740 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.567+0000 7fe68e30d640 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59ffed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe68400b210 tx=0x7fe684000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.567+0000 7fe57ae05640 1 -- 172.21.15.131:0/2483804342 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68400f950 con 0x564be5903740 2024-04-24T01:42:59.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.567+0000 7fe57ae05640 1 -- 172.21.15.131:0/2483804342 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68400faf0 con 0x564be5903740 2024-04-24T01:42:59.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.567+0000 7fe57ae05640 1 -- 172.21.15.131:0/2483804342 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68400fdd0 con 0x564be5903740 2024-04-24T01:42:59.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.567+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564be5a006a0 con 0x564be5903740 2024-04-24T01:42:59.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.567+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be5a03350 con 0x564be5903740 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.568+0000 7fe57ae05640 1 -- 172.21.15.131:0/2483804342 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe684017040 con 0x564be5903740 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.568+0000 7fe57ae05640 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe5740368b0 0x7fe574038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.568+0000 7fe57ae05640 1 -- 172.21.15.131:0/2483804342 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe684015020 con 0x564be5903740 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.568+0000 7fe68db0c640 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe5740368b0 0x7fe574038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.568+0000 7fe69080e800 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5905280 0x564be5a07110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.568+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a076a0 con 0x564be5905280 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.568+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5905280 0x564be5a07110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.569+0000 7fe68db0c640 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe5740368b0 0x7fe574038d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe680054000 tx=0x7fe68004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.569+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5905280 0x564be5a07110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.569+0000 7fe68eb0e640 1 -- 172.21.15.131:0/2483804342 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68800a4a0 con 0x564be5905280 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.569+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a046e0 con 0x564be5905280 2024-04-24T01:42:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.569+0000 7fe68eb0e640 1 -- 172.21.15.131:0/2483804342 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe68800a4a0 con 0x564be5905280 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.569+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a094c0 con 0x564be5905280 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.570+0000 7fe68eb0e640 1 -- 172.21.15.131:0/2483804342 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe68800a4a0 con 0x564be5905280 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.570+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a08800 con 0x564be5905280 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.570+0000 7fe68eb0e640 1 -- 172.21.15.131:0/2483804342 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe68800a4a0 con 0x564be5905280 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.570+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a08c50 con 0x564be5905280 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.570+0000 7fe68eb0e640 1 -- 172.21.15.131:0/2483804342 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe68800a4a0 con 0x564be5905280 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.570+0000 7fe69080e800 1 Processor -- start 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe69080e800 1 -- start start 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe69080e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a18290 0x564be5a186b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe69080e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564be57f66b0 con 0x564be5a18290 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe68db0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a18290 0x564be5a186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe68db0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a18290 0x564be5a186b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36438/0 (socket says 172.21.15.131:36438) 2024-04-24T01:42:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe68db0c640 1 -- 172.21.15.131:0/1182872824 learned_addr learned my addr 172.21.15.131:0/1182872824 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe68db0c640 1 -- 172.21.15.131:0/1182872824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be5a18bf0 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.571+0000 7fe68db0c640 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a18290 0x564be5a186b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe68001ced0 tx=0x7fe680002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe573fff640 1 -- 172.21.15.131:0/1182872824 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68006f070 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe573fff640 1 -- 172.21.15.131:0/1182872824 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680058040 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564be5a19660 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe573fff640 1 -- 172.21.15.131:0/1182872824 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680057050 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be5a19b00 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe573fff640 1 -- 172.21.15.131:0/1182872824 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe680072070 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe573fff640 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe568036950 0x7fe568038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.572+0000 7fe573fff640 1 -- 172.21.15.131:0/1182872824 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe68008f8d0 con 0x564be5a18290 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe568036950 0x7fe568038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe69080e800 1 Processor -- start 2024-04-24T01:42:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe69080e800 1 -- start start 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe568036950 0x7fe568038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x564be5a08320 tx=0x7fe688005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe69080e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a25890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe69080e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564be59f8c50 con 0x564be5a25470 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe68db0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a25890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe68db0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a25890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36446/0 (socket says 172.21.15.131:36446) 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe68db0c640 1 -- 172.21.15.131:0/58954594 learned_addr learned my addr 172.21.15.131:0/58954594 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.573+0000 7fe68db0c640 1 -- 172.21.15.131:0/58954594 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be5a25e60 con 0x564be5a25470 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe68db0c640 1 --2- 172.21.15.131:0/58954594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a25890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe680052d20 tx=0x7fe68006a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd08f20cd8760190 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe571ffb640 1 -- 172.21.15.131:0/58954594 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68005e5b0 con 0x564be5a25470 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe571ffb640 1 -- 172.21.15.131:0/58954594 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68005fbd0 con 0x564be5a25470 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe571ffb640 1 -- 172.21.15.131:0/58954594 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68005c380 con 0x564be5a25470 2024-04-24T01:42:59.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 -- 172.21.15.131:0/58954594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 msgr2=0x564be5a25890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 --2- 172.21.15.131:0/58954594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a25890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe680052d20 tx=0x7fe68006a790 comp rx=0 tx=0).stop 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 -- 172.21.15.131:0/58954594 shutdown_connections 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 --2- 172.21.15.131:0/58954594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a25890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 -- 172.21.15.131:0/58954594 >> 172.21.15.131:0/58954594 conn(0x564be5a217d0 msgr2=0x564be5a1f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 -- 172.21.15.131:0/58954594 shutdown_connections 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 -- 172.21.15.131:0/58954594 wait complete. 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.574+0000 7fe69080e800 1 Processor -- start 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe69080e800 1 -- start start 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe69080e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a2ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe69080e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564be5a26570 con 0x564be5a25470 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe68db0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a2ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe68db0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a2ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36452/0 (socket says 172.21.15.131:36452) 2024-04-24T01:42:59.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 learned_addr learned my addr 172.21.15.131:0/3040349076 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be5a2cfc0 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe68db0c640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a2ca80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe68008cc50 tx=0x7fe68008dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe55ffff640 1 -- 172.21.15.131:0/3040349076 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680001b40 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe55ffff640 1 -- 172.21.15.131:0/3040349076 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680001ce0 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564be5a2d250 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe55ffff640 1 -- 172.21.15.131:0/3040349076 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68008fc90 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.575+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be5a2ff00 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.576+0000 7fe55ffff640 1 -- 172.21.15.131:0/3040349076 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe68008f0d0 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.576+0000 7fe55ffff640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe558036950 0x7fe558038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.576+0000 7fe55ffff640 1 -- 172.21.15.131:0/3040349076 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe680099c70 con 0x564be5a25470 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.576+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe558036950 0x7fe558038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.577+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe558036950 0x7fe558038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x564be5a00cf0 tx=0x7fe68801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.577+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.577+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5a38590 0x564be5a3aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.577+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3b1a0 con 0x564be5a38590 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.577+0000 7fe68e30d640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5a38590 0x564be5a3aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.577+0000 7fe68e30d640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5a38590 0x564be5a3aa50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 realm 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3b5b0 con 0x564be5a38590 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3be80 con 0x564be5a38590 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3c220 con 0x564be5a38590 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.578+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3ca70 con 0x564be5a38590 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe69080e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe69080e800 20 searching for the correct realm 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564be5a3e7e0 0x564be5a40bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe68db0c640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564be5a3e7e0 0x564be5a40bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe68db0c640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564be5a3e7e0 0x564be5a40bd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe68db0c640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe680074060 0x7fe680077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe680074060 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.579+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe680074060 0x7fe680077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.580+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe680074060 0x7fe680077120 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.580+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68801f070 con 0x7fe680074060 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.580+0000 7fe68eb0e640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe688031040 0x7fe688032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.580+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.580+0000 7fe68e30d640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe688031040 0x7fe688032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.580+0000 7fe68e30d640 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe688031040 0x7fe688032940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.581+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe680074060 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68801f070 con 0x7fe680074060 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.582+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.583+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.583+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.583+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.583+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe680074060 2024-04-24T01:42:59.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.583+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe68801f070 con 0x7fe680074060 2024-04-24T01:42:59.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.583+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.584+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.585+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe680074060 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68801f070 con 0x7fe680074060 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.586+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe680074060 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68801f070 con 0x7fe680074060 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a3e7e0 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe688031040 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.587+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x564be5a38590 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41190 con 0x7fe680074060 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe68801f070 con 0x7fe680074060 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3d3f0 con 0x564be5a38590 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3dc90 con 0x564be5a38590 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.588+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a41610 con 0x564be5a38590 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 zone default found 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 4 Realm: () 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 zonegroup default 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a3d8f0 con 0x7fe688031040 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a43520 con 0x564be5a3e7e0 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a43910 con 0x564be5a3e7e0 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 started sync module instance, tier type = 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.589+0000 7fe69080e800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.590+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a429c0 con 0x7fe680074060 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.591+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.591+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94883975278000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a42620 con 0x7fe680074060 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.591+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a44730 con 0x564be5a38590 2024-04-24T01:42:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.593+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.593+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94883975283232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a44730 con 0x564be5a38590 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.593+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a45730 con 0x564be5a3e7e0 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.593+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94883975278000] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.594+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94883975283232] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.595+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.595+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94883975285584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a43d70 con 0x564be5a3e7e0 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.595+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a45fd0 con 0x7fe680074060 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.597+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.597+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94883975285584] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.597+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94883975289632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a45f40 con 0x7fe680074060 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.597+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a46e90 con 0x564be5a38590 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.598+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94883975289632] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.598+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.598+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94883975291840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a46e90 con 0x564be5a38590 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.598+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a478e0 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.599+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.599+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94883975295984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a47810 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.599+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a48810 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.599+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94883975291840] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.600+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94883975295984] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.600+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.600+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94883975293408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a48320 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.600+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a48ce0 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94883975293408] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94883975298176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a48ce0 con 0x7fe688031040 2024-04-24T01:42:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 20 add_watcher() i=0 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 20 add_watcher() i=1 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 20 add_watcher() i=2 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 20 add_watcher() i=3 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 20 add_watcher() i=4 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 20 add_watcher() i=5 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.601+0000 7fe69080e800 20 add_watcher() i=6 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.602+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94883975298176] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.602+0000 7fe69080e800 20 add_watcher() i=7 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.602+0000 7fe69080e800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.602+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a4c0e0 con 0x564be5a38590 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.602+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.602+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94883975301632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a49600 con 0x564be5a38590 2024-04-24T01:42:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.603+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94883975301632] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.603+0000 7fe544fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.603+0000 7fe69080e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.603+0000 7fe69080e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 5 note: GC not initialized 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe4bf7fe640 20 reqs_thread_entry: start 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 20 Filter name: none 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe4bd7fa640 20 reqs_thread_entry: start 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a7f4a0 con 0x564be5a38590 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a7dc40 con 0x564be5a38590 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.604+0000 7fe69080e800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a7e030 con 0x7fe688031040 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.605+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a7ef80 con 0x564be5a38590 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe69080e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe69080e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe69080e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94883975521392 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82fe0 con 0x564be5a38590 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify (1) cookie 94883975291840 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564be5a7ea80 con 0x564be5a38590 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe571ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94883975291840 notifier 4289 bl.length()=567 2024-04-24T01:42:59.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe571ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 notify.4 [notify cookie 94883975521392 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe571ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.606+0000 7fe571ffb640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe554003ea0 con 0x564be5a38590 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.607+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.607+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== watch-notify(notify_complete (2) cookie 94883975521392 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564be5a7e220 con 0x564be5a38590 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.607+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82f20 con 0x564be5a38590 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe69080e800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe69080e800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe69080e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94883975521264 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82ef0 con 0x7fe680074060 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== watch-notify(notify (1) cookie 94883975289632 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7fe6880247c0 con 0x7fe680074060 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe571ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94883975289632 notifier 4289 bl.length()=169 2024-04-24T01:42:59.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe571ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe571ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(69 notify.3 [notify cookie 94883975521264 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.608+0000 7fe571ffb640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe554003ea0 con 0x7fe680074060 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.609+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== watch-notify(notify_complete (2) cookie 94883975521264 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe688024990 con 0x7fe680074060 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.609+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.609+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a80ed0 con 0x7fe688031040 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe69080e800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe69080e800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe69080e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94883975531040 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82430 con 0x7fe680074060 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== watch-notify(notify (1) cookie 94883975289632 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fe688024990 con 0x7fe680074060 2024-04-24T01:42:59.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe571ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94883975289632 notifier 4289 bl.length()=177 2024-04-24T01:42:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe571ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-24T01:42:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe571ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T01:42:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(72 notify.3 [notify cookie 94883975531040 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.610+0000 7fe571ffb640 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe554003ea0 con 0x7fe680074060 2024-04-24T01:42:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.611+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== watch-notify(notify_complete (2) cookie 94883975531040 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe688024cc0 con 0x7fe680074060 2024-04-24T01:42:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.611+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.623 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:42:59.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.611+0000 7fe544fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.611+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94883975301632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82430 con 0x564be5a38590 2024-04-24T01:42:59.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.612+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94883975301632] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.613+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94883975278000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82430 con 0x7fe680074060 2024-04-24T01:42:59.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.614+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94883975278000] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.614+0000 7fe69080e800 20 remove_watcher() i=0 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.614+0000 7fe69080e800 2 removed watcher, disabling cache 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.614+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94883975283232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82430 con 0x564be5a38590 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.615+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94883975283232] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.615+0000 7fe69080e800 20 remove_watcher() i=1 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.615+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94883975285584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a82430 con 0x564be5a3e7e0 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.616+0000 7fe68db0c640 1 -- 172.21.15.131:0/3040349076 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94883975285584] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe680071030 con 0x564be5a3e7e0 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.616+0000 7fe69080e800 20 remove_watcher() i=2 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.616+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94883975289632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a42db0 con 0x7fe680074060 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.616+0000 7fe68eb0e640 1 -- 172.21.15.131:0/3040349076 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94883975289632] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe688040040 con 0x7fe680074060 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.616+0000 7fe69080e800 20 remove_watcher() i=3 2024-04-24T01:42:59.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.616+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94883975291840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a42db0 con 0x564be5a38590 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.617+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94883975291840] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x564be5a38590 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.617+0000 7fe69080e800 20 remove_watcher() i=4 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.617+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94883975295984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a463c0 con 0x7fe688031040 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.618+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94883975295984] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.618+0000 7fe69080e800 20 remove_watcher() i=5 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.618+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94883975293408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a42db0 con 0x7fe688031040 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.619+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94883975293408] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.619+0000 7fe69080e800 20 remove_watcher() i=6 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.619+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94883975298176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564be5a473f0 con 0x7fe688031040 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94883975298176] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe68402d070 con 0x7fe688031040 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 20 remove_watcher() i=7 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe688031040 msgr2=0x7fe688032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe688031040 0x7fe688032940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5a38590 msgr2=0x564be5a3aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5a38590 0x564be5a3aa50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe680074060 msgr2=0x7fe680077120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe680074060 0x7fe680077120 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564be5a3e7e0 msgr2=0x564be5a40bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564be5a3e7e0 0x564be5a40bd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe558036950 msgr2=0x7fe558038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe558036950 0x7fe558038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x564be5a00cf0 tx=0x7fe68801f000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe68e30d640 1 -- 172.21.15.131:0/3040349076 reap_dead start 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 msgr2=0x564be5a2ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.620+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a2ca80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe68008cc50 tx=0x7fe68008dc70 comp rx=0 tx=0).stop 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 shutdown_connections 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/3040349076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a25470 0x564be5a2ca80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 >> 172.21.15.131:0/3040349076 conn(0x564be5a217d0 msgr2=0x564be5a1ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 shutdown_connections 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/3040349076 wait complete. 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe568036950 msgr2=0x7fe568038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe568036950 0x7fe568038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x564be5a08320 tx=0x7fe688005840 comp rx=0 tx=0).stop 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a18290 msgr2=0x564be5a186b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a18290 0x564be5a186b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe68001ced0 tx=0x7fe680002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 shutdown_connections 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe568036950 0x7fe568038e10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/1182872824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5a18290 0x564be5a186b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 >> 172.21.15.131:0/1182872824 conn(0x564be5a0c330 msgr2=0x564be5a0c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 shutdown_connections 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/1182872824 wait complete. 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5905280 msgr2=0x564be5a07110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5905280 0x564be5a07110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe5740368b0 msgr2=0x7fe574038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe5740368b0 0x7fe574038d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe680054000 tx=0x7fe68004e000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 msgr2=0x564be59ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.621+0000 7fe69080e800 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59ffed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe68400b210 tx=0x7fe684000ed0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.622+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 shutdown_connections 2024-04-24T01:42:59.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.622+0000 7fe69080e800 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564be5905280 0x564be5a07110 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.622+0000 7fe69080e800 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe5740368b0 0x7fe574038d70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.622+0000 7fe69080e800 1 --2- 172.21.15.131:0/2483804342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564be5903740 0x564be59ffed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.622+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 >> 172.21.15.131:0/2483804342 conn(0x564be58ff2c0 msgr2=0x564be59f2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.622+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 shutdown_connections 2024-04-24T01:42:59.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.622+0000 7fe69080e800 1 -- 172.21.15.131:0/2483804342 wait complete. 2024-04-24T01:42:59.635 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:42:59.635 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-24T01:42:59.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-24T01:42:59.636 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-24T01:42:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.682+0000 7fa50e83a800 1 Processor -- start 2024-04-24T01:42:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.682+0000 7fa50e83a800 1 -- start start 2024-04-24T01:42:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa50e83a800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55acc1e2a190 0x55acc1e2c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa50e83a800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acc1ce4d40 con 0x55acc1d99a70 2024-04-24T01:42:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa50e83a800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55acc1cb74d0 con 0x55acc1e2a190 2024-04-24T01:42:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa500cd4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55acc1e2a190 0x55acc1e2c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa5094d5640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55acc1d99a70 0x55acc1e28a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45744/0 (socket says 172.21.15.131:45744) 2024-04-24T01:42:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa500cd4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55acc1e2a190 0x55acc1e2c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36468/0 (socket says 172.21.15.131:36468) 2024-04-24T01:42:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa5094d5640 1 -- 172.21.15.131:0/1155453375 learned_addr learned my addr 172.21.15.131:0/1155453375 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa500cd4640 1 -- 172.21.15.131:0/1155453375 >> v1:172.21.15.107:6789/0 conn(0x55acc1d99a70 legacy=0x55acc1e28a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.683+0000 7fa500cd4640 1 -- 172.21.15.131:0/1155453375 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc1ce3590 con 0x55acc1e2a190 2024-04-24T01:42:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.685+0000 7fa500cd4640 1 --2- 172.21.15.131:0/1155453375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e2a190 0x55acc1e2c650 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400a470 tx=0x7fa4f401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de2a7acff53557f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.685+0000 7fa508cd4640 1 -- 172.21.15.131:0/1155453375 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f4057070 con 0x55acc1e2a190 2024-04-24T01:42:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.685+0000 7fa508cd4640 1 -- 172.21.15.131:0/1155453375 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f4052570 con 0x55acc1e2a190 2024-04-24T01:42:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.685+0000 7fa508cd4640 1 -- 172.21.15.131:0/1155453375 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f4052870 con 0x55acc1e2a190 2024-04-24T01:42:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.686+0000 7fa50e83a800 1 -- 172.21.15.131:0/1155453375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e2a190 msgr2=0x55acc1e2c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.686+0000 7fa50e83a800 1 --2- 172.21.15.131:0/1155453375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e2a190 0x55acc1e2c650 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400a470 tx=0x7fa4f401ce90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.686+0000 7fa50e83a800 1 -- 172.21.15.131:0/1155453375 shutdown_connections 2024-04-24T01:42:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.686+0000 7fa50e83a800 1 --2- 172.21.15.131:0/1155453375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e2a190 0x55acc1e2c650 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.686+0000 7fa50e83a800 1 -- 172.21.15.131:0/1155453375 >> 172.21.15.131:0/1155453375 conn(0x55acc1e20340 msgr2=0x55acc1e22760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.686+0000 7fa50e83a800 1 -- 172.21.15.131:0/1155453375 shutdown_connections 2024-04-24T01:42:59.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.686+0000 7fa50e83a800 1 -- 172.21.15.131:0/1155453375 wait complete. 2024-04-24T01:42:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.697+0000 7fa50e83a800 1 Processor -- start 2024-04-24T01:42:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa50e83a800 1 -- start start 2024-04-24T01:42:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa50e83a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f17140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa50e83a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55acc1d713e0 con 0x55acc1d99a70 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa5094d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f17140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa5094d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f17140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36478/0 (socket says 172.21.15.131:36478) 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa5094d5640 1 -- 172.21.15.131:0/878269908 learned_addr learned my addr 172.21.15.131:0/878269908 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa5094d5640 1 -- 172.21.15.131:0/878269908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc1f17710 con 0x55acc1d99a70 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.698+0000 7fa5094d5640 1 --2- 172.21.15.131:0/878269908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f17140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc001de0 tx=0x7fa4fc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed220508f4a4fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa3f7606640 1 -- 172.21.15.131:0/878269908 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4fc012020 con 0x55acc1d99a70 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa3f7606640 1 -- 172.21.15.131:0/878269908 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00e5a0 con 0x55acc1d99a70 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa3f7606640 1 -- 172.21.15.131:0/878269908 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4fc00e8c0 con 0x55acc1d99a70 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa50e83a800 1 -- 172.21.15.131:0/878269908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 msgr2=0x55acc1f17140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa50e83a800 1 --2- 172.21.15.131:0/878269908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f17140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc001de0 tx=0x7fa4fc00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa50e83a800 1 -- 172.21.15.131:0/878269908 shutdown_connections 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa50e83a800 1 --2- 172.21.15.131:0/878269908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f17140 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa50e83a800 1 -- 172.21.15.131:0/878269908 >> 172.21.15.131:0/878269908 conn(0x55acc1e20340 msgr2=0x55acc1f12a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa50e83a800 1 -- 172.21.15.131:0/878269908 shutdown_connections 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.699+0000 7fa50e83a800 1 -- 172.21.15.131:0/878269908 wait complete. 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa50e83a800 1 Processor -- start 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa50e83a800 1 -- start start 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa50e83a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f1ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa50e83a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55acc1e2d000 con 0x55acc1d99a70 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa5094d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f1ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa5094d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f1ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36490/0 (socket says 172.21.15.131:36490) 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa5094d5640 1 -- 172.21.15.131:0/2785998291 learned_addr learned my addr 172.21.15.131:0/2785998291 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa5094d5640 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc1f1f230 con 0x55acc1d99a70 2024-04-24T01:42:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa5094d5640 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f1ecf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c010 tx=0x7fa4fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa3f5e03640 1 -- 172.21.15.131:0/2785998291 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4fc012070 con 0x55acc1d99a70 2024-04-24T01:42:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa3f5e03640 1 -- 172.21.15.131:0/2785998291 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc01a7a0 con 0x55acc1d99a70 2024-04-24T01:42:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acc1f1f4c0 con 0x55acc1d99a70 2024-04-24T01:42:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.700+0000 7fa3f5e03640 1 -- 172.21.15.131:0/2785998291 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4fc01aa80 con 0x55acc1d99a70 2024-04-24T01:42:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.701+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc1f22170 con 0x55acc1d99a70 2024-04-24T01:42:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.701+0000 7fa3f5e03640 1 -- 172.21.15.131:0/2785998291 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa4fc015020 con 0x55acc1d99a70 2024-04-24T01:42:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.701+0000 7fa3f5e03640 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3f0036950 0x7fa3f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.701+0000 7fa3f5e03640 1 -- 172.21.15.131:0/2785998291 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa4fc020070 con 0x55acc1d99a70 2024-04-24T01:42:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa500cd4640 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3f0036950 0x7fa3f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1e2a190 0x55acc1f25f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f26470 con 0x55acc1e2a190 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa509cd6640 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1e2a190 0x55acc1f25f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa500cd4640 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3f0036950 0x7fa3f0038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4054000 tx=0x7fa4f404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa509cd6640 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1e2a190 0x55acc1f25f30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa509cd6640 1 -- 172.21.15.131:0/2785998291 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa50400a4a0 con 0x55acc1e2a190 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.702+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f23500 con 0x55acc1e2a190 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.703+0000 7fa509cd6640 1 -- 172.21.15.131:0/2785998291 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa50400a4a0 con 0x55acc1e2a190 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.703+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f282b0 con 0x55acc1e2a190 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.703+0000 7fa509cd6640 1 -- 172.21.15.131:0/2785998291 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa50400a4a0 con 0x55acc1e2a190 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.703+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f275f0 con 0x55acc1e2a190 2024-04-24T01:42:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.703+0000 7fa509cd6640 1 -- 172.21.15.131:0/2785998291 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa50400a4a0 con 0x55acc1e2a190 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.703+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f27990 con 0x55acc1e2a190 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.703+0000 7fa509cd6640 1 -- 172.21.15.131:0/2785998291 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa50400a4a0 con 0x55acc1e2a190 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.704+0000 7fa50e83a800 1 Processor -- start 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.704+0000 7fa50e83a800 1 -- start start 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.704+0000 7fa50e83a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e26590 0x55acc1e24a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.704+0000 7fa50e83a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55acc1d176b0 con 0x55acc1e26590 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.704+0000 7fa500cd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e26590 0x55acc1e24a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.704+0000 7fa500cd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e26590 0x55acc1e24a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36506/0 (socket says 172.21.15.131:36506) 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.704+0000 7fa500cd4640 1 -- 172.21.15.131:0/2135046274 learned_addr learned my addr 172.21.15.131:0/2135046274 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.705+0000 7fa500cd4640 1 -- 172.21.15.131:0/2135046274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc1e24f40 con 0x55acc1e26590 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.705+0000 7fa500cd4640 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e26590 0x55acc1e24a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4044840 tx=0x7fa4f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.705+0000 7fa3eeffd640 1 -- 172.21.15.131:0/2135046274 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f406f070 con 0x55acc1e26590 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.705+0000 7fa3eeffd640 1 -- 172.21.15.131:0/2135046274 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f4058040 con 0x55acc1e26590 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.705+0000 7fa3eeffd640 1 -- 172.21.15.131:0/2135046274 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f4057050 con 0x55acc1e26590 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.705+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acc1e25170 con 0x55acc1e26590 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.705+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc1e25610 con 0x55acc1e26590 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa3eeffd640 1 -- 172.21.15.131:0/2135046274 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa4f4072070 con 0x55acc1e26590 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa3eeffd640 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3e0036900 0x7fa3e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa3eeffd640 1 -- 172.21.15.131:0/2135046274 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa4f408fa50 con 0x55acc1e26590 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa509cd6640 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3e0036900 0x7fa3e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa50e83a800 1 Processor -- start 2024-04-24T01:42:59.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa50e83a800 1 -- start start 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa509cd6640 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3e0036900 0x7fa3e0038dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55acc1f27110 tx=0x7fa504005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa50e83a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f46920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.706+0000 7fa50e83a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55acc1f17a90 con 0x55acc1f46500 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa500cd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f46920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa500cd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f46920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36514/0 (socket says 172.21.15.131:36514) 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa500cd4640 1 -- 172.21.15.131:0/1176442199 learned_addr learned my addr 172.21.15.131:0/1176442199 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa500cd4640 1 -- 172.21.15.131:0/1176442199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc1f46ef0 con 0x55acc1f46500 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa500cd4640 1 --2- 172.21.15.131:0/1176442199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f46920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4f408dda0 tx=0x7fa4f408e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180bfbe7155e6017 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa3ecff9640 1 -- 172.21.15.131:0/1176442199 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f4087070 con 0x55acc1f46500 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa3ecff9640 1 -- 172.21.15.131:0/1176442199 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f405e480 con 0x55acc1f46500 2024-04-24T01:42:59.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa3ecff9640 1 -- 172.21.15.131:0/1176442199 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f4072360 con 0x55acc1f46500 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa50e83a800 1 -- 172.21.15.131:0/1176442199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 msgr2=0x55acc1f46920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa50e83a800 1 --2- 172.21.15.131:0/1176442199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f46920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4f408dda0 tx=0x7fa4f408e050 comp rx=0 tx=0).stop 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa50e83a800 1 -- 172.21.15.131:0/1176442199 shutdown_connections 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa50e83a800 1 --2- 172.21.15.131:0/1176442199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f46920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.707+0000 7fa50e83a800 1 -- 172.21.15.131:0/1176442199 >> 172.21.15.131:0/1176442199 conn(0x55acc1f42860 msgr2=0x55acc1f408c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa50e83a800 1 -- 172.21.15.131:0/1176442199 shutdown_connections 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa50e83a800 1 -- 172.21.15.131:0/1176442199 wait complete. 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa50e83a800 1 Processor -- start 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa50e83a800 1 -- start start 2024-04-24T01:42:59.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa50e83a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f4db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa50e83a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55acc1f47660 con 0x55acc1f46500 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa500cd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f4db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa500cd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f4db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36530/0 (socket says 172.21.15.131:36530) 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 learned_addr learned my addr 172.21.15.131:0/565164390 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.708+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc1f4e0a0 con 0x55acc1f46500 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.709+0000 7fa500cd4640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f4db60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa4f408e090 tx=0x7fa4f408dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.709+0000 7fa3deffd640 1 -- 172.21.15.131:0/565164390 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f4087030 con 0x55acc1f46500 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.709+0000 7fa3deffd640 1 -- 172.21.15.131:0/565164390 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f405fd50 con 0x55acc1f46500 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.709+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acc1f4e330 con 0x55acc1f46500 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.709+0000 7fa3deffd640 1 -- 172.21.15.131:0/565164390 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4f40726e0 con 0x55acc1f46500 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.709+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc1f50fe0 con 0x55acc1f46500 2024-04-24T01:42:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.709+0000 7fa3deffd640 1 -- 172.21.15.131:0/565164390 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa4f4072880 con 0x55acc1f46500 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa3deffd640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3d4036900 0x7fa3d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa3deffd640 1 -- 172.21.15.131:0/565164390 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa4f4088070 con 0x55acc1f46500 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa509cd6640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3d4036900 0x7fa3d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa509cd6640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3d4036900 0x7fa3d4038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55acc1f23450 tx=0x7fa50401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1f59670 0x55acc1f5bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5c280 con 0x55acc1f59670 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.710+0000 7fa5094d5640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1f59670 0x55acc1f5bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa5094d5640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1f59670 0x55acc1f5bb30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 20 realm 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5c690 con 0x55acc1f59670 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5cf60 con 0x55acc1f59670 2024-04-24T01:42:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.711+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5d300 con 0x55acc1f59670 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa50e83a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5db50 con 0x55acc1f59670 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa50e83a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa50e83a800 20 searching for the correct realm 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55acc1f5f8c0 0x55acc1f61cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa500cd4640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55acc1f5f8c0 0x55acc1f61cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.712+0000 7fa500cd4640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55acc1f5f8c0 0x55acc1f61cb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa500cd4640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa4f4082070 0x7fa4f405c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa4f4082070 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa509cd6640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa4f4082070 0x7fa4f405c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa509cd6640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa4f4082070 0x7fa4f405c5b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa50401f070 con 0x7fa4f4082070 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa509cd6640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa504031040 0x7fa504032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.713+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.714+0000 7fa5094d5640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa504031040 0x7fa504032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.714+0000 7fa5094d5640 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa504031040 0x7fa504032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.714+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x7fa504031040 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.714+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.714+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.714+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x7fa504031040 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x7fa504031040 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa4f4082070 2024-04-24T01:42:59.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa50401f070 con 0x7fa4f4082070 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.715+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x7fa504031040 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa4f4082070 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.716+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa50401f070 con 0x7fa4f4082070 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x7fa504031040 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.717+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x7fa504031040 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.718+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa4f4082070 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa50401f070 con 0x7fa4f4082070 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc02b070 con 0x55acc1f59670 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.719+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa4f4082070 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa50401f070 con 0x7fa4f4082070 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f5f8c0 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.720+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa504031040 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x55acc1f59670 2024-04-24T01:42:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62290 con 0x7fa4f4082070 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa50401f070 con 0x7fa4f4082070 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5e500 con 0x55acc1f59670 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.721+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5eda0 con 0x55acc1f59670 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f5eda0 con 0x55acc1f59670 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 zone default found 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 4 Realm: () 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:59.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 zonegroup default 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f62710 con 0x7fa504031040 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f64180 con 0x55acc1f5f8c0 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.722+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f645f0 con 0x55acc1f5f8c0 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa50e83a800 20 started sync module instance, tier type = 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa50e83a800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.723+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f63590 con 0x7fa4f4082070 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.724+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa504040040 con 0x7fa4f4082070 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.724+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200476875136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f631f0 con 0x7fa4f4082070 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.724+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65520 con 0x55acc1f59670 2024-04-24T01:42:59.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.725+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200476875136] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa504040040 con 0x7fa4f4082070 2024-04-24T01:42:59.756 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.725+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.725+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200476879440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65520 con 0x55acc1f59670 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.725+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65f20 con 0x55acc1f5f8c0 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.726+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200476879440] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.726+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.726+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200476881008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65490 con 0x55acc1f5f8c0 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.726+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f66de0 con 0x7fa4f4082070 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.727+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa504040040 con 0x7fa4f4082070 2024-04-24T01:42:59.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.727+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200476887824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f675e0 con 0x7fa4f4082070 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.727+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f680e0 con 0x55acc1f59670 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.727+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200476881008] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.728+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.728+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200476887824] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa504040040 con 0x7fa4f4082070 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.728+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200476892112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f680a0 con 0x55acc1f59670 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.728+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f689b0 con 0x7fa504031040 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.729+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.729+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200476894384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f68d80 con 0x7fa504031040 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.729+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f695d0 con 0x7fa504031040 2024-04-24T01:42:59.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.729+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200476892112] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.730+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200476894384] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.730+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.730+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200476895440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f691a0 con 0x7fa504031040 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.730+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f699f0 con 0x7fa504031040 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200476898208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f69e10 con 0x7fa504031040 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 20 add_watcher() i=0 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 20 add_watcher() i=1 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 20 add_watcher() i=2 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 20 add_watcher() i=3 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 20 add_watcher() i=4 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 20 add_watcher() i=5 2024-04-24T01:42:59.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200476895440] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.731+0000 7fa50e83a800 20 add_watcher() i=6 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.732+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200476898208] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.732+0000 7fa50e83a800 20 add_watcher() i=7 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.732+0000 7fa50e83a800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.732+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f68cf0 con 0x55acc1f59670 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.732+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.732+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200476896496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f6a320 con 0x55acc1f59670 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.733+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200476896496] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.733+0000 7fa3bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.733+0000 7fa50e83a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:59.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.733+0000 7fa50e83a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa50e83a800 5 note: GC not initialized 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa3be7e4640 20 reqs_thread_entry: start 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa50e83a800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa50e83a800 20 Filter name: none 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa32ffff640 20 reqs_thread_entry: start 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa50e83a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.734+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1fa0190 con 0x7fa504031040 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f9e930 con 0x55acc1f59670 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 20 rados_obj.operate() r=0 bl.length=7 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.735+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f9ed20 con 0x55acc1f59670 2024-04-24T01:42:59.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa50e83a800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa50e83a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa50e83a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa50e83a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa50e83a800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa50e83a800 20 get_user_info_from_index found 0 xattrs 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa3bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.736+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200476896496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f53010 con 0x55acc1f59670 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.737+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94200476896496] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.737+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200476875136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f68cf0 con 0x7fa4f4082070 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.738+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94200476875136] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa504040040 con 0x7fa4f4082070 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.738+0000 7fa50e83a800 20 remove_watcher() i=0 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.738+0000 7fa50e83a800 2 removed watcher, disabling cache 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.738+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200476879440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f63980 con 0x55acc1f59670 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.740+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94200476879440] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.740+0000 7fa50e83a800 20 remove_watcher() i=1 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.740+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200476881008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f63980 con 0x55acc1f5f8c0 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.741+0000 7fa500cd4640 1 -- 172.21.15.131:0/565164390 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94200476881008] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4f408fd70 con 0x55acc1f5f8c0 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.741+0000 7fa50e83a800 20 remove_watcher() i=2 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.741+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200476887824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65070 con 0x7fa4f4082070 2024-04-24T01:42:59.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.742+0000 7fa509cd6640 1 -- 172.21.15.131:0/565164390 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94200476887824] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa504040040 con 0x7fa4f4082070 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.742+0000 7fa50e83a800 20 remove_watcher() i=3 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.742+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200476892112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65070 con 0x55acc1f59670 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.743+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94200476892112] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x55acc1f59670 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.743+0000 7fa50e83a800 20 remove_watcher() i=4 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.743+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200476894384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65070 con 0x7fa504031040 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.744+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94200476894384] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.744+0000 7fa50e83a800 20 remove_watcher() i=5 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.744+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200476895440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f684b0 con 0x7fa504031040 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.744+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94200476895440] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.744+0000 7fa50e83a800 20 remove_watcher() i=6 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.744+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200476898208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acc1f65070 con 0x7fa504031040 2024-04-24T01:42:59.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.745+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94200476898208] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4fc052040 con 0x7fa504031040 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.745+0000 7fa50e83a800 20 remove_watcher() i=7 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.745+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa504031040 msgr2=0x7fa504032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.745+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa504031040 0x7fa504032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.745+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1f59670 msgr2=0x55acc1f5bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.745+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1f59670 0x55acc1f5bb30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa4f4082070 msgr2=0x7fa4f405c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa4f4082070 0x7fa4f405c5b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55acc1f5f8c0 msgr2=0x55acc1f61cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55acc1f5f8c0 0x55acc1f61cb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3d4036900 msgr2=0x7fa3d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3d4036900 0x7fa3d4038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55acc1f23450 tx=0x7fa50401f000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 msgr2=0x55acc1f4db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f4db60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa4f408e090 tx=0x7fa4f408dd30 comp rx=0 tx=0).stop 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa5094d5640 1 -- 172.21.15.131:0/565164390 reap_dead start 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 shutdown_connections 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/565164390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1f46500 0x55acc1f4db60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 >> 172.21.15.131:0/565164390 conn(0x55acc1f42860 msgr2=0x55acc1f3fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 shutdown_connections 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/565164390 wait complete. 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3e0036900 msgr2=0x7fa3e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3e0036900 0x7fa3e0038dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55acc1f27110 tx=0x7fa504005840 comp rx=0 tx=0).stop 2024-04-24T01:42:59.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e26590 msgr2=0x55acc1e24a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e26590 0x55acc1e24a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4044840 tx=0x7fa4f4002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 shutdown_connections 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3e0036900 0x7fa3e0038dc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2135046274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1e26590 0x55acc1e24a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 >> 172.21.15.131:0/2135046274 conn(0x55acc1f2b100 msgr2=0x55acc1f2b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 shutdown_connections 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.746+0000 7fa50e83a800 1 -- 172.21.15.131:0/2135046274 wait complete. 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1e2a190 msgr2=0x55acc1f25f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1e2a190 0x55acc1f25f30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3f0036950 msgr2=0x7fa3f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3f0036950 0x7fa3f0038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4054000 tx=0x7fa4f404e000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 msgr2=0x55acc1f1ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f1ecf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c010 tx=0x7fa4fc000ed0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 shutdown_connections 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55acc1e2a190 0x55acc1f25f30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa3f0036950 0x7fa3f0038e10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 --2- 172.21.15.131:0/2785998291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55acc1d99a70 0x55acc1f1ecf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 >> 172.21.15.131:0/2785998291 conn(0x55acc1e20340 msgr2=0x55acc1f11260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 shutdown_connections 2024-04-24T01:42:59.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.747+0000 7fa50e83a800 1 -- 172.21.15.131:0/2785998291 wait complete. 2024-04-24T01:42:59.769 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:42:59.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:42:59.770 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:42:59.812 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:59.813 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:59.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f784c30c800 1 Processor -- start 2024-04-24T01:42:59.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f784c30c800 1 -- start start 2024-04-24T01:42:59.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f784c30c800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564e082ec480 0x564e082ee870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f784c30c800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e081a6d40 con 0x564e082e8970 2024-04-24T01:42:59.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f784c30c800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x564e081794d0 con 0x564e082ec480 2024-04-24T01:42:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f784960a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564e082ec480 0x564e082ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f7849e0b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x564e082e8970 0x564e082ead60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45756/0 (socket says 172.21.15.131:45756) 2024-04-24T01:42:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f784960a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564e082ec480 0x564e082ee870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36538/0 (socket says 172.21.15.131:36538) 2024-04-24T01:42:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.812+0000 7f7849e0b640 1 -- 172.21.15.131:0/1353217215 learned_addr learned my addr 172.21.15.131:0/1353217215 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:42:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.813+0000 7f784960a640 1 -- 172.21.15.131:0/1353217215 >> v1:172.21.15.107:6789/0 conn(0x564e082e8970 legacy=0x564e082ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.813+0000 7f784960a640 1 -- 172.21.15.131:0/1353217215 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e081a5590 con 0x564e082ec480 2024-04-24T01:42:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.813+0000 7f7848e09640 1 -- 172.21.15.131:0/1353217215 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631494266 0 0) 0x564e081a6d40 con 0x564e082e8970 2024-04-24T01:42:59.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.814+0000 7f784960a640 1 --2- 172.21.15.131:0/1353217215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082ec480 0x564e082ee870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f784000a470 tx=0x7f784001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8540356a5fe702dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f7848e09640 1 -- 172.21.15.131:0/1353217215 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840057070 con 0x564e082ec480 2024-04-24T01:42:59.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f7848e09640 1 -- 172.21.15.131:0/1353217215 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840052570 con 0x564e082ec480 2024-04-24T01:42:59.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f7848e09640 1 -- 172.21.15.131:0/1353217215 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840052870 con 0x564e082ec480 2024-04-24T01:42:59.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f784c30c800 1 -- 172.21.15.131:0/1353217215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082ec480 msgr2=0x564e082ee870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f784c30c800 1 --2- 172.21.15.131:0/1353217215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082ec480 0x564e082ee870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f784000a470 tx=0x7f784001ce90 comp rx=0 tx=0).stop 2024-04-24T01:42:59.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f784c30c800 1 -- 172.21.15.131:0/1353217215 shutdown_connections 2024-04-24T01:42:59.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f784c30c800 1 --2- 172.21.15.131:0/1353217215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082ec480 0x564e082ee870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f784c30c800 1 -- 172.21.15.131:0/1353217215 >> 172.21.15.131:0/1353217215 conn(0x564e082e2320 msgr2=0x564e082e4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f784c30c800 1 -- 172.21.15.131:0/1353217215 shutdown_connections 2024-04-24T01:42:59.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.815+0000 7f784c30c800 1 -- 172.21.15.131:0/1353217215 wait complete. 2024-04-24T01:42:59.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.827+0000 7f784c30c800 1 Processor -- start 2024-04-24T01:42:59.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.827+0000 7f784c30c800 1 -- start start 2024-04-24T01:42:59.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.827+0000 7f784c30c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e083d8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.827+0000 7f784c30c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564e082333c0 con 0x564e082e8970 2024-04-24T01:42:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.827+0000 7f7849e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e083d8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.828+0000 7f7849e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e083d8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36544/0 (socket says 172.21.15.131:36544) 2024-04-24T01:42:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.828+0000 7f7849e0b640 1 -- 172.21.15.131:0/3019062904 learned_addr learned my addr 172.21.15.131:0/3019062904 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.828+0000 7f7849e0b640 1 -- 172.21.15.131:0/3019062904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e083d9450 con 0x564e082e8970 2024-04-24T01:42:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.828+0000 7f7849e0b640 1 --2- 172.21.15.131:0/3019062904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e083d8e80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f783c00b210 tx=0x7f783c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711e356da814366d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.828+0000 7f7737e07640 1 -- 172.21.15.131:0/3019062904 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f783c008070 con 0x564e082e8970 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.828+0000 7f7737e07640 1 -- 172.21.15.131:0/3019062904 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c00d500 con 0x564e082e8970 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.828+0000 7f7737e07640 1 -- 172.21.15.131:0/3019062904 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f783c00d840 con 0x564e082e8970 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 -- 172.21.15.131:0/3019062904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 msgr2=0x564e083d8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 --2- 172.21.15.131:0/3019062904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e083d8e80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f783c00b210 tx=0x7f783c00b6d0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 -- 172.21.15.131:0/3019062904 shutdown_connections 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 --2- 172.21.15.131:0/3019062904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e083d8e80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 -- 172.21.15.131:0/3019062904 >> 172.21.15.131:0/3019062904 conn(0x564e082e2320 msgr2=0x564e083d47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 -- 172.21.15.131:0/3019062904 shutdown_connections 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 -- 172.21.15.131:0/3019062904 wait complete. 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 Processor -- start 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.829+0000 7f784c30c800 1 -- start start 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f784c30c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e082e8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f784c30c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564e082f10c0 con 0x564e082e8970 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7849e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e082e8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7849e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e082e8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36556/0 (socket says 172.21.15.131:36556) 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7849e0b640 1 -- 172.21.15.131:0/2227320018 learned_addr learned my addr 172.21.15.131:0/2227320018 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7849e0b640 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e082e87a0 con 0x564e082e8970 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7849e0b640 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e082e8260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f783c001e60 tx=0x7f783c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7736604640 1 -- 172.21.15.131:0/2227320018 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f783c019870 con 0x564e082e8970 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7736604640 1 -- 172.21.15.131:0/2227320018 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c019a10 con 0x564e082e8970 2024-04-24T01:42:59.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f7736604640 1 -- 172.21.15.131:0/2227320018 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f783c019cf0 con 0x564e082e8970 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e082e69a0 con 0x564e082e8970 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.830+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e082e6ec0 con 0x564e082e8970 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.831+0000 7f7736604640 1 -- 172.21.15.131:0/2227320018 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f783c017040 con 0x564e082e8970 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.831+0000 7f7736604640 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7730036950 0x7f7730038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.831+0000 7f7736604640 1 -- 172.21.15.131:0/2227320018 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f783c015020 con 0x564e082e8970 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.831+0000 7f784960a640 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7730036950 0x7f7730038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.831+0000 7f784c30c800 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e082ec480 0x564e083e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.831+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e083ea420 con 0x564e082ec480 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.832+0000 7f784a60c640 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e082ec480 0x564e083e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.832+0000 7f784960a640 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7730036950 0x7f7730038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7840054000 tx=0x7f784004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.832+0000 7f784a60c640 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e082ec480 0x564e083e9ea0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.832+0000 7f784a60c640 1 -- 172.21.15.131:0/2227320018 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f784400a4a0 con 0x564e082ec480 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.832+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e082e73c0 con 0x564e082ec480 2024-04-24T01:42:59.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.832+0000 7f784a60c640 1 -- 172.21.15.131:0/2227320018 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f784400a4a0 con 0x564e082ec480 2024-04-24T01:42:59.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.832+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e083ec240 con 0x564e082ec480 2024-04-24T01:42:59.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.833+0000 7f784a60c640 1 -- 172.21.15.131:0/2227320018 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f784400a4a0 con 0x564e082ec480 2024-04-24T01:42:59.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.833+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e083eb580 con 0x564e082ec480 2024-04-24T01:42:59.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.833+0000 7f784a60c640 1 -- 172.21.15.131:0/2227320018 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f784400a4a0 con 0x564e082ec480 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.833+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e083eb9d0 con 0x564e082ec480 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.833+0000 7f784a60c640 1 -- 172.21.15.131:0/2227320018 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f784400a4a0 con 0x564e082ec480 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784c30c800 1 Processor -- start 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784c30c800 1 -- start start 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784c30c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e083fb010 0x564e083fb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784c30c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564e081d96b0 con 0x564e083fb010 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784960a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e083fb010 0x564e083fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784960a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e083fb010 0x564e083fb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36570/0 (socket says 172.21.15.131:36570) 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784960a640 1 -- 172.21.15.131:0/2740798990 learned_addr learned my addr 172.21.15.131:0/2740798990 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.834+0000 7f784960a640 1 -- 172.21.15.131:0/2740798990 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e083fb970 con 0x564e083fb010 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.835+0000 7f784960a640 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e083fb010 0x564e083fb430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7840044840 tx=0x7f7840002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.835+0000 7f772f7fe640 1 -- 172.21.15.131:0/2740798990 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f784006f070 con 0x564e083fb010 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.835+0000 7f772f7fe640 1 -- 172.21.15.131:0/2740798990 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840058040 con 0x564e083fb010 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.835+0000 7f772f7fe640 1 -- 172.21.15.131:0/2740798990 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840057050 con 0x564e083fb010 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.835+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e083fc3e0 con 0x564e083fb010 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.835+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e083fc880 con 0x564e083fb010 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.835+0000 7f772f7fe640 1 -- 172.21.15.131:0/2740798990 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7840072070 con 0x564e083fb010 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f772f7fe640 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7724036950 0x7f7724038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f772f7fe640 1 -- 172.21.15.131:0/2740798990 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f784008fb30 con 0x564e083fb010 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784a60c640 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7724036950 0x7f7724038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784c30c800 1 Processor -- start 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784a60c640 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7724036950 0x7f7724038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x564e083eb0a0 tx=0x7f7844005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784c30c800 1 -- start start 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784c30c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e08408670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784c30c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564e083d97d0 con 0x564e08408250 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784960a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e08408670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784960a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e08408670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36584/0 (socket says 172.21.15.131:36584) 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784960a640 1 -- 172.21.15.131:0/1382884317 learned_addr learned my addr 172.21.15.131:0/1382884317 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.836+0000 7f784960a640 1 -- 172.21.15.131:0/1382884317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e08408c40 con 0x564e08408250 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784960a640 1 --2- 172.21.15.131:0/1382884317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e08408670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f784008deb0 tx=0x7f784005db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8411e3235468e421 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f772d7fa640 1 -- 172.21.15.131:0/1382884317 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f784005d510 con 0x564e08408250 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f772d7fa640 1 -- 172.21.15.131:0/1382884317 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784005cc80 con 0x564e08408250 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f772d7fa640 1 -- 172.21.15.131:0/1382884317 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78400018f0 con 0x564e08408250 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784c30c800 1 -- 172.21.15.131:0/1382884317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 msgr2=0x564e08408670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784c30c800 1 --2- 172.21.15.131:0/1382884317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e08408670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f784008deb0 tx=0x7f784005db30 comp rx=0 tx=0).stop 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784c30c800 1 -- 172.21.15.131:0/1382884317 shutdown_connections 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784c30c800 1 --2- 172.21.15.131:0/1382884317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e08408670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784c30c800 1 -- 172.21.15.131:0/1382884317 >> 172.21.15.131:0/1382884317 conn(0x564e084045b0 msgr2=0x564e08402610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784c30c800 1 -- 172.21.15.131:0/1382884317 shutdown_connections 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.837+0000 7f784c30c800 1 -- 172.21.15.131:0/1382884317 wait complete. 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784c30c800 1 Processor -- start 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784c30c800 1 -- start start 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784c30c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e0840f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784c30c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564e084093b0 con 0x564e08408250 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784960a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e0840f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784960a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e0840f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36598/0 (socket says 172.21.15.131:36598) 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 learned_addr learned my addr 172.21.15.131:0/2324381070 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0840fdf0 con 0x564e08408250 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f784960a640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e0840f8b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f784008e220 tx=0x7f784008de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.838+0000 7f771b7fe640 1 -- 172.21.15.131:0/2324381070 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f784005f9a0 con 0x564e08408250 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.839+0000 7f771b7fe640 1 -- 172.21.15.131:0/2324381070 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840094070 con 0x564e08408250 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.839+0000 7f771b7fe640 1 -- 172.21.15.131:0/2324381070 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f784005fc70 con 0x564e08408250 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.839+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e08410080 con 0x564e08408250 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.839+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e08412d30 con 0x564e08408250 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.839+0000 7f771b7fe640 1 -- 172.21.15.131:0/2324381070 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f784008f520 con 0x564e08408250 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.839+0000 7f771b7fe640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7714036950 0x7f7714038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.839+0000 7f771b7fe640 1 -- 172.21.15.131:0/2324381070 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f784009c100 con 0x564e08408250 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784a60c640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7714036950 0x7f7714038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e0841b370 0x564e0841d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0841df60 con 0x564e0841b370 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f7849e0b640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e0841b370 0x564e0841d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784a60c640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7714036950 0x7f7714038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x564e082e7310 tx=0x7f784401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f7849e0b640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e0841b370 0x564e0841d810 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 20 realm 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0841e370 con 0x564e0841b370 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.840+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0841ec40 con 0x564e0841b370 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0841efe0 con 0x564e0841b370 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0841f480 con 0x564e0841b370 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 20 searching for the correct realm 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564e08421420 0x564e08423890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.841+0000 7f784960a640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564e08421420 0x564e08423890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.842+0000 7f784960a640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564e08421420 0x564e08423890 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.842+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.842+0000 7f784960a640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7840074060 0x7f784004b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.842+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7840074060 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.842+0000 7f784a60c640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7840074060 0x7f784004b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.842+0000 7f784a60c640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7840074060 0x7f784004b9a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.843+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784401f070 con 0x7f7840074060 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.843+0000 7f784a60c640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7844031040 0x7f7844032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.843+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.843+0000 7f7849e0b640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7844031040 0x7f7844032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.843+0000 7f7849e0b640 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7844031040 0x7f7844032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.843+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.843+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.844+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.844+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.844+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.844+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.844+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.844+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7840074060 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784401f070 con 0x7f7840074060 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.845+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7840074060 2024-04-24T01:42:59.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f784401f070 con 0x7f7840074060 2024-04-24T01:42:59.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.846+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.847+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7840074060 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784401f070 con 0x7f7840074060 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.848+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.849+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7840074060 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784401f070 con 0x7f7840074060 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e08421420 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7844031040 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x564e0841b370 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.850+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564e08423f60 con 0x7f7840074060 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784401f070 con 0x7f7840074060 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0841fef0 con 0x564e0841b370 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e08420790 con 0x564e0841b370 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0841fb30 con 0x564e0841b370 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 zone default found 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 4 Realm: () 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 zonegroup default 2024-04-24T01:42:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.851+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e08420790 con 0x7f7844031040 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e08425dc0 con 0x564e08421420 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e08426160 con 0x564e08421420 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 20 started sync module instance, tier type = 2024-04-24T01:42:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.852+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08425260 con 0x7f7840074060 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.853+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7844040040 con 0x7f7840074060 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.853+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94893146003072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e084269b0 con 0x7f7840074060 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.853+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08427200 con 0x564e0841b370 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.854+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94893146003072] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7844040040 con 0x7f7840074060 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.855+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.855+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94893146006784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08426ed0 con 0x564e0841b370 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.855+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e084279f0 con 0x564e08421420 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.856+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94893146006784] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.856+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.856+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94893146010816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08427de0 con 0x564e08421420 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.856+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08428800 con 0x7f7840074060 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.857+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94893146010816] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.857+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7844040040 con 0x7f7840074060 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.857+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94893146014448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08428bf0 con 0x7f7840074060 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.857+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e084295f0 con 0x564e0841b370 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.858+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94893146014448] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7844040040 con 0x7f7840074060 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.858+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.858+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94893146007840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e084295b0 con 0x564e0841b370 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.858+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842a080 con 0x7f7844031040 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.859+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.859+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94893146020736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842a080 con 0x7f7844031040 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.859+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842afc0 con 0x7f7844031040 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.859+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94893146007840] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.860+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.860+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94893146024592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842af80 con 0x7f7844031040 2024-04-24T01:42:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.860+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842b980 con 0x7f7844031040 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94893146020736] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94893146024592] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94893146027152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842b8b0 con 0x7f7844031040 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 20 add_watcher() i=0 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 20 add_watcher() i=1 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 20 add_watcher() i=2 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 20 add_watcher() i=3 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 20 add_watcher() i=4 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 20 add_watcher() i=5 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.863+0000 7f784c30c800 20 add_watcher() i=6 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.864+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94893146027152] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.864+0000 7f784c30c800 20 add_watcher() i=7 2024-04-24T01:42:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.864+0000 7f784c30c800 2 all 8 watchers are set, enabling cache 2024-04-24T01:42:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.864+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e0842e8e0 con 0x564e0841b370 2024-04-24T01:42:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.864+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.864+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94893146023024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842bd90 con 0x564e0841b370 2024-04-24T01:42:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.865+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94893146023024] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.865+0000 7f76fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.865+0000 7f784c30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:42:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.865+0000 7f784c30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f784c30c800 5 note: GC not initialized 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f76fa7fc640 20 reqs_thread_entry: start 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f784c30c800 20 init_complete bucket index max shards: 11 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f784c30c800 20 Filter name: none 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f766ffff640 20 reqs_thread_entry: start 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f784c30c800 20 rados->read ofs=0 len=0 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564e08461680 con 0x564e0841b370 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.866+0000 7f784c30c800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:42:59.877 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:42:59.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.867+0000 7f76fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.867+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94893146023024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08460630 con 0x564e0841b370 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.868+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94893146023024] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.868+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94893146003072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842a470 con 0x7f7840074060 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.869+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94893146003072] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7844040040 con 0x7f7840074060 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.869+0000 7f784c30c800 20 remove_watcher() i=0 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.869+0000 7f784c30c800 2 removed watcher, disabling cache 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.869+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94893146006784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842a470 con 0x564e0841b370 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.870+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94893146006784] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.870+0000 7f784c30c800 20 remove_watcher() i=1 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.870+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94893146010816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08426500 con 0x564e08421420 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.871+0000 7f784960a640 1 -- 172.21.15.131:0/2324381070 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94893146010816] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7840071030 con 0x564e08421420 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.871+0000 7f784c30c800 20 remove_watcher() i=2 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.871+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94893146014448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842a470 con 0x7f7840074060 2024-04-24T01:42:59.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.872+0000 7f784a60c640 1 -- 172.21.15.131:0/2324381070 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94893146014448] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7844040040 con 0x7f7840074060 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.872+0000 7f784c30c800 20 remove_watcher() i=3 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.872+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94893146007840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e084274c0 con 0x564e0841b370 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.873+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94893146007840] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x564e0841b370 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.873+0000 7f784c30c800 20 remove_watcher() i=4 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.873+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94893146020736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e0842a470 con 0x7f7844031040 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.874+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94893146020736] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.874+0000 7f784c30c800 20 remove_watcher() i=5 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.874+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94893146024592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e08426920 con 0x7f7844031040 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.875+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94893146024592] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.875+0000 7f784c30c800 20 remove_watcher() i=6 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.875+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94893146027152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564e084274c0 con 0x7f7844031040 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94893146027152] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f783c02d070 con 0x7f7844031040 2024-04-24T01:42:59.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 20 remove_watcher() i=7 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7844031040 msgr2=0x7f7844032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7844031040 0x7f7844032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e0841b370 msgr2=0x564e0841d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e0841b370 0x564e0841d810 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7840074060 msgr2=0x7f784004b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7840074060 0x7f784004b9a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564e08421420 msgr2=0x564e08423890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x564e08421420 0x564e08423890 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7714036950 msgr2=0x7f7714038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7714036950 0x7f7714038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x564e082e7310 tx=0x7f784401f000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 msgr2=0x564e0840f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e0840f8b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f784008e220 tx=0x7f784008de10 comp rx=0 tx=0).stop 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f7849e0b640 1 -- 172.21.15.131:0/2324381070 reap_dead start 2024-04-24T01:42:59.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 shutdown_connections 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 --2- 172.21.15.131:0/2324381070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e08408250 0x564e0840f8b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 >> 172.21.15.131:0/2324381070 conn(0x564e084045b0 msgr2=0x564e08401c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 shutdown_connections 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.876+0000 7f784c30c800 1 -- 172.21.15.131:0/2324381070 wait complete. 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7724036950 msgr2=0x7f7724038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7724036950 0x7f7724038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x564e083eb0a0 tx=0x7f7844005840 comp rx=0 tx=0).stop 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e083fb010 msgr2=0x564e083fb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e083fb010 0x564e083fb430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7840044840 tx=0x7f7840002fb0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 shutdown_connections 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7724036950 0x7f7724038e10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2740798990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e083fb010 0x564e083fb430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 >> 172.21.15.131:0/2740798990 conn(0x564e083ef0b0 msgr2=0x564e083ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 shutdown_connections 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2740798990 wait complete. 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e082ec480 msgr2=0x564e083e9ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e082ec480 0x564e083e9ea0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7730036950 msgr2=0x7f7730038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7730036950 0x7f7730038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7840054000 tx=0x7f784004e000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 msgr2=0x564e082e8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e082e8260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f783c001e60 tx=0x7f783c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 shutdown_connections 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x564e082ec480 0x564e083e9ea0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7730036950 0x7f7730038e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 --2- 172.21.15.131:0/2227320018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e082e8970 0x564e082e8260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 >> 172.21.15.131:0/2227320018 conn(0x564e082e2320 msgr2=0x564e083d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 shutdown_connections 2024-04-24T01:42:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.877+0000 7f784c30c800 1 -- 172.21.15.131:0/2227320018 wait complete. 2024-04-24T01:42:59.888 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:42:59.889 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-24T01:42:59.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-24T01:42:59.889 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-24T01:42:59.972 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:42:59.972 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.971+0000 7fea5a12b800 1 Processor -- start 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.971+0000 7fea5a12b800 1 -- start start 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea5a12b800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55df73f177c0 0x55df73f17be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea5a12b800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df73dd7d40 con 0x55df73f18120 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea5a12b800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55df73daa4d0 con 0x55df73f177c0 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea55d52640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55df73f177c0 0x55df73f17be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea55d52640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55df73f177c0 0x55df73f17be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36602/0 (socket says 172.21.15.131:36602) 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea55d52640 1 -- 172.21.15.131:0/405957705 learned_addr learned my addr 172.21.15.131:0/405957705 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea55d52640 1 -- 172.21.15.131:0/405957705 >> v1:172.21.15.107:6789/0 conn(0x55df73f18120 legacy=0x55df73f185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea55d52640 1 -- 172.21.15.131:0/405957705 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df73dd6590 con 0x55df73f177c0 2024-04-24T01:42:59.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.972+0000 7fea55551640 1 -- 172.21.15.131:0/405957705 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754170511 0 0) 0x55df73dd7d40 con 0x55df73f18120 2024-04-24T01:42:59.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea55d52640 1 --2- 172.21.15.131:0/405957705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df73f17be0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea4800a520 tx=0x7fea4801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96366c50452ae665 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea55551640 1 -- 172.21.15.131:0/405957705 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48057070 con 0x55df73f177c0 2024-04-24T01:42:59.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea55551640 1 -- 172.21.15.131:0/405957705 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea48052570 con 0x55df73f177c0 2024-04-24T01:42:59.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea55551640 1 -- 172.21.15.131:0/405957705 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48052870 con 0x55df73f177c0 2024-04-24T01:42:59.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea5a12b800 1 -- 172.21.15.131:0/405957705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 msgr2=0x55df73f17be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea5a12b800 1 --2- 172.21.15.131:0/405957705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df73f17be0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea4800a520 tx=0x7fea4801d010 comp rx=0 tx=0).stop 2024-04-24T01:42:59.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea5a12b800 1 -- 172.21.15.131:0/405957705 shutdown_connections 2024-04-24T01:42:59.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea5a12b800 1 --2- 172.21.15.131:0/405957705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df73f17be0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.974+0000 7fea5a12b800 1 -- 172.21.15.131:0/405957705 >> 172.21.15.131:0/405957705 conn(0x55df73f13320 msgr2=0x55df73f15740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.975+0000 7fea5a12b800 1 -- 172.21.15.131:0/405957705 shutdown_connections 2024-04-24T01:42:59.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.975+0000 7fea5a12b800 1 -- 172.21.15.131:0/405957705 wait complete. 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.986+0000 7fea5a12b800 1 Processor -- start 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.986+0000 7fea5a12b800 1 -- start start 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.986+0000 7fea5a12b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df7400c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.986+0000 7fea5a12b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55df73e643c0 con 0x55df73f177c0 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fea55d52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df7400c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fea55d52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df7400c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36604/0 (socket says 172.21.15.131:36604) 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fea55d52640 1 -- 172.21.15.131:0/2089223726 learned_addr learned my addr 172.21.15.131:0/2089223726 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fea55d52640 1 -- 172.21.15.131:0/2089223726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7400c800 con 0x55df73f177c0 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fea55d52640 1 --2- 172.21.15.131:0/2089223726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df7400c230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea48055040 tx=0x7fea4804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da01c9e5eedb0f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fe943e07640 1 -- 172.21.15.131:0/2089223726 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48057040 con 0x55df73f177c0 2024-04-24T01:42:59.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fe943e07640 1 -- 172.21.15.131:0/2089223726 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea48052870 con 0x55df73f177c0 2024-04-24T01:42:59.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.987+0000 7fe943e07640 1 -- 172.21.15.131:0/2089223726 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48052b90 con 0x55df73f177c0 2024-04-24T01:42:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 -- 172.21.15.131:0/2089223726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 msgr2=0x55df7400c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:42:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 --2- 172.21.15.131:0/2089223726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df7400c230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea48055040 tx=0x7fea4804c000 comp rx=0 tx=0).stop 2024-04-24T01:42:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 -- 172.21.15.131:0/2089223726 shutdown_connections 2024-04-24T01:42:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 --2- 172.21.15.131:0/2089223726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df7400c230 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:42:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 -- 172.21.15.131:0/2089223726 >> 172.21.15.131:0/2089223726 conn(0x55df73f13320 msgr2=0x55df74007b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:42:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 -- 172.21.15.131:0/2089223726 shutdown_connections 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 -- 172.21.15.131:0/2089223726 wait complete. 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 Processor -- start 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 -- start start 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df74013d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.988+0000 7fea5a12b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55df73f18f80 con 0x55df73f177c0 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fea55d52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df74013d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fea55d52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df74013d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36610/0 (socket says 172.21.15.131:36610) 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fea55d52640 1 -- 172.21.15.131:0/714039526 learned_addr learned my addr 172.21.15.131:0/714039526 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fea55d52640 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df74014260 con 0x55df73f177c0 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fea55d52640 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df74013d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea48052540 tx=0x7fea48003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fe942604640 1 -- 172.21.15.131:0/714039526 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48073070 con 0x55df73f177c0 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fe942604640 1 -- 172.21.15.131:0/714039526 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4805d570 con 0x55df73f177c0 2024-04-24T01:42:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fe942604640 1 -- 172.21.15.131:0/714039526 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48057070 con 0x55df73f177c0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df740144f0 con 0x55df73f177c0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.989+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df74017100 con 0x55df73f177c0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.990+0000 7fe942604640 1 -- 172.21.15.131:0/714039526 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fea48076070 con 0x55df73f177c0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.990+0000 7fe942604640 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe93c036950 0x7fe93c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.990+0000 7fe942604640 1 -- 172.21.15.131:0/714039526 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fea4808dca0 con 0x55df73f177c0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.990+0000 7fea4d551640 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe93c036950 0x7fe93c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.990+0000 7fea5a12b800 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df73f18120 0x55df7401aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df7401b400 con 0x55df73f18120 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea56553640 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df73f18120 0x55df7401aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea4d551640 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe93c036950 0x7fe93c038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fea40000f60 tx=0x7fea400013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea56553640 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df73f18120 0x55df7401aec0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea56553640 1 -- 172.21.15.131:0/714039526 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea5000a4a0 con 0x55df73f18120 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74018470 con 0x55df73f18120 2024-04-24T01:42:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea56553640 1 -- 172.21.15.131:0/714039526 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea5000a4a0 con 0x55df73f18120 2024-04-24T01:42:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.991+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df7401d1c0 con 0x55df73f18120 2024-04-24T01:42:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.992+0000 7fea56553640 1 -- 172.21.15.131:0/714039526 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea5000a4a0 con 0x55df73f18120 2024-04-24T01:42:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.992+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df7401c500 con 0x55df73f18120 2024-04-24T01:43:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.992+0000 7fea56553640 1 -- 172.21.15.131:0/714039526 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea5000a4a0 con 0x55df73f18120 2024-04-24T01:43:00.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.992+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df7401c920 con 0x55df73f18120 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.992+0000 7fea56553640 1 -- 172.21.15.131:0/714039526 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea5000a4a0 con 0x55df73f18120 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea5a12b800 1 Processor -- start 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea5a12b800 1 -- start start 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea5a12b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df7402bfb0 0x55df7402c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea5a12b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55df73e0a6b0 con 0x55df7402bfb0 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea4d551640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df7402bfb0 0x55df7402c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea4d551640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df7402bfb0 0x55df7402c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36626/0 (socket says 172.21.15.131:36626) 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea4d551640 1 -- 172.21.15.131:0/1223178507 learned_addr learned my addr 172.21.15.131:0/1223178507 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.993+0000 7fea4d551640 1 -- 172.21.15.131:0/1223178507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7402c910 con 0x55df7402bfb0 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.994+0000 7fea4d551640 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df7402bfb0 0x55df7402c3d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c010 tx=0x7fea40010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.994+0000 7fe93b7fe640 1 -- 172.21.15.131:0/1223178507 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea40022070 con 0x55df7402bfb0 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.994+0000 7fe93b7fe640 1 -- 172.21.15.131:0/1223178507 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea40002e50 con 0x55df7402bfb0 2024-04-24T01:43:00.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.994+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df7402d380 con 0x55df7402bfb0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.994+0000 7fe93b7fe640 1 -- 172.21.15.131:0/1223178507 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4001b3b0 con 0x55df7402bfb0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.994+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7402d880 con 0x55df7402bfb0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.994+0000 7fe93b7fe640 1 -- 172.21.15.131:0/1223178507 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fea40025070 con 0x55df7402bfb0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fe93b7fe640 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe930036950 0x7fe930038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fe93b7fe640 1 -- 172.21.15.131:0/1223178507 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fea4004d860 con 0x55df7402bfb0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea56553640 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe930036950 0x7fe930038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea5a12b800 1 Processor -- start 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea5a12b800 1 -- start start 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea56553640 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe930036950 0x7fe930038e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55df7401c8a0 tx=0x7fea50005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea5a12b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df740396d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea5a12b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55df7400cac0 con 0x55df740392b0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea4d551640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df740396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea4d551640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df740396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36634/0 (socket says 172.21.15.131:36634) 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.995+0000 7fea4d551640 1 -- 172.21.15.131:0/3387849518 learned_addr learned my addr 172.21.15.131:0/3387849518 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.996+0000 7fea4d551640 1 -- 172.21.15.131:0/3387849518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df74039ca0 con 0x55df740392b0 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.996+0000 7fea4d551640 1 --2- 172.21.15.131:0/3387849518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df740396d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fea4000ffd0 tx=0x7fea4004bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380ebbe23e67f3c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.996+0000 7fe9397fa640 1 -- 172.21.15.131:0/3387849518 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4001a6a0 con 0x55df740392b0 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.996+0000 7fe9397fa640 1 -- 172.21.15.131:0/3387849518 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea40017050 con 0x55df740392b0 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.996+0000 7fe9397fa640 1 -- 172.21.15.131:0/3387849518 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4001a990 con 0x55df740392b0 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.996+0000 7fea5a12b800 1 -- 172.21.15.131:0/3387849518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 msgr2=0x55df740396d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.996+0000 7fea5a12b800 1 --2- 172.21.15.131:0/3387849518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df740396d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fea4000ffd0 tx=0x7fea4004bea0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 -- 172.21.15.131:0/3387849518 shutdown_connections 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 --2- 172.21.15.131:0/3387849518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df740396d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 -- 172.21.15.131:0/3387849518 >> 172.21.15.131:0/3387849518 conn(0x55df74035610 msgr2=0x55df74033670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 -- 172.21.15.131:0/3387849518 shutdown_connections 2024-04-24T01:43:00.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 -- 172.21.15.131:0/3387849518 wait complete. 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 Processor -- start 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 -- start start 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df74040910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea5a12b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55df7403a410 con 0x55df740392b0 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea4d551640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df74040910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea4d551640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df74040910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36650/0 (socket says 172.21.15.131:36650) 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 learned_addr learned my addr 172.21.15.131:0/4025903385 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.997+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df74040e50 con 0x55df740392b0 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.998+0000 7fea4d551640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df74040910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea40024fd0 tx=0x7fea4004bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.998+0000 7fe9277fe640 1 -- 172.21.15.131:0/4025903385 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea40037070 con 0x55df740392b0 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.998+0000 7fe9277fe640 1 -- 172.21.15.131:0/4025903385 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4000e680 con 0x55df740392b0 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.998+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df740410e0 con 0x55df740392b0 2024-04-24T01:43:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.998+0000 7fe9277fe640 1 -- 172.21.15.131:0/4025903385 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4001b730 con 0x55df740392b0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.998+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df74043d90 con 0x55df740392b0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.998+0000 7fe9277fe640 1 -- 172.21.15.131:0/4025903385 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fea4001b8d0 con 0x55df740392b0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fe9277fe640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe920036950 0x7fe920038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fe9277fe640 1 -- 172.21.15.131:0/4025903385 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fea4004e060 con 0x55df740392b0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fea56553640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe920036950 0x7fe920038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fea56553640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe920036950 0x7fe920038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55df7401c020 tx=0x7fea5001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df7404c570 0x55df7404ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df7404f180 con 0x55df7404c570 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:42:59.999+0000 7fea55d52640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df7404c570 0x55df7404ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea55d52640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df7404c570 0x55df7404ea30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 20 realm 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df7404f590 con 0x55df7404c570 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df7404fe60 con 0x55df7404c570 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.000+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74050200 con 0x55df7404c570 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea5a12b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74050a50 con 0x55df7404c570 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea5a12b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea5a12b800 20 searching for the correct realm 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55df740527c0 0x55df74054bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea4d551640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55df740527c0 0x55df74054bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.001+0000 7fea4d551640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55df740527c0 0x55df74054bb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea4d551640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fea40027060 0x7fea4003a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea40027060 2024-04-24T01:43:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea56553640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fea40027060 0x7fea4003a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea56553640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fea40027060 0x7fea4003a360 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5001f070 con 0x7fea40027060 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea56553640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fea50031040 0x7fea50032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.002+0000 7fea55d52640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fea50031040 0x7fea50032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.003+0000 7fea55d52640 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fea50031040 0x7fea50032940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.003+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.003+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.003+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.003+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.003+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.003+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea40027060 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5001f070 con 0x7fea40027060 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.004+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea40027060 2024-04-24T01:43:00.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea5001f070 con 0x7fea40027060 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.005+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.006+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.007+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea40027060 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5001f070 con 0x7fea40027060 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.008+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea4003f040 con 0x55df740527c0 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea40027060 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5001f070 con 0x7fea40027060 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df740527c0 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea40068040 con 0x55df740527c0 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.009+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea50031040 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x55df7404c570 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df740551e0 con 0x7fea40027060 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea5001f070 con 0x7fea40027060 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:00.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.010+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df740513a0 con 0x55df7404c570 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74051c40 con 0x55df7404c570 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74055640 con 0x55df7404c570 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 zone default found 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 4 Realm: () 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 zonegroup default 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74055670 con 0x7fea50031040 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.011+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74057490 con 0x55df740527c0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea40068040 con 0x55df740527c0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74057860 con 0x55df740527c0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea40068040 con 0x55df740527c0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 20 started sync module instance, tier type = 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.012+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74056930 con 0x7fea40027060 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.013+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea50040040 con 0x7fea40027060 2024-04-24T01:43:00.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.013+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418212580640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74058170 con 0x7fea40027060 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.013+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df740589c0 con 0x55df7404c570 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.014+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94418212580640] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea50040040 con 0x7fea40027060 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.014+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.014+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418212584640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74058690 con 0x55df7404c570 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.014+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df740591b0 con 0x55df740527c0 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.015+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94418212584640] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.016+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea40068040 con 0x55df740527c0 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.016+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418212588672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df740595a0 con 0x55df740527c0 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.016+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74059fc0 con 0x7fea40027060 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.016+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94418212588672] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea40068040 con 0x55df740527c0 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.017+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea50040040 con 0x7fea40027060 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.017+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418212592304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405a3b0 con 0x7fea40027060 2024-04-24T01:43:00.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.017+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405adb0 con 0x55df7404c570 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.018+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.018+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418212595904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405ad40 con 0x55df7404c570 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.018+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405bd60 con 0x7fea50031040 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.018+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94418212592304] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea50040040 con 0x7fea40027060 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.019+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.019+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418212599888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405bd20 con 0x7fea50031040 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.019+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405c7b0 con 0x7fea50031040 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.019+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94418212595904] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.020+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.020+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418212602560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405c7b0 con 0x7fea50031040 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.020+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405d1b0 con 0x7fea50031040 2024-04-24T01:43:00.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.020+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94418212599888] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.020+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94418212602560] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418212598224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405ccc0 con 0x7fea50031040 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 20 add_watcher() i=0 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 20 add_watcher() i=1 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 20 add_watcher() i=2 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 20 add_watcher() i=3 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 20 add_watcher() i=4 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 20 add_watcher() i=5 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.022+0000 7fea5a12b800 20 add_watcher() i=6 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.023+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94418212598224] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.023+0000 7fea5a12b800 20 add_watcher() i=7 2024-04-24T01:43:00.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.023+0000 7fea5a12b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.023+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df740601a0 con 0x55df7404c570 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.023+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.023+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418212605120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405d590 con 0x55df7404c570 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.024+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94418212605120] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.024+0000 7fe9077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.024+0000 7fea5a12b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.024+0000 7fea5a12b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 5 note: GC not initialized 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fe9067fc640 20 reqs_thread_entry: start 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 20 Filter name: none 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fe877fff640 20 reqs_thread_entry: start 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:00.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74093380 con 0x55df7404c570 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.025+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74095e10 con 0x7fea40027060 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.026+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fea50040040 con 0x7fea40027060 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.026+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df740995d0 con 0x55df7404c570 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea5a12b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea5a12b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea5a12b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94418212851776 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df74094e00 con 0x55df7404c570 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94418212595904 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55df74017100 con 0x55df7404c570 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fe9397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94418212595904 notifier 4310 bl.length()=567 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fe9397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(65 notify.4 [notify cookie 94418212851776 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fe9397fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fe9397fa640 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe918003ea0 con 0x55df7404c570 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.027+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.028+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 94418212851776 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55df740144f0 con 0x55df7404c570 2024-04-24T01:43:00.043 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:00.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.028+0000 7fe9077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.028+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418212605120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74098420 con 0x55df7404c570 2024-04-24T01:43:00.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.029+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94418212605120] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.029+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418212580640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405ccc0 con 0x7fea40027060 2024-04-24T01:43:00.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.030+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94418212580640] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea50040040 con 0x7fea40027060 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.030+0000 7fea5a12b800 20 remove_watcher() i=0 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.030+0000 7fea5a12b800 2 removed watcher, disabling cache 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.030+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418212584640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405ccc0 con 0x55df7404c570 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.031+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94418212584640] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.031+0000 7fea5a12b800 20 remove_watcher() i=1 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.031+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418212588672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405ccc0 con 0x55df740527c0 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.032+0000 7fea4d551640 1 -- 172.21.15.131:0/4025903385 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94418212588672] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea40068040 con 0x55df740527c0 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.032+0000 7fea5a12b800 20 remove_watcher() i=2 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.032+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418212592304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74058c80 con 0x7fea40027060 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.033+0000 7fea56553640 1 -- 172.21.15.131:0/4025903385 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94418212592304] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea50040040 con 0x7fea40027060 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.033+0000 7fea5a12b800 20 remove_watcher() i=3 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.033+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418212595904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74059ab0 con 0x55df7404c570 2024-04-24T01:43:00.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.034+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94418212595904] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x55df7404c570 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.034+0000 7fea5a12b800 20 remove_watcher() i=4 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.034+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418212599888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74058c80 con 0x7fea50031040 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.035+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94418212599888] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.035+0000 7fea5a12b800 20 remove_watcher() i=5 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.035+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418212602560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df7405a8c0 con 0x7fea50031040 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.036+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94418212602560] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.036+0000 7fea5a12b800 20 remove_watcher() i=6 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.036+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418212598224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df74058c80 con 0x7fea50031040 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94418212598224] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea48075030 con 0x7fea50031040 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 20 remove_watcher() i=7 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fea50031040 msgr2=0x7fea50032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fea50031040 0x7fea50032940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df7404c570 msgr2=0x55df7404ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df7404c570 0x55df7404ea30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fea40027060 msgr2=0x7fea4003a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fea40027060 0x7fea4003a360 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55df740527c0 msgr2=0x55df74054bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55df740527c0 0x55df74054bb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe920036950 msgr2=0x7fe920038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe920036950 0x7fe920038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55df7401c020 tx=0x7fea5001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 msgr2=0x55df74040910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/4025903385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df740392b0 0x55df74040910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea40024fd0 tx=0x7fea4004bb80 comp rx=0 tx=0).stop 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 reap_dead start 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea55d52640 1 -- 172.21.15.131:0/4025903385 reap_dead start 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 shutdown_connections 2024-04-24T01:43:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 >> 172.21.15.131:0/4025903385 conn(0x55df74035610 msgr2=0x55df74032c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 shutdown_connections 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/4025903385 wait complete. 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe930036950 msgr2=0x7fe930038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe930036950 0x7fe930038e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55df7401c8a0 tx=0x7fea50005840 comp rx=0 tx=0).stop 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df7402bfb0 msgr2=0x55df7402c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.037+0000 7fea5a12b800 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df7402bfb0 0x55df7402c3d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c010 tx=0x7fea40010f10 comp rx=0 tx=0).stop 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 shutdown_connections 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe930036950 0x7fe930038e10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/1223178507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df7402bfb0 0x55df7402c3d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 >> 172.21.15.131:0/1223178507 conn(0x55df74020050 msgr2=0x55df74020450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 shutdown_connections 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/1223178507 wait complete. 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df73f18120 msgr2=0x55df7401aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df73f18120 0x55df7401aec0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe93c036950 msgr2=0x7fe93c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe93c036950 0x7fe93c038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fea40000f60 tx=0x7fea400013f0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 msgr2=0x55df74013d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df74013d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea48052540 tx=0x7fea48003020 comp rx=0 tx=0).stop 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 shutdown_connections 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55df73f18120 0x55df7401aec0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe93c036950 0x7fe93c038e10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 --2- 172.21.15.131:0/714039526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55df73f177c0 0x55df74013d20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 >> 172.21.15.131:0/714039526 conn(0x55df73f13320 msgr2=0x55df74006370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 shutdown_connections 2024-04-24T01:43:00.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.038+0000 7fea5a12b800 1 -- 172.21.15.131:0/714039526 wait complete. 2024-04-24T01:43:00.054 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:00.054 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:43:00.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:43:00.054 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:43:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.132+0000 7fd4d0816800 1 Processor -- start 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.132+0000 7fd4d0816800 1 -- start start 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.132+0000 7fd4d0816800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ce31764f90 0x55ce317653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.132+0000 7fd4d0816800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce31623d40 con 0x55ce31766100 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.132+0000 7fd4d0816800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55ce315f64d0 con 0x55ce31764f90 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.133+0000 7fd4cbf5c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ce31764f90 0x55ce317653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.133+0000 7fd4cbf5c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ce31764f90 0x55ce317653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36658/0 (socket says 172.21.15.131:36658) 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.133+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/4064150082 learned_addr learned my addr 172.21.15.131:0/4064150082 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.133+0000 7fd4c375b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55ce31766100 0x55ce31766580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45774/0 (socket says 172.21.15.131:45774) 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.133+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/4064150082 >> v1:172.21.15.107:6789/0 conn(0x55ce31766100 legacy=0x55ce31766580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.133+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/4064150082 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce31622590 con 0x55ce31764f90 2024-04-24T01:43:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.133+0000 7fd4cb75b640 1 -- 172.21.15.131:0/4064150082 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536046361 0 0) 0x55ce31623d40 con 0x55ce31766100 2024-04-24T01:43:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.135+0000 7fd4cbf5c640 1 --2- 172.21.15.131:0/4064150082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce317653b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00a520 tx=0x7fd4bc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce46b7c3d0b3a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.135+0000 7fd4cb75b640 1 -- 172.21.15.131:0/4064150082 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc057070 con 0x55ce31764f90 2024-04-24T01:43:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.135+0000 7fd4cb75b640 1 -- 172.21.15.131:0/4064150082 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc052570 con 0x55ce31764f90 2024-04-24T01:43:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.135+0000 7fd4cb75b640 1 -- 172.21.15.131:0/4064150082 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc04ae60 con 0x55ce31764f90 2024-04-24T01:43:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.136+0000 7fd4d0816800 1 -- 172.21.15.131:0/4064150082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 msgr2=0x55ce317653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.136+0000 7fd4d0816800 1 --2- 172.21.15.131:0/4064150082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce317653b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00a520 tx=0x7fd4bc01d010 comp rx=0 tx=0).stop 2024-04-24T01:43:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.136+0000 7fd4d0816800 1 -- 172.21.15.131:0/4064150082 shutdown_connections 2024-04-24T01:43:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.136+0000 7fd4d0816800 1 --2- 172.21.15.131:0/4064150082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce317653b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.136+0000 7fd4d0816800 1 -- 172.21.15.131:0/4064150082 >> 172.21.15.131:0/4064150082 conn(0x55ce31760530 msgr2=0x55ce31762950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.136+0000 7fd4d0816800 1 -- 172.21.15.131:0/4064150082 shutdown_connections 2024-04-24T01:43:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.136+0000 7fd4d0816800 1 -- 172.21.15.131:0/4064150082 wait complete. 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.147+0000 7fd4d0816800 1 Processor -- start 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.147+0000 7fd4d0816800 1 -- start start 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.147+0000 7fd4d0816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce316da9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.147+0000 7fd4d0816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce316b03c0 con 0x55ce31764f90 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd4cbf5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce316da9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd4cbf5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce316da9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36662/0 (socket says 172.21.15.131:36662) 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/3918085814 learned_addr learned my addr 172.21.15.131:0/3918085814 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/3918085814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce316d8f60 con 0x55ce31764f90 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd4cbf5c640 1 --2- 172.21.15.131:0/3918085814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce316da9a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc055040 tx=0x7fd4bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5670fee2cf46db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd3b9e0b640 1 -- 172.21.15.131:0/3918085814 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc057040 con 0x55ce31764f90 2024-04-24T01:43:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd3b9e0b640 1 -- 172.21.15.131:0/3918085814 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc052720 con 0x55ce31764f90 2024-04-24T01:43:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.148+0000 7fd3b9e0b640 1 -- 172.21.15.131:0/3918085814 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc052a40 con 0x55ce31764f90 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 -- 172.21.15.131:0/3918085814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 msgr2=0x55ce316da9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 --2- 172.21.15.131:0/3918085814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce316da9a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc055040 tx=0x7fd4bc04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 -- 172.21.15.131:0/3918085814 shutdown_connections 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 --2- 172.21.15.131:0/3918085814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce316da9a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 -- 172.21.15.131:0/3918085814 >> 172.21.15.131:0/3918085814 conn(0x55ce31760530 msgr2=0x55ce31851ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 -- 172.21.15.131:0/3918085814 shutdown_connections 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 -- 172.21.15.131:0/3918085814 wait complete. 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 Processor -- start 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.149+0000 7fd4d0816800 1 -- start start 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.150+0000 7fd4d0816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce31860070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.150+0000 7fd4d0816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce3176e5a0 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.150+0000 7fd4cbf5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce31860070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.150+0000 7fd4cbf5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce31860070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36678/0 (socket says 172.21.15.131:36678) 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.150+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1687007060 learned_addr learned my addr 172.21.15.131:0/1687007060 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.150+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce318605b0 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.150+0000 7fd4cbf5c640 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce31860070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc052540 tx=0x7fd4bc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.151+0000 7fd3b3fff640 1 -- 172.21.15.131:0/1687007060 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc073070 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.151+0000 7fd3b3fff640 1 -- 172.21.15.131:0/1687007060 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc052c90 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.151+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce31860840 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.151+0000 7fd3b3fff640 1 -- 172.21.15.131:0/1687007060 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc057070 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.151+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce318634f0 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd3b3fff640 1 -- 172.21.15.131:0/1687007060 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd4bc076070 con 0x55ce31764f90 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd3b3fff640 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3b4036950 0x7fd3b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd3b3fff640 1 -- 172.21.15.131:0/1687007060 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd4bc08da10 con 0x55ce31764f90 2024-04-24T01:43:00.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd4c375b640 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3b4036950 0x7fd3b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce31766100 0x55ce318672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318677f0 con 0x55ce31766100 2024-04-24T01:43:00.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce31766100 0x55ce318672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd4c375b640 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3b4036950 0x7fd3b4038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4000c00 tx=0x7fd4b40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.152+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce31766100 0x55ce318672b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.153+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1687007060 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4c400a4a0 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.153+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce31864840 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.153+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1687007060 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4c400a4a0 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.153+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318695b0 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.153+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1687007060 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4c400a4a0 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.153+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318688f0 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.154+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1687007060 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4c400a4a0 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.154+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce31868d10 con 0x55ce31766100 2024-04-24T01:43:00.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.154+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1687007060 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4c400a4a0 con 0x55ce31766100 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.154+0000 7fd4d0816800 1 Processor -- start 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.154+0000 7fd4d0816800 1 -- start start 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.154+0000 7fd4d0816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce318783c0 0x55ce318787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.154+0000 7fd4d0816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce316566b0 con 0x55ce318783c0 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd4c375b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce318783c0 0x55ce318787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd4c375b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce318783c0 0x55ce318787e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36688/0 (socket says 172.21.15.131:36688) 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd4c375b640 1 -- 172.21.15.131:0/630772992 learned_addr learned my addr 172.21.15.131:0/630772992 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd4c375b640 1 -- 172.21.15.131:0/630772992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce31878d20 con 0x55ce318783c0 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd4c375b640 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce318783c0 0x55ce318787e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400e610 tx=0x7fd4b400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd3b17fa640 1 -- 172.21.15.131:0/630772992 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b4022070 con 0x55ce318783c0 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd3b17fa640 1 -- 172.21.15.131:0/630772992 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b4009050 con 0x55ce318783c0 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce31879790 con 0x55ce318783c0 2024-04-24T01:43:00.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd3b17fa640 1 -- 172.21.15.131:0/630772992 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b400d500 con 0x55ce318783c0 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.155+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce31879c90 con 0x55ce318783c0 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.156+0000 7fd3b17fa640 1 -- 172.21.15.131:0/630772992 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd4b4025070 con 0x55ce318783c0 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.156+0000 7fd3b17fa640 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3a4036950 0x7fd3a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.156+0000 7fd3b17fa640 1 -- 172.21.15.131:0/630772992 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd4b404db70 con 0x55ce318783c0 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.156+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3a4036950 0x7fd3a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.156+0000 7fd4d0816800 1 Processor -- start 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4d0816800 1 -- start start 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3a4036950 0x7fd3a4038e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55ce31868c90 tx=0x7fd4c4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4d0816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce31885b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4d0816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce316d9220 con 0x55ce31885700 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4c375b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce31885b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4c375b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce31885b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36690/0 (socket says 172.21.15.131:36690) 2024-04-24T01:43:00.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4c375b640 1 -- 172.21.15.131:0/2879506013 learned_addr learned my addr 172.21.15.131:0/2879506013 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4c375b640 1 -- 172.21.15.131:0/2879506013 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce318860f0 con 0x55ce31885700 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd4c375b640 1 --2- 172.21.15.131:0/2879506013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce31885b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4026fd0 tx=0x7fd4b4024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af287a02d8258eba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd3aaffd640 1 -- 172.21.15.131:0/2879506013 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b404a030 con 0x55ce31885700 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd3aaffd640 1 -- 172.21.15.131:0/2879506013 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b4025e30 con 0x55ce31885700 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.157+0000 7fd3aaffd640 1 -- 172.21.15.131:0/2879506013 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b401ad50 con 0x55ce31885700 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 -- 172.21.15.131:0/2879506013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 msgr2=0x55ce31885b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 --2- 172.21.15.131:0/2879506013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce31885b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4026fd0 tx=0x7fd4b4024eb0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 -- 172.21.15.131:0/2879506013 shutdown_connections 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 --2- 172.21.15.131:0/2879506013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce31885b20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 -- 172.21.15.131:0/2879506013 >> 172.21.15.131:0/2879506013 conn(0x55ce31881a60 msgr2=0x55ce3187fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 -- 172.21.15.131:0/2879506013 shutdown_connections 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 -- 172.21.15.131:0/2879506013 wait complete. 2024-04-24T01:43:00.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 Processor -- start 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 -- start start 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce3188cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.158+0000 7fd4d0816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce31886860 con 0x55ce31885700 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd4c375b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce3188cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd4c375b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce3188cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36700/0 (socket says 172.21.15.131:36700) 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 learned_addr learned my addr 172.21.15.131:0/1391862910 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce3188d300 con 0x55ce31885700 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd4c375b640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce3188cdc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4026fd0 tx=0x7fd4b404be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd3a97fa640 1 -- 172.21.15.131:0/1391862910 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b404a050 con 0x55ce31885700 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd3a97fa640 1 -- 172.21.15.131:0/1391862910 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b400d6a0 con 0x55ce31885700 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce3188d590 con 0x55ce31885700 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd3a97fa640 1 -- 172.21.15.131:0/1391862910 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b400d9e0 con 0x55ce31885700 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.159+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce31890240 con 0x55ce31885700 2024-04-24T01:43:00.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd3a97fa640 1 -- 172.21.15.131:0/1391862910 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd4b404d370 con 0x55ce31885700 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd3a97fa640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd394036950 0x7fd394038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd3a97fa640 1 -- 172.21.15.131:0/1391862910 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd4b4045880 con 0x55ce31885700 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd394036950 0x7fd394038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce318988c0 0x55ce3189ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189b4d0 con 0x55ce318988c0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.160+0000 7fd4cbf5c640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce318988c0 0x55ce3189ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd394036950 0x7fd394038e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55ce31868410 tx=0x7fd4c401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4cbf5c640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce318988c0 0x55ce3189ad80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 20 realm 2024-04-24T01:43:00.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189b8e0 con 0x55ce318988c0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189c1b0 con 0x55ce318988c0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.161+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189c550 con 0x55ce318988c0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4d0816800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189c9b0 con 0x55ce318988c0 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4d0816800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4d0816800 20 searching for the correct realm 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ce3189ea00 0x55ce318a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4c375b640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ce3189ea00 0x55ce318a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.162+0000 7fd4c375b640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ce3189ea00 0x55ce318a0df0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4c375b640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd4b4027060 0x7fd4b40450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4b4027060 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd4b4027060 0x7fd4b40450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd4b4027060 0x7fd4b40450b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4c401f070 con 0x7fd4b4027060 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4cc75d640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd4c4031040 0x7fd4c4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.163+0000 7fd4cbf5c640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd4c4031040 0x7fd4c4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.164+0000 7fd4cbf5c640 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd4c4031040 0x7fd4c4032940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.164+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.164+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.164+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.164+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.164+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.164+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4b4027060 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4c401f070 con 0x7fd4b4027060 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.165+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4b4027060 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4c401f070 con 0x7fd4b4027060 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.166+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.167+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.168+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4b4027060 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4c401f070 con 0x7fd4b4027060 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.169+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.170+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.170+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4b4027060 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.170+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4c401f070 con 0x7fd4b4027060 2024-04-24T01:43:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.170+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce3189ea00 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.170+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.170+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4c4031040 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x55ce318988c0 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a14a0 con 0x7fd4b4027060 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4c401f070 con 0x7fd4b4027060 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189d450 con 0x55ce318988c0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189d090 con 0x55ce318988c0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.171+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce3189d0a0 con 0x55ce318988c0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 zone default found 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 4 Realm: () 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 zonegroup default 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a1900 con 0x7fd4c4031040 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a3790 con 0x55ce3189ea00 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.172+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a3b30 con 0x55ce3189ea00 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.173+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.173+0000 7fd4d0816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.173+0000 7fd4d0816800 20 started sync module instance, tier type = 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.173+0000 7fd4d0816800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.173+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a2bd0 con 0x7fd4b4027060 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.174+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4c4040040 con 0x7fd4b4027060 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.174+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94344082761504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a3ed0 con 0x7fd4b4027060 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.174+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a4890 con 0x55ce318988c0 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.175+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94344082761504] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4c4040040 con 0x7fd4b4027060 2024-04-24T01:43:00.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.175+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.175+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94344082763888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a4890 con 0x55ce318988c0 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.175+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a52b0 con 0x55ce3189ea00 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.176+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.176+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94344082771360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a5b00 con 0x55ce3189ea00 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.176+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a6620 con 0x7fd4b4027060 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.176+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94344082763888] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.177+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4c4040040 con 0x7fd4b4027060 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.177+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94344082776304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a6a10 con 0x7fd4b4027060 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.177+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94344082771360] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.177+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a7260 con 0x55ce318988c0 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.178+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94344082776304] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4c4040040 con 0x7fd4b4027060 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.178+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.178+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94344082768864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a6ec0 con 0x55ce318988c0 2024-04-24T01:43:00.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.178+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a7950 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.179+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.179+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94344082768864] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.179+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94344082781184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a7910 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.179+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a6a10 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.180+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94344082781184] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94344082778640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a83c0 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a8d80 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94344082786512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a91a0 con 0x7fd4c4031040 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 20 add_watcher() i=0 2024-04-24T01:43:00.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 20 add_watcher() i=1 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 20 add_watcher() i=2 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 20 add_watcher() i=3 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 20 add_watcher() i=4 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4d0816800 20 add_watcher() i=5 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.182+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94344082778640] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.183+0000 7fd4d0816800 20 add_watcher() i=6 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.183+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94344082786512] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.183+0000 7fd4d0816800 20 add_watcher() i=7 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.183+0000 7fd4d0816800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.183+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a91a0 con 0x55ce318988c0 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.184+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.184+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94344082787568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a9110 con 0x55ce318988c0 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94344082787568] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4d0816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4d0816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4d0816800 5 note: GC not initialized 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd380fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4d0816800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4d0816800 20 Filter name: none 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd2fa7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4d0816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.185+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce318defb0 con 0x55ce318988c0 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.186+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.186+0000 7fd4d0816800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:00.199 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.187+0000 7fd381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.187+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94344082787568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318ddf00 con 0x55ce318988c0 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.188+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94344082787568] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.188+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94344082761504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a8cf0 con 0x7fd4b4027060 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.188+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94344082761504] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4c4040040 con 0x7fd4b4027060 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.189+0000 7fd4d0816800 20 remove_watcher() i=0 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.189+0000 7fd4d0816800 2 removed watcher, disabling cache 2024-04-24T01:43:00.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.189+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94344082763888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a8cf0 con 0x55ce318988c0 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.190+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94344082763888] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.190+0000 7fd4d0816800 20 remove_watcher() i=1 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.190+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94344082771360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a8cf0 con 0x55ce3189ea00 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.191+0000 7fd4c375b640 1 -- 172.21.15.131:0/1391862910 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94344082771360] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b4024030 con 0x55ce3189ea00 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.191+0000 7fd4d0816800 20 remove_watcher() i=2 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.191+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94344082776304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a2720 con 0x7fd4b4027060 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.191+0000 7fd4cc75d640 1 -- 172.21.15.131:0/1391862910 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94344082776304] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4c4040040 con 0x7fd4b4027060 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.192+0000 7fd4d0816800 20 remove_watcher() i=3 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.192+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94344082768864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a2720 con 0x55ce318988c0 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.192+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94344082768864] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x55ce318988c0 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.192+0000 7fd4d0816800 20 remove_watcher() i=4 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.192+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94344082781184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a43e0 con 0x7fd4c4031040 2024-04-24T01:43:00.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.193+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94344082781184] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.193+0000 7fd4d0816800 20 remove_watcher() i=5 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.193+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94344082778640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a2720 con 0x7fd4c4031040 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.194+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94344082778640] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.194+0000 7fd4d0816800 20 remove_watcher() i=6 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.194+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94344082786512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce318a7400 con 0x7fd4c4031040 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94344082786512] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4bc075030 con 0x7fd4c4031040 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 20 remove_watcher() i=7 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd4c4031040 msgr2=0x7fd4c4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd4c4031040 0x7fd4c4032940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce318988c0 msgr2=0x55ce3189ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce318988c0 0x55ce3189ad80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd4b4027060 msgr2=0x7fd4b40450b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd4b4027060 0x7fd4b40450b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ce3189ea00 msgr2=0x55ce318a0df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ce3189ea00 0x55ce318a0df0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd394036950 msgr2=0x7fd394038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd394036950 0x7fd394038e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55ce31868410 tx=0x7fd4c401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 msgr2=0x55ce3188cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1391862910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31885700 0x55ce3188cdc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4026fd0 tx=0x7fd4b404be50 comp rx=0 tx=0).stop 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 reap_dead start 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4cbf5c640 1 -- 172.21.15.131:0/1391862910 reap_dead start 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 shutdown_connections 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 >> 172.21.15.131:0/1391862910 conn(0x55ce31881a60 msgr2=0x55ce3187f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 shutdown_connections 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.195+0000 7fd4d0816800 1 -- 172.21.15.131:0/1391862910 wait complete. 2024-04-24T01:43:00.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3a4036950 msgr2=0x7fd3a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3a4036950 0x7fd3a4038e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55ce31868c90 tx=0x7fd4c4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce318783c0 msgr2=0x55ce318787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce318783c0 0x55ce318787e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400e610 tx=0x7fd4b400ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 shutdown_connections 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3a4036950 0x7fd3a4038e10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/630772992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce318783c0 0x55ce318787e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 >> 172.21.15.131:0/630772992 conn(0x55ce3186c460 msgr2=0x55ce3186c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 shutdown_connections 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/630772992 wait complete. 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce31766100 msgr2=0x55ce318672b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce31766100 0x55ce318672b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3b4036950 msgr2=0x7fd3b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3b4036950 0x7fd3b4038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4000c00 tx=0x7fd4b40013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 msgr2=0x55ce31860070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce31860070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc052540 tx=0x7fd4bc003020 comp rx=0 tx=0).stop 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 shutdown_connections 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ce31766100 0x55ce318672b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd3b4036950 0x7fd3b4038e10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 --2- 172.21.15.131:0/1687007060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce31764f90 0x55ce31860070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 >> 172.21.15.131:0/1687007060 conn(0x55ce31760530 msgr2=0x55ce316d9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 shutdown_connections 2024-04-24T01:43:00.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.196+0000 7fd4d0816800 1 -- 172.21.15.131:0/1687007060 wait complete. 2024-04-24T01:43:00.210 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:00.210 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-24T01:43:00.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-24T01:43:00.210 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-24T01:43:00.253 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:00.253 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.252+0000 7fab77e62800 1 Processor -- start 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.252+0000 7fab77e62800 1 -- start start 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab77e62800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5622b720d780 0x5622b720dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab77e62800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5622b70cdd40 con 0x5622b720e0e0 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab77e62800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5622b70a04d0 con 0x5622b720d780 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab75961640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5622b720d780 0x5622b720dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab75160640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5622b720e0e0 0x5622b720e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45790/0 (socket says 172.21.15.131:45790) 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab75160640 1 -- 172.21.15.131:0/1210563047 learned_addr learned my addr 172.21.15.131:0/1210563047 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab75961640 1 -- 172.21.15.131:0/1210563047 >> v1:172.21.15.107:6789/0 conn(0x5622b720e0e0 legacy=0x5622b720e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab75961640 1 -- 172.21.15.131:0/1210563047 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b70cc590 con 0x5622b720d780 2024-04-24T01:43:00.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.253+0000 7fab7495f640 1 -- 172.21.15.131:0/1210563047 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316488565 0 0) 0x5622b70cdd40 con 0x5622b720e0e0 2024-04-24T01:43:00.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.255+0000 7fab75961640 1 --2- 172.21.15.131:0/1210563047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b720dba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab6800a470 tx=0x7fab6801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c016226eda20b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.255+0000 7fab7495f640 1 -- 172.21.15.131:0/1210563047 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68057070 con 0x5622b720d780 2024-04-24T01:43:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.255+0000 7fab7495f640 1 -- 172.21.15.131:0/1210563047 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6804adc0 con 0x5622b720d780 2024-04-24T01:43:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.255+0000 7fab7495f640 1 -- 172.21.15.131:0/1210563047 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68052590 con 0x5622b720d780 2024-04-24T01:43:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.256+0000 7fab77e62800 1 -- 172.21.15.131:0/1210563047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 msgr2=0x5622b720dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.256+0000 7fab77e62800 1 --2- 172.21.15.131:0/1210563047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b720dba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab6800a470 tx=0x7fab6801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.256+0000 7fab77e62800 1 -- 172.21.15.131:0/1210563047 shutdown_connections 2024-04-24T01:43:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.256+0000 7fab77e62800 1 --2- 172.21.15.131:0/1210563047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b720dba0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.256+0000 7fab77e62800 1 -- 172.21.15.131:0/1210563047 >> 172.21.15.131:0/1210563047 conn(0x5622b7209320 msgr2=0x5622b720b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.256+0000 7fab77e62800 1 -- 172.21.15.131:0/1210563047 shutdown_connections 2024-04-24T01:43:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.256+0000 7fab77e62800 1 -- 172.21.15.131:0/1210563047 wait complete. 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.267+0000 7fab77e62800 1 Processor -- start 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.267+0000 7fab77e62800 1 -- start start 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.267+0000 7fab77e62800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7302230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7fab77e62800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5622b715a3c0 con 0x5622b720d780 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7fab75961640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7302230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7fab75961640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7302230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36718/0 (socket says 172.21.15.131:36718) 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7fab75961640 1 -- 172.21.15.131:0/4029965449 learned_addr learned my addr 172.21.15.131:0/4029965449 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7fab75961640 1 -- 172.21.15.131:0/4029965449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b7302800 con 0x5622b720d780 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7fab75961640 1 --2- 172.21.15.131:0/4029965449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7302230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab68055040 tx=0x7fab6804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4b1d8b27d7bc2f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7faa63e07640 1 -- 172.21.15.131:0/4029965449 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68057040 con 0x5622b720d780 2024-04-24T01:43:00.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7faa63e07640 1 -- 172.21.15.131:0/4029965449 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68062070 con 0x5622b720d780 2024-04-24T01:43:00.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.268+0000 7faa63e07640 1 -- 172.21.15.131:0/4029965449 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6805d470 con 0x5622b720d780 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 -- 172.21.15.131:0/4029965449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 msgr2=0x5622b7302230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 --2- 172.21.15.131:0/4029965449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7302230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab68055040 tx=0x7fab6804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 -- 172.21.15.131:0/4029965449 shutdown_connections 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 --2- 172.21.15.131:0/4029965449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7302230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 -- 172.21.15.131:0/4029965449 >> 172.21.15.131:0/4029965449 conn(0x5622b7209320 msgr2=0x5622b72fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 -- 172.21.15.131:0/4029965449 shutdown_connections 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 -- 172.21.15.131:0/4029965449 wait complete. 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 Processor -- start 2024-04-24T01:43:00.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.269+0000 7fab77e62800 1 -- start start 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab77e62800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7309ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab77e62800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5622b720efa0 con 0x5622b720d780 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab75961640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7309ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab75961640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7309ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36728/0 (socket says 172.21.15.131:36728) 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab75961640 1 -- 172.21.15.131:0/509510879 learned_addr learned my addr 172.21.15.131:0/509510879 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab75961640 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b730a220 con 0x5622b720d780 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab75961640 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7309ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fab6801ce60 tx=0x7fab68002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7faa62604640 1 -- 172.21.15.131:0/509510879 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6806b070 con 0x5622b720d780 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7faa62604640 1 -- 172.21.15.131:0/509510879 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6805d970 con 0x5622b720d780 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622b730a4b0 con 0x5622b720d780 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7faa62604640 1 -- 172.21.15.131:0/509510879 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68057070 con 0x5622b720d780 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.270+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b730d110 con 0x5622b720d780 2024-04-24T01:43:00.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.271+0000 7faa62604640 1 -- 172.21.15.131:0/509510879 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fab6805dc90 con 0x5622b720d780 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.271+0000 7faa62604640 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa5c036950 0x7faa5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.271+0000 7faa62604640 1 -- 172.21.15.131:0/509510879 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fab6808e170 con 0x5622b720d780 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.271+0000 7fab75160640 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa5c036950 0x7faa5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.272+0000 7fab77e62800 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b720e0e0 0x5622b7310ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.272+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7311410 con 0x5622b720e0e0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.272+0000 7fab76162640 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b720e0e0 0x5622b7310ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.272+0000 7fab75160640 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa5c036950 0x7faa5c038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab6c000c00 tx=0x7fab6c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.272+0000 7fab76162640 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b720e0e0 0x5622b7310ed0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.272+0000 7fab76162640 1 -- 172.21.15.131:0/509510879 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7000a4a0 con 0x5622b720e0e0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.272+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b730e460 con 0x5622b720e0e0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.273+0000 7fab76162640 1 -- 172.21.15.131:0/509510879 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab7000a4a0 con 0x5622b720e0e0 2024-04-24T01:43:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.273+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b73131a0 con 0x5622b720e0e0 2024-04-24T01:43:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.273+0000 7fab76162640 1 -- 172.21.15.131:0/509510879 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab7000a4a0 con 0x5622b720e0e0 2024-04-24T01:43:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.273+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b73124e0 con 0x5622b720e0e0 2024-04-24T01:43:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.273+0000 7fab76162640 1 -- 172.21.15.131:0/509510879 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab7000a4a0 con 0x5622b720e0e0 2024-04-24T01:43:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.273+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7312900 con 0x5622b720e0e0 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.273+0000 7fab76162640 1 -- 172.21.15.131:0/509510879 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab7000a4a0 con 0x5622b720e0e0 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.274+0000 7fab77e62800 1 Processor -- start 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.274+0000 7fab77e62800 1 -- start start 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.274+0000 7fab77e62800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b7321f90 0x5622b73223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.274+0000 7fab77e62800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5622b71006b0 con 0x5622b7321f90 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.274+0000 7fab75160640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b7321f90 0x5622b73223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.274+0000 7fab75160640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b7321f90 0x5622b73223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36742/0 (socket says 172.21.15.131:36742) 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.274+0000 7fab75160640 1 -- 172.21.15.131:0/2385087639 learned_addr learned my addr 172.21.15.131:0/2385087639 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.275+0000 7fab75160640 1 -- 172.21.15.131:0/2385087639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b73228f0 con 0x5622b7321f90 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.275+0000 7fab75160640 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b7321f90 0x5622b73223b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e610 tx=0x7fab6c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.275+0000 7faa5b7fe640 1 -- 172.21.15.131:0/2385087639 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c022070 con 0x5622b7321f90 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.275+0000 7faa5b7fe640 1 -- 172.21.15.131:0/2385087639 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c009050 con 0x5622b7321f90 2024-04-24T01:43:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.275+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622b7323360 con 0x5622b7321f90 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.275+0000 7faa5b7fe640 1 -- 172.21.15.131:0/2385087639 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c00d500 con 0x5622b7321f90 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.275+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b7323860 con 0x5622b7321f90 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7faa5b7fe640 1 -- 172.21.15.131:0/2385087639 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fab6c025070 con 0x5622b7321f90 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7faa5b7fe640 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa50036950 0x7faa50038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7faa5b7fe640 1 -- 172.21.15.131:0/2385087639 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fab6c04dab0 con 0x5622b7321f90 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7fab76162640 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa50036950 0x7faa50038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7fab77e62800 1 Processor -- start 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7fab77e62800 1 -- start start 2024-04-24T01:43:00.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7fab76162640 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa50036950 0x7faa50038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5622b7312880 tx=0x7fab70005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7fab77e62800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b732f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.276+0000 7fab77e62800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5622b7302ac0 con 0x5622b732f2d0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab75160640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b732f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab75160640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b732f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36758/0 (socket says 172.21.15.131:36758) 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab75160640 1 -- 172.21.15.131:0/2998647740 learned_addr learned my addr 172.21.15.131:0/2998647740 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab75160640 1 -- 172.21.15.131:0/2998647740 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b732fcc0 con 0x5622b732f2d0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab75160640 1 --2- 172.21.15.131:0/2998647740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b732f6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fab6c026fd0 tx=0x7fab6c026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd47b22106e9eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7faa597fa640 1 -- 172.21.15.131:0/2998647740 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c01ac20 con 0x5622b732f2d0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7faa597fa640 1 -- 172.21.15.131:0/2998647740 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c01adc0 con 0x5622b732f2d0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7faa597fa640 1 -- 172.21.15.131:0/2998647740 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c0254d0 con 0x5622b732f2d0 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab77e62800 1 -- 172.21.15.131:0/2998647740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 msgr2=0x5622b732f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab77e62800 1 --2- 172.21.15.131:0/2998647740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b732f6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fab6c026fd0 tx=0x7fab6c026680 comp rx=0 tx=0).stop 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab77e62800 1 -- 172.21.15.131:0/2998647740 shutdown_connections 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab77e62800 1 --2- 172.21.15.131:0/2998647740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b732f6f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.277+0000 7fab77e62800 1 -- 172.21.15.131:0/2998647740 >> 172.21.15.131:0/2998647740 conn(0x5622b732b630 msgr2=0x5622b7329690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab77e62800 1 -- 172.21.15.131:0/2998647740 shutdown_connections 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab77e62800 1 -- 172.21.15.131:0/2998647740 wait complete. 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab77e62800 1 Processor -- start 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab77e62800 1 -- start start 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab77e62800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b7336930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab77e62800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5622b7330430 con 0x5622b732f2d0 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab75160640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b7336930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab75160640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b7336930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36760/0 (socket says 172.21.15.131:36760) 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 learned_addr learned my addr 172.21.15.131:0/951058181 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.278+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b7336e70 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.279+0000 7fab75160640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b7336930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0266c0 tx=0x7fab6c04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.279+0000 7faa477fe640 1 -- 172.21.15.131:0/951058181 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c00d8b0 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.279+0000 7faa477fe640 1 -- 172.21.15.131:0/951058181 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c00da50 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.279+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622b7337100 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.279+0000 7faa477fe640 1 -- 172.21.15.131:0/951058181 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c01a450 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.279+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b7339db0 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.279+0000 7faa477fe640 1 -- 172.21.15.131:0/951058181 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fab6c01a5f0 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7faa477fe640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa40036950 0x7faa40038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7faa477fe640 1 -- 172.21.15.131:0/951058181 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fab6c036c80 con 0x5622b732f2d0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7fab76162640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa40036950 0x7faa40038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7fab76162640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa40036950 0x7faa40038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5622b7312000 tx=0x7fab7001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b7342420 0x5622b73448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7345030 con 0x5622b7342420 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.280+0000 7fab75961640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b7342420 0x5622b73448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab75961640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b7342420 0x5622b73448e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 realm 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7345440 con 0x5622b7342420 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7345d10 con 0x5622b7342420 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b73460b0 con 0x5622b7342420 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.281+0000 7fab77e62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7346900 con 0x5622b7342420 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab77e62800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab77e62800 20 searching for the correct realm 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5622b7348670 0x5622b734aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab75160640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5622b7348670 0x5622b734aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.282+0000 7fab75160640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5622b7348670 0x5622b734aa60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab75160640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fab6c027060 0x7fab6c01b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab6c027060 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab76162640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fab6c027060 0x7fab6c01b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab76162640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fab6c027060 0x7fab6c01b6f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7001f070 con 0x7fab6c027060 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab76162640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fab70031040 0x7fab70032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.283+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.284+0000 7fab75961640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fab70031040 0x7fab70032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.284+0000 7fab75961640 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fab70031040 0x7fab70032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.284+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.284+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.284+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.284+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.284+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab6c027060 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7001f070 con 0x7fab6c027060 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.285+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab6c027060 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab7001f070 con 0x7fab6c027060 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.286+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.287+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.288+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab6c027060 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7001f070 con 0x7fab6c027060 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.289+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c024030 con 0x5622b7348670 2024-04-24T01:43:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab6c027060 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7001f070 con 0x7fab6c027060 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7348670 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c067040 con 0x5622b7348670 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.290+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab70031040 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x5622b7342420 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b040 con 0x7fab6c027060 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7001f070 con 0x7fab6c027060 2024-04-24T01:43:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b73472b0 con 0x5622b7342420 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.291+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7347b50 con 0x5622b7342420 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7347b50 con 0x5622b7342420 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 zone default found 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 4 Realm: () 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 zonegroup default 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b734b4c0 con 0x7fab70031040 2024-04-24T01:43:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.292+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b734cf00 con 0x5622b7348670 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab6c067040 con 0x5622b7348670 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab77e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b734d420 con 0x5622b7348670 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab6c067040 con 0x5622b7348670 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab77e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab77e62800 20 started sync module instance, tier type = 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab77e62800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.293+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734c340 con 0x7fab6c027060 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.294+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab70040040 con 0x7fab6c027060 2024-04-24T01:43:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.294+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94707102566192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734dd30 con 0x7fab6c027060 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.294+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734e580 con 0x5622b7342420 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.295+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94707102566192] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab70040040 con 0x7fab6c027060 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.295+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.295+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94707102570624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734e1b0 con 0x5622b7342420 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.295+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734ecc0 con 0x5622b7348670 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.297+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94707102570624] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.297+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c067040 con 0x5622b7348670 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.297+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94707102574448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734f0b0 con 0x5622b7348670 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.297+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734fad0 con 0x7fab6c027060 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.298+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94707102574448] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c067040 con 0x5622b7348670 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.298+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab70040040 con 0x7fab6c027060 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.298+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94707102578112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734fec0 con 0x7fab6c027060 2024-04-24T01:43:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.298+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7350920 con 0x5622b7342420 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.299+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.299+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94707102581760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7350920 con 0x5622b7342420 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.299+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b73518c0 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.299+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94707102578112] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab70040040 con 0x7fab6c027060 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.300+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94707102581760] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.302+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.302+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94707102585744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7350b00 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.303+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7352160 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.303+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94707102587104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b73521b0 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7352c60 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94707102585744] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94707102587104] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94707102571680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7351d00 con 0x7fab70031040 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 20 add_watcher() i=0 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 20 add_watcher() i=1 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 20 add_watcher() i=2 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 20 add_watcher() i=3 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 20 add_watcher() i=4 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 20 add_watcher() i=5 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.304+0000 7fab77e62800 20 add_watcher() i=6 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.305+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94707102571680] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.305+0000 7fab77e62800 20 add_watcher() i=7 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.305+0000 7fab77e62800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:00.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.306+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7355d60 con 0x5622b7342420 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.306+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.306+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94707102590784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b73531e0 con 0x5622b7342420 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94707102590784] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7faa277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7fab77e62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7fab77e62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7fab77e62800 5 note: GC not initialized 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7faa267fc640 20 reqs_thread_entry: start 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7fab77e62800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7fab77e62800 20 Filter name: none 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.307+0000 7fa997fff640 20 reqs_thread_entry: start 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:00.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b7388eb0 con 0x5622b7342420 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b738b940 con 0x7fab6c027060 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fab70040040 con 0x7fab6c027060 2024-04-24T01:43:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.308+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b738f1b0 con 0x5622b7342420 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.309+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.309+0000 7fab77e62800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.309+0000 7fab77e62800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.309+0000 7fab77e62800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.309+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94707102837824 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622b738a930 con 0x5622b7342420 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.309+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94707102581760 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fab6808b040 con 0x5622b7342420 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.310+0000 7faa597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94707102581760 notifier 4324 bl.length()=567 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.310+0000 7faa597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.310+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(65 notify.4 [notify cookie 94707102837824 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.310+0000 7faa597fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.310+0000 7faa597fa640 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faa38003ea0 con 0x5622b7342420 2024-04-24T01:43:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.310+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.310+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 94707102837824 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab6807f040 con 0x5622b7342420 2024-04-24T01:43:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:00.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.311+0000 7faa277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.311+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94707102590784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b738b060 con 0x5622b7342420 2024-04-24T01:43:00.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.312+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94707102590784] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.312+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94707102566192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7352740 con 0x7fab6c027060 2024-04-24T01:43:00.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.313+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94707102566192] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab70040040 con 0x7fab6c027060 2024-04-24T01:43:00.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.313+0000 7fab77e62800 20 remove_watcher() i=0 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.313+0000 7fab77e62800 2 removed watcher, disabling cache 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.313+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94707102570624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7352740 con 0x5622b7342420 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.314+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94707102570624] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.314+0000 7fab77e62800 20 remove_watcher() i=1 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.314+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94707102574448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b7352740 con 0x5622b7348670 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.315+0000 7fab75160640 1 -- 172.21.15.131:0/951058181 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94707102574448] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c067040 con 0x5622b7348670 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.315+0000 7fab77e62800 20 remove_watcher() i=2 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.315+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94707102578112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734e770 con 0x7fab6c027060 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.316+0000 7fab76162640 1 -- 172.21.15.131:0/951058181 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94707102578112] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab70040040 con 0x7fab6c027060 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.316+0000 7fab77e62800 20 remove_watcher() i=3 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.316+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94707102581760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734f5c0 con 0x5622b7342420 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.317+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94707102581760] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x5622b7342420 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.317+0000 7fab77e62800 20 remove_watcher() i=4 2024-04-24T01:43:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.317+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94707102585744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734f5c0 con 0x7fab70031040 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.318+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94707102585744] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.318+0000 7fab77e62800 20 remove_watcher() i=5 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.318+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94707102587104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734f5c0 con 0x7fab70031040 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.319+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94707102587104] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.319+0000 7fab77e62800 20 remove_watcher() i=6 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.319+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94707102571680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622b734f5c0 con 0x7fab70031040 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.319+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94707102571680] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6805a040 con 0x7fab70031040 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.319+0000 7fab77e62800 20 remove_watcher() i=7 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fab70031040 msgr2=0x7fab70032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fab70031040 0x7fab70032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b7342420 msgr2=0x5622b73448e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b7342420 0x5622b73448e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fab6c027060 msgr2=0x7fab6c01b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fab6c027060 0x7fab6c01b6f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5622b7348670 msgr2=0x5622b734aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5622b7348670 0x5622b734aa60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa40036950 msgr2=0x7faa40038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa40036950 0x7faa40038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5622b7312000 tx=0x7fab7001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 msgr2=0x5622b7336930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/951058181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b732f2d0 0x5622b7336930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0266c0 tx=0x7fab6c04be50 comp rx=0 tx=0).stop 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 reap_dead start 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab75961640 1 -- 172.21.15.131:0/951058181 reap_dead start 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 shutdown_connections 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 >> 172.21.15.131:0/951058181 conn(0x5622b732b630 msgr2=0x5622b7328c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 shutdown_connections 2024-04-24T01:43:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/951058181 wait complete. 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa50036950 msgr2=0x7faa50038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa50036950 0x7faa50038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5622b7312880 tx=0x7fab70005840 comp rx=0 tx=0).stop 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b7321f90 msgr2=0x5622b73223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b7321f90 0x5622b73223b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e610 tx=0x7fab6c00ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 shutdown_connections 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa50036950 0x7faa50038e10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 --2- 172.21.15.131:0/2385087639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b7321f90 0x5622b73223b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 >> 172.21.15.131:0/2385087639 conn(0x5622b7316030 msgr2=0x5622b7316430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 shutdown_connections 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.320+0000 7fab77e62800 1 -- 172.21.15.131:0/2385087639 wait complete. 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b720e0e0 msgr2=0x5622b7310ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b720e0e0 0x5622b7310ed0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa5c036950 msgr2=0x7faa5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa5c036950 0x7faa5c038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab6c000c00 tx=0x7fab6c0013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 msgr2=0x5622b7309ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7309ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fab6801ce60 tx=0x7fab68002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 shutdown_connections 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5622b720e0e0 0x5622b7310ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faa5c036950 0x7faa5c038e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 --2- 172.21.15.131:0/509510879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622b720d780 0x5622b7309ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 >> 172.21.15.131:0/509510879 conn(0x5622b7209320 msgr2=0x5622b72fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 shutdown_connections 2024-04-24T01:43:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.321+0000 7fab77e62800 1 -- 172.21.15.131:0/509510879 wait complete. 2024-04-24T01:43:00.334 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:00.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:43:00.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:43:00.335 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:43:00.417 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:00.417 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:00.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.416+0000 7f70eda2f800 1 Processor -- start 2024-04-24T01:43:00.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.416+0000 7f70eda2f800 1 -- start start 2024-04-24T01:43:00.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.416+0000 7f70eda2f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5560d28d6480 0x5560d28d8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.416+0000 7f70eda2f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560d2790d40 con 0x5560d28d2970 2024-04-24T01:43:00.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.416+0000 7f70eda2f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5560d27634d0 con 0x5560d28d6480 2024-04-24T01:43:00.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.417+0000 7f70e05bf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5560d28d6480 0x5560d28d8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.417+0000 7f70e8dc0640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5560d28d2970 0x5560d28d4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45806/0 (socket says 172.21.15.131:45806) 2024-04-24T01:43:00.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.417+0000 7f70e05bf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5560d28d6480 0x5560d28d8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36772/0 (socket says 172.21.15.131:36772) 2024-04-24T01:43:00.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.417+0000 7f70e8dc0640 1 -- 172.21.15.131:0/822372178 learned_addr learned my addr 172.21.15.131:0/822372178 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:00.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.417+0000 7f70e05bf640 1 -- 172.21.15.131:0/822372178 >> v1:172.21.15.107:6789/0 conn(0x5560d28d2970 legacy=0x5560d28d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.417+0000 7f70e05bf640 1 -- 172.21.15.131:0/822372178 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d278f590 con 0x5560d28d6480 2024-04-24T01:43:00.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.417+0000 7f70e3fff640 1 -- 172.21.15.131:0/822372178 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912893241 0 0) 0x5560d2790d40 con 0x5560d28d2970 2024-04-24T01:43:00.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.419+0000 7f70e05bf640 1 --2- 172.21.15.131:0/822372178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d6480 0x5560d28d8870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f70d000a470 tx=0x7f70d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeefea13f655f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.419+0000 7f70e3fff640 1 -- 172.21.15.131:0/822372178 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d0057070 con 0x5560d28d6480 2024-04-24T01:43:00.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.419+0000 7f70e3fff640 1 -- 172.21.15.131:0/822372178 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0052570 con 0x5560d28d6480 2024-04-24T01:43:00.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.419+0000 7f70e3fff640 1 -- 172.21.15.131:0/822372178 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d0052870 con 0x5560d28d6480 2024-04-24T01:43:00.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.420+0000 7f70eda2f800 1 -- 172.21.15.131:0/822372178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d6480 msgr2=0x5560d28d8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.420+0000 7f70eda2f800 1 --2- 172.21.15.131:0/822372178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d6480 0x5560d28d8870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f70d000a470 tx=0x7f70d001ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.420+0000 7f70eda2f800 1 -- 172.21.15.131:0/822372178 shutdown_connections 2024-04-24T01:43:00.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.420+0000 7f70eda2f800 1 --2- 172.21.15.131:0/822372178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d6480 0x5560d28d8870 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.420+0000 7f70eda2f800 1 -- 172.21.15.131:0/822372178 >> 172.21.15.131:0/822372178 conn(0x5560d28cc320 msgr2=0x5560d28ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.420+0000 7f70eda2f800 1 -- 172.21.15.131:0/822372178 shutdown_connections 2024-04-24T01:43:00.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.420+0000 7f70eda2f800 1 -- 172.21.15.131:0/822372178 wait complete. 2024-04-24T01:43:00.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.431+0000 7f70eda2f800 1 Processor -- start 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.431+0000 7f70eda2f800 1 -- start start 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.432+0000 7f70eda2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d29c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.432+0000 7f70eda2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5560d281d3c0 con 0x5560d28d2970 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.432+0000 7f70e8dc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d29c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.432+0000 7f70e8dc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d29c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36780/0 (socket says 172.21.15.131:36780) 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.432+0000 7f70e8dc0640 1 -- 172.21.15.131:0/2170484431 learned_addr learned my addr 172.21.15.131:0/2170484431 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.432+0000 7f70e8dc0640 1 -- 172.21.15.131:0/2170484431 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d29c3680 con 0x5560d28d2970 2024-04-24T01:43:00.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.432+0000 7f70e8dc0640 1 --2- 172.21.15.131:0/2170484431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d29c30b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70d8001e00 tx=0x7f70d800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47651d8561576aa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f6fd6e0d640 1 -- 172.21.15.131:0/2170484431 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d8012020 con 0x5560d28d2970 2024-04-24T01:43:00.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f6fd6e0d640 1 -- 172.21.15.131:0/2170484431 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d800e5c0 con 0x5560d28d2970 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f6fd6e0d640 1 -- 172.21.15.131:0/2170484431 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d800e8e0 con 0x5560d28d2970 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f70eda2f800 1 -- 172.21.15.131:0/2170484431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 msgr2=0x5560d29c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f70eda2f800 1 --2- 172.21.15.131:0/2170484431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d29c30b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70d8001e00 tx=0x7f70d800b780 comp rx=0 tx=0).stop 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f70eda2f800 1 -- 172.21.15.131:0/2170484431 shutdown_connections 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f70eda2f800 1 --2- 172.21.15.131:0/2170484431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d29c30b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f70eda2f800 1 -- 172.21.15.131:0/2170484431 >> 172.21.15.131:0/2170484431 conn(0x5560d28cc320 msgr2=0x5560d29be930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f70eda2f800 1 -- 172.21.15.131:0/2170484431 shutdown_connections 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.433+0000 7f70eda2f800 1 -- 172.21.15.131:0/2170484431 wait complete. 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70eda2f800 1 Processor -- start 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70eda2f800 1 -- start start 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70eda2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d28d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70eda2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5560d28db0c0 con 0x5560d28d2970 2024-04-24T01:43:00.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70e8dc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d28d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70e8dc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d28d22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36790/0 (socket says 172.21.15.131:36790) 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70e8dc0640 1 -- 172.21.15.131:0/1107717407 learned_addr learned my addr 172.21.15.131:0/1107717407 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70e8dc0640 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d28d09a0 con 0x5560d28d2970 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.434+0000 7f70e8dc0640 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d28d22b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5560d29c3e40 tx=0x7f70d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.435+0000 7f6fd560a640 1 -- 172.21.15.131:0/1107717407 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d8012030 con 0x5560d28d2970 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.435+0000 7f6fd560a640 1 -- 172.21.15.131:0/1107717407 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d801a700 con 0x5560d28d2970 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.435+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560d28d0c30 con 0x5560d28d2970 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.435+0000 7f6fd560a640 1 -- 172.21.15.131:0/1107717407 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d801a9e0 con 0x5560d28d2970 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.435+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560d28d1150 con 0x5560d28d2970 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.435+0000 7f6fd560a640 1 -- 172.21.15.131:0/1107717407 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f70d8015020 con 0x5560d28d2970 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.435+0000 7f6fd560a640 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fd0036950 0x7f6fd0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f6fd560a640 1 -- 172.21.15.131:0/1107717407 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f70d8020030 con 0x5560d28d2970 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70e05bf640 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fd0036950 0x7f6fd0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70eda2f800 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d29d2000 0x5560d29d43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d29d4930 con 0x5560d29d2000 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70e95c1640 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d29d2000 0x5560d29d43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70e05bf640 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fd0036950 0x7f6fd0038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f70d0054000 tx=0x7f70d004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70e95c1640 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d29d2000 0x5560d29d43f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70e95c1640 1 -- 172.21.15.131:0/1107717407 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70e400a4a0 con 0x5560d29d2000 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.436+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d29d5210 con 0x5560d29d2000 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.437+0000 7f70e95c1640 1 -- 172.21.15.131:0/1107717407 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70e400a4a0 con 0x5560d29d2000 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.437+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d29d6600 con 0x5560d29d2000 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.437+0000 7f70e95c1640 1 -- 172.21.15.131:0/1107717407 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f70e400a4a0 con 0x5560d29d2000 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.437+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d29d5a60 con 0x5560d29d2000 2024-04-24T01:43:00.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.437+0000 7f70e95c1640 1 -- 172.21.15.131:0/1107717407 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70e400a4a0 con 0x5560d29d2000 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.437+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d29d5e40 con 0x5560d29d2000 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70e95c1640 1 -- 172.21.15.131:0/1107717407 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70e400a4a0 con 0x5560d29d2000 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70eda2f800 1 Processor -- start 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70eda2f800 1 -- start start 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70eda2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29e5730 0x5560d29e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70eda2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5560d28d27f0 con 0x5560d29e5730 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70e05bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29e5730 0x5560d29e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70e05bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29e5730 0x5560d29e5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36798/0 (socket says 172.21.15.131:36798) 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.438+0000 7f70e05bf640 1 -- 172.21.15.131:0/2074160702 learned_addr learned my addr 172.21.15.131:0/2074160702 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.439+0000 7f70e05bf640 1 -- 172.21.15.131:0/2074160702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d29e6090 con 0x5560d29e5730 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.439+0000 7f70e05bf640 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29e5730 0x5560d29e5b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f70d001ced0 tx=0x7f70d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.439+0000 7f6fce7fc640 1 -- 172.21.15.131:0/2074160702 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d006f070 con 0x5560d29e5730 2024-04-24T01:43:00.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.439+0000 7f6fce7fc640 1 -- 172.21.15.131:0/2074160702 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0058040 con 0x5560d29e5730 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.439+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560d29e6b00 con 0x5560d29e5730 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.439+0000 7f6fce7fc640 1 -- 172.21.15.131:0/2074160702 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d0057050 con 0x5560d29e5730 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.439+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560d29e6fa0 con 0x5560d29e5730 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f6fce7fc640 1 -- 172.21.15.131:0/2074160702 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f70d0072070 con 0x5560d29e5730 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f6fce7fc640 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fc0036950 0x7f6fc0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f6fce7fc640 1 -- 172.21.15.131:0/2074160702 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f70d008f830 con 0x5560d29e5730 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f70e95c1640 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fc0036950 0x7f6fc0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f70eda2f800 1 Processor -- start 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f70eda2f800 1 -- start start 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f70e95c1640 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fc0036950 0x7f6fc0038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5560d28d1790 tx=0x7f70e4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f70eda2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.440+0000 7f70eda2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5560d27c36b0 con 0x5560d29f2910 2024-04-24T01:43:00.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f70e05bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f70e05bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36800/0 (socket says 172.21.15.131:36800) 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f70e05bf640 1 -- 172.21.15.131:0/3786831814 learned_addr learned my addr 172.21.15.131:0/3786831814 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f70e05bf640 1 -- 172.21.15.131:0/3786831814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d29f3300 con 0x5560d29f2910 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f70e05bf640 1 --2- 172.21.15.131:0/3786831814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f2d30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70d008dc40 tx=0x7f70d0069860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b393403842703f39 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f6fbffff640 1 -- 172.21.15.131:0/3786831814 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d0069cc0 con 0x5560d29f2910 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f6fbffff640 1 -- 172.21.15.131:0/3786831814 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0069e60 con 0x5560d29f2910 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f6fbffff640 1 -- 172.21.15.131:0/3786831814 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d0072490 con 0x5560d29f2910 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.441+0000 7f70eda2f800 1 -- 172.21.15.131:0/3786831814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 msgr2=0x5560d29f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 --2- 172.21.15.131:0/3786831814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f2d30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70d008dc40 tx=0x7f70d0069860 comp rx=0 tx=0).stop 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 -- 172.21.15.131:0/3786831814 shutdown_connections 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 --2- 172.21.15.131:0/3786831814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f2d30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 -- 172.21.15.131:0/3786831814 >> 172.21.15.131:0/3786831814 conn(0x5560d29eec70 msgr2=0x5560d29eccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 -- 172.21.15.131:0/3786831814 shutdown_connections 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 -- 172.21.15.131:0/3786831814 wait complete. 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 Processor -- start 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 -- start start 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70eda2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5560d29f38f0 con 0x5560d29f2910 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70e05bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70e05bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36812/0 (socket says 172.21.15.131:36812) 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 learned_addr learned my addr 172.21.15.131:0/51021992 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.442+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560d29fa330 con 0x5560d29f2910 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.443+0000 7f70e05bf640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f9df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f70d0069c50 tx=0x7f70d008dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.443+0000 7f6fbe7fc640 1 -- 172.21.15.131:0/51021992 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d0093020 con 0x5560d29f2910 2024-04-24T01:43:00.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.443+0000 7f6fbe7fc640 1 -- 172.21.15.131:0/51021992 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0072660 con 0x5560d29f2910 2024-04-24T01:43:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.443+0000 7f6fbe7fc640 1 -- 172.21.15.131:0/51021992 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70d005fdb0 con 0x5560d29f2910 2024-04-24T01:43:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.443+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560d29fa5c0 con 0x5560d29f2910 2024-04-24T01:43:00.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.443+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560d29fd270 con 0x5560d29f2910 2024-04-24T01:43:00.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.443+0000 7f6fbe7fc640 1 -- 172.21.15.131:0/51021992 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f70d0096020 con 0x5560d29f2910 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f6fbe7fc640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fb4036900 0x7f6fb4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f6fbe7fc640 1 -- 172.21.15.131:0/51021992 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f70d0099c40 con 0x5560d29f2910 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f70e95c1640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fb4036900 0x7f6fb4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d2a058d0 0x5560d2a07d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a084c0 con 0x5560d2a058d0 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f70e8dc0640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d2a058d0 0x5560d2a07d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f70e8dc0640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d2a058d0 0x5560d2a07d70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.444+0000 7f70e95c1640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fb4036900 0x7f6fb4038dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5560d28d1760 tx=0x7f70e401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 realm 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a088d0 con 0x5560d2a058d0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a091a0 con 0x5560d2a058d0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a09540 con 0x5560d2a058d0 2024-04-24T01:43:00.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a099a0 con 0x5560d2a058d0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.445+0000 7f70eda2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70eda2f800 20 searching for the correct realm 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5560d2a0b9f0 0x5560d2a0dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70e05bf640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5560d2a0b9f0 0x5560d2a0dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70e05bf640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5560d2a0b9f0 0x5560d2a0dde0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70e05bf640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f70d00a3040 0x7f70d006c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70d00a3040 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.446+0000 7f70e95c1640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f70d00a3040 0x7f70d006c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.447+0000 7f70e95c1640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f70d00a3040 0x7f70d006c2a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.447+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e401f070 con 0x7f70d00a3040 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.447+0000 7f70e95c1640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f70e4031040 0x7f70e4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.447+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.447+0000 7f70e8dc0640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f70e4031040 0x7f70e4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.447+0000 7f70e8dc0640 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f70e4031040 0x7f70e4032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.448+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70d00a3040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e401f070 con 0x7f70d00a3040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.449+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70d00a3040 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f70e401f070 con 0x7f70d00a3040 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.450+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.451+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.452+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.452+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.452+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.452+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70d00a3040 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.452+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e401f070 con 0x7f70d00a3040 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.452+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.452+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.453+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.453+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.453+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.453+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.453+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.453+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.453+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70d00a3040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e401f070 con 0x7f70d00a3040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70e4031040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x5560d2a058d0 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.454+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e4b0 con 0x7f70d00a3040 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e401f070 con 0x7f70d00a3040 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0a470 con 0x5560d2a058d0 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0ad10 con 0x5560d2a058d0 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0a0b0 con 0x5560d2a058d0 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 zone default found 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 4 Realm: () 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:00.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 zonegroup default 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.455+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0e930 con 0x7f70e4031040 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a107c0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a10b60 con 0x5560d2a0b9f0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 20 started sync module instance, tier type = 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.456+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a0fc00 con 0x7f70d00a3040 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.457+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e4040040 con 0x7f70d00a3040 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.457+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874338988064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a113b0 con 0x7f70d00a3040 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.457+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a11c00 con 0x5560d2a058d0 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.458+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874338988064] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e4040040 con 0x7f70d00a3040 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.458+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.459+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874338991872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a117d0 con 0x5560d2a058d0 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.459+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a122f0 con 0x5560d2a0b9f0 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.460+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874338991872] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.460+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.460+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874338995648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a12690 con 0x5560d2a0b9f0 2024-04-24T01:43:00.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.460+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a130c0 con 0x7f70d00a3040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.461+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874338995648] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.461+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e4040040 con 0x7f70d00a3040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.461+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874338999248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a134e0 con 0x7f70d00a3040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.461+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a13f30 con 0x5560d2a058d0 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.462+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.462+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874339002912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a13ef0 con 0x5560d2a058d0 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.462+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a14ef0 con 0x7f70e4031040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.462+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874338999248] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e4040040 con 0x7f70d00a3040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.463+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.463+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874339007008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a14ef0 con 0x7f70e4031040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.463+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15900 con 0x7f70e4031040 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.463+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874339002912] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.464+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874339007008] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.464+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.464+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874338992928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15450 con 0x7f70e4031040 2024-04-24T01:43:00.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.464+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15e10 con 0x7f70e4031040 2024-04-24T01:43:00.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874338992928] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874339005104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15e10 con 0x7f70e4031040 2024-04-24T01:43:00.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 20 add_watcher() i=0 2024-04-24T01:43:00.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 20 add_watcher() i=1 2024-04-24T01:43:00.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 20 add_watcher() i=2 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 20 add_watcher() i=3 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 20 add_watcher() i=4 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 20 add_watcher() i=5 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.465+0000 7f70eda2f800 20 add_watcher() i=6 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.466+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874339005104] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.466+0000 7f70eda2f800 20 add_watcher() i=7 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.466+0000 7f70eda2f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.466+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a19120 con 0x5560d2a058d0 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.466+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.466+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874339011280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a163a0 con 0x5560d2a058d0 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.467+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874339011280] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.467+0000 7f6f9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.467+0000 7f70eda2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.467+0000 7f70eda2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.467+0000 7f70eda2f800 5 note: GC not initialized 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.467+0000 7f6f9dfe3640 20 reqs_thread_entry: start 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.468+0000 7f70eda2f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.468+0000 7f70eda2f800 20 Filter name: none 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.468+0000 7f6f0f7fe640 20 reqs_thread_entry: start 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.468+0000 7f70eda2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.468+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a4bfd0 con 0x5560d2a058d0 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.468+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.468+0000 7f70eda2f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:00.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.469+0000 7f6f9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.469+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874339011280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a18510 con 0x5560d2a058d0 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.470+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93874339011280] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.470+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874338988064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15ad0 con 0x7f70d00a3040 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.471+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93874338988064] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e4040040 con 0x7f70d00a3040 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.471+0000 7f70eda2f800 20 remove_watcher() i=0 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.471+0000 7f70eda2f800 2 removed watcher, disabling cache 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.471+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874338991872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15ad0 con 0x5560d2a058d0 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.472+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93874338991872] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.472+0000 7f70eda2f800 20 remove_watcher() i=1 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.472+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874338995648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a10f00 con 0x5560d2a0b9f0 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.473+0000 7f70e05bf640 1 -- 172.21.15.131:0/51021992 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93874338995648] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d0071030 con 0x5560d2a0b9f0 2024-04-24T01:43:00.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.473+0000 7f70eda2f800 20 remove_watcher() i=2 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.473+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874338999248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15ad0 con 0x7f70d00a3040 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.474+0000 7f70e95c1640 1 -- 172.21.15.131:0/51021992 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93874338999248] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e4040040 con 0x7f70d00a3040 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.474+0000 7f70eda2f800 20 remove_watcher() i=3 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.474+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874339002912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a11dc0 con 0x5560d2a058d0 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.475+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93874339002912] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x5560d2a058d0 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.475+0000 7f70eda2f800 20 remove_watcher() i=4 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.475+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874339007008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a15ad0 con 0x7f70e4031040 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.476+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93874339007008] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.476+0000 7f70eda2f800 20 remove_watcher() i=5 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.476+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874338992928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a11dc0 con 0x7f70e4031040 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.477+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93874338992928] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.477+0000 7f70eda2f800 20 remove_watcher() i=6 2024-04-24T01:43:00.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.477+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874339005104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5560d2a11dc0 con 0x7f70e4031040 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93874339005104] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70d800dcd0 con 0x7f70e4031040 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 20 remove_watcher() i=7 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f70e4031040 msgr2=0x7f70e4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f70e4031040 0x7f70e4032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d2a058d0 msgr2=0x5560d2a07d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d2a058d0 0x5560d2a07d70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f70d00a3040 msgr2=0x7f70d006c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f70d00a3040 0x7f70d006c2a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5560d2a0b9f0 msgr2=0x5560d2a0dde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5560d2a0b9f0 0x5560d2a0dde0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fb4036900 msgr2=0x7f6fb4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fb4036900 0x7f6fb4038dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5560d28d1760 tx=0x7f70e401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 msgr2=0x5560d29f9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 --2- 172.21.15.131:0/51021992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29f2910 0x5560d29f9df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f70d0069c50 tx=0x7f70d008dbd0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 reap_dead start 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70e8dc0640 1 -- 172.21.15.131:0/51021992 reap_dead start 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 shutdown_connections 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 >> 172.21.15.131:0/51021992 conn(0x5560d29eec70 msgr2=0x5560d29ec2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 shutdown_connections 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.478+0000 7f70eda2f800 1 -- 172.21.15.131:0/51021992 wait complete. 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fc0036950 msgr2=0x7f6fc0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fc0036950 0x7f6fc0038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5560d28d1790 tx=0x7f70e4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29e5730 msgr2=0x5560d29e5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29e5730 0x5560d29e5b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f70d001ced0 tx=0x7f70d0002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 shutdown_connections 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fc0036950 0x7f6fc0038e10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/2074160702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d29e5730 0x5560d29e5b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 >> 172.21.15.131:0/2074160702 conn(0x5560d29d97d0 msgr2=0x5560d29d9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 shutdown_connections 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/2074160702 wait complete. 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d29d2000 msgr2=0x5560d29d43f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d29d2000 0x5560d29d43f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fd0036950 msgr2=0x7f6fd0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fd0036950 0x7f6fd0038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f70d0054000 tx=0x7f70d004e000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 msgr2=0x5560d28d22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d28d22b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5560d29c3e40 tx=0x7f70d8000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 shutdown_connections 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5560d29d2000 0x5560d29d43f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6fd0036950 0x7f6fd0038e10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 --2- 172.21.15.131:0/1107717407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560d28d2970 0x5560d28d22b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 >> 172.21.15.131:0/1107717407 conn(0x5560d28cc320 msgr2=0x5560d29bd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 shutdown_connections 2024-04-24T01:43:00.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.479+0000 7f70eda2f800 1 -- 172.21.15.131:0/1107717407 wait complete. 2024-04-24T01:43:00.495 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:00.495 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-24T01:43:00.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-24T01:43:00.496 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-24T01:43:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:00.577 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.576+0000 7fd59da3f800 1 Processor -- start 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.576+0000 7fd59da3f800 1 -- start start 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.576+0000 7fd59da3f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560dd04cf8d0 0x560dd04d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.576+0000 7fd59da3f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560dd038dd40 con 0x560dd04d2200 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.576+0000 7fd59da3f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x560dd03604d0 con 0x560dd04cf8d0 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.577+0000 7fd59ad3d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x560dd04d2200 0x560dd04d45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45820/0 (socket says 172.21.15.131:45820) 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.577+0000 7fd59ad3d640 1 -- 172.21.15.131:0/2371857517 learned_addr learned my addr 172.21.15.131:0/2371857517 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.577+0000 7fd59b53e640 1 --2- 172.21.15.131:0/2371857517 >> v2:172.21.15.107:3300/0 conn(0x560dd04cf8d0 0x560dd04d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.577+0000 7fd59a53c640 1 -- 172.21.15.131:0/2371857517 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597373304 0 0) 0x560dd038dd40 con 0x560dd04d2200 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.577+0000 7fd59a53c640 1 -- 172.21.15.131:0/2371857517 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd584001e10 con 0x560dd04d2200 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.577+0000 7fd59b53e640 1 -- 172.21.15.131:0/2371857517 >> v1:172.21.15.107:6789/0 conn(0x560dd04d2200 legacy=0x560dd04d45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.577+0000 7fd59b53e640 1 -- 172.21.15.131:0/2371857517 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd038c590 con 0x560dd04cf8d0 2024-04-24T01:43:00.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59b53e640 1 --2- 172.21.15.131:0/2371857517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd04d1cc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00a470 tx=0x7fd58c01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5943ba967610552a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59a53c640 1 -- 172.21.15.131:0/2371857517 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c057070 con 0x560dd04cf8d0 2024-04-24T01:43:00.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59a53c640 1 -- 172.21.15.131:0/2371857517 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c052570 con 0x560dd04cf8d0 2024-04-24T01:43:00.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59a53c640 1 -- 172.21.15.131:0/2371857517 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c052870 con 0x560dd04cf8d0 2024-04-24T01:43:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59da3f800 1 -- 172.21.15.131:0/2371857517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 msgr2=0x560dd04d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59da3f800 1 --2- 172.21.15.131:0/2371857517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd04d1cc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00a470 tx=0x7fd58c01cdb0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59da3f800 1 -- 172.21.15.131:0/2371857517 shutdown_connections 2024-04-24T01:43:00.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59da3f800 1 --2- 172.21.15.131:0/2371857517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd04d1cc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59da3f800 1 -- 172.21.15.131:0/2371857517 >> 172.21.15.131:0/2371857517 conn(0x560dd04c93a0 msgr2=0x560dd04cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.579+0000 7fd59da3f800 1 -- 172.21.15.131:0/2371857517 shutdown_connections 2024-04-24T01:43:00.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.580+0000 7fd59da3f800 1 -- 172.21.15.131:0/2371857517 wait complete. 2024-04-24T01:43:00.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.591+0000 7fd59da3f800 1 Processor -- start 2024-04-24T01:43:00.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.591+0000 7fd59da3f800 1 -- start start 2024-04-24T01:43:00.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.591+0000 7fd59da3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.591+0000 7fd59da3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560dd041a3e0 con 0x560dd04cf8d0 2024-04-24T01:43:00.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd59b53e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd59b53e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36836/0 (socket says 172.21.15.131:36836) 2024-04-24T01:43:00.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd59b53e640 1 -- 172.21.15.131:0/1765845430 learned_addr learned my addr 172.21.15.131:0/1765845430 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd59b53e640 1 -- 172.21.15.131:0/1765845430 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd05c0580 con 0x560dd04cf8d0 2024-04-24T01:43:00.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd59b53e640 1 --2- 172.21.15.131:0/1765845430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05bffb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd58c055040 tx=0x7fd58c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caee3cae91ee3696 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd48960a640 1 -- 172.21.15.131:0/1765845430 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c057070 con 0x560dd04cf8d0 2024-04-24T01:43:00.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd48960a640 1 -- 172.21.15.131:0/1765845430 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c063070 con 0x560dd04cf8d0 2024-04-24T01:43:00.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.592+0000 7fd48960a640 1 -- 172.21.15.131:0/1765845430 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c052720 con 0x560dd04cf8d0 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 -- 172.21.15.131:0/1765845430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 msgr2=0x560dd05bffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1765845430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05bffb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd58c055040 tx=0x7fd58c04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 -- 172.21.15.131:0/1765845430 shutdown_connections 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1765845430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05bffb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 -- 172.21.15.131:0/1765845430 >> 172.21.15.131:0/1765845430 conn(0x560dd04c93a0 msgr2=0x560dd05bb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 -- 172.21.15.131:0/1765845430 shutdown_connections 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 -- 172.21.15.131:0/1765845430 wait complete. 2024-04-24T01:43:00.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.593+0000 7fd59da3f800 1 Processor -- start 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59da3f800 1 -- start start 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59da3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59da3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560dd04d5fb0 con 0x560dd04cf8d0 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59b53e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59b53e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36846/0 (socket says 172.21.15.131:36846) 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59b53e640 1 -- 172.21.15.131:0/1225281906 learned_addr learned my addr 172.21.15.131:0/1225281906 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59b53e640 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd05c8030 con 0x560dd04cf8d0 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd59b53e640 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05c7af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd58c055040 tx=0x7fd58c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.594+0000 7fd487e07640 1 -- 172.21.15.131:0/1225281906 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c052e30 con 0x560dd04cf8d0 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.595+0000 7fd487e07640 1 -- 172.21.15.131:0/1225281906 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c06c070 con 0x560dd04cf8d0 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.595+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dd05c82c0 con 0x560dd04cf8d0 2024-04-24T01:43:00.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.595+0000 7fd487e07640 1 -- 172.21.15.131:0/1225281906 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c05e5f0 con 0x560dd04cf8d0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.595+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd05caed0 con 0x560dd04cf8d0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.595+0000 7fd487e07640 1 -- 172.21.15.131:0/1225281906 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd58c05e790 con 0x560dd04cf8d0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.595+0000 7fd487e07640 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd480036950 0x7fd480038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.595+0000 7fd487e07640 1 -- 172.21.15.131:0/1225281906 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd58c08e940 con 0x560dd04cf8d0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd480036950 0x7fd480038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd04d2200 0x560dd05cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd05cf1d0 con 0x560dd04d2200 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd04d2200 0x560dd05cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd480036950 0x7fd480038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd590000f60 tx=0x7fd5900010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd04d2200 0x560dd05cec90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59bd3f640 1 -- 172.21.15.131:0/1225281906 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59400a4a0 con 0x560dd04d2200 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.596+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd05cc240 con 0x560dd04d2200 2024-04-24T01:43:00.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.597+0000 7fd59bd3f640 1 -- 172.21.15.131:0/1225281906 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd59400a4a0 con 0x560dd04d2200 2024-04-24T01:43:00.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.597+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd05d0fb0 con 0x560dd04d2200 2024-04-24T01:43:00.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.597+0000 7fd59bd3f640 1 -- 172.21.15.131:0/1225281906 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd59400a4a0 con 0x560dd04d2200 2024-04-24T01:43:00.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.597+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd05d02f0 con 0x560dd04d2200 2024-04-24T01:43:00.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.597+0000 7fd59bd3f640 1 -- 172.21.15.131:0/1225281906 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd59400a4a0 con 0x560dd04d2200 2024-04-24T01:43:00.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.597+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd05d0710 con 0x560dd04d2200 2024-04-24T01:43:00.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59bd3f640 1 -- 172.21.15.131:0/1225281906 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd59400a4a0 con 0x560dd04d2200 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59da3f800 1 Processor -- start 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59da3f800 1 -- start start 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59da3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd05dfdf0 0x560dd05e0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59da3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560dd03c06b0 con 0x560dd05dfdf0 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59ad3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd05dfdf0 0x560dd05e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59ad3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd05dfdf0 0x560dd05e0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36852/0 (socket says 172.21.15.131:36852) 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.598+0000 7fd59ad3d640 1 -- 172.21.15.131:0/2353767608 learned_addr learned my addr 172.21.15.131:0/2353767608 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.599+0000 7fd59ad3d640 1 -- 172.21.15.131:0/2353767608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd05e0770 con 0x560dd05dfdf0 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.599+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd05dfdf0 0x560dd05e0230 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd59000bec0 tx=0x7fd59000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.599+0000 7fd485602640 1 -- 172.21.15.131:0/2353767608 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59001b550 con 0x560dd05dfdf0 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.599+0000 7fd485602640 1 -- 172.21.15.131:0/2353767608 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59001b6f0 con 0x560dd05dfdf0 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.599+0000 7fd485602640 1 -- 172.21.15.131:0/2353767608 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59001ba10 con 0x560dd05dfdf0 2024-04-24T01:43:00.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.599+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dd05e1100 con 0x560dd05dfdf0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.599+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd05e15a0 con 0x560dd05dfdf0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd485602640 1 -- 172.21.15.131:0/2353767608 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd590023020 con 0x560dd05dfdf0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd485602640 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd474036950 0x7fd474038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd485602640 1 -- 172.21.15.131:0/2353767608 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd590021020 con 0x560dd05dfdf0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd474036950 0x7fd474038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd59da3f800 1 Processor -- start 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd474036950 0x7fd474038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x560dd05d0690 tx=0x7fd594005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd59da3f800 1 -- start start 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.600+0000 7fd59da3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd04cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd59da3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560dd05c0840 con 0x560dd04ceec0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd59ad3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd04cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd59ad3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd04cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36860/0 (socket says 172.21.15.131:36860) 2024-04-24T01:43:00.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3228557258 learned_addr learned my addr 172.21.15.131:0/3228557258 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3228557258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd04cd6c0 con 0x560dd04ceec0 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/3228557258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd04cf2e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd59004ce20 tx=0x7fd590024f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0201625f4da29b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd47effd640 1 -- 172.21.15.131:0/3228557258 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd590025930 con 0x560dd04ceec0 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd47effd640 1 -- 172.21.15.131:0/3228557258 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590025410 con 0x560dd04ceec0 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.601+0000 7fd47effd640 1 -- 172.21.15.131:0/3228557258 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd590025ad0 con 0x560dd04ceec0 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 -- 172.21.15.131:0/3228557258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 msgr2=0x560dd04cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3228557258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd04cf2e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd59004ce20 tx=0x7fd590024f40 comp rx=0 tx=0).stop 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 -- 172.21.15.131:0/3228557258 shutdown_connections 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3228557258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd04cf2e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 -- 172.21.15.131:0/3228557258 >> 172.21.15.131:0/3228557258 conn(0x560dd05e9450 msgr2=0x560dd05e74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 -- 172.21.15.131:0/3228557258 shutdown_connections 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 -- 172.21.15.131:0/3228557258 wait complete. 2024-04-24T01:43:00.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 Processor -- start 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 -- start start 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd05f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59da3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560dd04cdb90 con 0x560dd04ceec0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59ad3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd05f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59ad3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd05f6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36872/0 (socket says 172.21.15.131:36872) 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.602+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 learned_addr learned my addr 172.21.15.131:0/3961129103 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.603+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd05f6e70 con 0x560dd04ceec0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.603+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd05f6930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd590046fd0 tx=0x7fd59004cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.603+0000 7fd47d7fa640 1 -- 172.21.15.131:0/3961129103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd590019760 con 0x560dd04ceec0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.603+0000 7fd47d7fa640 1 -- 172.21.15.131:0/3961129103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59000c360 con 0x560dd04ceec0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.603+0000 7fd47d7fa640 1 -- 172.21.15.131:0/3961129103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59000c680 con 0x560dd04ceec0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.603+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dd05f7100 con 0x560dd04ceec0 2024-04-24T01:43:00.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.603+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd05f7100 con 0x560dd04ceec0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd47d7fa640 1 -- 172.21.15.131:0/3961129103 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd59004eaf0 con 0x560dd04ceec0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd47d7fa640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd464036950 0x7fd464038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd47d7fa640 1 -- 172.21.15.131:0/3961129103 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd590039c40 con 0x560dd04ceec0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd464036950 0x7fd464038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd464036950 0x7fd464038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x560dd05cfe10 tx=0x7fd59401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd0602270 0x560dd0604730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.604+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0604e80 con 0x560dd0602270 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59b53e640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd0602270 0x560dd0604730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59b53e640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd0602270 0x560dd0604730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 20 realm 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0605290 con 0x560dd0602270 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0605b60 con 0x560dd0602270 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.605+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0605f00 con 0x560dd0602270 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59da3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59da3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59da3f800 20 searching for the correct realm 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560dd06084c0 0x560dd060a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd060ae90 con 0x560dd06084c0 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560dd06084c0 0x560dd060a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.606+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560dd06084c0 0x560dd060a8b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59ad3d640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd590049150 0x7fd590031070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd060ae90 con 0x7fd590049150 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd590049150 0x7fd590031070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd590049150 0x7fd590031070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59401f070 con 0x7fd590049150 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59bd3f640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd594031040 0x7fd594032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.607+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd060ae90 con 0x7fd594031040 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.608+0000 7fd59b53e640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd594031040 0x7fd594032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.608+0000 7fd59b53e640 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd594031040 0x7fd594032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.608+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.608+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.608+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.608+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd590049150 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59401f070 con 0x7fd590049150 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.609+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd590049150 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.610+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd59401f070 con 0x7fd590049150 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.611+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.611+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.611+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.611+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.611+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.612+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd590049150 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59401f070 con 0x7fd590049150 2024-04-24T01:43:00.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.613+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.614+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.614+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.614+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.614+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd590049150 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59401f070 con 0x7fd590049150 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd06084c0 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.615+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd594031040 2024-04-24T01:43:00.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x560dd0602270 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606750 con 0x7fd590049150 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59401f070 con 0x7fd590049150 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0606fa0 con 0x560dd0602270 2024-04-24T01:43:00.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0607390 con 0x560dd0602270 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.616+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0607390 con 0x560dd0602270 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 zone default found 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 4 Realm: () 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:00.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 zonegroup default 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd060b310 con 0x7fd594031040 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd060ccf0 con 0x560dd06084c0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.617+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd060d090 con 0x560dd06084c0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.618+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.618+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.618+0000 7fd59da3f800 20 started sync module instance, tier type = 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.618+0000 7fd59da3f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.618+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060c190 con 0x7fd590049150 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.619+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594040040 con 0x7fd590049150 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.619+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94617330564320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060d430 con 0x7fd590049150 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.619+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060ddf0 con 0x560dd0602270 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.620+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94617330564320] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594040040 con 0x7fd590049150 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.620+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.620+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94617330566528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060ddf0 con 0x560dd0602270 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.620+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060e7b0 con 0x560dd06084c0 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.621+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94617330566528] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.621+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.621+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94617330571584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060dd60 con 0x560dd06084c0 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.621+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060f670 con 0x7fd590049150 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.622+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594040040 con 0x7fd590049150 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.622+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94617330578336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060fe10 con 0x7fd590049150 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.622+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd0610930 con 0x560dd0602270 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.622+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94617330571584] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.623+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.623+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94617330582528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd06108f0 con 0x560dd0602270 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.623+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd0611360 con 0x7fd594031040 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.623+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94617330578336] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594040040 con 0x7fd590049150 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.624+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.624+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94617330582528] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.624+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94617330585232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd0611360 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.624+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd060eba0 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.625+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94617330585232] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.625+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.625+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94617330576288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd06118f0 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.625+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd06121e0 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94617330587888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd0611d10 con 0x7fd594031040 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 20 add_watcher() i=0 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 20 add_watcher() i=1 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 20 add_watcher() i=2 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 20 add_watcher() i=3 2024-04-24T01:43:00.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 20 add_watcher() i=4 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 20 add_watcher() i=5 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94617330576288] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.626+0000 7fd59da3f800 20 add_watcher() i=6 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.627+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94617330587888] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.627+0000 7fd59da3f800 20 add_watcher() i=7 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.627+0000 7fd59da3f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.627+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd060f890 con 0x560dd0602270 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.627+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.627+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94617330579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd0612c90 con 0x560dd0602270 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.628+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94617330579552] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.628+0000 7fd451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.628+0000 7fd59da3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:00.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.628+0000 7fd59da3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.628+0000 7fd59da3f800 5 note: GC not initialized 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd450fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 20 Filter name: none 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd3ca7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd0648a70 con 0x560dd0602270 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:00.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.629+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd06494e0 con 0x7fd594031040 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.630+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.630+0000 7fd59da3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.630+0000 7fd59da3f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.630+0000 7fd59da3f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.630+0000 7fd59da3f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.630+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064ee90 con 0x560dd0602270 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd59da3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd59da3f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd59da3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:00.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94617330837760 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd064a580 con 0x560dd0602270 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94617330582528 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x560dd05caed0 con 0x560dd0602270 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd47effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94617330582528 notifier 4338 bl.length()=678 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd47effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd47effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd47effd640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd460003ea0 con 0x560dd0602270 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.631+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(65 notify.4 [notify cookie 94617330837760 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.632+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== watch-notify(notify_complete (2) cookie 94617330837760 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dd05c82c0 con 0x560dd0602270 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.632+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.632+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e900 con 0x7fd594031040 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59da3f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59da3f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:00.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59da3f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94617330837760 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dd064a0d0 con 0x560dd06084c0 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== watch-notify(notify (1) cookie 94617330571584 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560dd05f6e70 con 0x560dd06084c0 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd47e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94617330571584 notifier 4338 bl.length()=177 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd47e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd47e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 notify.2 [notify cookie 94617330837760 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd47e7fc640 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd3d0003400 con 0x560dd06084c0 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.633+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== watch-notify(notify_complete (2) cookie 94617330837760 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dd04cd6c0 con 0x560dd06084c0 2024-04-24T01:43:00.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.634+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.649 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:43:00.631974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.634+0000 7fd451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.634+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94617330579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x560dd0602270 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.635+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94617330579552] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.635+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94617330564320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x7fd590049150 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.636+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94617330564320] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594040040 con 0x7fd590049150 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.636+0000 7fd59da3f800 20 remove_watcher() i=0 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.636+0000 7fd59da3f800 2 removed watcher, disabling cache 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.636+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94617330566528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x560dd0602270 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.638+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94617330566528] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.638+0000 7fd59da3f800 20 remove_watcher() i=1 2024-04-24T01:43:00.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.638+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94617330571584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x560dd06084c0 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.639+0000 7fd59ad3d640 1 -- 172.21.15.131:0/3961129103 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94617330571584] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd590009050 con 0x560dd06084c0 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.639+0000 7fd59da3f800 20 remove_watcher() i=2 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.639+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94617330578336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x7fd590049150 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.640+0000 7fd59bd3f640 1 -- 172.21.15.131:0/3961129103 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94617330578336] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594040040 con 0x7fd590049150 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.640+0000 7fd59da3f800 20 remove_watcher() i=3 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.640+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94617330582528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x560dd0602270 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.641+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94617330582528] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x560dd0602270 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.641+0000 7fd59da3f800 20 remove_watcher() i=4 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.641+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94617330585232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x7fd594031040 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.642+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94617330585232] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.642+0000 7fd59da3f800 20 remove_watcher() i=5 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.642+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94617330576288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x7fd594031040 2024-04-24T01:43:00.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.643+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94617330576288] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.643+0000 7fd59da3f800 20 remove_watcher() i=6 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.643+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94617330587888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dd064e9c0 con 0x7fd594031040 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94617330587888] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c009d10 con 0x7fd594031040 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 20 remove_watcher() i=7 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd594031040 msgr2=0x7fd594032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd594031040 0x7fd594032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd0602270 msgr2=0x560dd0604730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd0602270 0x560dd0604730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd590049150 msgr2=0x7fd590031070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd590049150 0x7fd590031070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560dd06084c0 msgr2=0x560dd060a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560dd06084c0 0x560dd060a8b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd464036950 msgr2=0x7fd464038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd464036950 0x7fd464038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x560dd05cfe10 tx=0x7fd59401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 msgr2=0x560dd05f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59b53e640 1 -- 172.21.15.131:0/3961129103 reap_dead start 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd05f6930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd590046fd0 tx=0x7fd59004cd80 comp rx=0 tx=0).stop 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 shutdown_connections 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/3961129103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04ceec0 0x560dd05f6930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 >> 172.21.15.131:0/3961129103 conn(0x560dd05e9450 msgr2=0x560dd05e6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 shutdown_connections 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/3961129103 wait complete. 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd474036950 msgr2=0x7fd474038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd474036950 0x7fd474038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x560dd05d0690 tx=0x7fd594005840 comp rx=0 tx=0).stop 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd05dfdf0 msgr2=0x560dd05e0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.644+0000 7fd59da3f800 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd05dfdf0 0x560dd05e0230 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd59000bec0 tx=0x7fd59000d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 shutdown_connections 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd474036950 0x7fd474038e10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/2353767608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd05dfdf0 0x560dd05e0230 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 >> 172.21.15.131:0/2353767608 conn(0x560dd05d3e40 msgr2=0x560dd05d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 shutdown_connections 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/2353767608 wait complete. 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd04d2200 msgr2=0x560dd05cec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd04d2200 0x560dd05cec90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd480036950 msgr2=0x7fd480038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd480036950 0x7fd480038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd590000f60 tx=0x7fd5900010a0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 msgr2=0x560dd05c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05c7af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd58c055040 tx=0x7fd58c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 shutdown_connections 2024-04-24T01:43:00.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560dd04d2200 0x560dd05cec90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd480036950 0x7fd480038e10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 --2- 172.21.15.131:0/1225281906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560dd04cf8d0 0x560dd05c7af0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 >> 172.21.15.131:0/1225281906 conn(0x560dd04c93a0 msgr2=0x560dd05ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 shutdown_connections 2024-04-24T01:43:00.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.645+0000 7fd59da3f800 1 -- 172.21.15.131:0/1225281906 wait complete. 2024-04-24T01:43:00.660 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:43:00.631974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:00.660 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:43:00.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:43:00.660 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:43:00.703 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:00.703 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:00.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.702+0000 7f7429c0e800 1 Processor -- start 2024-04-24T01:43:00.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.702+0000 7f7429c0e800 1 -- start start 2024-04-24T01:43:00.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.702+0000 7f7429c0e800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5637611ea760 0x5637611eab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.702+0000 7f7429c0e800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5637610aad40 con 0x5637611eb0c0 2024-04-24T01:43:00.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.702+0000 7f7429c0e800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x56376107d4d0 con 0x5637611ea760 2024-04-24T01:43:00.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.703+0000 7f7427714640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5637611ea760 0x5637611eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.703+0000 7f7427714640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5637611ea760 0x5637611eab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36880/0 (socket says 172.21.15.131:36880) 2024-04-24T01:43:00.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.703+0000 7f741ef13640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5637611eb0c0 0x5637611eb570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45822/0 (socket says 172.21.15.131:45822) 2024-04-24T01:43:00.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.703+0000 7f7427714640 1 -- 172.21.15.131:0/2685786655 learned_addr learned my addr 172.21.15.131:0/2685786655 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.703+0000 7f7427714640 1 -- 172.21.15.131:0/2685786655 >> v1:172.21.15.107:6789/0 conn(0x5637611eb0c0 legacy=0x5637611eb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.703+0000 7f7427714640 1 -- 172.21.15.131:0/2685786655 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637610a9590 con 0x5637611ea760 2024-04-24T01:43:00.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.703+0000 7f7426f13640 1 -- 172.21.15.131:0/2685786655 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843844185 0 0) 0x5637610aad40 con 0x5637611eb0c0 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7427714640 1 --2- 172.21.15.131:0/2685786655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637611eab80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f741800a520 tx=0x7f741801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d0c0ae8cf467b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7426f13640 1 -- 172.21.15.131:0/2685786655 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418057070 con 0x5637611ea760 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7426f13640 1 -- 172.21.15.131:0/2685786655 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7418052570 con 0x5637611ea760 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7426f13640 1 -- 172.21.15.131:0/2685786655 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418052870 con 0x5637611ea760 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7429c0e800 1 -- 172.21.15.131:0/2685786655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 msgr2=0x5637611eab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7429c0e800 1 --2- 172.21.15.131:0/2685786655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637611eab80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f741800a520 tx=0x7f741801d010 comp rx=0 tx=0).stop 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7429c0e800 1 -- 172.21.15.131:0/2685786655 shutdown_connections 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7429c0e800 1 --2- 172.21.15.131:0/2685786655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637611eab80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7429c0e800 1 -- 172.21.15.131:0/2685786655 >> 172.21.15.131:0/2685786655 conn(0x5637611e6380 msgr2=0x5637611e87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7429c0e800 1 -- 172.21.15.131:0/2685786655 shutdown_connections 2024-04-24T01:43:00.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.705+0000 7f7429c0e800 1 -- 172.21.15.131:0/2685786655 wait complete. 2024-04-24T01:43:00.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.717+0000 7f7429c0e800 1 Processor -- start 2024-04-24T01:43:00.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.717+0000 7f7429c0e800 1 -- start start 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.717+0000 7f7429c0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612df210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.717+0000 7f7429c0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5637611373c0 con 0x5637611ea760 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.717+0000 7f7427714640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612df210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.717+0000 7f7427714640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612df210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36888/0 (socket says 172.21.15.131:36888) 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.717+0000 7f7427714640 1 -- 172.21.15.131:0/3669427635 learned_addr learned my addr 172.21.15.131:0/3669427635 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.718+0000 7f7427714640 1 -- 172.21.15.131:0/3669427635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637612df7e0 con 0x5637611ea760 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.718+0000 7f7427714640 1 --2- 172.21.15.131:0/3669427635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612df210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7418055040 tx=0x7f741804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c569363be7a330 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.718+0000 7f731560a640 1 -- 172.21.15.131:0/3669427635 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418057040 con 0x5637611ea760 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.718+0000 7f731560a640 1 -- 172.21.15.131:0/3669427635 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7418052870 con 0x5637611ea760 2024-04-24T01:43:00.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.718+0000 7f731560a640 1 -- 172.21.15.131:0/3669427635 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418052b90 con 0x5637611ea760 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 -- 172.21.15.131:0/3669427635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 msgr2=0x5637612df210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 --2- 172.21.15.131:0/3669427635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612df210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7418055040 tx=0x7f741804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 -- 172.21.15.131:0/3669427635 shutdown_connections 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 --2- 172.21.15.131:0/3669427635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612df210 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 -- 172.21.15.131:0/3669427635 >> 172.21.15.131:0/3669427635 conn(0x5637611e6380 msgr2=0x5637612dab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 -- 172.21.15.131:0/3669427635 shutdown_connections 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 -- 172.21.15.131:0/3669427635 wait complete. 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 Processor -- start 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 -- start start 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612e6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7429c0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5637611ebf80 con 0x5637611ea760 2024-04-24T01:43:00.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7427714640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612e6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7427714640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612e6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36894/0 (socket says 172.21.15.131:36894) 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.719+0000 7f7427714640 1 -- 172.21.15.131:0/544277510 learned_addr learned my addr 172.21.15.131:0/544277510 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.720+0000 7f7427714640 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637612e71a0 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.720+0000 7f7427714640 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612e6c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7418052540 tx=0x7f7418003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.720+0000 7f7313e07640 1 -- 172.21.15.131:0/544277510 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418073070 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.720+0000 7f7313e07640 1 -- 172.21.15.131:0/544277510 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741805d570 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.720+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637612e7430 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.720+0000 7f7313e07640 1 -- 172.21.15.131:0/544277510 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7418057070 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.720+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637612ea0e0 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f7313e07640 1 -- 172.21.15.131:0/544277510 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7418076070 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f7313e07640 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f730c036950 0x7f730c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f7313e07640 1 -- 172.21.15.131:0/544277510 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f741808dd20 con 0x5637611ea760 2024-04-24T01:43:00.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f741ef13640 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f730c036950 0x7f730c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f7429c0e800 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5637611eb0c0 0x5637612edea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5637612ee3e0 con 0x5637611eb0c0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f7427f15640 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5637611eb0c0 0x5637612edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.721+0000 7f741ef13640 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f730c036950 0x7f730c038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f74100013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.722+0000 7f7427f15640 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5637611eb0c0 0x5637612edea0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.722+0000 7f7427f15640 1 -- 172.21.15.131:0/544277510 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f742000a4a0 con 0x5637611eb0c0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.722+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5637612eb430 con 0x5637611eb0c0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.722+0000 7f7427f15640 1 -- 172.21.15.131:0/544277510 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f742000a4a0 con 0x5637611eb0c0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.722+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5637612f01a0 con 0x5637611eb0c0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.722+0000 7f7427f15640 1 -- 172.21.15.131:0/544277510 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f742000a4a0 con 0x5637611eb0c0 2024-04-24T01:43:00.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.722+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5637612ef4e0 con 0x5637611eb0c0 2024-04-24T01:43:00.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.723+0000 7f7427f15640 1 -- 172.21.15.131:0/544277510 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f742000a4a0 con 0x5637611eb0c0 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.723+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5637612ef900 con 0x5637611eb0c0 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.723+0000 7f7427f15640 1 -- 172.21.15.131:0/544277510 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f742000a4a0 con 0x5637611eb0c0 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.723+0000 7f7429c0e800 1 Processor -- start 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.723+0000 7f7429c0e800 1 -- start start 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.723+0000 7f7429c0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637612fef90 0x5637612ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.723+0000 7f7429c0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5637610dd6b0 con 0x5637612fef90 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f741ef13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637612fef90 0x5637612ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f741ef13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637612fef90 0x5637612ff3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36898/0 (socket says 172.21.15.131:36898) 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f741ef13640 1 -- 172.21.15.131:0/1612775690 learned_addr learned my addr 172.21.15.131:0/1612775690 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f741ef13640 1 -- 172.21.15.131:0/1612775690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637612ff8f0 con 0x5637612fef90 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f741ef13640 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637612fef90 0x5637612ff3b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f741000e610 tx=0x7f741000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f7311602640 1 -- 172.21.15.131:0/1612775690 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7410022070 con 0x5637612fef90 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f7311602640 1 -- 172.21.15.131:0/1612775690 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7410009050 con 0x5637612fef90 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563761300360 con 0x5637612fef90 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.724+0000 7f7311602640 1 -- 172.21.15.131:0/1612775690 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741000d500 con 0x5637612fef90 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.725+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563761300860 con 0x5637612fef90 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.725+0000 7f7311602640 1 -- 172.21.15.131:0/1612775690 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7410025070 con 0x5637612fef90 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.725+0000 7f7311602640 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7300036900 0x7f7300038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.725+0000 7f7311602640 1 -- 172.21.15.131:0/1612775690 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f741004db00 con 0x5637612fef90 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.725+0000 7f7427f15640 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7300036900 0x7f7300038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f7429c0e800 1 Processor -- start 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f7427f15640 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7300036900 0x7f7300038dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5637612ef880 tx=0x7f7420005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f7429c0e800 1 -- start start 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f7429c0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x56376130c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f7429c0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5637612dfaa0 con 0x56376130c330 2024-04-24T01:43:00.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f741ef13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x56376130c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f741ef13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x56376130c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36908/0 (socket says 172.21.15.131:36908) 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f741ef13640 1 -- 172.21.15.131:0/3300010623 learned_addr learned my addr 172.21.15.131:0/3300010623 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f741ef13640 1 -- 172.21.15.131:0/3300010623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56376130cd20 con 0x56376130c330 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f741ef13640 1 --2- 172.21.15.131:0/3300010623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x56376130c750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f741004bf40 tx=0x7f7410026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343c42316f4b2fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.726+0000 7f730affd640 1 -- 172.21.15.131:0/3300010623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741004a030 con 0x56376130c330 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f730affd640 1 -- 172.21.15.131:0/3300010623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74100401f0 con 0x56376130c330 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f730affd640 1 -- 172.21.15.131:0/3300010623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741001ad70 con 0x56376130c330 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 -- 172.21.15.131:0/3300010623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 msgr2=0x56376130c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 --2- 172.21.15.131:0/3300010623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x56376130c750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f741004bf40 tx=0x7f7410026680 comp rx=0 tx=0).stop 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 -- 172.21.15.131:0/3300010623 shutdown_connections 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 --2- 172.21.15.131:0/3300010623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x56376130c750 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 -- 172.21.15.131:0/3300010623 >> 172.21.15.131:0/3300010623 conn(0x563761308690 msgr2=0x5637613066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 -- 172.21.15.131:0/3300010623 shutdown_connections 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 -- 172.21.15.131:0/3300010623 wait complete. 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 Processor -- start 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 -- start start 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x563761313990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.727+0000 7f7429c0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56376130d490 con 0x56376130c330 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f741ef13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x563761313990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f741ef13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x563761313990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36916/0 (socket says 172.21.15.131:36916) 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 learned_addr learned my addr 172.21.15.131:0/1133305908 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563761313ed0 con 0x56376130c330 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f741ef13640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x563761313990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7410024840 tx=0x7f741004bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f73097fa640 1 -- 172.21.15.131:0/1133305908 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7410045040 con 0x56376130c330 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f73097fa640 1 -- 172.21.15.131:0/1133305908 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741000d6a0 con 0x56376130c330 2024-04-24T01:43:00.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563761314160 con 0x56376130c330 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f73097fa640 1 -- 172.21.15.131:0/1133305908 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741000d980 con 0x56376130c330 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.728+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563761316e10 con 0x56376130c330 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f73097fa640 1 -- 172.21.15.131:0/1133305908 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f741001a320 con 0x56376130c330 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f73097fa640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f72f0036900 0x7f72f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f73097fa640 1 -- 172.21.15.131:0/1133305908 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7410033b30 con 0x56376130c330 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f7427f15640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f72f0036900 0x7f72f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56376131f430 0x5637613218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761322020 con 0x56376131f430 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.729+0000 7f7427714640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56376131f430 0x5637613218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7427f15640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f72f0036900 0x7f72f0038dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5637612ef000 tx=0x7f742001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7427714640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56376131f430 0x5637613218d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7418075030 con 0x56376131f430 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 20 realm 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761322430 con 0x56376131f430 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7418075030 con 0x56376131f430 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761322cd0 con 0x56376131f430 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7418075030 con 0x56376131f430 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.730+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761323070 con 0x56376131f430 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7418075030 con 0x56376131f430 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7429c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5637613238c0 con 0x56376131f430 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7418075030 con 0x56376131f430 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7429c0e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7429c0e800 20 searching for the correct realm 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563761325630 0x563761327a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f741ef13640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563761325630 0x563761327a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f741ef13640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563761325630 0x563761327a20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f741ef13640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7410036070 0x7f7410051a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.731+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7410036070 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.732+0000 7f7427f15640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7410036070 0x7f7410051a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.732+0000 7f7427f15640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7410036070 0x7f7410051a50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.732+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f7410036070 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.732+0000 7f7427f15640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7420031040 0x7f7420032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.732+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.732+0000 7f7427714640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7420031040 0x7f7420032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7420031040 0x7f7420032940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.733+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7410036070 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f7410036070 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.734+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.735+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.735+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.735+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.735+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7410036070 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.735+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f742001f070 con 0x7f7410036070 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.735+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.736+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.737+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.737+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.737+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.737+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.737+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.737+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.737+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7410036070 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f7410036070 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.738+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7410036070 2024-04-24T01:43:00.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f7410036070 2024-04-24T01:43:00.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x563761325630 2024-04-24T01:43:00.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7420031040 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.739+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x56376131f430 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563761328000 con 0x7f7410036070 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f7410036070 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761324210 con 0x56376131f430 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761324ab0 con 0x56376131f430 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.740+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761323e50 con 0x56376131f430 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 zone default found 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 4 Realm: () 2024-04-24T01:43:00.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 zonegroup default 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761328460 con 0x7f7420031040 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56376132a2f0 con 0x563761325630 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56376132a690 con 0x563761325630 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 started sync module instance, tier type = 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.741+0000 7f7429c0e800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.742+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563761329730 con 0x7f7410036070 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.742+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f7410036070 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.742+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94795853896480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563761329f40 con 0x7f7410036070 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.743+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132b3d0 con 0x56376131f430 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.743+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94795853896480] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f7410036070 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.744+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.744+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94795853900336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132b7c0 con 0x56376131f430 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.744+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132c1f0 con 0x563761325630 2024-04-24T01:43:00.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.745+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94795853900336] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.745+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.745+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94795853901392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132c5e0 con 0x563761325630 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.745+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132cfa0 con 0x7f7410036070 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.746+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94795853901392] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.746+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f7410036070 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.746+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94795853908720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132cf10 con 0x7f7410036070 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.746+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132de90 con 0x56376131f430 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.747+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94795853908720] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f7410036070 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.748+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.748+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94795853910976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132de90 con 0x56376131f430 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.748+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132e850 con 0x7f7420031040 2024-04-24T01:43:00.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.749+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.749+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94795853915040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132e7c0 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.749+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94795853910976] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.749+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132da20 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.750+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94795853915040] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.750+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.750+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94795853912608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132f290 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.750+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132fc50 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94795853912608] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94795853917168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132fc50 con 0x7f7420031040 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 20 add_watcher() i=0 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 20 add_watcher() i=1 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 20 add_watcher() i=2 2024-04-24T01:43:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 20 add_watcher() i=3 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 20 add_watcher() i=4 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 20 add_watcher() i=5 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.751+0000 7f7429c0e800 20 add_watcher() i=6 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.752+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94795853917168] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.752+0000 7f7429c0e800 20 add_watcher() i=7 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.752+0000 7f7429c0e800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.752+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761333050 con 0x56376131f430 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.752+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.752+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94795853920624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563761330510 con 0x56376131f430 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.753+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94795853920624] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.753+0000 7f72ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.753+0000 7f7429c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:00.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.753+0000 7f7429c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.753+0000 7f7429c0e800 5 note: GC not initialized 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.754+0000 7f72dcfe1640 20 reqs_thread_entry: start 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.754+0000 7f7429c0e800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.754+0000 7f7429c0e800 20 Filter name: none 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.754+0000 7f72567fc640 20 reqs_thread_entry: start 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.754+0000 7f7429c0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.754+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563761365eb0 con 0x56376131f430 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.756+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.756+0000 7f7429c0e800 20 rados_obj.operate() r=0 bl.length=502 2024-04-24T01:43:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:43:00.631974Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:00.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.756+0000 7f72ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.756+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94795853920624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563761364a80 con 0x56376131f430 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.757+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94795853920624] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.757+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94795853896480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132f940 con 0x7f7410036070 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.758+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94795853896480] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f7410036070 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.758+0000 7f7429c0e800 20 remove_watcher() i=0 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.758+0000 7f7429c0e800 2 removed watcher, disabling cache 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.758+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94795853900336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563761329b20 con 0x56376131f430 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.760+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94795853900336] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.760+0000 7f7429c0e800 20 remove_watcher() i=1 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.760+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94795853901392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563761329b20 con 0x563761325630 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.761+0000 7f741ef13640 1 -- 172.21.15.131:0/1133305908 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94795853901392] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7410024030 con 0x563761325630 2024-04-24T01:43:00.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.761+0000 7f7429c0e800 20 remove_watcher() i=2 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.761+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94795853908720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132f940 con 0x7f7410036070 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.762+0000 7f7427f15640 1 -- 172.21.15.131:0/1133305908 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94795853908720] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f7410036070 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.762+0000 7f7429c0e800 20 remove_watcher() i=3 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.762+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94795853910976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132caf0 con 0x56376131f430 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.763+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94795853910976] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x56376131f430 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.763+0000 7f7429c0e800 20 remove_watcher() i=4 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.763+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94795853915040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132caf0 con 0x7f7420031040 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.764+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94795853915040] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.764+0000 7f7429c0e800 20 remove_watcher() i=5 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.764+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94795853912608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132e3a0 con 0x7f7420031040 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.764+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94795853912608] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.764+0000 7f7429c0e800 20 remove_watcher() i=6 2024-04-24T01:43:00.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.764+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94795853917168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56376132caf0 con 0x7f7420031040 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.765+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94795853917168] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7418086040 con 0x7f7420031040 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.765+0000 7f7429c0e800 20 remove_watcher() i=7 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7420031040 msgr2=0x7f7420032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7420031040 0x7f7420032940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56376131f430 msgr2=0x5637613218d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56376131f430 0x5637613218d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7410036070 msgr2=0x7f7410051a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7410036070 0x7f7410051a50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563761325630 msgr2=0x563761327a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563761325630 0x563761327a20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f72f0036900 msgr2=0x7f72f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f72f0036900 0x7f72f0038dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5637612ef000 tx=0x7f742001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 msgr2=0x563761313990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1133305908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56376130c330 0x563761313990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7410024840 tx=0x7f741004bea0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 reap_dead start 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7427714640 1 -- 172.21.15.131:0/1133305908 reap_dead start 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 shutdown_connections 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 >> 172.21.15.131:0/1133305908 conn(0x563761308690 msgr2=0x563761305cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 shutdown_connections 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1133305908 wait complete. 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7300036900 msgr2=0x7f7300038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7300036900 0x7f7300038dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5637612ef880 tx=0x7f7420005840 comp rx=0 tx=0).stop 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637612fef90 msgr2=0x5637612ff3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637612fef90 0x5637612ff3b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f741000e610 tx=0x7f741000ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 shutdown_connections 2024-04-24T01:43:00.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7300036900 0x7f7300038dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/1612775690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637612fef90 0x5637612ff3b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 >> 172.21.15.131:0/1612775690 conn(0x5637612f3030 msgr2=0x5637612f3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 shutdown_connections 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/1612775690 wait complete. 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5637611eb0c0 msgr2=0x5637612edea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.766+0000 7f7429c0e800 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5637611eb0c0 0x5637612edea0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f730c036950 msgr2=0x7f730c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f730c036950 0x7f730c038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f74100013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 msgr2=0x5637612e6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612e6c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7418052540 tx=0x7f7418003020 comp rx=0 tx=0).stop 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 shutdown_connections 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5637611eb0c0 0x5637612edea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f730c036950 0x7f730c038e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 --2- 172.21.15.131:0/544277510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637611ea760 0x5637612e6c60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 >> 172.21.15.131:0/544277510 conn(0x5637611e6380 msgr2=0x5637612d93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 shutdown_connections 2024-04-24T01:43:00.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.767+0000 7f7429c0e800 1 -- 172.21.15.131:0/544277510 wait complete. 2024-04-24T01:43:00.779 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:43:00.631974Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:00.779 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-24T01:43:00.779 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-24T01:43:00.779 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-24T01:43:00.866 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:00.866 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.865+0000 7f2518c11800 1 Processor -- start 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.865+0000 7f2518c11800 1 -- start start 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.865+0000 7f2518c11800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55679d94aef0 0x55679d94b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.865+0000 7f2518c11800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55679d809d40 con 0x55679d94c150 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.865+0000 7f2518c11800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55679d7dc4d0 con 0x55679d94aef0 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.865+0000 7f2514347640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55679d94aef0 0x55679d94b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.866+0000 7f2513b46640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55679d94c150 0x55679d94c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45832/0 (socket says 172.21.15.131:45832) 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.866+0000 7f2514347640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55679d94aef0 0x55679d94b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36932/0 (socket says 172.21.15.131:36932) 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.866+0000 7f2513b46640 1 -- 172.21.15.131:0/2810932421 learned_addr learned my addr 172.21.15.131:0/2810932421 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.866+0000 7f2514347640 1 -- 172.21.15.131:0/2810932421 >> v1:172.21.15.107:6789/0 conn(0x55679d94c150 legacy=0x55679d94c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.866+0000 7f2514347640 1 -- 172.21.15.131:0/2810932421 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679d808590 con 0x55679d94aef0 2024-04-24T01:43:00.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.866+0000 7f2513345640 1 -- 172.21.15.131:0/2810932421 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515402283 0 0) 0x55679d809d40 con 0x55679d94c150 2024-04-24T01:43:00.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.868+0000 7f2514347640 1 --2- 172.21.15.131:0/2810932421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d94b310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f250400a470 tx=0x7f250401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c364dc9a980e2d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.868+0000 7f2513345640 1 -- 172.21.15.131:0/2810932421 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2504057070 con 0x55679d94aef0 2024-04-24T01:43:00.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.868+0000 7f2513345640 1 -- 172.21.15.131:0/2810932421 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2504052570 con 0x55679d94aef0 2024-04-24T01:43:00.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.868+0000 7f2513345640 1 -- 172.21.15.131:0/2810932421 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2504052870 con 0x55679d94aef0 2024-04-24T01:43:00.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.869+0000 7f2518c11800 1 -- 172.21.15.131:0/2810932421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 msgr2=0x55679d94b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.869+0000 7f2518c11800 1 --2- 172.21.15.131:0/2810932421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d94b310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f250400a470 tx=0x7f250401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.869+0000 7f2518c11800 1 -- 172.21.15.131:0/2810932421 shutdown_connections 2024-04-24T01:43:00.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.869+0000 7f2518c11800 1 --2- 172.21.15.131:0/2810932421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d94b310 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.869+0000 7f2518c11800 1 -- 172.21.15.131:0/2810932421 >> 172.21.15.131:0/2810932421 conn(0x55679d9464f0 msgr2=0x55679d948910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.869+0000 7f2518c11800 1 -- 172.21.15.131:0/2810932421 shutdown_connections 2024-04-24T01:43:00.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.869+0000 7f2518c11800 1 -- 172.21.15.131:0/2810932421 wait complete. 2024-04-24T01:43:00.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.880+0000 7f2518c11800 1 Processor -- start 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.881+0000 7f2518c11800 1 -- start start 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.881+0000 7f2518c11800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d8c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.881+0000 7f2518c11800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55679d8963b0 con 0x55679d94aef0 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.881+0000 7f2514347640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d8c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.881+0000 7f2514347640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d8c0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36938/0 (socket says 172.21.15.131:36938) 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.881+0000 7f2514347640 1 -- 172.21.15.131:0/272642684 learned_addr learned my addr 172.21.15.131:0/272642684 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.881+0000 7f2514347640 1 -- 172.21.15.131:0/272642684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679d8be6f0 con 0x55679d94aef0 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f2514347640 1 --2- 172.21.15.131:0/272642684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d8c0130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2504055040 tx=0x7f250404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5331b68ffccbd18f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f240260c640 1 -- 172.21.15.131:0/272642684 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2504057070 con 0x55679d94aef0 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f240260c640 1 -- 172.21.15.131:0/272642684 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2504063070 con 0x55679d94aef0 2024-04-24T01:43:00.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f240260c640 1 -- 172.21.15.131:0/272642684 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2504052720 con 0x55679d94aef0 2024-04-24T01:43:00.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f2518c11800 1 -- 172.21.15.131:0/272642684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 msgr2=0x55679d8c0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f2518c11800 1 --2- 172.21.15.131:0/272642684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d8c0130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2504055040 tx=0x7f250404c000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f2518c11800 1 -- 172.21.15.131:0/272642684 shutdown_connections 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f2518c11800 1 --2- 172.21.15.131:0/272642684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679d8c0130 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.882+0000 7f2518c11800 1 -- 172.21.15.131:0/272642684 >> 172.21.15.131:0/272642684 conn(0x55679d9464f0 msgr2=0x55679da37d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2518c11800 1 -- 172.21.15.131:0/272642684 shutdown_connections 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2518c11800 1 -- 172.21.15.131:0/272642684 wait complete. 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2518c11800 1 Processor -- start 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2518c11800 1 -- start start 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2518c11800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679da46060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2518c11800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55679d9545f0 con 0x55679d94aef0 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2514347640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679da46060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2514347640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679da46060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36944/0 (socket says 172.21.15.131:36944) 2024-04-24T01:43:00.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2514347640 1 -- 172.21.15.131:0/1632976416 learned_addr learned my addr 172.21.15.131:0/1632976416 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.883+0000 7f2514347640 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679da465a0 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.884+0000 7f2514347640 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679da46060 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2504060040 tx=0x7f2504002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.884+0000 7f2400e09640 1 -- 172.21.15.131:0/1632976416 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2504052c70 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.884+0000 7f2400e09640 1 -- 172.21.15.131:0/1632976416 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250406c070 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.884+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55679da46830 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.884+0000 7f2400e09640 1 -- 172.21.15.131:0/1632976416 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250405e480 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.884+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679da494e0 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2400e09640 1 -- 172.21.15.131:0/1632976416 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f250405e620 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2400e09640 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc036900 0x7f23fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2400e09640 1 -- 172.21.15.131:0/1632976416 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f250408e750 con 0x55679d94aef0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2513b46640 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc036900 0x7f23fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2518c11800 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679d94c150 0x55679da4d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da4d870 con 0x55679d94c150 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2514b48640 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679d94c150 0x55679da4d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2513b46640 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc036900 0x7f23fc038dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2508000c00 tx=0x7f25080013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.885+0000 7f2514b48640 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679d94c150 0x55679da4d2a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2514b48640 1 -- 172.21.15.131:0/1632976416 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f250c00a4a0 con 0x55679d94c150 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da4a850 con 0x55679d94c150 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2514b48640 1 -- 172.21.15.131:0/1632976416 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f250c00a4a0 con 0x55679d94c150 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da4f650 con 0x55679d94c150 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2514b48640 1 -- 172.21.15.131:0/1632976416 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f250c00a4a0 con 0x55679d94c150 2024-04-24T01:43:00.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da4e990 con 0x55679d94c150 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2514b48640 1 -- 172.21.15.131:0/1632976416 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f250c00a4a0 con 0x55679d94c150 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.886+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da4edb0 con 0x55679d94c150 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2514b48640 1 -- 172.21.15.131:0/1632976416 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f250c00a4a0 con 0x55679d94c150 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2518c11800 1 Processor -- start 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2518c11800 1 -- start start 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2518c11800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da5e440 0x55679da5e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2518c11800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55679d83c6b0 con 0x55679da5e440 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2513b46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da5e440 0x55679da5e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2513b46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da5e440 0x55679da5e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36956/0 (socket says 172.21.15.131:36956) 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.887+0000 7f2513b46640 1 -- 172.21.15.131:0/794775335 learned_addr learned my addr 172.21.15.131:0/794775335 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.888+0000 7f2513b46640 1 -- 172.21.15.131:0/794775335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679da5eda0 con 0x55679da5e440 2024-04-24T01:43:00.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.888+0000 7f2513b46640 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da5e440 0x55679da5e860 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f250800e610 tx=0x7f250800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.888+0000 7f23f9ffb640 1 -- 172.21.15.131:0/794775335 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2508022070 con 0x55679da5e440 2024-04-24T01:43:00.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.888+0000 7f23f9ffb640 1 -- 172.21.15.131:0/794775335 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2508009050 con 0x55679da5e440 2024-04-24T01:43:00.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.888+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55679da5f810 con 0x55679da5e440 2024-04-24T01:43:00.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.888+0000 7f23f9ffb640 1 -- 172.21.15.131:0/794775335 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250800d500 con 0x55679da5e440 2024-04-24T01:43:00.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.888+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679da5fd10 con 0x55679da5e440 2024-04-24T01:43:00.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f23f9ffb640 1 -- 172.21.15.131:0/794775335 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2508025070 con 0x55679da5e440 2024-04-24T01:43:00.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f23f9ffb640 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036900 0x7f23ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f23f9ffb640 1 -- 172.21.15.131:0/794775335 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f250804db80 con 0x55679da5e440 2024-04-24T01:43:00.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f2514b48640 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036900 0x7f23ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f2518c11800 1 Processor -- start 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f2518c11800 1 -- start start 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f2514b48640 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036900 0x7f23ec038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55679da4ed30 tx=0x7f250c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f2518c11800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da6bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.889+0000 7f2518c11800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55679d8be9b0 con 0x55679da6b7e0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f2513b46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da6bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f2513b46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da6bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36972/0 (socket says 172.21.15.131:36972) 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f2513b46640 1 -- 172.21.15.131:0/590327298 learned_addr learned my addr 172.21.15.131:0/590327298 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f2513b46640 1 -- 172.21.15.131:0/590327298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679da6c1d0 con 0x55679da6b7e0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f2513b46640 1 --2- 172.21.15.131:0/590327298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da6bc00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f250804bf40 tx=0x7f25080243f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeb08338d2523d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f23f37fe640 1 -- 172.21.15.131:0/590327298 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250804a030 con 0x55679da6b7e0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f23f37fe640 1 -- 172.21.15.131:0/590327298 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2508025e30 con 0x55679da6b7e0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f23f37fe640 1 -- 172.21.15.131:0/590327298 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250801ad50 con 0x55679da6b7e0 2024-04-24T01:43:00.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.890+0000 7f2518c11800 1 -- 172.21.15.131:0/590327298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 msgr2=0x55679da6bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 --2- 172.21.15.131:0/590327298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da6bc00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f250804bf40 tx=0x7f25080243f0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 -- 172.21.15.131:0/590327298 shutdown_connections 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 --2- 172.21.15.131:0/590327298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da6bc00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 -- 172.21.15.131:0/590327298 >> 172.21.15.131:0/590327298 conn(0x55679da67b40 msgr2=0x55679da65ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 -- 172.21.15.131:0/590327298 shutdown_connections 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 -- 172.21.15.131:0/590327298 wait complete. 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 Processor -- start 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 -- start start 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da72e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2518c11800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55679da6c940 con 0x55679da6b7e0 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2513b46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da72e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2513b46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da72e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:36984/0 (socket says 172.21.15.131:36984) 2024-04-24T01:43:00.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 learned_addr learned my addr 172.21.15.131:0/1415011108 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.891+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679da73380 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.892+0000 7f2513b46640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da72e40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2508024fd0 tx=0x7f250804bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.892+0000 7f23f1ffb640 1 -- 172.21.15.131:0/1415011108 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2508045040 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.892+0000 7f23f1ffb640 1 -- 172.21.15.131:0/1415011108 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250800d6a0 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.892+0000 7f23f1ffb640 1 -- 172.21.15.131:0/1415011108 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f250800d980 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.892+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55679da73610 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.892+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679da762c0 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.892+0000 7f23f1ffb640 1 -- 172.21.15.131:0/1415011108 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f250804d380 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f23f1ffb640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e4036950 0x7f23e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f23f1ffb640 1 -- 172.21.15.131:0/1415011108 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2508037c90 con 0x55679da6b7e0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f2514b48640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e4036950 0x7f23e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f2514b48640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e4036950 0x7f23e4038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55679da4e4b0 tx=0x7f250c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679da7e8e0 0x55679da80da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da814f0 con 0x55679da7e8e0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f2514347640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679da7e8e0 0x55679da80da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.893+0000 7f2514347640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679da7e8e0 0x55679da80da0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 realm 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da81900 con 0x55679da7e8e0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:00.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da821d0 con 0x55679da7e8e0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da82570 con 0x55679da7e8e0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.894+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da82dc0 con 0x55679da7e8e0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2518c11800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2518c11800 20 searching for the correct realm 2024-04-24T01:43:00.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55679da84b30 0x55679da86f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2513b46640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55679da84b30 0x55679da86f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2513b46640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55679da84b30 0x55679da86f20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2513b46640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2508036070 0x7f250802c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.895+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f2508036070 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.896+0000 7f2514b48640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2508036070 0x7f250802c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.896+0000 7f2514b48640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2508036070 0x7f250802c060 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.896+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250c01f070 con 0x7f2508036070 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.896+0000 7f2514b48640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f250c031040 0x7f250c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.896+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.896+0000 7f2514347640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f250c031040 0x7f250c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.897+0000 7f2514347640 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f250c031040 0x7f250c032940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.897+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.897+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.897+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.897+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.897+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.897+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f2508036070 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250c01f070 con 0x7f2508036070 2024-04-24T01:43:00.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.898+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f2508036070 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f250c01f070 con 0x7f2508036070 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.899+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.900+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.901+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.901+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.901+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.901+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.901+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.901+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f2508036070 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250c01f070 con 0x7f2508036070 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.902+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508024030 con 0x55679da84b30 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f2508036070 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250c01f070 con 0x7f2508036070 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.903+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da84b30 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f250c031040 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x55679da7e8e0 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55679da87550 con 0x7f2508036070 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250c01f070 con 0x7f2508036070 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:00.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.904+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da83710 con 0x55679da7e8e0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da83fb0 con 0x55679da7e8e0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da83fb0 con 0x55679da7e8e0 2024-04-24T01:43:00.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 zone default found 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 4 Realm: () 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 zonegroup default 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da879b0 con 0x7f250c031040 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.905+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da89390 con 0x55679da84b30 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2518c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da89870 con 0x55679da84b30 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2518c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2518c11800 20 started sync module instance, tier type = 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2518c11800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.906+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da88830 con 0x7f2508036070 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.907+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250c040040 con 0x7f2508036070 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.907+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93903515061280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da88490 con 0x7f2508036070 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.907+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8a7a0 con 0x55679da7e8e0 2024-04-24T01:43:00.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.908+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93903515061280] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250c040040 con 0x7f2508036070 2024-04-24T01:43:00.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.908+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.908+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93903515065552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8a7a0 con 0x55679da7e8e0 2024-04-24T01:43:00.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.908+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8b1c0 con 0x55679da84b30 2024-04-24T01:43:00.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.909+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.909+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93903515069616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8ba60 con 0x55679da84b30 2024-04-24T01:43:00.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.909+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8c520 con 0x7f2508036070 2024-04-24T01:43:00.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.910+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93903515065552] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.910+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93903515069616] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.911+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250c040040 con 0x7f2508036070 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.911+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93903515071920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8a2f0 con 0x7f2508036070 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.911+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8ce20 con 0x55679da7e8e0 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.912+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93903515071920] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250c040040 con 0x7f2508036070 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.912+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.912+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93903515076880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8cde0 con 0x55679da7e8e0 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.912+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8d850 con 0x7f250c031040 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.913+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93903515076880] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.913+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.913+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93903515079552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8d850 con 0x7f250c031040 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.913+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8e260 con 0x7f250c031040 2024-04-24T01:43:00.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.914+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93903515079552] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.914+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.914+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93903515074544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8e260 con 0x7f250c031040 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.914+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8ec20 con 0x7f250c031040 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.915+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93903515074544] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.915+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93903515082160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8ee00 con 0x7f250c031040 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=0 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=1 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=2 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=3 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=4 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=5 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=6 2024-04-24T01:43:00.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93903515082160] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 20 add_watcher() i=7 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.916+0000 7f2518c11800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.917+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679da91fc0 con 0x55679da7e8e0 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.917+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.917+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93903515097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8ed70 con 0x55679da7e8e0 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93903515097488] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f23ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f2518c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f2518c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f2518c11800 5 note: GC not initialized 2024-04-24T01:43:00.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f23c97e2640 20 reqs_thread_entry: start 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f2518c11800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f2518c11800 20 Filter name: none 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.918+0000 7f233affd640 20 reqs_thread_entry: start 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 20 rados->read ofs=0 len=0 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679dac53c0 con 0x55679da7e8e0 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 20 rados_obj.operate() r=0 bl.length=502 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.919+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679dacba70 con 0x55679da7e8e0 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f2518c11800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f2518c11800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f2518c11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93903515333856 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679dac7160 con 0x55679da7e8e0 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 93903515076880 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55679da494e0 con 0x55679da7e8e0 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f23f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93903515076880 notifier 4352 bl.length()=567 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f23f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f23f37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f23f37fe640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f23d8003ea0 con 0x55679da7e8e0 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.920+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(64 notify.4 [notify cookie 93903515333856 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.921+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.921+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 93903515333856 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55679da46830 con 0x55679da7e8e0 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.921+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679dacb4e0 con 0x7f250c031040 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f2518c11800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93903515333856 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55679dac6cb0 con 0x55679da84b30 2024-04-24T01:43:00.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== watch-notify(notify (1) cookie 93903515069616 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55679da73610 con 0x55679da84b30 2024-04-24T01:43:00.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f23f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 93903515069616 notifier 4352 bl.length()=170 2024-04-24T01:43:00.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f23f2ffd640 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f23480032c0 con 0x55679da84b30 2024-04-24T01:43:00.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 notify.2 [notify cookie 93903515333856 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.922+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.923+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== watch-notify(notify_complete (2) cookie 93903515333856 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55679da73380 con 0x55679da84b30 2024-04-24T01:43:00.937 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:00.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.923+0000 7f23ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:00.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.923+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93903515097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679dac7890 con 0x55679da7e8e0 2024-04-24T01:43:00.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.924+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93903515097488] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.924+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93903515061280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da91990 con 0x7f2508036070 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.925+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93903515061280] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250c040040 con 0x7f2508036070 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.925+0000 7f2518c11800 20 remove_watcher() i=0 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.925+0000 7f2518c11800 2 removed watcher, disabling cache 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.925+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93903515065552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da88c20 con 0x55679da7e8e0 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.926+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93903515065552] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.926+0000 7f2518c11800 20 remove_watcher() i=1 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.926+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93903515069616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da89cd0 con 0x55679da84b30 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.927+0000 7f2513b46640 1 -- 172.21.15.131:0/1415011108 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93903515069616] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2508068040 con 0x55679da84b30 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.927+0000 7f2518c11800 20 remove_watcher() i=2 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.927+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93903515071920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8acb0 con 0x7f2508036070 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.928+0000 7f2514b48640 1 -- 172.21.15.131:0/1415011108 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93903515071920] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f250c040040 con 0x7f2508036070 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.928+0000 7f2518c11800 20 remove_watcher() i=3 2024-04-24T01:43:00.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.928+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93903515076880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8acb0 con 0x55679da7e8e0 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.930+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93903515076880] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x55679da7e8e0 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.930+0000 7f2518c11800 20 remove_watcher() i=4 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.930+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93903515079552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8c910 con 0x7f250c031040 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.931+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93903515079552] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.931+0000 7f2518c11800 20 remove_watcher() i=5 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.931+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93903515074544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8d380 con 0x7f250c031040 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.932+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93903515074544] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.932+0000 7f2518c11800 20 remove_watcher() i=6 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.932+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93903515082160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55679da8c910 con 0x7f250c031040 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.932+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93903515082160] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504009d10 con 0x7f250c031040 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.932+0000 7f2518c11800 20 remove_watcher() i=7 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f250c031040 msgr2=0x7f250c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f250c031040 0x7f250c032940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679da7e8e0 msgr2=0x55679da80da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679da7e8e0 0x55679da80da0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2508036070 msgr2=0x7f250802c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2508036070 0x7f250802c060 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55679da84b30 msgr2=0x55679da86f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55679da84b30 0x55679da86f20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e4036950 msgr2=0x7f23e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23e4036950 0x7f23e4038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55679da4e4b0 tx=0x7f250c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 msgr2=0x55679da72e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2514347640 1 -- 172.21.15.131:0/1415011108 reap_dead start 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da72e40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2508024fd0 tx=0x7f250804bea0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 shutdown_connections 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/1415011108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da6b7e0 0x55679da72e40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 >> 172.21.15.131:0/1415011108 conn(0x55679da67b40 msgr2=0x55679da651a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 shutdown_connections 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/1415011108 wait complete. 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036900 msgr2=0x7f23ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036900 0x7f23ec038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55679da4ed30 tx=0x7f250c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da5e440 msgr2=0x55679da5e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da5e440 0x55679da5e860 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f250800e610 tx=0x7f250800ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 shutdown_connections 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23ec036900 0x7f23ec038dc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 --2- 172.21.15.131:0/794775335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679da5e440 0x55679da5e860 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 >> 172.21.15.131:0/794775335 conn(0x55679da524e0 msgr2=0x55679da528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 shutdown_connections 2024-04-24T01:43:00.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.933+0000 7f2518c11800 1 -- 172.21.15.131:0/794775335 wait complete. 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679d94c150 msgr2=0x55679da4d2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679d94c150 0x55679da4d2a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc036900 msgr2=0x7f23fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc036900 0x7f23fc038dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2508000c00 tx=0x7f25080013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 msgr2=0x55679da46060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679da46060 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2504060040 tx=0x7f2504002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 shutdown_connections 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55679d94c150 0x55679da4d2a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f23fc036900 0x7f23fc038dc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 --2- 172.21.15.131:0/1632976416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55679d94aef0 0x55679da46060 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 >> 172.21.15.131:0/1632976416 conn(0x55679d9464f0 msgr2=0x55679da37920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 shutdown_connections 2024-04-24T01:43:00.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.934+0000 7f2518c11800 1 -- 172.21.15.131:0/1632976416 wait complete. 2024-04-24T01:43:00.948 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:00.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-24T01:43:00.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-24T01:43:00.949 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-24T01:43:00.993 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:00.993 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.992+0000 7f92e7b46800 1 Processor -- start 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.992+0000 7f92e7b46800 1 -- start start 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.992+0000 7f92e7b46800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b004d798d0 0x55b004d7bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.992+0000 7f92e7b46800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b004c37d40 con 0x55b004d7c200 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.992+0000 7f92e7b46800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55b004c0a4d0 con 0x55b004d798d0 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.993+0000 7f92e5645640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b004d798d0 0x55b004d7bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.993+0000 7f92dce44640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55b004d7c200 0x55b004d7e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45844/0 (socket says 172.21.15.131:45844) 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.993+0000 7f92dce44640 1 -- 172.21.15.131:0/914715125 learned_addr learned my addr 172.21.15.131:0/914715125 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.993+0000 7f92e5645640 1 -- 172.21.15.131:0/914715125 >> v1:172.21.15.107:6789/0 conn(0x55b004d7c200 legacy=0x55b004d7e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.993+0000 7f92e4e44640 1 -- 172.21.15.131:0/914715125 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056442768 0 0) 0x55b004c37d40 con 0x55b004d7c200 2024-04-24T01:43:00.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.993+0000 7f92e5645640 1 -- 172.21.15.131:0/914715125 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b004c36590 con 0x55b004d798d0 2024-04-24T01:43:00.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.995+0000 7f92e5645640 1 --2- 172.21.15.131:0/914715125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d7bcc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92d800a470 tx=0x7f92d801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bc53b9274b4a34 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:00.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.995+0000 7f92e4e44640 1 -- 172.21.15.131:0/914715125 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d8057070 con 0x55b004d798d0 2024-04-24T01:43:00.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.995+0000 7f92e4e44640 1 -- 172.21.15.131:0/914715125 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d8052570 con 0x55b004d798d0 2024-04-24T01:43:00.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.995+0000 7f92e4e44640 1 -- 172.21.15.131:0/914715125 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d8052870 con 0x55b004d798d0 2024-04-24T01:43:00.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.995+0000 7f92e7b46800 1 -- 172.21.15.131:0/914715125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 msgr2=0x55b004d7bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:00.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.995+0000 7f92e7b46800 1 --2- 172.21.15.131:0/914715125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d7bcc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92d800a470 tx=0x7f92d801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:00.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.996+0000 7f92e7b46800 1 -- 172.21.15.131:0/914715125 shutdown_connections 2024-04-24T01:43:00.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.996+0000 7f92e7b46800 1 --2- 172.21.15.131:0/914715125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d7bcc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:00.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.996+0000 7f92e7b46800 1 -- 172.21.15.131:0/914715125 >> 172.21.15.131:0/914715125 conn(0x55b004d733a0 msgr2=0x55b004d757c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:00.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.996+0000 7f92e7b46800 1 -- 172.21.15.131:0/914715125 shutdown_connections 2024-04-24T01:43:00.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:00.996+0000 7f92e7b46800 1 -- 172.21.15.131:0/914715125 wait complete. 2024-04-24T01:43:01.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.007+0000 7f92e7b46800 1 Processor -- start 2024-04-24T01:43:01.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.007+0000 7f92e7b46800 1 -- start start 2024-04-24T01:43:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.007+0000 7f92e7b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d79210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.007+0000 7f92e7b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b004cc43b0 con 0x55b004d798d0 2024-04-24T01:43:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f92e5645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d79210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f92e5645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d79210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37000/0 (socket says 172.21.15.131:37000) 2024-04-24T01:43:01.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f92e5645640 1 -- 172.21.15.131:0/2547435031 learned_addr learned my addr 172.21.15.131:0/2547435031 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f92e5645640 1 -- 172.21.15.131:0/2547435031 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b004d777d0 con 0x55b004d798d0 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f92e5645640 1 --2- 172.21.15.131:0/2547435031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d79210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f92d8055040 tx=0x7f92d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b1dce43d74dca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f91d3606640 1 -- 172.21.15.131:0/2547435031 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d8057070 con 0x55b004d798d0 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f91d3606640 1 -- 172.21.15.131:0/2547435031 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d8063070 con 0x55b004d798d0 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.008+0000 7f91d3606640 1 -- 172.21.15.131:0/2547435031 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d8052720 con 0x55b004d798d0 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 -- 172.21.15.131:0/2547435031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 msgr2=0x55b004d79210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2547435031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d79210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f92d8055040 tx=0x7f92d804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 -- 172.21.15.131:0/2547435031 shutdown_connections 2024-04-24T01:43:01.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2547435031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004d79210 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 -- 172.21.15.131:0/2547435031 >> 172.21.15.131:0/2547435031 conn(0x55b004d733a0 msgr2=0x55b004e65830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 -- 172.21.15.131:0/2547435031 shutdown_connections 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 -- 172.21.15.131:0/2547435031 wait complete. 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 Processor -- start 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 -- start start 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004e73b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.009+0000 7f92e7b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b004d80010 con 0x55b004d798d0 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f92e5645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004e73b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f92e5645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004e73b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37006/0 (socket says 172.21.15.131:37006) 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f92e5645640 1 -- 172.21.15.131:0/2796894719 learned_addr learned my addr 172.21.15.131:0/2796894719 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f92e5645640 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b004e74070 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f92e5645640 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004e73b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f92d8060040 tx=0x7f92d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f91d1e03640 1 -- 172.21.15.131:0/2796894719 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d8052e30 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f91d1e03640 1 -- 172.21.15.131:0/2796894719 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d806c070 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b004e74300 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f91d1e03640 1 -- 172.21.15.131:0/2796894719 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d805e5f0 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.010+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b004e76fb0 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.011+0000 7f91d1e03640 1 -- 172.21.15.131:0/2796894719 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f92d805e790 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.011+0000 7f91d1e03640 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91cc036950 0x7f91cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.011+0000 7f91d1e03640 1 -- 172.21.15.131:0/2796894719 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f92d808e880 con 0x55b004d798d0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.011+0000 7f92dce44640 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91cc036950 0x7f91cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.011+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004d7c200 0x55b004e7ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.011+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004e7b2b0 con 0x55b004d7c200 2024-04-24T01:43:01.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.012+0000 7f92e5e46640 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004d7c200 0x55b004e7ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.012+0000 7f92dce44640 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91cc036950 0x7f91cc038e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92d0000c00 tx=0x7f92d00013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.012+0000 7f92e5e46640 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004d7c200 0x55b004e7ad70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.012+0000 7f92e5e46640 1 -- 172.21.15.131:0/2796894719 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92e000a4a0 con 0x55b004d7c200 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.012+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004e78320 con 0x55b004d7c200 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.012+0000 7f92e5e46640 1 -- 172.21.15.131:0/2796894719 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92e000a4a0 con 0x55b004d7c200 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.012+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004e7d090 con 0x55b004d7c200 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.013+0000 7f92e5e46640 1 -- 172.21.15.131:0/2796894719 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f92e000a4a0 con 0x55b004d7c200 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.013+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004e7c3d0 con 0x55b004d7c200 2024-04-24T01:43:01.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.013+0000 7f92e5e46640 1 -- 172.21.15.131:0/2796894719 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92e000a4a0 con 0x55b004d7c200 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.013+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004e7c7f0 con 0x55b004d7c200 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.013+0000 7f92e5e46640 1 -- 172.21.15.131:0/2796894719 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f92e000a4a0 con 0x55b004d7c200 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.013+0000 7f92e7b46800 1 Processor -- start 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.014+0000 7f92e7b46800 1 -- start start 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.014+0000 7f92e7b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e8bea0 0x55b004e8c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.014+0000 7f92e7b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b004c6a6b0 con 0x55b004e8bea0 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.014+0000 7f92dce44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e8bea0 0x55b004e8c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.014+0000 7f92dce44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e8bea0 0x55b004e8c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37022/0 (socket says 172.21.15.131:37022) 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.014+0000 7f92dce44640 1 -- 172.21.15.131:0/4260443024 learned_addr learned my addr 172.21.15.131:0/4260443024 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.014+0000 7f92dce44640 1 -- 172.21.15.131:0/4260443024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b004e8c800 con 0x55b004e8bea0 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.015+0000 7f92dce44640 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e8bea0 0x55b004e8c2c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e610 tx=0x7f92d000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.015+0000 7f91caffd640 1 -- 172.21.15.131:0/4260443024 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d0022070 con 0x55b004e8bea0 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.015+0000 7f91caffd640 1 -- 172.21.15.131:0/4260443024 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d0009050 con 0x55b004e8bea0 2024-04-24T01:43:01.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.015+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b004e8d270 con 0x55b004e8bea0 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.015+0000 7f91caffd640 1 -- 172.21.15.131:0/4260443024 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d000d500 con 0x55b004e8bea0 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.015+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b004e8d770 con 0x55b004e8bea0 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.015+0000 7f91caffd640 1 -- 172.21.15.131:0/4260443024 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f92d0025070 con 0x55b004e8bea0 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f91caffd640 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91bc036950 0x7f91bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f91caffd640 1 -- 172.21.15.131:0/4260443024 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f92d004db70 con 0x55b004e8bea0 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92e5e46640 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91bc036950 0x7f91bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92e7b46800 1 Processor -- start 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92e7b46800 1 -- start start 2024-04-24T01:43:01.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92e5e46640 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91bc036950 0x7f91bc038e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55b004e7c770 tx=0x7f92e0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92e7b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004e99600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92e7b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b004d77a90 con 0x55b004e991e0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92dce44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004e99600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92dce44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004e99600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37030/0 (socket says 172.21.15.131:37030) 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92dce44640 1 -- 172.21.15.131:0/612937227 learned_addr learned my addr 172.21.15.131:0/612937227 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.016+0000 7f92dce44640 1 -- 172.21.15.131:0/612937227 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b004e99bd0 con 0x55b004e991e0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92dce44640 1 --2- 172.21.15.131:0/612937227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004e99600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f92d0026fd0 tx=0x7f92d0024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc018dadc4001eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f91c8ff9640 1 -- 172.21.15.131:0/612937227 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d004a030 con 0x55b004e991e0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f91c8ff9640 1 -- 172.21.15.131:0/612937227 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d0025e30 con 0x55b004e991e0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f91c8ff9640 1 -- 172.21.15.131:0/612937227 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d001ad50 con 0x55b004e991e0 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92e7b46800 1 -- 172.21.15.131:0/612937227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 msgr2=0x55b004e99600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92e7b46800 1 --2- 172.21.15.131:0/612937227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004e99600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f92d0026fd0 tx=0x7f92d0024eb0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92e7b46800 1 -- 172.21.15.131:0/612937227 shutdown_connections 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92e7b46800 1 --2- 172.21.15.131:0/612937227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004e99600 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92e7b46800 1 -- 172.21.15.131:0/612937227 >> 172.21.15.131:0/612937227 conn(0x55b004e95540 msgr2=0x55b004e935a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92e7b46800 1 -- 172.21.15.131:0/612937227 shutdown_connections 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.017+0000 7f92e7b46800 1 -- 172.21.15.131:0/612937227 wait complete. 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92e7b46800 1 Processor -- start 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92e7b46800 1 -- start start 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92e7b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004ea0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92e7b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b004e9a340 con 0x55b004e991e0 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92dce44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004ea0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92dce44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004ea0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37040/0 (socket says 172.21.15.131:37040) 2024-04-24T01:43:01.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 learned_addr learned my addr 172.21.15.131:0/1295144009 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b004ea0d90 con 0x55b004e991e0 2024-04-24T01:43:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92dce44640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004ea0850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f92d0026fd0 tx=0x7f92d004be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f91baffd640 1 -- 172.21.15.131:0/1295144009 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d004a050 con 0x55b004e991e0 2024-04-24T01:43:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f91baffd640 1 -- 172.21.15.131:0/1295144009 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d000d6a0 con 0x55b004e991e0 2024-04-24T01:43:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f91baffd640 1 -- 172.21.15.131:0/1295144009 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d000d9e0 con 0x55b004e991e0 2024-04-24T01:43:01.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b004ea1020 con 0x55b004e991e0 2024-04-24T01:43:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.018+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b004ea3cd0 con 0x55b004e991e0 2024-04-24T01:43:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.019+0000 7f91baffd640 1 -- 172.21.15.131:0/1295144009 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f92d004d370 con 0x55b004e991e0 2024-04-24T01:43:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.019+0000 7f91baffd640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91b0036950 0x7f91b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.019+0000 7f91baffd640 1 -- 172.21.15.131:0/1295144009 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f92d0045880 con 0x55b004e991e0 2024-04-24T01:43:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.019+0000 7f92e5e46640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91b0036950 0x7f91b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e5e46640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91b0036950 0x7f91b0038e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55b004e7bef0 tx=0x7f92e001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004eac3a0 0x55b004eae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eaefb0 con 0x55b004eac3a0 2024-04-24T01:43:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e5645640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004eac3a0 0x55b004eae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e5645640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004eac3a0 0x55b004eae860 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e7b46800 20 realm 2024-04-24T01:43:01.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.020+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eaf3c0 con 0x55b004eac3a0 2024-04-24T01:43:01.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:01.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eafc90 con 0x55b004eac3a0 2024-04-24T01:43:01.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0030 con 0x55b004eac3a0 2024-04-24T01:43:01.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eac3a0 2024-04-24T01:43:01.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:01.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 20 searching for the correct realm 2024-04-24T01:43:01.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.021+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b004eb25f0 0x55b004eb49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.022+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb4fc0 con 0x55b004eb25f0 2024-04-24T01:43:01.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.022+0000 7f92dce44640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b004eb25f0 0x55b004eb49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.022+0000 7f92dce44640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b004eb25f0 0x55b004eb49e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.022+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.022+0000 7f92dce44640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f92d0027060 0x7f92d00450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.022+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb4fc0 con 0x7f92d0027060 2024-04-24T01:43:01.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.022+0000 7f92e5e46640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f92d0027060 0x7f92d00450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.023+0000 7f92e5e46640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f92d0027060 0x7f92d00450b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.023+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e001f070 con 0x7f92d0027060 2024-04-24T01:43:01.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.023+0000 7f92e5e46640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f92e0031040 0x7f92e0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.023+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb4fc0 con 0x7f92e0031040 2024-04-24T01:43:01.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.023+0000 7f92e5645640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f92e0031040 0x7f92e0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.023+0000 7f92e5645640 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f92e0031040 0x7f92e0032940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eac3a0 2024-04-24T01:43:01.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eac3a0 2024-04-24T01:43:01.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x7f92e0031040 2024-04-24T01:43:01.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.024+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x7f92e0031040 2024-04-24T01:43:01.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x7f92d0027060 2024-04-24T01:43:01.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e001f070 con 0x7f92d0027060 2024-04-24T01:43:01.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eb25f0 2024-04-24T01:43:01.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eac3a0 2024-04-24T01:43:01.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.025+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x7f92e0031040 2024-04-24T01:43:01.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eac3a0 2024-04-24T01:43:01.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x7f92d0027060 2024-04-24T01:43:01.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f92e001f070 con 0x7f92d0027060 2024-04-24T01:43:01.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eb25f0 2024-04-24T01:43:01.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.026+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eb25f0 2024-04-24T01:43:01.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.027+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.027+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x7f92e0031040 2024-04-24T01:43:01.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.027+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.027+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eb25f0 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb0880 con 0x55b004eb25f0 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x55b004eac3a0 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x55b004eac3a0 2024-04-24T01:43:01.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.028+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x7f92e0031040 2024-04-24T01:43:01.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x55b004eb25f0 2024-04-24T01:43:01.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x7f92d0027060 2024-04-24T01:43:01.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e001f070 con 0x7f92d0027060 2024-04-24T01:43:01.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x55b004eac3a0 2024-04-24T01:43:01.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x7f92e0031040 2024-04-24T01:43:01.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.029+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x55b004eb25f0 2024-04-24T01:43:01.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x7f92e0031040 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x7f92d0027060 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e001f070 con 0x7f92d0027060 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x55b004eb25f0 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.030+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x7f92e0031040 2024-04-24T01:43:01.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x55b004eac3a0 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f92d0064040 con 0x7f92d0027060 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e001f070 con 0x7f92d0027060 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:01.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb10d0 con 0x55b004eac3a0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.031+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb14c0 con 0x55b004eac3a0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb14c0 con 0x55b004eac3a0 2024-04-24T01:43:01.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:01.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 zone default found 2024-04-24T01:43:01.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 4 Realm: () 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 zonegroup default 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb5440 con 0x7f92e0031040 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.032+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb6e20 con 0x55b004eb25f0 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb71c0 con 0x55b004eb25f0 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92e7b46800 20 started sync module instance, tier type = 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92e7b46800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.033+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb62c0 con 0x7f92d0027060 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.034+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.034+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94214485138960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb7560 con 0x7f92d0027060 2024-04-24T01:43:01.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.034+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb7f20 con 0x55b004eac3a0 2024-04-24T01:43:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.035+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94214485138960] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.035+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.035+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94214485141168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb7f20 con 0x55b004eac3a0 2024-04-24T01:43:01.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.035+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb88e0 con 0x55b004eb25f0 2024-04-24T01:43:01.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.036+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94214485141168] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.037+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.037+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94214485146224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb7e90 con 0x55b004eb25f0 2024-04-24T01:43:01.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.037+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb97a0 con 0x7f92d0027060 2024-04-24T01:43:01.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.037+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94214485146224] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.038+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.038+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94214485152496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb9bc0 con 0x7f92d0027060 2024-04-24T01:43:01.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.038+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eba580 con 0x55b004eac3a0 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.038+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.038+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94214485156048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eba4f0 con 0x55b004eac3a0 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.038+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebb4f0 con 0x7f92e0031040 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.039+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94214485152496] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.039+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.039+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94214485153552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebb4f0 con 0x7f92e0031040 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.039+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebbef0 con 0x7f92e0031040 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.039+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94214485156048] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.040+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94214485153552] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.040+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.040+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94214485162496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebb080 con 0x7f92e0031040 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.041+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebc580 con 0x7f92e0031040 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.041+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94214485162496] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.041+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.041+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94214485158256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebc580 con 0x7f92e0031040 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=0 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=1 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=2 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=3 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=4 2024-04-24T01:43:01.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=5 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=6 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94214485158256] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 20 add_watcher() i=7 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.042+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebf820 con 0x55b004eac3a0 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.043+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.043+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94214485176816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebc5d0 con 0x55b004eac3a0 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94214485176816] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f919b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e7b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e7b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:01.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e7b46800 5 note: GC not initialized 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f919a7e4640 20 reqs_thread_entry: start 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e7b46800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e7b46800 20 Filter name: none 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f910bfff640 20 reqs_thread_entry: start 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e7b46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.044+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004ef2b10 con 0x55b004eac3a0 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:01.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004ef2660 con 0x55b004eac3a0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.045+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ef9300 con 0x55b004eac3a0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.046+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.046+0000 7f92e7b46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.046+0000 7f92e7b46800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.046+0000 7f92e7b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.046+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94214485413200 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004ef4ac0 con 0x55b004eac3a0 2024-04-24T01:43:01.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify (1) cookie 94214485156048 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f92d808ce30 con 0x55b004eac3a0 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f91c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94214485156048 notifier 4359 bl.length()=732 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f91c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f91c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(65 notify.4 [notify cookie 94214485413200 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f91c8ff9640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f91a8003ea0 con 0x55b004eac3a0 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== watch-notify(notify_complete (2) cookie 94214485413200 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b004e76fb0 con 0x55b004eac3a0 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.047+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ef8d50 con 0x55b004eac3a0 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f92e7b46800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-24T01:43:01.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f92e7b46800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T01:43:01.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f92e7b46800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-24T01:43:01.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94214485413200 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b004ef45c0 con 0x7f92d0027060 2024-04-24T01:43:01.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== watch-notify(notify (1) cookie 94214485138960 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f92e00247b0 con 0x7f92d0027060 2024-04-24T01:43:01.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f91c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94214485138960 notifier 4359 bl.length()=166 2024-04-24T01:43:01.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f91c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-24T01:43:01.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f91c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T01:43:01.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(68 notify.0 [notify cookie 94214485413200 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.048+0000 7f91c8ff9640 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f91a8003ea0 con 0x7f92d0027060 2024-04-24T01:43:01.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.049+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.049+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== watch-notify(notify_complete (2) cookie 94214485413200 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f92e0024980 con 0x7f92d0027060 2024-04-24T01:43:01.088 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"315p4kWFkf6PPUXuSv0iAfhiFYAqCyAq1KMJMQoH","active":true,"create_date":"2024-04-24T01:43:01.047601Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:01.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.049+0000 7f919b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.049+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94214485176816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebe8c0 con 0x55b004eac3a0 2024-04-24T01:43:01.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.050+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94214485176816] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.050+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94214485138960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004ebf1f0 con 0x7f92d0027060 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.051+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94214485138960] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.051+0000 7f92e7b46800 20 remove_watcher() i=0 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.051+0000 7f92e7b46800 2 removed watcher, disabling cache 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.051+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94214485141168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb5e10 con 0x55b004eac3a0 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.052+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94214485141168] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.053+0000 7f92e7b46800 20 remove_watcher() i=1 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.053+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94214485146224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb5e10 con 0x55b004eb25f0 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.053+0000 7f92dce44640 1 -- 172.21.15.131:0/1295144009 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94214485146224] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0024030 con 0x55b004eb25f0 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.054+0000 7f92e7b46800 20 remove_watcher() i=2 2024-04-24T01:43:01.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.054+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94214485152496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb7a70 con 0x7f92d0027060 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.054+0000 7f92e5e46640 1 -- 172.21.15.131:0/1295144009 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94214485152496] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e0040040 con 0x7f92d0027060 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.054+0000 7f92e7b46800 20 remove_watcher() i=3 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.054+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94214485156048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb92f0 con 0x55b004eac3a0 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.055+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94214485156048] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x55b004eac3a0 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.055+0000 7f92e7b46800 20 remove_watcher() i=4 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.055+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94214485153552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb7a70 con 0x7f92e0031040 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.056+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94214485153552] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.056+0000 7f92e7b46800 20 remove_watcher() i=5 2024-04-24T01:43:01.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.056+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94214485162496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eba0d0 con 0x7f92e0031040 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.057+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94214485162496] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.057+0000 7f92e7b46800 20 remove_watcher() i=6 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.057+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94214485158256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b004eb7a70 con 0x7f92e0031040 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94214485158256] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d8071990 con 0x7f92e0031040 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 20 remove_watcher() i=7 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f92e0031040 msgr2=0x7f92e0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f92e0031040 0x7f92e0032940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004eac3a0 msgr2=0x55b004eae860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004eac3a0 0x55b004eae860 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f92d0027060 msgr2=0x7f92d00450b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f92d0027060 0x7f92d00450b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b004eb25f0 msgr2=0x55b004eb49e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b004eb25f0 0x55b004eb49e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91b0036950 msgr2=0x7f91b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91b0036950 0x7f91b0038e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55b004e7bef0 tx=0x7f92e001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 msgr2=0x55b004ea0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 --2- 172.21.15.131:0/1295144009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e991e0 0x55b004ea0850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f92d0026fd0 tx=0x7f92d004be50 comp rx=0 tx=0).stop 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 reap_dead start 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e5645640 1 -- 172.21.15.131:0/1295144009 reap_dead start 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 shutdown_connections 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 >> 172.21.15.131:0/1295144009 conn(0x55b004e95540 msgr2=0x55b004e92ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.058+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 shutdown_connections 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/1295144009 wait complete. 2024-04-24T01:43:01.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91bc036950 msgr2=0x7f91bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91bc036950 0x7f91bc038e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55b004e7c770 tx=0x7f92e0005840 comp rx=0 tx=0).stop 2024-04-24T01:43:01.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e8bea0 msgr2=0x55b004e8c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e8bea0 0x55b004e8c2c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e610 tx=0x7f92d000ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:01.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 shutdown_connections 2024-04-24T01:43:01.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91bc036950 0x7f91bc038e10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/4260443024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004e8bea0 0x55b004e8c2c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 >> 172.21.15.131:0/4260443024 conn(0x55b004e7ff40 msgr2=0x55b004e80340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 shutdown_connections 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/4260443024 wait complete. 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004d7c200 msgr2=0x55b004e7ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004d7c200 0x55b004e7ad70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91cc036950 msgr2=0x7f91cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91cc036950 0x7f91cc038e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92d0000c00 tx=0x7f92d00013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 msgr2=0x55b004e73b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004e73b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f92d8060040 tx=0x7f92d8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 shutdown_connections 2024-04-24T01:43:01.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b004d7c200 0x55b004e7ad70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f91cc036950 0x7f91cc038e10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 --2- 172.21.15.131:0/2796894719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b004d798d0 0x55b004e73b30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 >> 172.21.15.131:0/2796894719 conn(0x55b004d733a0 msgr2=0x55b004e65400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 shutdown_connections 2024-04-24T01:43:01.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.059+0000 7f92e7b46800 1 -- 172.21.15.131:0/2796894719 wait complete. 2024-04-24T01:43:01.102 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': '315p4kWFkf6PPUXuSv0iAfhiFYAqCyAq1KMJMQoH', 'active': True, 'create_date': '2024-04-24T01:43:01.047601Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:01.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-24T01:43:01.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-24T01:43:01.103 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-24T01:43:01.150 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:01.150 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:01.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.149+0000 7f77aec3f800 1 Processor -- start 2024-04-24T01:43:01.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.149+0000 7f77aec3f800 1 -- start start 2024-04-24T01:43:01.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.149+0000 7f77aec3f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557b6101a300 0x557b6101c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.149+0000 7f77aec3f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b60ed4d40 con 0x557b61017550 2024-04-24T01:43:01.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.149+0000 7f77aec3f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x557b60ea74d0 con 0x557b6101a300 2024-04-24T01:43:01.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.150+0000 7f77a3f3d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557b6101a300 0x557b6101c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.150+0000 7f77ac73e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x557b61017550 0x557b61017970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45854/0 (socket says 172.21.15.131:45854) 2024-04-24T01:43:01.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.150+0000 7f77ac73e640 1 -- 172.21.15.131:0/2798686954 learned_addr learned my addr 172.21.15.131:0/2798686954 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:01.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.150+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2798686954 >> v1:172.21.15.107:6789/0 conn(0x557b61017550 legacy=0x557b61017970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.150+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2798686954 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b60ed3590 con 0x557b6101a300 2024-04-24T01:43:01.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.150+0000 7f77abf3d640 1 -- 172.21.15.131:0/2798686954 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181450702 0 0) 0x557b60ed4d40 con 0x557b61017550 2024-04-24T01:43:01.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.152+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/2798686954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b6101a300 0x557b6101c730 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f779400a470 tx=0x7f779401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c2f1119fb7042d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.152+0000 7f77abf3d640 1 -- 172.21.15.131:0/2798686954 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7794057070 con 0x557b6101a300 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.152+0000 7f77abf3d640 1 -- 172.21.15.131:0/2798686954 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7794052570 con 0x557b6101a300 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.152+0000 7f77abf3d640 1 -- 172.21.15.131:0/2798686954 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7794052870 con 0x557b6101a300 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.152+0000 7f77aec3f800 1 -- 172.21.15.131:0/2798686954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b6101a300 msgr2=0x557b6101c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.152+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2798686954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b6101a300 0x557b6101c730 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f779400a470 tx=0x7f779401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.153+0000 7f77aec3f800 1 -- 172.21.15.131:0/2798686954 shutdown_connections 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.153+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2798686954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b6101a300 0x557b6101c730 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.153+0000 7f77aec3f800 1 -- 172.21.15.131:0/2798686954 >> 172.21.15.131:0/2798686954 conn(0x557b61011470 msgr2=0x557b61013890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.153+0000 7f77aec3f800 1 -- 172.21.15.131:0/2798686954 shutdown_connections 2024-04-24T01:43:01.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.153+0000 7f77aec3f800 1 -- 172.21.15.131:0/2798686954 wait complete. 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.164+0000 7f77aec3f800 1 Processor -- start 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.164+0000 7f77aec3f800 1 -- start start 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.164+0000 7f77aec3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b60f8b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.164+0000 7f77aec3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b60f613e0 con 0x557b61017550 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f77ac73e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b60f8b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f77ac73e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b60f8b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37068/0 (socket says 172.21.15.131:37068) 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f77ac73e640 1 -- 172.21.15.131:0/2338600018 learned_addr learned my addr 172.21.15.131:0/2338600018 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f77ac73e640 1 -- 172.21.15.131:0/2338600018 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b60f896f0 con 0x557b61017550 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f77ac73e640 1 --2- 172.21.15.131:0/2338600018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b60f8b130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f779c00b240 tx=0x7f779c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42978dd4cda151d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f769a60c640 1 -- 172.21.15.131:0/2338600018 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c008070 con 0x557b61017550 2024-04-24T01:43:01.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f769a60c640 1 -- 172.21.15.131:0/2338600018 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c00d500 con 0x557b61017550 2024-04-24T01:43:01.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.165+0000 7f769a60c640 1 -- 172.21.15.131:0/2338600018 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c00d860 con 0x557b61017550 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 -- 172.21.15.131:0/2338600018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 msgr2=0x557b60f8b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2338600018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b60f8b130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f779c00b240 tx=0x7f779c00b700 comp rx=0 tx=0).stop 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 -- 172.21.15.131:0/2338600018 shutdown_connections 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2338600018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b60f8b130 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 -- 172.21.15.131:0/2338600018 >> 172.21.15.131:0/2338600018 conn(0x557b61011470 msgr2=0x557b61102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 -- 172.21.15.131:0/2338600018 shutdown_connections 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 -- 172.21.15.131:0/2338600018 wait complete. 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 Processor -- start 2024-04-24T01:43:01.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 -- start start 2024-04-24T01:43:01.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b61110da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.166+0000 7f77aec3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b6101d0b0 con 0x557b61017550 2024-04-24T01:43:01.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f77ac73e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b61110da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f77ac73e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b61110da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37080/0 (socket says 172.21.15.131:37080) 2024-04-24T01:43:01.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f77ac73e640 1 -- 172.21.15.131:0/1711465548 learned_addr learned my addr 172.21.15.131:0/1711465548 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f77ac73e640 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b611112e0 con 0x557b61017550 2024-04-24T01:43:01.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f77ac73e640 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b61110da0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x557b60f8a760 tx=0x7f779c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f7698e09640 1 -- 172.21.15.131:0/1711465548 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c019870 con 0x557b61017550 2024-04-24T01:43:01.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f7698e09640 1 -- 172.21.15.131:0/1711465548 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c019a10 con 0x557b61017550 2024-04-24T01:43:01.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b61111570 con 0x557b61017550 2024-04-24T01:43:01.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f7698e09640 1 -- 172.21.15.131:0/1711465548 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c019d30 con 0x557b61017550 2024-04-24T01:43:01.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.167+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b61114220 con 0x557b61017550 2024-04-24T01:43:01.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.168+0000 7f7698e09640 1 -- 172.21.15.131:0/1711465548 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f779c017040 con 0x557b61017550 2024-04-24T01:43:01.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.168+0000 7f7698e09640 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7694036950 0x7f7694038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.168+0000 7f7698e09640 1 -- 172.21.15.131:0/1711465548 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f779c015020 con 0x557b61017550 2024-04-24T01:43:01.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.168+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7694036950 0x7f7694038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.168+0000 7f77aec3f800 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b6101a300 0x557b61117fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.168+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61118520 con 0x557b6101a300 2024-04-24T01:43:01.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.168+0000 7f77acf3f640 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b6101a300 0x557b61117fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.169+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7694036950 0x7f7694038e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7794054000 tx=0x7f779404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.169+0000 7f77acf3f640 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b6101a300 0x557b61117fe0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.169+0000 7f77acf3f640 1 -- 172.21.15.131:0/1711465548 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77a400a4a0 con 0x557b6101a300 2024-04-24T01:43:01.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.169+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61115590 con 0x557b6101a300 2024-04-24T01:43:01.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.169+0000 7f77acf3f640 1 -- 172.21.15.131:0/1711465548 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77a400a4a0 con 0x557b6101a300 2024-04-24T01:43:01.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.169+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6111a320 con 0x557b6101a300 2024-04-24T01:43:01.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.170+0000 7f77acf3f640 1 -- 172.21.15.131:0/1711465548 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77a400a4a0 con 0x557b6101a300 2024-04-24T01:43:01.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.170+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61119660 con 0x557b6101a300 2024-04-24T01:43:01.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.170+0000 7f77acf3f640 1 -- 172.21.15.131:0/1711465548 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77a400a4a0 con 0x557b6101a300 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.170+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61119a80 con 0x557b6101a300 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.170+0000 7f77acf3f640 1 -- 172.21.15.131:0/1711465548 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77a400a4a0 con 0x557b6101a300 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.170+0000 7f77aec3f800 1 Processor -- start 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.170+0000 7f77aec3f800 1 -- start start 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f77aec3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61129130 0x557b61129550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f77aec3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b60f076b0 con 0x557b61129130 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f77a3f3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61129130 0x557b61129550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f77a3f3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61129130 0x557b61129550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37094/0 (socket says 172.21.15.131:37094) 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f77a3f3d640 1 -- 172.21.15.131:0/3074549425 learned_addr learned my addr 172.21.15.131:0/3074549425 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f77a3f3d640 1 -- 172.21.15.131:0/3074549425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b61129a90 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61129130 0x557b61129550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7794044840 tx=0x7f7794002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.171+0000 7f7691ffb640 1 -- 172.21.15.131:0/3074549425 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779406f070 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f7691ffb640 1 -- 172.21.15.131:0/3074549425 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7794058040 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b6112a500 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f7691ffb640 1 -- 172.21.15.131:0/3074549425 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7794057050 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6112a9a0 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f7691ffb640 1 -- 172.21.15.131:0/3074549425 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7794072070 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f7691ffb640 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7684036950 0x7f7684038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f7691ffb640 1 -- 172.21.15.131:0/3074549425 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f779408fa00 con 0x557b61129130 2024-04-24T01:43:01.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.172+0000 7f77acf3f640 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7684036950 0x7f7684038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77aec3f800 1 Processor -- start 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77acf3f640 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7684036950 0x7f7684038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557b61119a00 tx=0x7f77a4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77aec3f800 1 -- start start 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77aec3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b61136790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77aec3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b60f89a70 con 0x557b61136370 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77a3f3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b61136790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77a3f3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b61136790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37102/0 (socket says 172.21.15.131:37102) 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77a3f3d640 1 -- 172.21.15.131:0/4264219719 learned_addr learned my addr 172.21.15.131:0/4264219719 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77a3f3d640 1 -- 172.21.15.131:0/4264219719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b61136d60 con 0x557b61136370 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.173+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/4264219719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b61136790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f779408dd50 tx=0x7f779408df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a067e30c07397732 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f768b7fe640 1 -- 172.21.15.131:0/4264219719 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779408b030 con 0x557b61136370 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f768b7fe640 1 -- 172.21.15.131:0/4264219719 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779405e480 con 0x557b61136370 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f768b7fe640 1 -- 172.21.15.131:0/4264219719 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7794087b40 con 0x557b61136370 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 -- 172.21.15.131:0/4264219719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 msgr2=0x557b61136790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 --2- 172.21.15.131:0/4264219719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b61136790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f779408dd50 tx=0x7f779408df50 comp rx=0 tx=0).stop 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 -- 172.21.15.131:0/4264219719 shutdown_connections 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 --2- 172.21.15.131:0/4264219719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b61136790 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 -- 172.21.15.131:0/4264219719 >> 172.21.15.131:0/4264219719 conn(0x557b611326d0 msgr2=0x557b61130730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 -- 172.21.15.131:0/4264219719 shutdown_connections 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 -- 172.21.15.131:0/4264219719 wait complete. 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 Processor -- start 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.174+0000 7f77aec3f800 1 -- start start 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77aec3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b6113d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77aec3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b611374d0 con 0x557b61136370 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77a3f3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b6113d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77a3f3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b6113d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37116/0 (socket says 172.21.15.131:37116) 2024-04-24T01:43:01.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 learned_addr learned my addr 172.21.15.131:0/2998256103 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6113df10 con 0x557b61136370 2024-04-24T01:43:01.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b6113d9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f779408dd50 tx=0x7f779408dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f7689ffb640 1 -- 172.21.15.131:0/2998256103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7794072660 con 0x557b61136370 2024-04-24T01:43:01.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f7689ffb640 1 -- 172.21.15.131:0/2998256103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779405daf0 con 0x557b61136370 2024-04-24T01:43:01.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f7689ffb640 1 -- 172.21.15.131:0/2998256103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779405de10 con 0x557b61136370 2024-04-24T01:43:01.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b6113e1a0 con 0x557b61136370 2024-04-24T01:43:01.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.175+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6113e1a0 con 0x557b61136370 2024-04-24T01:43:01.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.176+0000 7f7689ffb640 1 -- 172.21.15.131:0/2998256103 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f779407b020 con 0x557b61136370 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.176+0000 7f7689ffb640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f767c036950 0x7f767c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.176+0000 7f7689ffb640 1 -- 172.21.15.131:0/2998256103 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f779408c070 con 0x557b61136370 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.176+0000 7f77acf3f640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f767c036950 0x7f767c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77acf3f640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f767c036950 0x7f767c038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557b61119180 tx=0x7f77a401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b611492b0 0x557b6114b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114bec0 con 0x557b611492b0 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77ac73e640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b611492b0 0x557b6114b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77ac73e640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b611492b0 0x557b6114b770 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77aec3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77aec3f800 20 realm 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.177+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114c2d0 con 0x557b611492b0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114cba0 con 0x557b611492b0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114cf40 con 0x557b611492b0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114d790 con 0x557b611492b0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 20 searching for the correct realm 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557b6114f500 0x557b611518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.178+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557b6114f500 0x557b611518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.179+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557b6114f500 0x557b611518f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.179+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.179+0000 7f77a3f3d640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7794074060 0x7f7794051730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.179+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f7794074060 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.179+0000 7f77acf3f640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7794074060 0x7f7794051730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.179+0000 7f77acf3f640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7794074060 0x7f7794051730 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.180+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a401f070 con 0x7f7794074060 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.180+0000 7f77acf3f640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f77a4031040 0x7f77a4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.180+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.180+0000 7f77ac73e640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f77a4031040 0x7f77a4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.180+0000 7f77ac73e640 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f77a4031040 0x7f77a4032940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.181+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f7794074060 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a401f070 con 0x7f7794074060 2024-04-24T01:43:01.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.182+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f7794074060 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77a401f070 con 0x7f7794074060 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.183+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.184+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.185+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f7794074060 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a401f070 con 0x7f7794074060 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.186+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f7794074060 2024-04-24T01:43:01.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a401f070 con 0x7f7794074060 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b6114f500 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f77a4031040 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.187+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x557b611492b0 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b61151ed0 con 0x7f7794074060 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77a401f070 con 0x7f7794074060 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:01.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114e110 con 0x557b611492b0 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114e9b0 con 0x557b611492b0 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.188+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61152350 con 0x557b611492b0 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 zone default found 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 4 Realm: () 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 zonegroup default 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b6114e610 con 0x7f77a4031040 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61154230 con 0x557b6114f500 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.189+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b611545d0 con 0x557b6114f500 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.190+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.190+0000 7f77aec3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.190+0000 7f77aec3f800 20 started sync module instance, tier type = 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.190+0000 7f77aec3f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:01.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.190+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b611536d0 con 0x7f7794074060 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.191+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4040040 con 0x7f7794074060 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.191+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988398119616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61153330 con 0x7f7794074060 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.191+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155500 con 0x557b611492b0 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.192+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988398119616] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4040040 con 0x7f7794074060 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.192+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.192+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988398123568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155500 con 0x557b611492b0 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.192+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155f00 con 0x557b6114f500 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.193+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988398123568] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.193+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.193+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988398125136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155470 con 0x557b6114f500 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.193+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61156dc0 con 0x7f7794074060 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.194+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4040040 con 0x7f7794074060 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.194+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988398131952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b611575c0 con 0x7f7794074060 2024-04-24T01:43:01.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.194+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b611580c0 con 0x557b611492b0 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.194+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988398125136] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.195+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.195+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988398136240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61158080 con 0x557b611492b0 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.195+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61158b00 con 0x7f77a4031040 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.195+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988398131952] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4040040 con 0x7f7794074060 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.196+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.196+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988398133264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61158b00 con 0x7f77a4031040 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.196+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61159510 con 0x7f77a4031040 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.196+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988398136240] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.197+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988398133264] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.197+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.197+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988398138960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61158a70 con 0x7f77a4031040 2024-04-24T01:43:01.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.197+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b611599c0 con 0x7f77a4031040 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988398138960] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988398142736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61159de0 con 0x7f77a4031040 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 20 add_watcher() i=0 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 20 add_watcher() i=1 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 20 add_watcher() i=2 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 20 add_watcher() i=3 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 20 add_watcher() i=4 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 20 add_watcher() i=5 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.198+0000 7f77aec3f800 20 add_watcher() i=6 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.200+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988398142736] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.200+0000 7f77aec3f800 20 add_watcher() i=7 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.200+0000 7f77aec3f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:01.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.200+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61159de0 con 0x557b611492b0 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.200+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.200+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988398143792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61159d50 con 0x557b611492b0 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.201+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988398143792] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.201+0000 7f76627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.201+0000 7f77aec3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.201+0000 7f77aec3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.201+0000 7f77aec3f800 5 note: GC not initialized 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f76617e2640 20 reqs_thread_entry: start 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 20 Filter name: none 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f75d2ffd640 20 reqs_thread_entry: start 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:01.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61190140 con 0x557b611492b0 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.202+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b611968e0 con 0x557b611492b0 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.203+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.203+0000 7f77aec3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.203+0000 7f77aec3f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.203+0000 7f77aec3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93988398392144 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b61192010 con 0x557b611492b0 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 93988398136240 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f779c051040 con 0x557b611492b0 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f768b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 93988398136240 notifier 4366 bl.length()=732 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f768b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f768b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f768b7fe640 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7670003ea0 con 0x557b611492b0 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(64 notify.4 [notify cookie 93988398392144 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.204+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 93988398392144 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f779c036080 con 0x557b611492b0 2024-04-24T01:43:01.231 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:01.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.205+0000 7f76627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.205+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988398143792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61192440 con 0x557b611492b0 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.206+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93988398143792] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.206+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988398119616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61159930 con 0x7f7794074060 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.207+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93988398119616] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4040040 con 0x7f7794074060 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.207+0000 7f77aec3f800 20 remove_watcher() i=0 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.207+0000 7f77aec3f800 2 removed watcher, disabling cache 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.207+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988398123568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61159930 con 0x557b611492b0 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.208+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93988398123568] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.208+0000 7f77aec3f800 20 remove_watcher() i=1 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.208+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988398125136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61159930 con 0x557b6114f500 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.209+0000 7f77a3f3d640 1 -- 172.21.15.131:0/2998256103 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93988398125136] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7794071030 con 0x557b6114f500 2024-04-24T01:43:01.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.209+0000 7f77aec3f800 20 remove_watcher() i=2 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.209+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988398131952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155050 con 0x7f7794074060 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.210+0000 7f77acf3f640 1 -- 172.21.15.131:0/2998256103 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93988398131952] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77a4040040 con 0x7f7794074060 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.210+0000 7f77aec3f800 20 remove_watcher() i=3 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.210+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988398136240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155050 con 0x557b611492b0 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.211+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93988398136240] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x557b611492b0 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.211+0000 7f77aec3f800 20 remove_watcher() i=4 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.211+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988398133264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155050 con 0x7f77a4031040 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.212+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93988398133264] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.212+0000 7f77aec3f800 20 remove_watcher() i=5 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.212+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988398138960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155050 con 0x7f77a4031040 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.213+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93988398138960] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.213+0000 7f77aec3f800 20 remove_watcher() i=6 2024-04-24T01:43:01.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.213+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988398142736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b61155050 con 0x7f77a4031040 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93988398142736] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f779c02d070 con 0x7f77a4031040 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 20 remove_watcher() i=7 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f77a4031040 msgr2=0x7f77a4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f77a4031040 0x7f77a4032940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b611492b0 msgr2=0x557b6114b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b611492b0 0x557b6114b770 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7794074060 msgr2=0x7f7794051730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7794074060 0x7f7794051730 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557b6114f500 msgr2=0x557b611518f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557b6114f500 0x557b611518f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f767c036950 msgr2=0x7f767c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f767c036950 0x7f767c038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557b61119180 tx=0x7f77a401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 msgr2=0x557b6113d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77ac73e640 1 -- 172.21.15.131:0/2998256103 reap_dead start 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b6113d9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f779408dd50 tx=0x7f779408dce0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 shutdown_connections 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 --2- 172.21.15.131:0/2998256103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61136370 0x557b6113d9d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 >> 172.21.15.131:0/2998256103 conn(0x557b611326d0 msgr2=0x557b6112fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 shutdown_connections 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.214+0000 7f77aec3f800 1 -- 172.21.15.131:0/2998256103 wait complete. 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7684036950 msgr2=0x7f7684038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7684036950 0x7f7684038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557b61119a00 tx=0x7f77a4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61129130 msgr2=0x557b61129550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61129130 0x557b61129550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7794044840 tx=0x7f7794002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 shutdown_connections 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7684036950 0x7f7684038e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/3074549425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61129130 0x557b61129550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 >> 172.21.15.131:0/3074549425 conn(0x557b6111d1d0 msgr2=0x557b6111d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 shutdown_connections 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/3074549425 wait complete. 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b6101a300 msgr2=0x557b61117fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b6101a300 0x557b61117fe0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7694036950 msgr2=0x7f7694038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7694036950 0x7f7694038e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7794054000 tx=0x7f779404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 msgr2=0x557b61110da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b61110da0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x557b60f8a760 tx=0x7f779c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 shutdown_connections 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557b6101a300 0x557b61117fe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7694036950 0x7f7694038e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 --2- 172.21.15.131:0/1711465548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b61017550 0x557b61110da0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 >> 172.21.15.131:0/1711465548 conn(0x557b61011470 msgr2=0x557b60f89fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 shutdown_connections 2024-04-24T01:43:01.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.215+0000 7f77aec3f800 1 -- 172.21.15.131:0/1711465548 wait complete. 2024-04-24T01:43:01.242 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:01.242 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:43:01.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:43:01.243 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:43:01.286 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:01.286 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:01.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.285+0000 7f0c90936800 1 Processor -- start 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.285+0000 7f0c90936800 1 -- start start 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.285+0000 7f0c90936800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a989bb4400 0x55a989bb67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.285+0000 7f0c90936800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a989a6ed40 con 0x55a989bb08f0 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.285+0000 7f0c90936800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55a989a414d0 con 0x55a989bb4400 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.286+0000 7f0c83ecb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a989bb4400 0x55a989bb67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.286+0000 7f0c8c6cc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55a989bb08f0 0x55a989bb2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45870/0 (socket says 172.21.15.131:45870) 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.286+0000 7f0c83ecb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a989bb4400 0x55a989bb67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37128/0 (socket says 172.21.15.131:37128) 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.286+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2992566164 learned_addr learned my addr 172.21.15.131:0/2992566164 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.286+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2992566164 >> v1:172.21.15.107:6789/0 conn(0x55a989bb08f0 legacy=0x55a989bb2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.286+0000 7f0c8becb640 1 -- 172.21.15.131:0/2992566164 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975799998 0 0) 0x55a989a6ed40 con 0x55a989bb08f0 2024-04-24T01:43:01.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.286+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2992566164 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a989a6d590 con 0x55a989bb4400 2024-04-24T01:43:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.288+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/2992566164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb4400 0x55a989bb67f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400a470 tx=0x7f0c7401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f639ad24304988c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.288+0000 7f0c8becb640 1 -- 172.21.15.131:0/2992566164 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c74057070 con 0x55a989bb4400 2024-04-24T01:43:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.288+0000 7f0c8becb640 1 -- 172.21.15.131:0/2992566164 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74052570 con 0x55a989bb4400 2024-04-24T01:43:01.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.288+0000 7f0c8becb640 1 -- 172.21.15.131:0/2992566164 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c74052870 con 0x55a989bb4400 2024-04-24T01:43:01.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.289+0000 7f0c90936800 1 -- 172.21.15.131:0/2992566164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb4400 msgr2=0x55a989bb67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.289+0000 7f0c90936800 1 --2- 172.21.15.131:0/2992566164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb4400 0x55a989bb67f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400a470 tx=0x7f0c7401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:01.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.289+0000 7f0c90936800 1 -- 172.21.15.131:0/2992566164 shutdown_connections 2024-04-24T01:43:01.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.289+0000 7f0c90936800 1 --2- 172.21.15.131:0/2992566164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb4400 0x55a989bb67f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.289+0000 7f0c90936800 1 -- 172.21.15.131:0/2992566164 >> 172.21.15.131:0/2992566164 conn(0x55a989baa320 msgr2=0x55a989bac740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.289+0000 7f0c90936800 1 -- 172.21.15.131:0/2992566164 shutdown_connections 2024-04-24T01:43:01.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.289+0000 7f0c90936800 1 -- 172.21.15.131:0/2992566164 wait complete. 2024-04-24T01:43:01.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c90936800 1 Processor -- start 2024-04-24T01:43:01.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c90936800 1 -- start start 2024-04-24T01:43:01.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c90936800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c90936800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a989afb3c0 con 0x55a989bb08f0 2024-04-24T01:43:01.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c8c6cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c8c6cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37136/0 (socket says 172.21.15.131:37136) 2024-04-24T01:43:01.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/4210571485 learned_addr learned my addr 172.21.15.131:0/4210571485 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.301+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/4210571485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a989ca1440 con 0x55a989bb08f0 2024-04-24T01:43:01.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.302+0000 7f0c8c6cc640 1 --2- 172.21.15.131:0/4210571485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca0e70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b210 tx=0x7f0c7c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15513a50ba52a5ef server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.302+0000 7f0b7a60c640 1 -- 172.21.15.131:0/4210571485 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7c008070 con 0x55a989bb08f0 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.302+0000 7f0b7a60c640 1 -- 172.21.15.131:0/4210571485 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00d500 con 0x55a989bb08f0 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.302+0000 7f0b7a60c640 1 -- 172.21.15.131:0/4210571485 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7c00d840 con 0x55a989bb08f0 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.302+0000 7f0c90936800 1 -- 172.21.15.131:0/4210571485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 msgr2=0x55a989ca0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.302+0000 7f0c90936800 1 --2- 172.21.15.131:0/4210571485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca0e70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b210 tx=0x7f0c7c00b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 -- 172.21.15.131:0/4210571485 shutdown_connections 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 --2- 172.21.15.131:0/4210571485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca0e70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 -- 172.21.15.131:0/4210571485 >> 172.21.15.131:0/4210571485 conn(0x55a989baa320 msgr2=0x55a989c9c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 -- 172.21.15.131:0/4210571485 shutdown_connections 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 -- 172.21.15.131:0/4210571485 wait complete. 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 Processor -- start 2024-04-24T01:43:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 -- start start 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c90936800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a989bb7030 con 0x55a989bb08f0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c8c6cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c8c6cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37140/0 (socket says 172.21.15.131:37140) 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.303+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/508923512 learned_addr learned my addr 172.21.15.131:0/508923512 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.304+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a989ca8f80 con 0x55a989bb08f0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.304+0000 7f0c8c6cc640 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca8a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b210 tx=0x7f0c7c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.304+0000 7f0b78e09640 1 -- 172.21.15.131:0/508923512 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7c00f950 con 0x55a989bb08f0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.304+0000 7f0b78e09640 1 -- 172.21.15.131:0/508923512 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00faf0 con 0x55a989bb08f0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.304+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a989ca9210 con 0x55a989bb08f0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.304+0000 7f0b78e09640 1 -- 172.21.15.131:0/508923512 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7c00fdd0 con 0x55a989bb08f0 2024-04-24T01:43:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.304+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a989cabec0 con 0x55a989bb08f0 2024-04-24T01:43:01.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0b78e09640 1 -- 172.21.15.131:0/508923512 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c7c017040 con 0x55a989bb08f0 2024-04-24T01:43:01.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0b78e09640 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b74036900 0x7f0b74038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0b78e09640 1 -- 172.21.15.131:0/508923512 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0c7c015020 con 0x55a989bb08f0 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b74036900 0x7f0b74038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0c90936800 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989bb4400 0x55a989cafc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cb01c0 con 0x55a989bb4400 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989bb4400 0x55a989cafc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b74036900 0x7f0b74038dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c74054000 tx=0x7f0c7404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.305+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989bb4400 0x55a989cafc80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c8cecd640 1 -- 172.21.15.131:0/508923512 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8400a4a0 con 0x55a989bb4400 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cad250 con 0x55a989bb4400 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c8cecd640 1 -- 172.21.15.131:0/508923512 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c8400a4a0 con 0x55a989bb4400 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cb1fe0 con 0x55a989bb4400 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c8cecd640 1 -- 172.21.15.131:0/508923512 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c8400a4a0 con 0x55a989bb4400 2024-04-24T01:43:01.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cb1320 con 0x55a989bb4400 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c8cecd640 1 -- 172.21.15.131:0/508923512 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c8400a4a0 con 0x55a989bb4400 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.306+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cb16c0 con 0x55a989bb4400 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c8cecd640 1 -- 172.21.15.131:0/508923512 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c8400a4a0 con 0x55a989bb4400 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c90936800 1 Processor -- start 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c90936800 1 -- start start 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c90936800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989cc0e40 0x55a989cc1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c90936800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a989aa16b0 con 0x55a989cc0e40 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c83ecb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989cc0e40 0x55a989cc1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c83ecb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989cc0e40 0x55a989cc1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37152/0 (socket says 172.21.15.131:37152) 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.307+0000 7f0c83ecb640 1 -- 172.21.15.131:0/4130272542 learned_addr learned my addr 172.21.15.131:0/4130272542 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.308+0000 7f0c83ecb640 1 -- 172.21.15.131:0/4130272542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a989cc17c0 con 0x55a989cc0e40 2024-04-24T01:43:01.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.308+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989cc0e40 0x55a989cc1280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c74044840 tx=0x7f0c74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.308+0000 7f0b71ffb640 1 -- 172.21.15.131:0/4130272542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7406f070 con 0x55a989cc0e40 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.308+0000 7f0b71ffb640 1 -- 172.21.15.131:0/4130272542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74058040 con 0x55a989cc0e40 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.308+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a989cc2150 con 0x55a989cc0e40 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.308+0000 7f0b71ffb640 1 -- 172.21.15.131:0/4130272542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c74057050 con 0x55a989cc0e40 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.308+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a989cc25f0 con 0x55a989cc0e40 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0b71ffb640 1 -- 172.21.15.131:0/4130272542 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c74072070 con 0x55a989cc0e40 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0b71ffb640 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b64036950 0x7f0b64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0b71ffb640 1 -- 172.21.15.131:0/4130272542 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0c7408faf0 con 0x55a989cc0e40 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b64036950 0x7f0b64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0c90936800 1 Processor -- start 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b64036950 0x7f0b64038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a989cb0e40 tx=0x7f0c84005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0c90936800 1 -- start start 2024-04-24T01:43:01.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0c90936800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989bb0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.309+0000 7f0c90936800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a989ca17c0 con 0x55a989bafee0 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0c83ecb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989bb0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0c83ecb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989bb0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37158/0 (socket says 172.21.15.131:37158) 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0c83ecb640 1 -- 172.21.15.131:0/1731658512 learned_addr learned my addr 172.21.15.131:0/1731658512 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0c83ecb640 1 -- 172.21.15.131:0/1731658512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a989bae6e0 con 0x55a989bafee0 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/1731658512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989bb0300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c7408deb0 tx=0x7f0c7405db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b194caa078ceda7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0b6b7fe640 1 -- 172.21.15.131:0/1731658512 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7405d510 con 0x55a989bafee0 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0b6b7fe640 1 -- 172.21.15.131:0/1731658512 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7405cc80 con 0x55a989bafee0 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.310+0000 7f0b6b7fe640 1 -- 172.21.15.131:0/1731658512 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c740018f0 con 0x55a989bafee0 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 -- 172.21.15.131:0/1731658512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 msgr2=0x55a989bb0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 --2- 172.21.15.131:0/1731658512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989bb0300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c7408deb0 tx=0x7f0c7405db30 comp rx=0 tx=0).stop 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 -- 172.21.15.131:0/1731658512 shutdown_connections 2024-04-24T01:43:01.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 --2- 172.21.15.131:0/1731658512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989bb0300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 -- 172.21.15.131:0/1731658512 >> 172.21.15.131:0/1731658512 conn(0x55a989cca380 msgr2=0x55a989cc83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 -- 172.21.15.131:0/1731658512 shutdown_connections 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 -- 172.21.15.131:0/1731658512 wait complete. 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 Processor -- start 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 -- start start 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989cd7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c90936800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a989baebb0 con 0x55a989bafee0 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c83ecb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989cd7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c83ecb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989cd7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37170/0 (socket says 172.21.15.131:37170) 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 learned_addr learned my addr 172.21.15.131:0/2916067800 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.311+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a989cd7d80 con 0x55a989bafee0 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.312+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989cd7840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c7405eb10 tx=0x7f0c7408de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.312+0000 7f0b69ffb640 1 -- 172.21.15.131:0/2916067800 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7405fa80 con 0x55a989bafee0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.312+0000 7f0b69ffb640 1 -- 172.21.15.131:0/2916067800 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74094070 con 0x55a989bafee0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.312+0000 7f0b69ffb640 1 -- 172.21.15.131:0/2916067800 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7405fd50 con 0x55a989bafee0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.312+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a989cd8010 con 0x55a989bafee0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.312+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a989cdacc0 con 0x55a989bafee0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0b69ffb640 1 -- 172.21.15.131:0/2916067800 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c7408f2d0 con 0x55a989bafee0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0b69ffb640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b5c036950 0x7f0b5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0b69ffb640 1 -- 172.21.15.131:0/2916067800 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0c740910d0 con 0x55a989bafee0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b5c036950 0x7f0b5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989ce3300 0x55a989ce57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce5ef0 con 0x55a989ce3300 2024-04-24T01:43:01.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0c8c6cc640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989ce3300 0x55a989ce57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b5c036950 0x7f0b5c038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55a989ca9860 tx=0x7f0c8401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.313+0000 7f0c8c6cc640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989ce3300 0x55a989ce57a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7c02d070 con 0x55a989ce3300 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 realm 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce6300 con 0x55a989ce3300 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7c02d070 con 0x55a989ce3300 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce6bd0 con 0x55a989ce3300 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7c02d070 con 0x55a989ce3300 2024-04-24T01:43:01.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce6f70 con 0x55a989ce3300 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c7c02d070 con 0x55a989ce3300 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce73d0 con 0x55a989ce3300 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c7c02d070 con 0x55a989ce3300 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 20 searching for the correct realm 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a989ce9420 0x55a989ceb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.314+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.315+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a989ce9420 0x55a989ceb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.315+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a989ce9420 0x55a989ceb810 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.315+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.315+0000 7f0c83ecb640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0c74074060 0x7f0c74001210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.315+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c74074060 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.315+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0c74074060 0x7f0c74001210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.315+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0c74074060 0x7f0c74001210 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.316+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8401f070 con 0x7f0c74074060 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.316+0000 7f0c8cecd640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0c84031040 0x7f0c84032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.316+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.316+0000 7f0c8c6cc640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0c84031040 0x7f0c84032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.316+0000 7f0c8c6cc640 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0c84031040 0x7f0c84032940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.316+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x7f0c84031040 2024-04-24T01:43:01.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.316+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c7c048040 con 0x55a989ce3300 2024-04-24T01:43:01.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x55a989ce3300 2024-04-24T01:43:01.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x7f0c84031040 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x7f0c84031040 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.317+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c74074060 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8401f070 con 0x7f0c74074060 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x55a989ce3300 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x7f0c84031040 2024-04-24T01:43:01.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x55a989ce3300 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.318+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c74074060 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c8401f070 con 0x7f0c74074060 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c048040 con 0x7f0c84031040 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.319+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.320+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c74074060 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8401f070 con 0x7f0c74074060 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.321+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c74074060 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8401f070 con 0x7f0c74074060 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.322+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce9420 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c84031040 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x55a989ce3300 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a989cebec0 con 0x7f0c74074060 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8401f070 con 0x7f0c74074060 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c90936800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c90936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c90936800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c90936800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c90936800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.323+0000 7f0c90936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce7ea0 con 0x55a989ce3300 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce8740 con 0x55a989ce3300 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989ce7ae0 con 0x55a989ce3300 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 zone default found 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 4 Realm: () 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:01.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 zonegroup default 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cec340 con 0x7f0c84031040 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.324+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cee1d0 con 0x55a989ce9420 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cee570 con 0x55a989ce9420 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 20 started sync module instance, tier type = 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.325+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989ced610 con 0x7f0c74074060 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.326+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c84040040 con 0x7f0c74074060 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.326+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94186649868848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989ceedc0 con 0x7f0c74074060 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.326+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cef610 con 0x55a989ce3300 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.327+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94186649868848] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c84040040 con 0x7f0c74074060 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.327+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.327+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94186649872656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cef240 con 0x55a989ce3300 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.327+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cefd50 con 0x55a989ce9420 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.328+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.328+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94186649876480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf05f0 con 0x55a989ce9420 2024-04-24T01:43:01.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.328+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf1090 con 0x7f0c74074060 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.329+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94186649872656] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.329+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94186649876480] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.329+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c84040040 con 0x7f0c74074060 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.330+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94186649878848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989ceed30 con 0x7f0c74074060 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.330+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf1970 con 0x55a989ce3300 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.331+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.331+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94186649883776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf18e0 con 0x55a989ce3300 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.331+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf28d0 con 0x7f0c84031040 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.331+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94186649878848] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c84040040 con 0x7f0c74074060 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.332+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.332+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94186649881440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf28d0 con 0x7f0c84031040 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.332+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf32e0 con 0x7f0c84031040 2024-04-24T01:43:01.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.332+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94186649883776] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.333+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94186649881440] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.333+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.333+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94186649886000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf2e30 con 0x7f0c84031040 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.333+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf37f0 con 0x7f0c84031040 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94186649886000] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94186649891648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf3c10 con 0x7f0c84031040 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c90936800 20 add_watcher() i=0 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c90936800 20 add_watcher() i=1 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c90936800 20 add_watcher() i=2 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c90936800 20 add_watcher() i=3 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c90936800 20 add_watcher() i=4 2024-04-24T01:43:01.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.335+0000 7f0c90936800 20 add_watcher() i=5 2024-04-24T01:43:01.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.336+0000 7f0c90936800 20 add_watcher() i=6 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.337+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94186649891648] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.337+0000 7f0c90936800 20 add_watcher() i=7 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.337+0000 7f0c90936800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.337+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf3c10 con 0x55a989ce3300 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.337+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.337+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94186649892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf3b80 con 0x55a989ce3300 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.338+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94186649892704] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.338+0000 7f0b427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.338+0000 7f0c90936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.338+0000 7f0c90936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.338+0000 7f0c90936800 5 note: GC not initialized 2024-04-24T01:43:01.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.338+0000 7f0b417e2640 20 reqs_thread_entry: start 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.338+0000 7f0c90936800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.339+0000 7f0c90936800 20 Filter name: none 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.339+0000 7f0ab2ffd640 20 reqs_thread_entry: start 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.339+0000 7f0c90936800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.339+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a989d29a30 con 0x55a989ce3300 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.340+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.340+0000 7f0c90936800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:43:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:01.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.341+0000 7f0b427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.341+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94186649892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989d28600 con 0x55a989ce3300 2024-04-24T01:43:01.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.342+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94186649892704] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.342+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94186649868848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf3760 con 0x7f0c74074060 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.343+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94186649868848] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c84040040 con 0x7f0c74074060 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.343+0000 7f0c90936800 20 remove_watcher() i=0 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.343+0000 7f0c90936800 2 removed watcher, disabling cache 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.343+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94186649872656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf3760 con 0x55a989ce3300 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.344+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94186649872656] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.344+0000 7f0c90936800 20 remove_watcher() i=1 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.344+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94186649876480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf3760 con 0x55a989ce9420 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.345+0000 7f0c83ecb640 1 -- 172.21.15.131:0/2916067800 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94186649876480] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c74071030 con 0x55a989ce9420 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.345+0000 7f0c90936800 20 remove_watcher() i=2 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.345+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94186649878848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cef800 con 0x7f0c74074060 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.346+0000 7f0c8cecd640 1 -- 172.21.15.131:0/2916067800 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94186649878848] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c84040040 con 0x7f0c74074060 2024-04-24T01:43:01.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.346+0000 7f0c90936800 20 remove_watcher() i=3 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.346+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94186649883776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf0140 con 0x55a989ce3300 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.347+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94186649883776] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x55a989ce3300 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.347+0000 7f0c90936800 20 remove_watcher() i=4 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.347+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94186649881440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cef800 con 0x7f0c84031040 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.348+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94186649881440] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.348+0000 7f0c90936800 20 remove_watcher() i=5 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.348+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94186649886000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf1480 con 0x7f0c84031040 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.349+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94186649886000] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.349+0000 7f0c90936800 20 remove_watcher() i=6 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.349+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94186649891648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a989cf0140 con 0x7f0c84031040 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94186649891648] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7c053080 con 0x7f0c84031040 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 20 remove_watcher() i=7 2024-04-24T01:43:01.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0c84031040 msgr2=0x7f0c84032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0c84031040 0x7f0c84032940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989ce3300 msgr2=0x55a989ce57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989ce3300 0x55a989ce57a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0c74074060 msgr2=0x7f0c74001210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0c74074060 0x7f0c74001210 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a989ce9420 msgr2=0x55a989ceb810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a989ce9420 0x55a989ceb810 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b5c036950 msgr2=0x7f0b5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b5c036950 0x7f0b5c038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55a989ca9860 tx=0x7f0c8401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 msgr2=0x55a989cd7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 --2- 172.21.15.131:0/2916067800 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bafee0 0x55a989cd7840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c7405eb10 tx=0x7f0c7408de10 comp rx=0 tx=0).stop 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 reap_dead start 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c8c6cc640 1 -- 172.21.15.131:0/2916067800 reap_dead start 2024-04-24T01:43:01.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 shutdown_connections 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 >> 172.21.15.131:0/2916067800 conn(0x55a989cca380 msgr2=0x55a989cc79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 shutdown_connections 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.350+0000 7f0c90936800 1 -- 172.21.15.131:0/2916067800 wait complete. 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b64036950 msgr2=0x7f0b64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b64036950 0x7f0b64038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a989cb0e40 tx=0x7f0c84005840 comp rx=0 tx=0).stop 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989cc0e40 msgr2=0x55a989cc1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989cc0e40 0x55a989cc1280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c74044840 tx=0x7f0c74002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 shutdown_connections 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b64036950 0x7f0b64038e10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/4130272542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989cc0e40 0x55a989cc1280 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 >> 172.21.15.131:0/4130272542 conn(0x55a989cb4e90 msgr2=0x55a989cb5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 shutdown_connections 2024-04-24T01:43:01.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/4130272542 wait complete. 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989bb4400 msgr2=0x55a989cafc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989bb4400 0x55a989cafc80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b74036900 msgr2=0x7f0b74038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b74036900 0x7f0b74038dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c74054000 tx=0x7f0c7404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 msgr2=0x55a989ca8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca8a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b210 tx=0x7f0c7c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 shutdown_connections 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a989bb4400 0x55a989cafc80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b74036900 0x7f0b74038dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 --2- 172.21.15.131:0/508923512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a989bb08f0 0x55a989ca8a40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 >> 172.21.15.131:0/508923512 conn(0x55a989baa320 msgr2=0x55a989c9af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 shutdown_connections 2024-04-24T01:43:01.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.351+0000 7f0c90936800 1 -- 172.21.15.131:0/508923512 wait complete. 2024-04-24T01:43:01.362 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:01.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:43:01.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:43:01.363 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:43:01.448 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:01.448 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.444+0000 7f5589f2d800 1 Processor -- start 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.444+0000 7f5589f2d800 1 -- start start 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.444+0000 7f5589f2d800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561e18251f90 0x561e182523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5589f2d800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561e18110d40 con 0x561e18253100 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5589f2d800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x561e180e34d0 con 0x561e18251f90 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5585b78640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561e18251f90 0x561e182523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5585b78640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561e18251f90 0x561e182523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37176/0 (socket says 172.21.15.131:37176) 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5585b78640 1 -- 172.21.15.131:0/964539973 learned_addr learned my addr 172.21.15.131:0/964539973 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5585377640 1 --1- 172.21.15.131:0/964539973 >> v1:172.21.15.107:6789/0 conn(0x561e18253100 0x561e18253580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:45872/0 (socket says 172.21.15.131:45872) 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5585b78640 1 -- 172.21.15.131:0/964539973 >> v1:172.21.15.107:6789/0 conn(0x561e18253100 legacy=0x561e18253580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.445+0000 7f5585b78640 1 -- 172.21.15.131:0/964539973 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1810f590 con 0x561e18251f90 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5585b78640 1 --2- 172.21.15.131:0/964539973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e182523b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f557800a520 tx=0x7f557801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a51f388eb6ab9f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5584b76640 1 -- 172.21.15.131:0/964539973 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5578057070 con 0x561e18251f90 2024-04-24T01:43:01.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5584b76640 1 -- 172.21.15.131:0/964539973 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5578052570 con 0x561e18251f90 2024-04-24T01:43:01.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5584b76640 1 -- 172.21.15.131:0/964539973 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5578052870 con 0x561e18251f90 2024-04-24T01:43:01.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5589f2d800 1 -- 172.21.15.131:0/964539973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 msgr2=0x561e182523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5589f2d800 1 --2- 172.21.15.131:0/964539973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e182523b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f557800a520 tx=0x7f557801ce40 comp rx=0 tx=0).stop 2024-04-24T01:43:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5589f2d800 1 -- 172.21.15.131:0/964539973 shutdown_connections 2024-04-24T01:43:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5589f2d800 1 --2- 172.21.15.131:0/964539973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e182523b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5589f2d800 1 -- 172.21.15.131:0/964539973 >> 172.21.15.131:0/964539973 conn(0x561e1824d530 msgr2=0x561e1824f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5589f2d800 1 -- 172.21.15.131:0/964539973 shutdown_connections 2024-04-24T01:43:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.447+0000 7f5589f2d800 1 -- 172.21.15.131:0/964539973 wait complete. 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.459+0000 7f5589f2d800 1 Processor -- start 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.459+0000 7f5589f2d800 1 -- start start 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.459+0000 7f5589f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e181c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.459+0000 7f5589f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561e1819d3c0 con 0x561e18251f90 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.460+0000 7f5585b78640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e181c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.460+0000 7f5585b78640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e181c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41532/0 (socket says 172.21.15.131:41532) 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.460+0000 7f5585b78640 1 -- 172.21.15.131:0/1052651691 learned_addr learned my addr 172.21.15.131:0/1052651691 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.460+0000 7f5585b78640 1 -- 172.21.15.131:0/1052651691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e181c5f60 con 0x561e18251f90 2024-04-24T01:43:01.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.460+0000 7f5585b78640 1 --2- 172.21.15.131:0/1052651691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e181c79a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5578055040 tx=0x7f557804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a4cb2eb59e3e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.460+0000 7f5473e07640 1 -- 172.21.15.131:0/1052651691 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5578057040 con 0x561e18251f90 2024-04-24T01:43:01.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5473e07640 1 -- 172.21.15.131:0/1052651691 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5578052870 con 0x561e18251f90 2024-04-24T01:43:01.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5473e07640 1 -- 172.21.15.131:0/1052651691 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5578052b90 con 0x561e18251f90 2024-04-24T01:43:01.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5589f2d800 1 -- 172.21.15.131:0/1052651691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 msgr2=0x561e181c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5589f2d800 1 --2- 172.21.15.131:0/1052651691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e181c79a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5578055040 tx=0x7f557804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5589f2d800 1 -- 172.21.15.131:0/1052651691 shutdown_connections 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5589f2d800 1 --2- 172.21.15.131:0/1052651691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e181c79a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5589f2d800 1 -- 172.21.15.131:0/1052651691 >> 172.21.15.131:0/1052651691 conn(0x561e1824d530 msgr2=0x561e1833ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5589f2d800 1 -- 172.21.15.131:0/1052651691 shutdown_connections 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.461+0000 7f5589f2d800 1 -- 172.21.15.131:0/1052651691 wait complete. 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5589f2d800 1 Processor -- start 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5589f2d800 1 -- start start 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5589f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e1834d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5589f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561e1825b5a0 con 0x561e18251f90 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5585b78640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e1834d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5585b78640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e1834d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41536/0 (socket says 172.21.15.131:41536) 2024-04-24T01:43:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5585b78640 1 -- 172.21.15.131:0/3443639563 learned_addr learned my addr 172.21.15.131:0/3443639563 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5585b78640 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1834d7d0 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5585b78640 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e1834d290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5578052540 tx=0x7f5578003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5472604640 1 -- 172.21.15.131:0/3443639563 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5578073070 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5472604640 1 -- 172.21.15.131:0/3443639563 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557805d440 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e1834da60 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.462+0000 7f5472604640 1 -- 172.21.15.131:0/3443639563 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5578057070 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.463+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e18350710 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.463+0000 7f5472604640 1 -- 172.21.15.131:0/3443639563 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5578076070 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.463+0000 7f5472604640 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f546c036950 0x7f546c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.463+0000 7f5472604640 1 -- 172.21.15.131:0/3443639563 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f557808daa0 con 0x561e18251f90 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5585377640 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f546c036950 0x7f546c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e18253100 0x561e183544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18354a10 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5586379640 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e18253100 0x561e183544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5585377640 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f546c036950 0x7f546c038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f557c00b340 tx=0x7f557c001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5586379640 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e18253100 0x561e183544d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5586379640 1 -- 172.21.15.131:0/3443639563 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f558000a4a0 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.464+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18351a80 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.465+0000 7f5586379640 1 -- 172.21.15.131:0/3443639563 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f558000a4a0 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.465+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18356820 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.465+0000 7f5586379640 1 -- 172.21.15.131:0/3443639563 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f558000a4a0 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.465+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18355b60 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.465+0000 7f5586379640 1 -- 172.21.15.131:0/3443639563 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f558000a4a0 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.465+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18355fb0 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.465+0000 7f5586379640 1 -- 172.21.15.131:0/3443639563 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f558000a4a0 con 0x561e18253100 2024-04-24T01:43:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5589f2d800 1 Processor -- start 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5589f2d800 1 -- start start 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5589f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183655f0 0x561e18365a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5589f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561e181436b0 con 0x561e183655f0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5585377640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183655f0 0x561e18365a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5585377640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183655f0 0x561e18365a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41546/0 (socket says 172.21.15.131:41546) 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5585377640 1 -- 172.21.15.131:0/3080550843 learned_addr learned my addr 172.21.15.131:0/3080550843 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.466+0000 7f5585377640 1 -- 172.21.15.131:0/3080550843 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e18365f50 con 0x561e183655f0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.467+0000 7f5585377640 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183655f0 0x561e18365a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f557c00e610 tx=0x7f557c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.467+0000 7f546b7fe640 1 -- 172.21.15.131:0/3080550843 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557c022070 con 0x561e183655f0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.467+0000 7f546b7fe640 1 -- 172.21.15.131:0/3080550843 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557c009050 con 0x561e183655f0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.467+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e183669c0 con 0x561e183655f0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.467+0000 7f546b7fe640 1 -- 172.21.15.131:0/3080550843 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557c00d7b0 con 0x561e183655f0 2024-04-24T01:43:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.467+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e18366ec0 con 0x561e183655f0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.467+0000 7f546b7fe640 1 -- 172.21.15.131:0/3080550843 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f557c025070 con 0x561e183655f0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f546b7fe640 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5460036950 0x7f5460038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f546b7fe640 1 -- 172.21.15.131:0/3080550843 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f557c04dca0 con 0x561e183655f0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5586379640 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5460036950 0x7f5460038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5589f2d800 1 Processor -- start 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5589f2d800 1 -- start start 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5586379640 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5460036950 0x7f5460038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x561e18355680 tx=0x7f5580005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5589f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18372cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5589f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561e181c6220 con 0x561e183728b0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5585377640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18372cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5585377640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18372cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41562/0 (socket says 172.21.15.131:41562) 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5585377640 1 -- 172.21.15.131:0/468910875 learned_addr learned my addr 172.21.15.131:0/468910875 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.468+0000 7f5585377640 1 -- 172.21.15.131:0/468910875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e183732a0 con 0x561e183728b0 2024-04-24T01:43:01.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5585377640 1 --2- 172.21.15.131:0/468910875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18372cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f557c04c020 tx=0x7f557c04c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b41621d9653579 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f54697fa640 1 -- 172.21.15.131:0/468910875 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557c04a030 con 0x561e183728b0 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f54697fa640 1 -- 172.21.15.131:0/468910875 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557c0263b0 con 0x561e183728b0 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f54697fa640 1 -- 172.21.15.131:0/468910875 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557c01a320 con 0x561e183728b0 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5589f2d800 1 -- 172.21.15.131:0/468910875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 msgr2=0x561e18372cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5589f2d800 1 --2- 172.21.15.131:0/468910875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18372cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f557c04c020 tx=0x7f557c04c2a0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5589f2d800 1 -- 172.21.15.131:0/468910875 shutdown_connections 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5589f2d800 1 --2- 172.21.15.131:0/468910875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18372cd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5589f2d800 1 -- 172.21.15.131:0/468910875 >> 172.21.15.131:0/468910875 conn(0x561e1836ec10 msgr2=0x561e1836cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5589f2d800 1 -- 172.21.15.131:0/468910875 shutdown_connections 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.469+0000 7f5589f2d800 1 -- 172.21.15.131:0/468910875 wait complete. 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5589f2d800 1 Processor -- start 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5589f2d800 1 -- start start 2024-04-24T01:43:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5589f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18379f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5589f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561e18373a10 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5585377640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18379f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5585377640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18379f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41572/0 (socket says 172.21.15.131:41572) 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 learned_addr learned my addr 172.21.15.131:0/860579443 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1837a490 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f5585377640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18379f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f557c024a70 tx=0x7f557c04bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.470+0000 7f54577fe640 1 -- 172.21.15.131:0/860579443 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557c045040 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.471+0000 7f54577fe640 1 -- 172.21.15.131:0/860579443 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557c01ae50 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.471+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e1837a720 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.471+0000 7f54577fe640 1 -- 172.21.15.131:0/860579443 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557c025a20 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.471+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e1837d3d0 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.471+0000 7f54577fe640 1 -- 172.21.15.131:0/860579443 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f557c025bc0 con 0x561e183728b0 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f54577fe640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5450036900 0x7f5450038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f54577fe640 1 -- 172.21.15.131:0/860579443 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f557c04afe0 con 0x561e183728b0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5586379640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5450036900 0x7f5450038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e183859a0 0x561e18387e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e183885b0 con 0x561e183859a0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5585b78640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e183859a0 0x561e18387e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5586379640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5450036900 0x7f5450038dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x561e183519f0 tx=0x7f558001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5585b78640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e183859a0 0x561e18387e60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5589f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5589f2d800 20 realm 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.472+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e183889c0 con 0x561e183859a0 2024-04-24T01:43:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18389290 con 0x561e183859a0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18389630 con 0x561e183859a0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18389a90 con 0x561e183859a0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 20 searching for the correct realm 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561e1838bae0 0x561e1838ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.473+0000 7f5585377640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561e1838bae0 0x561e1838ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.474+0000 7f5585377640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561e1838bae0 0x561e1838ded0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.474+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.474+0000 7f5585377640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f557c036070 0x7f557c036930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.474+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f557c036070 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.474+0000 7f5586379640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f557c036070 0x7f557c036930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.474+0000 7f5586379640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f557c036070 0x7f557c036930 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.475+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558001f070 con 0x7f557c036070 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.475+0000 7f5586379640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5580031040 0x7f5580032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.475+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.475+0000 7f5585b78640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5580031040 0x7f5580032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.475+0000 7f5585b78640 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5580031040 0x7f5580032430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.475+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.475+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.476+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f557c036070 2024-04-24T01:43:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558001f070 con 0x7f557c036070 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.477+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f557c036070 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f558001f070 con 0x7f557c036070 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.478+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.479+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.480+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.480+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.480+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.480+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f557c036070 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.480+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558001f070 con 0x7f557c036070 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.480+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.481+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.481+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.481+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.481+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.481+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.481+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f557c036070 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558001f070 con 0x7f557c036070 2024-04-24T01:43:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e1838bae0 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f5580031040 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.482+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x561e183859a0 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e1838e580 con 0x7f557c036070 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558001f070 con 0x7f557c036070 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e1838a530 con 0x561e183859a0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e1838add0 con 0x561e183859a0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.483+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e1838a170 con 0x561e183859a0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 zone default found 2024-04-24T01:43:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 4 Realm: () 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 zonegroup default 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e1838add0 con 0x7f5580031040 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e183903c0 con 0x561e1838bae0 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.484+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18390760 con 0x561e1838bae0 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.485+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.485+0000 7f5589f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.485+0000 7f5589f2d800 20 started sync module instance, tier type = 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.485+0000 7f5589f2d800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.485+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e1838f860 con 0x7f557c036070 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.486+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580040040 con 0x7f557c036070 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.486+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94687255395408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18391000 con 0x7f557c036070 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.486+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18391850 con 0x561e183859a0 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.486+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94687255395408] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580040040 con 0x7f557c036070 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.487+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.487+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94687255399248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18391540 con 0x561e183859a0 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.487+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18392060 con 0x561e1838bae0 2024-04-24T01:43:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.488+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.488+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94687255403312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18392900 con 0x561e1838bae0 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.488+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e183933f0 con 0x7f557c036070 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.488+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94687255399248] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.489+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94687255403312] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.489+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580040040 con 0x7f557c036070 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.489+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94687255405648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18390fb0 con 0x7f557c036070 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.489+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18393e00 con 0x561e183859a0 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.490+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94687255405648] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580040040 con 0x7f557c036070 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.490+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.490+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94687255408320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18393e00 con 0x561e183859a0 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.490+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e183946b0 con 0x7f5580031040 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.491+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.491+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94687255412224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18394220 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.491+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18395660 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.491+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94687255408320] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.492+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94687255412224] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.492+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.492+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94687255415456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18395170 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.492+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18395b30 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94687255415456] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94687255411024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18395b30 con 0x7f5580031040 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 20 add_watcher() i=0 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 20 add_watcher() i=1 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 20 add_watcher() i=2 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 20 add_watcher() i=3 2024-04-24T01:43:01.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 20 add_watcher() i=4 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 20 add_watcher() i=5 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.493+0000 7f5589f2d800 20 add_watcher() i=6 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.494+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94687255411024] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.494+0000 7f5589f2d800 20 add_watcher() i=7 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.494+0000 7f5589f2d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.494+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e18398f30 con 0x561e183859a0 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.494+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.494+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94687255418960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18396450 con 0x561e183859a0 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.495+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94687255418960] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f54377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 5 note: GC not initialized 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f54367fc640 20 reqs_thread_entry: start 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 20 Filter name: none 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f53a7fff640 20 reqs_thread_entry: start 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e183cbda0 con 0x561e183859a0 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.496+0000 7f5589f2d800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:43:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.497+0000 7f54377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.497+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94687255418960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e183ca9b0 con 0x561e183859a0 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.498+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94687255418960] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.498+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94687255395408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18395820 con 0x7f557c036070 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.499+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94687255395408] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580040040 con 0x7f557c036070 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.499+0000 7f5589f2d800 20 remove_watcher() i=0 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.499+0000 7f5589f2d800 2 removed watcher, disabling cache 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.499+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94687255399248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e1838fc50 con 0x561e183859a0 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.500+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94687255399248] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.500+0000 7f5589f2d800 20 remove_watcher() i=1 2024-04-24T01:43:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.500+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94687255403312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e1838fc50 con 0x561e1838bae0 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.501+0000 7f5585377640 1 -- 172.21.15.131:0/860579443 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94687255403312] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557c024030 con 0x561e1838bae0 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.501+0000 7f5589f2d800 20 remove_watcher() i=2 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.501+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94687255405648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18391b30 con 0x7f557c036070 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.502+0000 7f5586379640 1 -- 172.21.15.131:0/860579443 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94687255405648] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580040040 con 0x7f557c036070 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.502+0000 7f5589f2d800 20 remove_watcher() i=3 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.502+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94687255408320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18392450 con 0x561e183859a0 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.503+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94687255408320] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x561e183859a0 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.503+0000 7f5589f2d800 20 remove_watcher() i=4 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.503+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94687255412224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18392ec0 con 0x7f5580031040 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.504+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94687255412224] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.504+0000 7f5589f2d800 20 remove_watcher() i=5 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.504+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94687255415456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18392ec0 con 0x7f5580031040 2024-04-24T01:43:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.505+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94687255415456] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.505+0000 7f5589f2d800 20 remove_watcher() i=6 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.505+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94687255411024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e18394aa0 con 0x7f5580031040 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94687255411024] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5578075030 con 0x7f5580031040 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 20 remove_watcher() i=7 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5580031040 msgr2=0x7f5580032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5580031040 0x7f5580032430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e183859a0 msgr2=0x561e18387e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e183859a0 0x561e18387e60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f557c036070 msgr2=0x7f557c036930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f557c036070 0x7f557c036930 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561e1838bae0 msgr2=0x561e1838ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561e1838bae0 0x561e1838ded0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5450036900 msgr2=0x7f5450038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5450036900 0x7f5450038dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x561e183519f0 tx=0x7f558001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 msgr2=0x561e18379f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18379f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f557c024a70 tx=0x7f557c04bf80 comp rx=0 tx=0).stop 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5585b78640 1 -- 172.21.15.131:0/860579443 reap_dead start 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 shutdown_connections 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/860579443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183728b0 0x561e18379f50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 >> 172.21.15.131:0/860579443 conn(0x561e1836ec10 msgr2=0x561e1836c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 shutdown_connections 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/860579443 wait complete. 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5460036950 msgr2=0x7f5460038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5460036950 0x7f5460038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x561e18355680 tx=0x7f5580005840 comp rx=0 tx=0).stop 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183655f0 msgr2=0x561e18365a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183655f0 0x561e18365a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f557c00e610 tx=0x7f557c00ea10 comp rx=0 tx=0).stop 2024-04-24T01:43:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 shutdown_connections 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5460036950 0x7f5460038e10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3080550843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e183655f0 0x561e18365a10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 >> 172.21.15.131:0/3080550843 conn(0x561e18359690 msgr2=0x561e18359a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.506+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 shutdown_connections 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3080550843 wait complete. 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e18253100 msgr2=0x561e183544d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e18253100 0x561e183544d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f546c036950 msgr2=0x7f546c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f546c036950 0x7f546c038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f557c00b340 tx=0x7f557c001520 comp rx=0 tx=0).stop 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 msgr2=0x561e1834d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e1834d290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5578052540 tx=0x7f5578003020 comp rx=0 tx=0).stop 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 shutdown_connections 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561e18253100 0x561e183544d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f546c036950 0x7f546c038e10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 --2- 172.21.15.131:0/3443639563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e18251f90 0x561e1834d290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 >> 172.21.15.131:0/3443639563 conn(0x561e1824d530 msgr2=0x561e181c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 shutdown_connections 2024-04-24T01:43:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.507+0000 7f5589f2d800 1 -- 172.21.15.131:0/3443639563 wait complete. 2024-04-24T01:43:01.545 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:01.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-24T01:43:01.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-24T01:43:01.545 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-24T01:43:01.627 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:01.628 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4f82f800 1 Processor -- start 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4f82f800 1 -- start start 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4f82f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d8399072c0 0x55d83990fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4f82f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8397c5d40 con 0x55d839905780 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4f82f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55d8397984d0 con 0x55d8399072c0 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4a3bf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d8399072c0 0x55d83990fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4abc0640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55d839905780 0x55d839905ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56500/0 (socket says 172.21.15.131:56500) 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4abc0640 1 -- 172.21.15.131:0/950496600 learned_addr learned my addr 172.21.15.131:0/950496600 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:01.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4a3bf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d8399072c0 0x55d83990fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41580/0 (socket says 172.21.15.131:41580) 2024-04-24T01:43:01.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/950496600 >> v1:172.21.15.107:6789/0 conn(0x55d839905780 legacy=0x55d839905ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.627+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/950496600 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8397c4590 con 0x55d8399072c0 2024-04-24T01:43:01.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.629+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/950496600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d8399072c0 0x55d83990fdc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000a470 tx=0x7f6d4001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f567f59923660f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.629+0000 7f6d49bbe640 1 -- 172.21.15.131:0/950496600 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d40057070 con 0x55d8399072c0 2024-04-24T01:43:01.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.629+0000 7f6d49bbe640 1 -- 172.21.15.131:0/950496600 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d40052440 con 0x55d8399072c0 2024-04-24T01:43:01.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.629+0000 7f6d49bbe640 1 -- 172.21.15.131:0/950496600 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d40052740 con 0x55d8399072c0 2024-04-24T01:43:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.630+0000 7f6d4f82f800 1 -- 172.21.15.131:0/950496600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d8399072c0 msgr2=0x55d83990fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.630+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/950496600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d8399072c0 0x55d83990fdc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000a470 tx=0x7f6d4001ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.630+0000 7f6d4f82f800 1 -- 172.21.15.131:0/950496600 shutdown_connections 2024-04-24T01:43:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.630+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/950496600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d8399072c0 0x55d83990fdc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.630+0000 7f6d4f82f800 1 -- 172.21.15.131:0/950496600 >> 172.21.15.131:0/950496600 conn(0x55d8399013a0 msgr2=0x55d8399037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.630+0000 7f6d4f82f800 1 -- 172.21.15.131:0/950496600 shutdown_connections 2024-04-24T01:43:01.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.630+0000 7f6d4f82f800 1 -- 172.21.15.131:0/950496600 wait complete. 2024-04-24T01:43:01.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4f82f800 1 Processor -- start 2024-04-24T01:43:01.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4f82f800 1 -- start start 2024-04-24T01:43:01.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4f82f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d8399fa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4f82f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d8398523e0 con 0x55d839905780 2024-04-24T01:43:01.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4abc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d8399fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4abc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d8399fa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41592/0 (socket says 172.21.15.131:41592) 2024-04-24T01:43:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4abc0640 1 -- 172.21.15.131:0/2527744980 learned_addr learned my addr 172.21.15.131:0/2527744980 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.642+0000 7f6d4abc0640 1 -- 172.21.15.131:0/2527744980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8399fab40 con 0x55d839905780 2024-04-24T01:43:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4abc0640 1 --2- 172.21.15.131:0/2527744980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d8399fa570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c001de0 tx=0x7f6d3c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7dea696b5a8058 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6c38e09640 1 -- 172.21.15.131:0/2527744980 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c012020 con 0x55d839905780 2024-04-24T01:43:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6c38e09640 1 -- 172.21.15.131:0/2527744980 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00e5a0 con 0x55d839905780 2024-04-24T01:43:01.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6c38e09640 1 -- 172.21.15.131:0/2527744980 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c00e8c0 con 0x55d839905780 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4f82f800 1 -- 172.21.15.131:0/2527744980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 msgr2=0x55d8399fa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/2527744980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d8399fa570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c001de0 tx=0x7f6d3c00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4f82f800 1 -- 172.21.15.131:0/2527744980 shutdown_connections 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/2527744980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d8399fa570 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4f82f800 1 -- 172.21.15.131:0/2527744980 >> 172.21.15.131:0/2527744980 conn(0x55d8399013a0 msgr2=0x55d8399f5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4f82f800 1 -- 172.21.15.131:0/2527744980 shutdown_connections 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.643+0000 7f6d4f82f800 1 -- 172.21.15.131:0/2527744980 wait complete. 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4f82f800 1 Processor -- start 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4f82f800 1 -- start start 2024-04-24T01:43:01.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4f82f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d839a020c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4f82f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d8399125e0 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4abc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d839a020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4abc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d839a020c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41604/0 (socket says 172.21.15.131:41604) 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4abc0640 1 -- 172.21.15.131:0/1515474900 learned_addr learned my addr 172.21.15.131:0/1515474900 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.644+0000 7f6d4abc0640 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d839a02600 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.645+0000 7f6d4abc0640 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d839a020c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c010 tx=0x7f6d3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.645+0000 7f6c37606640 1 -- 172.21.15.131:0/1515474900 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c012070 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.645+0000 7f6c37606640 1 -- 172.21.15.131:0/1515474900 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c01a7a0 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.645+0000 7f6c37606640 1 -- 172.21.15.131:0/1515474900 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c01aa80 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.645+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d839a02890 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.645+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d839a05540 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6c37606640 1 -- 172.21.15.131:0/1515474900 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d3c015020 con 0x55d839905780 2024-04-24T01:43:01.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6c37606640 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c30036950 0x7f6c30038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6c37606640 1 -- 172.21.15.131:0/1515474900 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f6d3c020070 con 0x55d839905780 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c30036950 0x7f6c30038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d8399072c0 0x55d839a09300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a09880 con 0x55d8399072c0 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d8399072c0 0x55d839a09300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c30036950 0x7f6c30038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d40054000 tx=0x7f6d4004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.646+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d8399072c0 0x55d839a09300 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/1515474900 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d4400a4a0 con 0x55d8399072c0 2024-04-24T01:43:01.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a068b0 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/1515474900 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d4400a4a0 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a0b6d0 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/1515474900 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d4400a4a0 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a0aa10 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/1515474900 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d4400a4a0 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.647+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a0ae30 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/1515474900 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d4400a4a0 con 0x55d8399072c0 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4f82f800 1 Processor -- start 2024-04-24T01:43:01.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4f82f800 1 -- start start 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4f82f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a1a4c0 0x55d839a1a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4f82f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d8397f86b0 con 0x55d839a1a4c0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4a3bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a1a4c0 0x55d839a1a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4a3bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a1a4c0 0x55d839a1a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41620/0 (socket says 172.21.15.131:41620) 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.648+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/3825371075 learned_addr learned my addr 172.21.15.131:0/3825371075 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.649+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/3825371075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d839a1ae20 con 0x55d839a1a4c0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.649+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a1a4c0 0x55d839a1a8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d40044840 tx=0x7f6d40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.649+0000 7f6c34e01640 1 -- 172.21.15.131:0/3825371075 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4006f070 con 0x55d839a1a4c0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.649+0000 7f6c34e01640 1 -- 172.21.15.131:0/3825371075 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d40058040 con 0x55d839a1a4c0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.649+0000 7f6c34e01640 1 -- 172.21.15.131:0/3825371075 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d40057050 con 0x55d839a1a4c0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.649+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d839a1b890 con 0x55d839a1a4c0 2024-04-24T01:43:01.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.649+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d839a1bd30 con 0x55d839a1a4c0 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.650+0000 7f6c34e01640 1 -- 172.21.15.131:0/3825371075 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d40072070 con 0x55d839a1a4c0 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.650+0000 7f6c34e01640 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c24036900 0x7f6c24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.650+0000 7f6c34e01640 1 -- 172.21.15.131:0/3825371075 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f6d4008f8a0 con 0x55d839a1a4c0 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.650+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c24036900 0x7f6c24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.650+0000 7f6d4f82f800 1 Processor -- start 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.650+0000 7f6d4f82f800 1 -- start start 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.650+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c24036900 0x7f6c24038dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55d839a0adb0 tx=0x7f6d44005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6d4f82f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a27b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6d4f82f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d8399faec0 con 0x55d839a27720 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6d4a3bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a27b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6d4a3bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a27b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41634/0 (socket says 172.21.15.131:41634) 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/3427583701 learned_addr learned my addr 172.21.15.131:0/3427583701 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/3427583701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d839a28110 con 0x55d839a27720 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/3427583701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a27b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6d4008dbf0 tx=0x7f6d4008ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88978feb8a77743a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6c2e7fc640 1 -- 172.21.15.131:0/3427583701 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4005e480 con 0x55d839a27720 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6c2e7fc640 1 -- 172.21.15.131:0/3427583701 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4005faf0 con 0x55d839a27720 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.651+0000 7f6c2e7fc640 1 -- 172.21.15.131:0/3427583701 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4005e620 con 0x55d839a27720 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3427583701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 msgr2=0x55d839a27b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/3427583701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a27b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6d4008dbf0 tx=0x7f6d4008ded0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3427583701 shutdown_connections 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/3427583701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a27b40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3427583701 >> 172.21.15.131:0/3427583701 conn(0x55d839a23a40 msgr2=0x55d839a21aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3427583701 shutdown_connections 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3427583701 wait complete. 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 Processor -- start 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 -- start start 2024-04-24T01:43:01.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a2ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4f82f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d839a28890 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4a3bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a2ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4a3bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a2ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41638/0 (socket says 172.21.15.131:41638) 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.652+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 learned_addr learned my addr 172.21.15.131:0/676917277 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.653+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d839a2f290 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.653+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a2ed50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d40052ce0 tx=0x7f6d4008db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.653+0000 7f6c2cff9640 1 -- 172.21.15.131:0/676917277 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d40093020 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.653+0000 7f6c2cff9640 1 -- 172.21.15.131:0/676917277 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4008fdd0 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.653+0000 7f6c2cff9640 1 -- 172.21.15.131:0/676917277 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d40069730 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.653+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d839a2f520 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.653+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d839a321d0 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6c2cff9640 1 -- 172.21.15.131:0/676917277 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d40096020 con 0x55d839a27720 2024-04-24T01:43:01.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6c2cff9640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c140368b0 0x7f6c14038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6c2cff9640 1 -- 172.21.15.131:0/676917277 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f6d40099c40 con 0x55d839a27720 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c140368b0 0x7f6c14038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c140368b0 0x7f6c14038d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55d839a0a530 tx=0x7f6d4401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d839a3a860 0x55d839a3cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3d470 con 0x55d839a3a860 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.654+0000 7f6d4abc0640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d839a3a860 0x55d839a3cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4abc0640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d839a3a860 0x55d839a3cd20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 realm 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3d880 con 0x55d839a3a860 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3e150 con 0x55d839a3a860 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3e4f0 con 0x55d839a3a860 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.655+0000 7f6d4f82f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3ed40 con 0x55d839a3a860 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4f82f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4f82f800 20 searching for the correct realm 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d839a40ab0 0x55d839a42ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d839a40ab0 0x55d839a42ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d839a40ab0 0x55d839a42ea0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4a3bf640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6d400a3040 0x7f6d400818a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.656+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d400a3040 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.657+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6d400a3040 0x7f6d400818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.657+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6d400a3040 0x7f6d400818a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.657+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4401f070 con 0x7f6d400a3040 2024-04-24T01:43:01.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.657+0000 7f6d4b3c1640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6d44031040 0x7f6d44032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.657+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.657+0000 7f6d4abc0640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6d44031040 0x7f6d44032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.658+0000 7f6d4abc0640 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6d44031040 0x7f6d44032430 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.658+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.658+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.658+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.658+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.658+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.658+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d400a3040 2024-04-24T01:43:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4401f070 con 0x7f6d400a3040 2024-04-24T01:43:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.659+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.660+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.660+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.660+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.660+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.660+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d400a3040 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.660+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d4401f070 con 0x7f6d400a3040 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.660+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.661+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.662+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d400a3040 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4401f070 con 0x7f6d400a3040 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.663+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d400a3040 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4401f070 con 0x7f6d400a3040 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a40ab0 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.664+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d44031040 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x55d839a3a860 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43480 con 0x7f6d400a3040 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4401f070 con 0x7f6d400a3040 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.665+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3f6c0 con 0x55d839a3a860 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3ff60 con 0x55d839a3a860 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a3ff60 con 0x55d839a3a860 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 zone default found 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 4 Realm: () 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 zonegroup default 2024-04-24T01:43:01.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a43900 con 0x7f6d44031040 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.666+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a45310 con 0x55d839a40ab0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a45830 con 0x55d839a40ab0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4f82f800 20 started sync module instance, tier type = 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4f82f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:01.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.667+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a44780 con 0x7f6d400a3040 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.668+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.668+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94387168365424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a443e0 con 0x7f6d400a3040 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.668+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a46760 con 0x55d839a3a860 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.669+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94387168365424] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.669+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.669+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94387168369808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a46760 con 0x55d839a3a860 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.669+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a47160 con 0x55d839a40ab0 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.670+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.670+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94387168373872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a47a00 con 0x55d839a40ab0 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.670+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a48470 con 0x7f6d400a3040 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.671+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94387168369808] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.671+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.671+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94387168378688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a48860 con 0x7f6d400a3040 2024-04-24T01:43:01.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.671+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a492c0 con 0x55d839a3a860 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.671+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94387168373872] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.673+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94387168378688] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.673+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.673+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94387168371376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a492c0 con 0x55d839a3a860 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.673+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a49b60 con 0x7f6d44031040 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.674+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.674+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94387168383680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a49c30 con 0x7f6d44031040 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.674+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a4a750 con 0x7f6d44031040 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.674+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94387168371376] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.675+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94387168383680] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.676+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.676+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94387168384736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a47550 con 0x7f6d44031040 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.676+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a4abc0 con 0x7f6d44031040 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94387168384736] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94387168388880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a4afe0 con 0x7f6d44031040 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 20 add_watcher() i=0 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 20 add_watcher() i=1 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 20 add_watcher() i=2 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 20 add_watcher() i=3 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 20 add_watcher() i=4 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 20 add_watcher() i=5 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.677+0000 7f6d4f82f800 20 add_watcher() i=6 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.678+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94387168388880] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.678+0000 7f6d4f82f800 20 add_watcher() i=7 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.678+0000 7f6d4f82f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.678+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a4afe0 con 0x55d839a3a860 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.678+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.678+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94387168389936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a4af80 con 0x55d839a3a860 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.679+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94387168389936] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.679+0000 7f6c017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.679+0000 7f6d4f82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.679+0000 7f6d4f82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.679+0000 7f6d4f82f800 5 note: GC not initialized 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6b7bfff640 20 reqs_thread_entry: start 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 20 Filter name: none 2024-04-24T01:43:01.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6b79ffb640 20 reqs_thread_entry: start 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a81330 con 0x55d839a3a860 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a82070 con 0x7f6d400a3040 2024-04-24T01:43:01.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-24T01:43:01.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T01:43:01.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-24T01:43:01.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.680+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a87e40 con 0x55d839a3a860 2024-04-24T01:43:01.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4f82f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4f82f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4f82f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94387168639184 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a83950 con 0x55d839a3a860 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94387168371376 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55d839a05540 con 0x55d839a3a860 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6c2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94387168371376 notifier 4387 bl.length()=849 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(65 notify.4 [notify cookie 94387168639184 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6c2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6c2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6c2e7fc640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6c10003ea0 con 0x55d839a3a860 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== watch-notify(notify_complete (2) cookie 94387168639184 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d839a02890 con 0x55d839a3a860 2024-04-24T01:43:01.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.682+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a878d0 con 0x7f6d400a3040 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4f82f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4f82f800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4f82f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94387168639184 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d839a83950 con 0x7f6d400a3040 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== watch-notify(notify (1) cookie 94387168365424 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f6d44024890 con 0x7f6d400a3040 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6c2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94387168365424 notifier 4387 bl.length()=166 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.0 [notify cookie 94387168639184 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6c2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6c2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6c2e7fc640 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6c10003ea0 con 0x7f6d400a3040 2024-04-24T01:43:01.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.684+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== watch-notify(notify_complete (2) cookie 94387168639184 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d44032a40 con 0x7f6d400a3040 2024-04-24T01:43:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:43:01.682776Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.685+0000 7f6c017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.685+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94387168389936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a83950 con 0x55d839a3a860 2024-04-24T01:43:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.686+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94387168389936] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.686+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94387168365424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a83950 con 0x7f6d400a3040 2024-04-24T01:43:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.687+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94387168365424] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.687+0000 7f6d4f82f800 20 remove_watcher() i=0 2024-04-24T01:43:01.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.687+0000 7f6d4f82f800 2 removed watcher, disabling cache 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.687+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94387168369808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a83950 con 0x55d839a3a860 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.688+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94387168369808] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.688+0000 7f6d4f82f800 20 remove_watcher() i=1 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.688+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94387168373872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a83950 con 0x55d839a40ab0 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.689+0000 7f6d4a3bf640 1 -- 172.21.15.131:0/676917277 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94387168373872] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d40071030 con 0x55d839a40ab0 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.689+0000 7f6d4f82f800 20 remove_watcher() i=2 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.689+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94387168378688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a44b70 con 0x7f6d400a3040 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.690+0000 7f6d4b3c1640 1 -- 172.21.15.131:0/676917277 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94387168378688] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d44040040 con 0x7f6d400a3040 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.690+0000 7f6d4f82f800 20 remove_watcher() i=3 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.690+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94387168371376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a47f40 con 0x55d839a3a860 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.691+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94387168371376] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x55d839a3a860 2024-04-24T01:43:01.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.691+0000 7f6d4f82f800 20 remove_watcher() i=4 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.691+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94387168383680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a44b70 con 0x7f6d44031040 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.692+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94387168383680] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.692+0000 7f6d4f82f800 20 remove_watcher() i=5 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.692+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94387168384736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a462b0 con 0x7f6d44031040 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.693+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94387168384736] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.693+0000 7f6d4f82f800 20 remove_watcher() i=6 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.693+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94387168388880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d839a47f40 con 0x7f6d44031040 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94387168388880] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c02b070 con 0x7f6d44031040 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 20 remove_watcher() i=7 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6d44031040 msgr2=0x7f6d44032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6d44031040 0x7f6d44032430 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d839a3a860 msgr2=0x55d839a3cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d839a3a860 0x55d839a3cd20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6d400a3040 msgr2=0x7f6d400818a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6d400a3040 0x7f6d400818a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d839a40ab0 msgr2=0x55d839a42ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d839a40ab0 0x55d839a42ea0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c140368b0 msgr2=0x7f6c14038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c140368b0 0x7f6c14038d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55d839a0a530 tx=0x7f6d4401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 msgr2=0x55d839a2ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/676917277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a27720 0x55d839a2ed50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d40052ce0 tx=0x7f6d4008db80 comp rx=0 tx=0).stop 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4abc0640 1 -- 172.21.15.131:0/676917277 reap_dead start 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 shutdown_connections 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 >> 172.21.15.131:0/676917277 conn(0x55d839a23a40 msgr2=0x55d839a210a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 shutdown_connections 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.694+0000 7f6d4f82f800 1 -- 172.21.15.131:0/676917277 wait complete. 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c24036900 msgr2=0x7f6c24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c24036900 0x7f6c24038dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55d839a0adb0 tx=0x7f6d44005840 comp rx=0 tx=0).stop 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a1a4c0 msgr2=0x55d839a1a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a1a4c0 0x55d839a1a8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d40044840 tx=0x7f6d40002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 shutdown_connections 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c24036900 0x7f6c24038dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/3825371075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839a1a4c0 0x55d839a1a8e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 >> 172.21.15.131:0/3825371075 conn(0x55d839a0e560 msgr2=0x55d839a0e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 shutdown_connections 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/3825371075 wait complete. 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d8399072c0 msgr2=0x55d839a09300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d8399072c0 0x55d839a09300 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c30036950 msgr2=0x7f6c30038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c30036950 0x7f6c30038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d40054000 tx=0x7f6d4004e000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 msgr2=0x55d839a020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d839a020c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c010 tx=0x7f6d3c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 shutdown_connections 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d8399072c0 0x55d839a09300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6c30036950 0x7f6c30038e10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 --2- 172.21.15.131:0/1515474900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d839905780 0x55d839a020c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 >> 172.21.15.131:0/1515474900 conn(0x55d8399013a0 msgr2=0x55d8399f4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 shutdown_connections 2024-04-24T01:43:01.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.695+0000 7f6d4f82f800 1 -- 172.21.15.131:0/1515474900 wait complete. 2024-04-24T01:43:01.710 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:43:01.682776Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:01.710 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:43:01.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:43:01.711 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:43:01.753 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:01.753 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.752+0000 7fefa4775800 1 Processor -- start 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.752+0000 7fefa4775800 1 -- start start 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.752+0000 7fefa4775800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c05f12a300 0x55c05f132e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.752+0000 7fefa4775800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c05efe8d40 con 0x55c05f1287c0 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.752+0000 7fefa4775800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55c05efbb4d0 con 0x55c05f12a300 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.753+0000 7fef99a73640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c05f12a300 0x55c05f132e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.753+0000 7fef99a73640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c05f12a300 0x55c05f132e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41654/0 (socket says 172.21.15.131:41654) 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.753+0000 7fef99a73640 1 -- 172.21.15.131:0/1476055240 learned_addr learned my addr 172.21.15.131:0/1476055240 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.753+0000 7fefa2274640 1 --1- 172.21.15.131:0/1476055240 >> v1:172.21.15.107:6789/0 conn(0x55c05f1287c0 0x55c05f128be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56516/0 (socket says 172.21.15.131:56516) 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.753+0000 7fef99a73640 1 -- 172.21.15.131:0/1476055240 >> v1:172.21.15.107:6789/0 conn(0x55c05f1287c0 legacy=0x55c05f128be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.753+0000 7fefa1a73640 1 -- 172.21.15.131:0/1476055240 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334926562 0 0) 0x55c05efe8d40 con 0x55c05f1287c0 2024-04-24T01:43:01.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.753+0000 7fef99a73640 1 -- 172.21.15.131:0/1476055240 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05efe7590 con 0x55c05f12a300 2024-04-24T01:43:01.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.755+0000 7fef99a73640 1 --2- 172.21.15.131:0/1476055240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f12a300 0x55c05f132e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00a520 tx=0x7fef8c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8dc6697986238b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.755+0000 7fefa1a73640 1 -- 172.21.15.131:0/1476055240 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c057070 con 0x55c05f12a300 2024-04-24T01:43:01.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.755+0000 7fefa1a73640 1 -- 172.21.15.131:0/1476055240 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c052570 con 0x55c05f12a300 2024-04-24T01:43:01.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.755+0000 7fefa1a73640 1 -- 172.21.15.131:0/1476055240 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c04ae60 con 0x55c05f12a300 2024-04-24T01:43:01.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.756+0000 7fefa4775800 1 -- 172.21.15.131:0/1476055240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f12a300 msgr2=0x55c05f132e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.756+0000 7fefa4775800 1 --2- 172.21.15.131:0/1476055240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f12a300 0x55c05f132e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00a520 tx=0x7fef8c01d010 comp rx=0 tx=0).stop 2024-04-24T01:43:01.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.756+0000 7fefa4775800 1 -- 172.21.15.131:0/1476055240 shutdown_connections 2024-04-24T01:43:01.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.756+0000 7fefa4775800 1 --2- 172.21.15.131:0/1476055240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f12a300 0x55c05f132e00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.756+0000 7fefa4775800 1 -- 172.21.15.131:0/1476055240 >> 172.21.15.131:0/1476055240 conn(0x55c05f124320 msgr2=0x55c05f126740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.756+0000 7fefa4775800 1 -- 172.21.15.131:0/1476055240 shutdown_connections 2024-04-24T01:43:01.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.756+0000 7fefa4775800 1 -- 172.21.15.131:0/1476055240 wait complete. 2024-04-24T01:43:01.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.767+0000 7fefa4775800 1 Processor -- start 2024-04-24T01:43:01.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.767+0000 7fefa4775800 1 -- start start 2024-04-24T01:43:01.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.767+0000 7fefa4775800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f21d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.767+0000 7fefa4775800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c05f0753c0 con 0x55c05f1287c0 2024-04-24T01:43:01.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.768+0000 7fefa2274640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f21d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.768+0000 7fefa2274640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f21d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41664/0 (socket says 172.21.15.131:41664) 2024-04-24T01:43:01.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.768+0000 7fefa2274640 1 -- 172.21.15.131:0/1951267732 learned_addr learned my addr 172.21.15.131:0/1951267732 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.768+0000 7fefa2274640 1 -- 172.21.15.131:0/1951267732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05f21d9b0 con 0x55c05f1287c0 2024-04-24T01:43:01.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.768+0000 7fefa2274640 1 --2- 172.21.15.131:0/1951267732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f21d3e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b210 tx=0x7fef9400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae277695091945e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.768+0000 7fee90608640 1 -- 172.21.15.131:0/1951267732 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef94008070 con 0x55c05f1287c0 2024-04-24T01:43:01.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fee90608640 1 -- 172.21.15.131:0/1951267732 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9400d500 con 0x55c05f1287c0 2024-04-24T01:43:01.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fee90608640 1 -- 172.21.15.131:0/1951267732 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9400d840 con 0x55c05f1287c0 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 -- 172.21.15.131:0/1951267732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 msgr2=0x55c05f21d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 --2- 172.21.15.131:0/1951267732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f21d3e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b210 tx=0x7fef9400b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 -- 172.21.15.131:0/1951267732 shutdown_connections 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 --2- 172.21.15.131:0/1951267732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f21d3e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 -- 172.21.15.131:0/1951267732 >> 172.21.15.131:0/1951267732 conn(0x55c05f124320 msgr2=0x55c05f218d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 -- 172.21.15.131:0/1951267732 shutdown_connections 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 -- 172.21.15.131:0/1951267732 wait complete. 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.769+0000 7fefa4775800 1 Processor -- start 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa4775800 1 -- start start 2024-04-24T01:43:01.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa4775800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f225070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa4775800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c05f135620 con 0x55c05f1287c0 2024-04-24T01:43:01.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa2274640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f225070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa2274640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f225070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41666/0 (socket says 172.21.15.131:41666) 2024-04-24T01:43:01.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa2274640 1 -- 172.21.15.131:0/1702954143 learned_addr learned my addr 172.21.15.131:0/1702954143 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa2274640 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05f2255b0 con 0x55c05f1287c0 2024-04-24T01:43:01.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.770+0000 7fefa2274640 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f225070 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b210 tx=0x7fef94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.771+0000 7fee8ee05640 1 -- 172.21.15.131:0/1702954143 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9400f950 con 0x55c05f1287c0 2024-04-24T01:43:01.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.771+0000 7fee8ee05640 1 -- 172.21.15.131:0/1702954143 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9400faf0 con 0x55c05f1287c0 2024-04-24T01:43:01.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.771+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c05f225840 con 0x55c05f1287c0 2024-04-24T01:43:01.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.771+0000 7fee8ee05640 1 -- 172.21.15.131:0/1702954143 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9400fdd0 con 0x55c05f1287c0 2024-04-24T01:43:01.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.771+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05f2284a0 con 0x55c05f1287c0 2024-04-24T01:43:01.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.771+0000 7fee8ee05640 1 -- 172.21.15.131:0/1702954143 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fef94017040 con 0x55c05f1287c0 2024-04-24T01:43:01.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.771+0000 7fee8ee05640 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee88036950 0x7fee88038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fee8ee05640 1 -- 172.21.15.131:0/1702954143 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fef94015020 con 0x55c05f1287c0 2024-04-24T01:43:01.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fef99a73640 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee88036950 0x7fee88038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fefa4775800 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f12a300 0x55c05f22c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f22c7a0 con 0x55c05f12a300 2024-04-24T01:43:01.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fefa2a75640 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f12a300 0x55c05f22c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fef99a73640 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee88036950 0x7fee88038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef8c054000 tx=0x7fef8c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fefa2a75640 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f12a300 0x55c05f22c260 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fefa2a75640 1 -- 172.21.15.131:0/1702954143 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9c00a4a0 con 0x55c05f12a300 2024-04-24T01:43:01.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.772+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f229830 con 0x55c05f12a300 2024-04-24T01:43:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.773+0000 7fefa2a75640 1 -- 172.21.15.131:0/1702954143 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef9c00a4a0 con 0x55c05f12a300 2024-04-24T01:43:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.773+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f22e610 con 0x55c05f12a300 2024-04-24T01:43:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.773+0000 7fefa2a75640 1 -- 172.21.15.131:0/1702954143 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef9c00a4a0 con 0x55c05f12a300 2024-04-24T01:43:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.773+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f22d950 con 0x55c05f12a300 2024-04-24T01:43:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.773+0000 7fefa2a75640 1 -- 172.21.15.131:0/1702954143 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef9c00a4a0 con 0x55c05f12a300 2024-04-24T01:43:01.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.773+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f22dcf0 con 0x55c05f12a300 2024-04-24T01:43:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.773+0000 7fefa2a75640 1 -- 172.21.15.131:0/1702954143 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef9c00a4a0 con 0x55c05f12a300 2024-04-24T01:43:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.774+0000 7fefa4775800 1 Processor -- start 2024-04-24T01:43:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.774+0000 7fefa4775800 1 -- start start 2024-04-24T01:43:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.774+0000 7fefa4775800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f23d3c0 0x55c05f23d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.774+0000 7fefa4775800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c05f01b6b0 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.774+0000 7fef99a73640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f23d3c0 0x55c05f23d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.774+0000 7fef99a73640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f23d3c0 0x55c05f23d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41668/0 (socket says 172.21.15.131:41668) 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.774+0000 7fef99a73640 1 -- 172.21.15.131:0/1273937007 learned_addr learned my addr 172.21.15.131:0/1273937007 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.775+0000 7fef99a73640 1 -- 172.21.15.131:0/1273937007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05f23dd20 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.775+0000 7fef99a73640 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f23d3c0 0x55c05f23d7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fef8c055040 tx=0x7fef8c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.775+0000 7fee87fff640 1 -- 172.21.15.131:0/1273937007 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c057040 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.775+0000 7fee87fff640 1 -- 172.21.15.131:0/1273937007 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c06d070 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.775+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c05f23e790 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.775+0000 7fee87fff640 1 -- 172.21.15.131:0/1273937007 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c05d440 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.775+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05f23ec30 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fee87fff640 1 -- 172.21.15.131:0/1273937007 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fef8c067070 con 0x55c05f23d3c0 2024-04-24T01:43:01.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fee87fff640 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee7c036950 0x7fee7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fee87fff640 1 -- 172.21.15.131:0/1273937007 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fef8c08f450 con 0x55c05f23d3c0 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fefa2a75640 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee7c036950 0x7fee7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fefa4775800 1 Processor -- start 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fefa2a75640 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee7c036950 0x7fee7c038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55c05f22d470 tx=0x7fef9c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fefa4775800 1 -- start start 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fefa4775800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f24aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.776+0000 7fefa4775800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c05f21dd30 con 0x55c05f24a600 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fef99a73640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f24aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fef99a73640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f24aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41674/0 (socket says 172.21.15.131:41674) 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fef99a73640 1 -- 172.21.15.131:0/2355315769 learned_addr learned my addr 172.21.15.131:0/2355315769 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fef99a73640 1 -- 172.21.15.131:0/2355315769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05f24aff0 con 0x55c05f24a600 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fef99a73640 1 --2- 172.21.15.131:0/2355315769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f24aa20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0674a0 tx=0x7fef8c000f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc33387d9cb99ca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fee85ffb640 1 -- 172.21.15.131:0/2355315769 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c081070 con 0x55c05f24a600 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fee85ffb640 1 -- 172.21.15.131:0/2355315769 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c08f0d0 con 0x55c05f24a600 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fee85ffb640 1 -- 172.21.15.131:0/2355315769 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c072460 con 0x55c05f24a600 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fefa4775800 1 -- 172.21.15.131:0/2355315769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 msgr2=0x55c05f24aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fefa4775800 1 --2- 172.21.15.131:0/2355315769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f24aa20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0674a0 tx=0x7fef8c000f90 comp rx=0 tx=0).stop 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fefa4775800 1 -- 172.21.15.131:0/2355315769 shutdown_connections 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fefa4775800 1 --2- 172.21.15.131:0/2355315769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f24aa20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.777+0000 7fefa4775800 1 -- 172.21.15.131:0/2355315769 >> 172.21.15.131:0/2355315769 conn(0x55c05f246960 msgr2=0x55c05f2449c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fefa4775800 1 -- 172.21.15.131:0/2355315769 shutdown_connections 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fefa4775800 1 -- 172.21.15.131:0/2355315769 wait complete. 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fefa4775800 1 Processor -- start 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fefa4775800 1 -- start start 2024-04-24T01:43:01.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fefa4775800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f251cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fefa4775800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c05f24b760 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fef99a73640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f251cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fef99a73640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f251cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41676/0 (socket says 172.21.15.131:41676) 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 learned_addr learned my addr 172.21.15.131:0/369813051 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.778+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05f252200 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.779+0000 7fef99a73640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f251cc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0674a0 tx=0x7fef8c08d7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.779+0000 7fee73fff640 1 -- 172.21.15.131:0/369813051 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c081040 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.779+0000 7fee73fff640 1 -- 172.21.15.131:0/369813051 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c094070 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.779+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c05f252490 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.779+0000 7fee73fff640 1 -- 172.21.15.131:0/369813051 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8c0713c0 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.779+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05f255140 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.779+0000 7fee73fff640 1 -- 172.21.15.131:0/369813051 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fef8c084070 con 0x55c05f24a600 2024-04-24T01:43:01.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fee73fff640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee6c036950 0x7fee6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fee73fff640 1 -- 172.21.15.131:0/369813051 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fef8c0910d0 con 0x55c05f24a600 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa2a75640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee6c036950 0x7fee6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f25d7b0 0x55c05f25fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f2603a0 con 0x55c05f25d7b0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa2274640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f25d7b0 0x55c05f25fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa2a75640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee6c036950 0x7fee6c038e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55c05f225e90 tx=0x7fef9c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa2274640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f25d7b0 0x55c05f25fc50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9402d070 con 0x55c05f25d7b0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa4775800 20 realm 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.780+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f2607b0 con 0x55c05f25d7b0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9402d070 con 0x55c05f25d7b0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f261080 con 0x55c05f25d7b0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9402d070 con 0x55c05f25d7b0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f261420 con 0x55c05f25d7b0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef9402d070 con 0x55c05f25d7b0 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f261880 con 0x55c05f25d7b0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef9402d070 con 0x55c05f25d7b0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 20 searching for the correct realm 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c05f2638d0 0x55c05f265cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.781+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.782+0000 7fef99a73640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c05f2638d0 0x55c05f265cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.782+0000 7fef99a73640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c05f2638d0 0x55c05f265cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.782+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.782+0000 7fef99a73640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fef8c05c3e0 0x7fef8c08fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.782+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef8c05c3e0 2024-04-24T01:43:01.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.782+0000 7fefa2a75640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fef8c05c3e0 0x7fef8c08fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.782+0000 7fefa2a75640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fef8c05c3e0 0x7fef8c08fa80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.783+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c01f070 con 0x7fef8c05c3e0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.783+0000 7fefa2a75640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fef9c031040 0x7fef9c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.783+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.783+0000 7fefa2274640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fef9c031040 0x7fef9c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.783+0000 7fefa2274640 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fef9c031040 0x7fef9c032430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.783+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.783+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef8c05c3e0 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c01f070 con 0x7fef8c05c3e0 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.784+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.785+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef8c05c3e0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef9c01f070 con 0x7fef8c05c3e0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.786+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.787+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef8c05c3e0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c01f070 con 0x7fef8c05c3e0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.788+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef8c05c3e0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c01f070 con 0x7fef8c05c3e0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.789+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f2638d0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef9c031040 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x55c05f25d7b0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05f266370 con 0x7fef8c05c3e0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c01f070 con 0x7fef8c05c3e0 2024-04-24T01:43:01.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.790+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f262320 con 0x55c05f25d7b0 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f262bc0 con 0x55c05f25d7b0 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f261f60 con 0x55c05f25d7b0 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 zone default found 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 4 Realm: () 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 zonegroup default 2024-04-24T01:43:01.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f2667d0 con 0x7fef9c031040 2024-04-24T01:43:01.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.791+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f268660 con 0x55c05f2638d0 2024-04-24T01:43:01.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fefa4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f268a00 con 0x55c05f2638d0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fefa4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fefa4775800 20 started sync module instance, tier type = 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fefa4775800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.792+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f267aa0 con 0x7fef8c05c3e0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.793+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c040040 con 0x7fef8c05c3e0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.793+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94284718440080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f2682b0 con 0x7fef8c05c3e0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.793+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f269780 con 0x55c05f25d7b0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.794+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94284718440080] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c040040 con 0x7fef8c05c3e0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.794+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.794+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94284718443936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f269b70 con 0x55c05f25d7b0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.794+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26a5b0 con 0x55c05f2638d0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.796+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94284718443936] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.796+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.796+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94284718448768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26a9d0 con 0x55c05f2638d0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.796+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26b390 con 0x7fef8c05c3e0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.797+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c040040 con 0x7fef8c05c3e0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.797+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94284718452960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26bc30 con 0x7fef8c05c3e0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.797+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26c700 con 0x55c05f25d7b0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.797+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94284718448768] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.798+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.798+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94284718457328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26c6c0 con 0x55c05f25d7b0 2024-04-24T01:43:01.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.798+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26d160 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.798+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94284718452960] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c040040 con 0x7fef8c05c3e0 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.799+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.799+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94284718460048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26d160 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.799+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26db80 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.799+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94284718457328] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.800+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.800+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94284718462576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26db40 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.800+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26e520 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.800+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94284718460048] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94284718462576] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94284718444992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26b780 con 0x7fef9c031040 2024-04-24T01:43:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 20 add_watcher() i=0 2024-04-24T01:43:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 20 add_watcher() i=1 2024-04-24T01:43:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 20 add_watcher() i=2 2024-04-24T01:43:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 20 add_watcher() i=3 2024-04-24T01:43:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 20 add_watcher() i=4 2024-04-24T01:43:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 20 add_watcher() i=5 2024-04-24T01:43:01.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.801+0000 7fefa4775800 20 add_watcher() i=6 2024-04-24T01:43:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.803+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94284718444992] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.803+0000 7fefa4775800 20 add_watcher() i=7 2024-04-24T01:43:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.803+0000 7fefa4775800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.803+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f271550 con 0x55c05f25d7b0 2024-04-24T01:43:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.804+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.804+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94284718465104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26e9d0 con 0x55c05f25d7b0 2024-04-24T01:43:01.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94284718465104] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fee58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa4775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa4775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa4775800 5 note: GC not initialized 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fedd37fe640 20 reqs_thread_entry: start 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa4775800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa4775800 20 Filter name: none 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fedd17fa640 20 reqs_thread_entry: start 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa4775800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.805+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05f2a4280 con 0x55c05f25d7b0 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.806+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.806+0000 7fefa4775800 20 rados_obj.operate() r=0 bl.length=673 2024-04-24T01:43:01.827 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:43:01.682776Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:01.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.806+0000 7fee58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.806+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94284718465104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f2a47c0 con 0x55c05f25d7b0 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.807+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94284718465104] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.807+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94284718440080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f2a47c0 con 0x7fef8c05c3e0 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.808+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94284718440080] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c040040 con 0x7fef8c05c3e0 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.808+0000 7fefa4775800 20 remove_watcher() i=0 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.808+0000 7fefa4775800 2 removed watcher, disabling cache 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.808+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94284718443936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f267e90 con 0x55c05f25d7b0 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.810+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94284718443936] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.810+0000 7fefa4775800 20 remove_watcher() i=1 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.810+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94284718448768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f267e90 con 0x55c05f2638d0 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.811+0000 7fef99a73640 1 -- 172.21.15.131:0/369813051 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94284718448768] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef8c066030 con 0x55c05f2638d0 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.811+0000 7fefa4775800 20 remove_watcher() i=2 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.811+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94284718452960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26a080 con 0x7fef8c05c3e0 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.811+0000 7fefa2a75640 1 -- 172.21.15.131:0/369813051 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94284718452960] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c040040 con 0x7fef8c05c3e0 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.812+0000 7fefa4775800 20 remove_watcher() i=3 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.812+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94284718457328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f268da0 con 0x55c05f25d7b0 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.812+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94284718457328] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x55c05f25d7b0 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.813+0000 7fefa4775800 20 remove_watcher() i=4 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.813+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94284718460048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f268da0 con 0x7fef9c031040 2024-04-24T01:43:01.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.813+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94284718460048] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.813+0000 7fefa4775800 20 remove_watcher() i=5 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.813+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94284718462576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f26cc90 con 0x7fef9c031040 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.814+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94284718462576] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.814+0000 7fefa4775800 20 remove_watcher() i=6 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.814+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94284718444992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05f268da0 con 0x7fef9c031040 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94284718444992] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef94048040 con 0x7fef9c031040 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 20 remove_watcher() i=7 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fef9c031040 msgr2=0x7fef9c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fef9c031040 0x7fef9c032430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f25d7b0 msgr2=0x55c05f25fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f25d7b0 0x55c05f25fc50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fef8c05c3e0 msgr2=0x7fef8c08fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fef8c05c3e0 0x7fef8c08fa80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c05f2638d0 msgr2=0x55c05f265cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.815+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c05f2638d0 0x55c05f265cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee6c036950 msgr2=0x7fee6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee6c036950 0x7fee6c038e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55c05f225e90 tx=0x7fef9c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa2274640 1 -- 172.21.15.131:0/369813051 reap_dead start 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 msgr2=0x55c05f251cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f251cc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0674a0 tx=0x7fef8c08d7f0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 shutdown_connections 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/369813051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f24a600 0x55c05f251cc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 >> 172.21.15.131:0/369813051 conn(0x55c05f246960 msgr2=0x55c05f243fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 shutdown_connections 2024-04-24T01:43:01.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/369813051 wait complete. 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee7c036950 msgr2=0x7fee7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee7c036950 0x7fee7c038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55c05f22d470 tx=0x7fef9c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f23d3c0 msgr2=0x55c05f23d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f23d3c0 0x55c05f23d7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fef8c055040 tx=0x7fef8c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 shutdown_connections 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee7c036950 0x7fee7c038e10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/1273937007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f23d3c0 0x55c05f23d7e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 >> 172.21.15.131:0/1273937007 conn(0x55c05f231460 msgr2=0x55c05f231860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 shutdown_connections 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/1273937007 wait complete. 2024-04-24T01:43:01.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f12a300 msgr2=0x55c05f22c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.816+0000 7fefa4775800 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f12a300 0x55c05f22c260 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee88036950 msgr2=0x7fee88038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee88036950 0x7fee88038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef8c054000 tx=0x7fef8c04e000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 msgr2=0x55c05f225070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f225070 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b210 tx=0x7fef94000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 shutdown_connections 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c05f12a300 0x55c05f22c260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fee88036950 0x7fee88038e10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 --2- 172.21.15.131:0/1702954143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c05f1287c0 0x55c05f225070 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 >> 172.21.15.131:0/1702954143 conn(0x55c05f124320 msgr2=0x55c05f217500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 shutdown_connections 2024-04-24T01:43:01.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.817+0000 7fefa4775800 1 -- 172.21.15.131:0/1702954143 wait complete. 2024-04-24T01:43:01.839 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:43:01.682776Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:01.839 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-24T01:43:01.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-24T01:43:01.839 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-24T01:43:01.919 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:01.919 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.918+0000 7f362f816800 1 Processor -- start 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.918+0000 7f362f816800 1 -- start start 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.918+0000 7f362f816800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ac500df950 0x55ac500e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.918+0000 7f362f816800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac4ff9dd40 con 0x55ac500e2280 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.918+0000 7f362f816800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55ac4ff704d0 con 0x55ac500df950 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.919+0000 7f362af5c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ac500df950 0x55ac500e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.919+0000 7f3623fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55ac500e2280 0x55ac500e4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56520/0 (socket says 172.21.15.131:56520) 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.919+0000 7f362af5c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ac500df950 0x55ac500e1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41678/0 (socket says 172.21.15.131:41678) 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.919+0000 7f3623fff640 1 -- 172.21.15.131:0/3722514857 learned_addr learned my addr 172.21.15.131:0/3722514857 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:01.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.919+0000 7f362af5c640 1 -- 172.21.15.131:0/3722514857 >> v1:172.21.15.107:6789/0 conn(0x55ac500e2280 legacy=0x55ac500e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.919+0000 7f362a75b640 1 -- 172.21.15.131:0/3722514857 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716668168 0 0) 0x55ac4ff9dd40 con 0x55ac500e2280 2024-04-24T01:43:01.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.919+0000 7f362af5c640 1 -- 172.21.15.131:0/3722514857 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac4ff9c590 con 0x55ac500df950 2024-04-24T01:43:01.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.921+0000 7f362af5c640 1 --2- 172.21.15.131:0/3722514857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500e1d40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f361c00a470 tx=0x7f361c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a2cda8dc4df82e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.921+0000 7f362a75b640 1 -- 172.21.15.131:0/3722514857 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361c057070 con 0x55ac500df950 2024-04-24T01:43:01.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.921+0000 7f362a75b640 1 -- 172.21.15.131:0/3722514857 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c052570 con 0x55ac500df950 2024-04-24T01:43:01.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.921+0000 7f362a75b640 1 -- 172.21.15.131:0/3722514857 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361c052870 con 0x55ac500df950 2024-04-24T01:43:01.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.922+0000 7f362f816800 1 -- 172.21.15.131:0/3722514857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 msgr2=0x55ac500e1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.922+0000 7f362f816800 1 --2- 172.21.15.131:0/3722514857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500e1d40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f361c00a470 tx=0x7f361c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:01.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.922+0000 7f362f816800 1 -- 172.21.15.131:0/3722514857 shutdown_connections 2024-04-24T01:43:01.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.922+0000 7f362f816800 1 --2- 172.21.15.131:0/3722514857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500e1d40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.922+0000 7f362f816800 1 -- 172.21.15.131:0/3722514857 >> 172.21.15.131:0/3722514857 conn(0x55ac500d93a0 msgr2=0x55ac500db7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.922+0000 7f362f816800 1 -- 172.21.15.131:0/3722514857 shutdown_connections 2024-04-24T01:43:01.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.922+0000 7f362f816800 1 -- 172.21.15.131:0/3722514857 wait complete. 2024-04-24T01:43:01.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.933+0000 7f362f816800 1 Processor -- start 2024-04-24T01:43:01.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.933+0000 7f362f816800 1 -- start start 2024-04-24T01:43:01.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.933+0000 7f362f816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500df290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.933+0000 7f362f816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ac5002a3b0 con 0x55ac500df950 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f362af5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500df290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f362af5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500df290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41692/0 (socket says 172.21.15.131:41692) 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f362af5c640 1 -- 172.21.15.131:0/3886081877 learned_addr learned my addr 172.21.15.131:0/3886081877 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f362af5c640 1 -- 172.21.15.131:0/3886081877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac500dd850 con 0x55ac500df950 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f362af5c640 1 --2- 172.21.15.131:0/3886081877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500df290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f361c055040 tx=0x7f361c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1221a6dc761eef7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f3518e09640 1 -- 172.21.15.131:0/3886081877 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361c063070 con 0x55ac500df950 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f3518e09640 1 -- 172.21.15.131:0/3886081877 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c058040 con 0x55ac500df950 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.934+0000 7f3518e09640 1 -- 172.21.15.131:0/3886081877 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361c057070 con 0x55ac500df950 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 -- 172.21.15.131:0/3886081877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 msgr2=0x55ac500df290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 --2- 172.21.15.131:0/3886081877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500df290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f361c055040 tx=0x7f361c04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 -- 172.21.15.131:0/3886081877 shutdown_connections 2024-04-24T01:43:01.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 --2- 172.21.15.131:0/3886081877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac500df290 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 -- 172.21.15.131:0/3886081877 >> 172.21.15.131:0/3886081877 conn(0x55ac500d93a0 msgr2=0x55ac501cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 -- 172.21.15.131:0/3886081877 shutdown_connections 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 -- 172.21.15.131:0/3886081877 wait complete. 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.935+0000 7f362f816800 1 Processor -- start 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362f816800 1 -- start start 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362f816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac501ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362f816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ac500e80a0 con 0x55ac500df950 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362af5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac501ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362af5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac501ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41706/0 (socket says 172.21.15.131:41706) 2024-04-24T01:43:01.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362af5c640 1 -- 172.21.15.131:0/3606914867 learned_addr learned my addr 172.21.15.131:0/3606914867 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362af5c640 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac501de4d0 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362af5c640 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac501ddf90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f361c061040 tx=0x7f361c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f3517606640 1 -- 172.21.15.131:0/3606914867 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361c063030 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f3517606640 1 -- 172.21.15.131:0/3606914867 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c052d90 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac501de760 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f3517606640 1 -- 172.21.15.131:0/3606914867 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361c05e5b0 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.936+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac501e1410 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.937+0000 7f3517606640 1 -- 172.21.15.131:0/3606914867 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f361c05e750 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.937+0000 7f3517606640 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3510036950 0x7f3510038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.937+0000 7f3517606640 1 -- 172.21.15.131:0/3606914867 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f361c064070 con 0x55ac500df950 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.937+0000 7f3623fff640 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3510036950 0x7f3510038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.938+0000 7f362f816800 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac500e2280 0x55ac501e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.938+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac501e5710 con 0x55ac500e2280 2024-04-24T01:43:01.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.938+0000 7f362b75d640 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac500e2280 0x55ac501e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.938+0000 7f3623fff640 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3510036950 0x7f3510038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3614000c00 tx=0x7f36140013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.938+0000 7f362b75d640 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac500e2280 0x55ac501e51d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.938+0000 7f362b75d640 1 -- 172.21.15.131:0/3606914867 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f362400a4a0 con 0x55ac500e2280 2024-04-24T01:43:01.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.938+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac501e2780 con 0x55ac500e2280 2024-04-24T01:43:01.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.939+0000 7f362b75d640 1 -- 172.21.15.131:0/3606914867 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f362400a4a0 con 0x55ac500e2280 2024-04-24T01:43:01.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.939+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac501e74f0 con 0x55ac500e2280 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.939+0000 7f362b75d640 1 -- 172.21.15.131:0/3606914867 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f362400a4a0 con 0x55ac500e2280 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.939+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac501e6830 con 0x55ac500e2280 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.939+0000 7f362b75d640 1 -- 172.21.15.131:0/3606914867 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f362400a4a0 con 0x55ac500e2280 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.939+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac501e6c80 con 0x55ac500e2280 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.939+0000 7f362b75d640 1 -- 172.21.15.131:0/3606914867 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f362400a4a0 con 0x55ac500e2280 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f362f816800 1 Processor -- start 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f362f816800 1 -- start start 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f362f816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac501f62c0 0x55ac501f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f362f816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ac4ffd06b0 con 0x55ac501f62c0 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f3623fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac501f62c0 0x55ac501f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f3623fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac501f62c0 0x55ac501f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41720/0 (socket says 172.21.15.131:41720) 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f3623fff640 1 -- 172.21.15.131:0/2501276949 learned_addr learned my addr 172.21.15.131:0/2501276949 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.940+0000 7f3623fff640 1 -- 172.21.15.131:0/2501276949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac501f6c20 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.941+0000 7f3623fff640 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac501f62c0 0x55ac501f66e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f361400e610 tx=0x7f361400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.941+0000 7f3514e01640 1 -- 172.21.15.131:0/2501276949 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3614022070 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.941+0000 7f3514e01640 1 -- 172.21.15.131:0/2501276949 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3614009050 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.941+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac501f7690 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.941+0000 7f3514e01640 1 -- 172.21.15.131:0/2501276949 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361400d500 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.941+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac501f7b90 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.941+0000 7f3514e01640 1 -- 172.21.15.131:0/2501276949 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3614025070 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f3514e01640 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3504036950 0x7f3504038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f3514e01640 1 -- 172.21.15.131:0/2501276949 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f361404db70 con 0x55ac501f62c0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f362b75d640 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3504036950 0x7f3504038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f362f816800 1 Processor -- start 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f362b75d640 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3504036950 0x7f3504038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55ac501e6350 tx=0x7f3624005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f362f816800 1 -- start start 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f362f816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac50203a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f362f816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ac500ddb10 con 0x55ac50203600 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f3623fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac50203a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f3623fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac50203a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41730/0 (socket says 172.21.15.131:41730) 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.942+0000 7f3623fff640 1 -- 172.21.15.131:0/3610647428 learned_addr learned my addr 172.21.15.131:0/3610647428 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f3623fff640 1 -- 172.21.15.131:0/3610647428 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac50203ff0 con 0x55ac50203600 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f3623fff640 1 --2- 172.21.15.131:0/3610647428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac50203a20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3614026fd0 tx=0x7f3614024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9682f1ee83d4755 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f350e7fc640 1 -- 172.21.15.131:0/3610647428 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361404a030 con 0x55ac50203600 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f350e7fc640 1 -- 172.21.15.131:0/3610647428 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3614025e30 con 0x55ac50203600 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f350e7fc640 1 -- 172.21.15.131:0/3610647428 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361401ad50 con 0x55ac50203600 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f362f816800 1 -- 172.21.15.131:0/3610647428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 msgr2=0x55ac50203a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f362f816800 1 --2- 172.21.15.131:0/3610647428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac50203a20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3614026fd0 tx=0x7f3614024eb0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f362f816800 1 -- 172.21.15.131:0/3610647428 shutdown_connections 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f362f816800 1 --2- 172.21.15.131:0/3610647428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac50203a20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f362f816800 1 -- 172.21.15.131:0/3610647428 >> 172.21.15.131:0/3610647428 conn(0x55ac501ff960 msgr2=0x55ac501fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f362f816800 1 -- 172.21.15.131:0/3610647428 shutdown_connections 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.943+0000 7f362f816800 1 -- 172.21.15.131:0/3610647428 wait complete. 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f362f816800 1 Processor -- start 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f362f816800 1 -- start start 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f362f816800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac5020acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f362f816800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ac50204760 con 0x55ac50203600 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f3623fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac5020acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f3623fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac5020acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41740/0 (socket says 172.21.15.131:41740) 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 learned_addr learned my addr 172.21.15.131:0/3770000995 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:01.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5020b200 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f3623fff640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac5020acc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3614026fd0 tx=0x7f361404be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.944+0000 7f350cff9640 1 -- 172.21.15.131:0/3770000995 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361404a050 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f350cff9640 1 -- 172.21.15.131:0/3770000995 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361400d6a0 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac5020b490 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f350cff9640 1 -- 172.21.15.131:0/3770000995 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f361400d9e0 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5020e140 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f350cff9640 1 -- 172.21.15.131:0/3770000995 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f361404d370 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f350cff9640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f34f4036900 0x7f34f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f350cff9640 1 -- 172.21.15.131:0/3770000995 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3614045880 con 0x55ac50203600 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.945+0000 7f362b75d640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f34f4036900 0x7f34f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362b75d640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f34f4036900 0x7f34f4038dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ac501e26f0 tx=0x7f362401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac50216810 0x55ac50218cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac50219420 con 0x55ac50216810 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362af5c640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac50216810 0x55ac50218cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362af5c640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac50216810 0x55ac50218cd0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362f816800 20 realm 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.946+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac50219830 con 0x55ac50216810 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021a100 con 0x55ac50216810 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021a4a0 con 0x55ac50216810 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021acf0 con 0x55ac50216810 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.947+0000 7f362f816800 20 searching for the correct realm 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ac5021ca60 0x55ac5021ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f3623fff640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ac5021ca60 0x55ac5021ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f3623fff640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ac5021ca60 0x55ac5021ee50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f3623fff640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3614027060 0x7f36140467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3614027060 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.948+0000 7f362b75d640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3614027060 0x7f36140467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.949+0000 7f362b75d640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3614027060 0x7f36140467d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.949+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362401f070 con 0x7f3614027060 2024-04-24T01:43:01.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.949+0000 7f362b75d640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3624031040 0x7f3624032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.949+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.949+0000 7f362af5c640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3624031040 0x7f3624032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.950+0000 7f362af5c640 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3624031040 0x7f3624032940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.950+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.950+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac50216810 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.950+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.950+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac50216810 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.950+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.950+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3614027060 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362401f070 con 0x7f3614027060 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac50216810 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.951+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac50216810 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3614027060 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f362401f070 con 0x7f3614027060 2024-04-24T01:43:01.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.952+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.953+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac50216810 2024-04-24T01:43:01.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.954+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.954+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac50216810 2024-04-24T01:43:01.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.954+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.954+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.954+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.954+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3614027060 2024-04-24T01:43:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362401f070 con 0x7f3614027060 2024-04-24T01:43:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac50216810 2024-04-24T01:43:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.955+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3614027060 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362401f070 con 0x7f3614027060 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x55ac5021ca60 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.956+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f430 con 0x7f3624031040 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f361c0a0040 con 0x55ac50216810 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f361c0a0040 con 0x7f3614027060 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362401f070 con 0x7f3614027060 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021b6a0 con 0x55ac50216810 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.957+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021bf40 con 0x55ac50216810 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021bf40 con 0x55ac50216810 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 20 zone default found 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 4 Realm: () 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 20 zonegroup default 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5021f8b0 con 0x7f3624031040 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.958+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac50221320 con 0x55ac5021ca60 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac50221820 con 0x55ac5021ca60 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 20 started sync module instance, tier type = 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.959+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50220730 con 0x7f3614027060 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.960+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.960+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94198567144224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50220f40 con 0x7f3614027060 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.960+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50222750 con 0x55ac50216810 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.961+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94198567144224] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.961+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.961+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94198567150240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50222b70 con 0x55ac50216810 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.961+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50223530 con 0x55ac5021ca60 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.962+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.962+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94198567150240] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.962+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94198567153792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50223dd0 con 0x55ac5021ca60 2024-04-24T01:43:01.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.962+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac502226e0 con 0x7f3614027060 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.963+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94198567153792] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.963+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.963+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94198567156000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac502247f0 con 0x7f3614027060 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.963+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac502251b0 con 0x55ac50216810 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.965+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.965+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94198567161088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac502255d0 con 0x55ac50216810 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.965+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94198567156000] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.965+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50224360 con 0x7f3624031040 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.966+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94198567161088] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.966+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.966+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94198567162144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50225540 con 0x7f3624031040 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.966+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50226550 con 0x7f3624031040 2024-04-24T01:43:01.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.966+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94198567162144] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94198567164864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50226490 con 0x7f3624031040 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50226f00 con 0x7f3624031040 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94198567168464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50227370 con 0x7f3624031040 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94198567164864] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 20 add_watcher() i=0 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 20 add_watcher() i=1 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 20 add_watcher() i=2 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 20 add_watcher() i=3 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 20 add_watcher() i=4 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.967+0000 7f362f816800 20 add_watcher() i=5 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.968+0000 7f362f816800 20 add_watcher() i=6 2024-04-24T01:43:01.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.968+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94198567168464] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.968+0000 7f362f816800 20 add_watcher() i=7 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.968+0000 7f362f816800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.968+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac50227370 con 0x55ac50216810 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.969+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.969+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94198567169728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50227320 con 0x55ac50216810 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94198567169728] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f34e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 5 note: GC not initialized 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f345bfff640 20 reqs_thread_entry: start 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:01.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 20 Filter name: none 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f3459ffb640 20 reqs_thread_entry: start 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 20 rados->read ofs=0 len=0 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.970+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5025d660 con 0x55ac50216810 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.971+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.971+0000 7f362f816800 20 rados_obj.operate() r=0 bl.length=673 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.971+0000 7f362f816800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.971+0000 7f362f816800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.971+0000 7f362f816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.971+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50264230 con 0x55ac50216810 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f362f816800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f362f816800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f362f816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94198567419040 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5025f9a0 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94198567161088 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55ac501e1410 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(64 notify.4 [notify cookie 94198567419040 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f350e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94198567161088 notifier 4401 bl.length()=758 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f350e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f350e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.972+0000 7f350e7fc640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f34f0003ea0 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.973+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.973+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 94198567419040 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f361c078030 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.973+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50263ca0 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f362f816800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-24T01:43:01.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94198567419040 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac5025f4f0 con 0x7f3614027060 2024-04-24T01:43:01.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== watch-notify(notify (1) cookie 94198567144224 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f36240247b0 con 0x7f3614027060 2024-04-24T01:43:01.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f350e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94198567144224 notifier 4401 bl.length()=159 2024-04-24T01:43:01.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.0 [notify cookie 94198567419040 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f350e7fc640 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f34f0003ea0 con 0x7f3614027060 2024-04-24T01:43:01.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.974+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== watch-notify(notify_complete (2) cookie 94198567419040 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3624024980 con 0x7f3614027060 2024-04-24T01:43:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:43:01.682776Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:01.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.975+0000 7f34e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:01.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.975+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94198567169728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac5025bd60 con 0x55ac50216810 2024-04-24T01:43:01.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.976+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94198567169728] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.976+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94198567144224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50226ec0 con 0x7f3614027060 2024-04-24T01:43:01.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.977+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94198567144224] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.977+0000 7f362f816800 20 remove_watcher() i=0 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.977+0000 7f362f816800 2 removed watcher, disabling cache 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.977+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94198567150240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50220b20 con 0x55ac50216810 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.978+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94198567150240] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.978+0000 7f362f816800 20 remove_watcher() i=1 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.978+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94198567153792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50220b20 con 0x55ac5021ca60 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.979+0000 7f3623fff640 1 -- 172.21.15.131:0/3770000995 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94198567153792] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3614024030 con 0x55ac5021ca60 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.979+0000 7f362f816800 20 remove_watcher() i=2 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.979+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94198567156000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50223080 con 0x7f3614027060 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.980+0000 7f362b75d640 1 -- 172.21.15.131:0/3770000995 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94198567156000] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624040040 con 0x7f3614027060 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.980+0000 7f362f816800 20 remove_watcher() i=3 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.980+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94198567161088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50223920 con 0x55ac50216810 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.981+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94198567161088] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x55ac50216810 2024-04-24T01:43:01.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.981+0000 7f362f816800 20 remove_watcher() i=4 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.981+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94198567162144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50223080 con 0x7f3624031040 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.982+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94198567162144] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.982+0000 7f362f816800 20 remove_watcher() i=5 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.982+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94198567164864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50223080 con 0x7f3624031040 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.983+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94198567164864] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.983+0000 7f362f816800 20 remove_watcher() i=6 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.983+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94198567168464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac50223080 con 0x7f3624031040 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94198567168464] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f361c070020 con 0x7f3624031040 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 20 remove_watcher() i=7 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3624031040 msgr2=0x7f3624032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3624031040 0x7f3624032940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac50216810 msgr2=0x55ac50218cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac50216810 0x55ac50218cd0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3614027060 msgr2=0x7f36140467d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3614027060 0x7f36140467d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ac5021ca60 msgr2=0x55ac5021ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ac5021ca60 0x55ac5021ee50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f34f4036900 msgr2=0x7f34f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f34f4036900 0x7f34f4038dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ac501e26f0 tx=0x7f362401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 msgr2=0x55ac5020acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362af5c640 1 -- 172.21.15.131:0/3770000995 reap_dead start 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac5020acc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3614026fd0 tx=0x7f361404be50 comp rx=0 tx=0).stop 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 shutdown_connections 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 --2- 172.21.15.131:0/3770000995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac50203600 0x55ac5020acc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.984+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 >> 172.21.15.131:0/3770000995 conn(0x55ac501ff960 msgr2=0x55ac501fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 shutdown_connections 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3770000995 wait complete. 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3504036950 msgr2=0x7f3504038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3504036950 0x7f3504038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55ac501e6350 tx=0x7f3624005840 comp rx=0 tx=0).stop 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac501f62c0 msgr2=0x55ac501f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac501f62c0 0x55ac501f66e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f361400e610 tx=0x7f361400ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 shutdown_connections 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3504036950 0x7f3504038e10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/2501276949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac501f62c0 0x55ac501f66e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 >> 172.21.15.131:0/2501276949 conn(0x55ac501ea360 msgr2=0x55ac501ea760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 shutdown_connections 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/2501276949 wait complete. 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac500e2280 msgr2=0x55ac501e51d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:01.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac500e2280 0x55ac501e51d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3510036950 msgr2=0x7f3510038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3510036950 0x7f3510038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3614000c00 tx=0x7f36140013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 msgr2=0x55ac501ddf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac501ddf90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f361c061040 tx=0x7f361c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 shutdown_connections 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ac500e2280 0x55ac501e51d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3510036950 0x7f3510038e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 --2- 172.21.15.131:0/3606914867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ac500df950 0x55ac501ddf90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 >> 172.21.15.131:0/3606914867 conn(0x55ac500d93a0 msgr2=0x55ac500de070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 shutdown_connections 2024-04-24T01:43:02.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:01.985+0000 7f362f816800 1 -- 172.21.15.131:0/3606914867 wait complete. 2024-04-24T01:43:02.001 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:43:01.682776Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:02.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-24T01:43:02.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-24T01:43:02.001 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-24T01:43:02.044 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:02.044 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:02.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.043+0000 7fda15839800 1 Processor -- start 2024-04-24T01:43:02.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.043+0000 7fda15839800 1 -- start start 2024-04-24T01:43:02.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.043+0000 7fda15839800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b255119480 0x55b25511b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.043+0000 7fda15839800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b254fd3d40 con 0x55b255115970 2024-04-24T01:43:02.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.043+0000 7fda15839800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55b254fa64d0 con 0x55b255119480 2024-04-24T01:43:02.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.044+0000 7fda07fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b255119480 0x55b25511b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.044+0000 7fda07fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b255119480 0x55b25511b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41744/0 (socket says 172.21.15.131:41744) 2024-04-24T01:43:02.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.044+0000 7fda1046e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55b255115970 0x55b255117d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56536/0 (socket says 172.21.15.131:56536) 2024-04-24T01:43:02.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.044+0000 7fda07fff640 1 -- 172.21.15.131:0/3804841248 learned_addr learned my addr 172.21.15.131:0/3804841248 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.044+0000 7fda07fff640 1 -- 172.21.15.131:0/3804841248 >> v1:172.21.15.107:6789/0 conn(0x55b255115970 legacy=0x55b255117d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.044+0000 7fda0fc6d640 1 -- 172.21.15.131:0/3804841248 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3242550112 0 0) 0x55b254fd3d40 con 0x55b255115970 2024-04-24T01:43:02.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.044+0000 7fda07fff640 1 -- 172.21.15.131:0/3804841248 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b254fd2590 con 0x55b255119480 2024-04-24T01:43:02.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda07fff640 1 --2- 172.21.15.131:0/3804841248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255119480 0x55b25511b870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800a520 tx=0x7fd9f801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c6f68df9b0574d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda0fc6d640 1 -- 172.21.15.131:0/3804841248 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f8057070 con 0x55b255119480 2024-04-24T01:43:02.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda0fc6d640 1 -- 172.21.15.131:0/3804841248 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f8052570 con 0x55b255119480 2024-04-24T01:43:02.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda0fc6d640 1 -- 172.21.15.131:0/3804841248 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f804ae60 con 0x55b255119480 2024-04-24T01:43:02.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda15839800 1 -- 172.21.15.131:0/3804841248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255119480 msgr2=0x55b25511b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda15839800 1 --2- 172.21.15.131:0/3804841248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255119480 0x55b25511b870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800a520 tx=0x7fd9f801d010 comp rx=0 tx=0).stop 2024-04-24T01:43:02.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda15839800 1 -- 172.21.15.131:0/3804841248 shutdown_connections 2024-04-24T01:43:02.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda15839800 1 --2- 172.21.15.131:0/3804841248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255119480 0x55b25511b870 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.046+0000 7fda15839800 1 -- 172.21.15.131:0/3804841248 >> 172.21.15.131:0/3804841248 conn(0x55b25510f320 msgr2=0x55b255111740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.047+0000 7fda15839800 1 -- 172.21.15.131:0/3804841248 shutdown_connections 2024-04-24T01:43:02.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.047+0000 7fda15839800 1 -- 172.21.15.131:0/3804841248 wait complete. 2024-04-24T01:43:02.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.058+0000 7fda15839800 1 Processor -- start 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.058+0000 7fda15839800 1 -- start start 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.058+0000 7fda15839800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b2551152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.058+0000 7fda15839800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b2550603c0 con 0x55b255115970 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fda1046e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b2551152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fda1046e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b2551152b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41746/0 (socket says 172.21.15.131:41746) 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fda1046e640 1 -- 172.21.15.131:0/1732493318 learned_addr learned my addr 172.21.15.131:0/1732493318 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fda1046e640 1 -- 172.21.15.131:0/1732493318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b255113870 con 0x55b255115970 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fda1046e640 1 --2- 172.21.15.131:0/1732493318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b2551152b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b210 tx=0x7fda0000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1058d20dad29f2d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fd8fe60c640 1 -- 172.21.15.131:0/1732493318 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda00008070 con 0x55b255115970 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fd8fe60c640 1 -- 172.21.15.131:0/1732493318 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0000d500 con 0x55b255115970 2024-04-24T01:43:02.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.059+0000 7fd8fe60c640 1 -- 172.21.15.131:0/1732493318 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0000d840 con 0x55b255115970 2024-04-24T01:43:02.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 -- 172.21.15.131:0/1732493318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 msgr2=0x55b2551152b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 --2- 172.21.15.131:0/1732493318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b2551152b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b210 tx=0x7fda0000b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 -- 172.21.15.131:0/1732493318 shutdown_connections 2024-04-24T01:43:02.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 --2- 172.21.15.131:0/1732493318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b2551152b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 -- 172.21.15.131:0/1732493318 >> 172.21.15.131:0/1732493318 conn(0x55b25510f320 msgr2=0x55b255201870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 -- 172.21.15.131:0/1732493318 shutdown_connections 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 -- 172.21.15.131:0/1732493318 wait complete. 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 Processor -- start 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 -- start start 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b25520fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.060+0000 7fda15839800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b25511e0c0 con 0x55b255115970 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fda1046e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b25520fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fda1046e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b25520fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41750/0 (socket says 172.21.15.131:41750) 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fda1046e640 1 -- 172.21.15.131:0/508785089 learned_addr learned my addr 172.21.15.131:0/508785089 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fda1046e640 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b255210220 con 0x55b255115970 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fda1046e640 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b25520fce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b210 tx=0x7fda00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fd8fce09640 1 -- 172.21.15.131:0/508785089 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0000f950 con 0x55b255115970 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fd8fce09640 1 -- 172.21.15.131:0/508785089 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0000faf0 con 0x55b255115970 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2552104b0 con 0x55b255115970 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fd8fce09640 1 -- 172.21.15.131:0/508785089 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0000fdd0 con 0x55b255115970 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.061+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b255213160 con 0x55b255115970 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.062+0000 7fd8fce09640 1 -- 172.21.15.131:0/508785089 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fda00017040 con 0x55b255115970 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.062+0000 7fd8fce09640 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8f8036900 0x7fd8f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.062+0000 7fd8fce09640 1 -- 172.21.15.131:0/508785089 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fda00015020 con 0x55b255115970 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.062+0000 7fda07fff640 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8f8036900 0x7fd8f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.062+0000 7fda15839800 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b255119480 0x55b255216f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.062+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b255217460 con 0x55b255119480 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.063+0000 7fda10c6f640 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b255119480 0x55b255216f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.063+0000 7fda07fff640 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8f8036900 0x7fd8f8038dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8054000 tx=0x7fd9f804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.063+0000 7fda10c6f640 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b255119480 0x55b255216f20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.063+0000 7fda10c6f640 1 -- 172.21.15.131:0/508785089 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda0800a4a0 con 0x55b255119480 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.063+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2552144d0 con 0x55b255119480 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.063+0000 7fda10c6f640 1 -- 172.21.15.131:0/508785089 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda0800a4a0 con 0x55b255119480 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.063+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b255219270 con 0x55b255119480 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.064+0000 7fda10c6f640 1 -- 172.21.15.131:0/508785089 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda0800a4a0 con 0x55b255119480 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.064+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2552185b0 con 0x55b255119480 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.064+0000 7fda10c6f640 1 -- 172.21.15.131:0/508785089 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda0800a4a0 con 0x55b255119480 2024-04-24T01:43:02.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.064+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2552189d0 con 0x55b255119480 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.064+0000 7fda10c6f640 1 -- 172.21.15.131:0/508785089 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda0800a4a0 con 0x55b255119480 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.064+0000 7fda15839800 1 Processor -- start 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda15839800 1 -- start start 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda15839800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255228080 0x55b2552284a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda15839800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b2550066b0 con 0x55b255228080 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda07fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255228080 0x55b2552284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda07fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255228080 0x55b2552284a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41758/0 (socket says 172.21.15.131:41758) 2024-04-24T01:43:02.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda07fff640 1 -- 172.21.15.131:0/3097949254 learned_addr learned my addr 172.21.15.131:0/3097949254 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda07fff640 1 -- 172.21.15.131:0/3097949254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2552289e0 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.065+0000 7fda07fff640 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255228080 0x55b2552284a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8005930 tx=0x7fd9f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fd8f5ffb640 1 -- 172.21.15.131:0/3097949254 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f8057040 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fd8f5ffb640 1 -- 172.21.15.131:0/3097949254 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f805d650 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fd8f5ffb640 1 -- 172.21.15.131:0/3097949254 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f805d950 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b255229450 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2552298f0 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fd8f5ffb640 1 -- 172.21.15.131:0/3097949254 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd9f8067070 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fd8f5ffb640 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8e8036950 0x7fd8e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.066+0000 7fd8f5ffb640 1 -- 172.21.15.131:0/3097949254 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd9f808f620 con 0x55b255228080 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda10c6f640 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8e8036950 0x7fd8e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda15839800 1 Processor -- start 2024-04-24T01:43:02.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda15839800 1 -- start start 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda10c6f640 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8e8036950 0x7fd8e8038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55b255218950 tx=0x7fda08005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda15839800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b255235720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda15839800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b255113bf0 con 0x55b255235300 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda07fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b255235720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda07fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b255235720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41772/0 (socket says 172.21.15.131:41772) 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda07fff640 1 -- 172.21.15.131:0/1982762156 learned_addr learned my addr 172.21.15.131:0/1982762156 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.067+0000 7fda07fff640 1 -- 172.21.15.131:0/1982762156 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b255235cf0 con 0x55b255235300 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda07fff640 1 --2- 172.21.15.131:0/1982762156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b255235720 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9f808d9b0 tx=0x7fd9f8067b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af46d70deaae027 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fd8e77fe640 1 -- 172.21.15.131:0/1982762156 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f8071920 con 0x55b255235300 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fd8e77fe640 1 -- 172.21.15.131:0/1982762156 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f8071400 con 0x55b255235300 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fd8e77fe640 1 -- 172.21.15.131:0/1982762156 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f8071ac0 con 0x55b255235300 2024-04-24T01:43:02.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 -- 172.21.15.131:0/1982762156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 msgr2=0x55b255235720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 --2- 172.21.15.131:0/1982762156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b255235720 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9f808d9b0 tx=0x7fd9f8067b60 comp rx=0 tx=0).stop 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 -- 172.21.15.131:0/1982762156 shutdown_connections 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 --2- 172.21.15.131:0/1982762156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b255235720 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 -- 172.21.15.131:0/1982762156 >> 172.21.15.131:0/1982762156 conn(0x55b255231660 msgr2=0x55b25522f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 -- 172.21.15.131:0/1982762156 shutdown_connections 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 -- 172.21.15.131:0/1982762156 wait complete. 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.068+0000 7fda15839800 1 Processor -- start 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda15839800 1 -- start start 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda15839800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b25523c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda15839800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b255236460 con 0x55b255235300 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda07fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b25523c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda07fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b25523c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41788/0 (socket says 172.21.15.131:41788) 2024-04-24T01:43:02.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 learned_addr learned my addr 172.21.15.131:0/335300142 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25523ceb0 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda07fff640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b25523c970 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8067ba0 tx=0x7fd9f808d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fd8e5ffb640 1 -- 172.21.15.131:0/335300142 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f808c070 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fd8e5ffb640 1 -- 172.21.15.131:0/335300142 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f808f280 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b25523d140 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fd8e5ffb640 1 -- 172.21.15.131:0/335300142 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f808c210 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.069+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25523fdf0 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.070+0000 7fd8e5ffb640 1 -- 172.21.15.131:0/335300142 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd9f808c3d0 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.070+0000 7fd8e5ffb640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8d8036950 0x7fd8d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.070+0000 7fd8e5ffb640 1 -- 172.21.15.131:0/335300142 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd9f809ac30 con 0x55b255235300 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.070+0000 7fda10c6f640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8d8036950 0x7fd8d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda10c6f640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8d8036950 0x7fd8d8038e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55b2552180d0 tx=0x7fda0801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b2552484a0 0x55b25524a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524b0b0 con 0x55b2552484a0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda1046e640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b2552484a0 0x55b25524a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda1046e640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b2552484a0 0x55b25524a960 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda0002d070 con 0x55b2552484a0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda15839800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda15839800 20 realm 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.071+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524b4c0 con 0x55b2552484a0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda0002d070 con 0x55b2552484a0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524bd90 con 0x55b2552484a0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda0002d070 con 0x55b2552484a0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524c130 con 0x55b2552484a0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda0002d070 con 0x55b2552484a0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524c980 con 0x55b2552484a0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda0002d070 con 0x55b2552484a0 2024-04-24T01:43:02.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 20 searching for the correct realm 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b25524e6f0 0x55b255250ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.072+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.073+0000 7fda07fff640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b25524e6f0 0x55b255250ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.073+0000 7fda07fff640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b25524e6f0 0x55b255250ae0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.073+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.073+0000 7fda07fff640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd9f808abb0 0x7fd9f805c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.073+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fd9f808abb0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.073+0000 7fda10c6f640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd9f808abb0 0x7fd9f805c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.073+0000 7fda10c6f640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd9f808abb0 0x7fd9f805c3e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.074+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda0801f070 con 0x7fd9f808abb0 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.074+0000 7fda10c6f640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fda08031040 0x7fda08032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.074+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.074+0000 7fda1046e640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fda08031040 0x7fda08032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.074+0000 7fda1046e640 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fda08031040 0x7fda08032430 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x7fda08031040 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda00048040 con 0x55b2552484a0 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x55b2552484a0 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x7fda08031040 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x7fda08031040 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.075+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fd9f808abb0 2024-04-24T01:43:02.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.076+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda0801f070 con 0x7fd9f808abb0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.076+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.076+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.076+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.076+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x55b2552484a0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.076+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x7fda08031040 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x55b2552484a0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fd9f808abb0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda0801f070 con 0x7fd9f808abb0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.077+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00048040 con 0x7fda08031040 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.078+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.079+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.079+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.079+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.079+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.079+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.079+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fd9f808abb0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.080+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda0801f070 con 0x7fd9f808abb0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.080+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.080+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.080+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.080+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.080+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fd9f808abb0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda0801f070 con 0x7fd9f808abb0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b25524e6f0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.081+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fda08031040 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x55b2552484a0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2552510c0 con 0x7fd9f808abb0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda0801f070 con 0x7fd9f808abb0 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:02.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524d300 con 0x55b2552484a0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.082+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524dba0 con 0x55b2552484a0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b255251540 con 0x55b2552484a0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 zone default found 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 4 Realm: () 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 zonegroup default 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25524d7f0 con 0x7fda08031040 2024-04-24T01:43:02.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.083+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b255253920 con 0x55b25524e6f0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda15839800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b255253cc0 con 0x55b25524e6f0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda15839800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda15839800 20 started sync module instance, tier type = 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda15839800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.084+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255252d60 con 0x7fd9f808abb0 2024-04-24T01:43:02.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.085+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda08040040 con 0x7fd9f808abb0 2024-04-24T01:43:02.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.085+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94224421040464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255253570 con 0x7fd9f808abb0 2024-04-24T01:43:02.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.085+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255254a20 con 0x55b2552484a0 2024-04-24T01:43:02.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.086+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94224421040464] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda08040040 con 0x7fd9f808abb0 2024-04-24T01:43:02.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.086+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.086+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94224421044320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255254e10 con 0x55b2552484a0 2024-04-24T01:43:02.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.086+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255255850 con 0x55b25524e6f0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.087+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94224421044320] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.087+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.087+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94224421049120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255255c40 con 0x55b25524e6f0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.087+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255256640 con 0x7fd9f808abb0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.088+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94224421049120] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.088+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda08040040 con 0x7fd9f808abb0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.088+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94224421045376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255256a60 con 0x7fd9f808abb0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.088+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2552574b0 con 0x55b2552484a0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.089+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.089+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94224421056416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255257470 con 0x55b2552484a0 2024-04-24T01:43:02.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.089+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255258470 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.089+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94224421045376] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda08040040 con 0x7fd9f808abb0 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.090+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.090+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94224421052752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255258470 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.090+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255258e80 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.090+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94224421056416] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.091+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.091+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94224421052752] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.091+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94224421058704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255258e80 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.091+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255257f70 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.092+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94224421058704] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.092+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.092+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94224421063120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255258df0 con 0x7fda08031040 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.092+0000 7fda15839800 20 add_watcher() i=0 2024-04-24T01:43:02.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 20 add_watcher() i=1 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 20 add_watcher() i=2 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 20 add_watcher() i=3 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 20 add_watcher() i=4 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 20 add_watcher() i=5 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 20 add_watcher() i=6 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94224421063120] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 20 add_watcher() i=7 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.093+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25525c870 con 0x55b2552484a0 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.094+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.094+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94224421065616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255259c60 con 0x55b2552484a0 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94224421065616] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fd8c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 5 note: GC not initialized 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fd8c57e2640 20 reqs_thread_entry: start 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 20 Filter name: none 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fd836ffd640 20 reqs_thread_entry: start 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.095+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b25528fa10 con 0x55b2552484a0 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.096+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.096+0000 7fda15839800 20 rados_obj.operate() r=0 bl.length=582 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.096+0000 7fda15839800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.096+0000 7fda15839800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:02.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.096+0000 7fda15839800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.096+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255296050 con 0x55b2552484a0 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.097+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.097+0000 7fda15839800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.097+0000 7fda15839800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.097+0000 7fda15839800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.097+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94224421313216 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2552919d0 con 0x55b2552484a0 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94224421056416 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fda00036080 con 0x55b2552484a0 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fd8e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94224421056416 notifier 4408 bl.length()=732 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fd8e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fd8e77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fd8e77fe640 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd8d4003ea0 con 0x55b2552484a0 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(64 notify.4 [notify cookie 94224421313216 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== watch-notify(notify_complete (2) cookie 94224421313216 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b255213160 con 0x55b2552484a0 2024-04-24T01:43:02.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.098+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.115 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:43:01.682776Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.099+0000 7fd8c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.099+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94224421065616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2552949a0 con 0x55b2552484a0 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.100+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94224421065616] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.100+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94224421040464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255259390 con 0x7fd9f808abb0 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.101+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94224421040464] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda08040040 con 0x7fd9f808abb0 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.101+0000 7fda15839800 20 remove_watcher() i=0 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.101+0000 7fda15839800 2 removed watcher, disabling cache 2024-04-24T01:43:02.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.101+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94224421044320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255259390 con 0x55b2552484a0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.102+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94224421044320] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.102+0000 7fda15839800 20 remove_watcher() i=1 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.102+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94224421049120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255254060 con 0x55b25524e6f0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.103+0000 7fda07fff640 1 -- 172.21.15.131:0/335300142 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94224421049120] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f8066030 con 0x55b25524e6f0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.103+0000 7fda15839800 20 remove_watcher() i=2 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.103+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94224421045376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255259390 con 0x7fd9f808abb0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.104+0000 7fda10c6f640 1 -- 172.21.15.131:0/335300142 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94224421045376] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda08040040 con 0x7fd9f808abb0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.104+0000 7fda15839800 20 remove_watcher() i=3 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.104+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94224421056416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255259390 con 0x55b2552484a0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.105+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94224421056416] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x55b2552484a0 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.105+0000 7fda15839800 20 remove_watcher() i=4 2024-04-24T01:43:02.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.105+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94224421052752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255259390 con 0x7fda08031040 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.106+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94224421052752] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.106+0000 7fda15839800 20 remove_watcher() i=5 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.106+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94224421058704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255259390 con 0x7fda08031040 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.107+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94224421058704] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.107+0000 7fda15839800 20 remove_watcher() i=6 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.107+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94224421063120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b255257890 con 0x7fda08031040 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94224421063120] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda00053080 con 0x7fda08031040 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 20 remove_watcher() i=7 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fda08031040 msgr2=0x7fda08032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fda08031040 0x7fda08032430 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b2552484a0 msgr2=0x55b25524a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b2552484a0 0x55b25524a960 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd9f808abb0 msgr2=0x7fd9f805c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd9f808abb0 0x7fd9f805c3e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b25524e6f0 msgr2=0x55b255250ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b25524e6f0 0x55b255250ae0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8d8036950 msgr2=0x7fd8d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8d8036950 0x7fd8d8038e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55b2552180d0 tx=0x7fda0801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 msgr2=0x55b25523c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 --2- 172.21.15.131:0/335300142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255235300 0x55b25523c970 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8067ba0 tx=0x7fd9f808d940 comp rx=0 tx=0).stop 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 reap_dead start 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda1046e640 1 -- 172.21.15.131:0/335300142 reap_dead start 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 shutdown_connections 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 >> 172.21.15.131:0/335300142 conn(0x55b255231660 msgr2=0x55b25522ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 shutdown_connections 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.108+0000 7fda15839800 1 -- 172.21.15.131:0/335300142 wait complete. 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8e8036950 msgr2=0x7fd8e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8e8036950 0x7fd8e8038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55b255218950 tx=0x7fda08005840 comp rx=0 tx=0).stop 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255228080 msgr2=0x55b2552284a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255228080 0x55b2552284a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8005930 tx=0x7fd9f8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 shutdown_connections 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8e8036950 0x7fd8e8038e10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/3097949254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255228080 0x55b2552284a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 >> 172.21.15.131:0/3097949254 conn(0x55b25521c120 msgr2=0x55b25521c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 shutdown_connections 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/3097949254 wait complete. 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b255119480 msgr2=0x55b255216f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b255119480 0x55b255216f20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8f8036900 msgr2=0x7fd8f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8f8036900 0x7fd8f8038dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8054000 tx=0x7fd9f804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 msgr2=0x55b25520fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b25520fce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b210 tx=0x7fda00000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 shutdown_connections 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b255119480 0x55b255216f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd8f8036900 0x7fd8f8038dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 --2- 172.21.15.131:0/508785089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b255115970 0x55b25520fce0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 >> 172.21.15.131:0/508785089 conn(0x55b25510f320 msgr2=0x55b255114150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 shutdown_connections 2024-04-24T01:43:02.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.109+0000 7fda15839800 1 -- 172.21.15.131:0/508785089 wait complete. 2024-04-24T01:43:02.127 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:43:01.682776Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:02.127 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-24T01:43:02.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-24T01:43:02.127 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-24T01:43:02.207 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:02.207 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:02.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc95401f800 1 Processor -- start 2024-04-24T01:43:02.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc95401f800 1 -- start start 2024-04-24T01:43:02.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc95401f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5639413f4780 0x563941488e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc95401f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56394133ed40 con 0x5639413f5ac0 2024-04-24T01:43:02.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc95401f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5639413114d0 con 0x5639413f4780 2024-04-24T01:43:02.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc95131d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5639413f4780 0x563941488e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc951b1e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5639413f5ac0 0x5639413f4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56542/0 (socket says 172.21.15.131:56542) 2024-04-24T01:43:02.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.206+0000 7fc951b1e640 1 -- 172.21.15.131:0/1303789459 learned_addr learned my addr 172.21.15.131:0/1303789459 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:02.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.207+0000 7fc95131d640 1 -- 172.21.15.131:0/1303789459 >> v1:172.21.15.107:6789/0 conn(0x5639413f5ac0 legacy=0x5639413f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.207+0000 7fc950b1c640 1 -- 172.21.15.131:0/1303789459 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409143388 0 0) 0x56394133ed40 con 0x5639413f5ac0 2024-04-24T01:43:02.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.207+0000 7fc95131d640 1 -- 172.21.15.131:0/1303789459 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394133d590 con 0x5639413f4780 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95131d640 1 --2- 172.21.15.131:0/1303789459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941488e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc94801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7149f67e9885b884 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc950b1c640 1 -- 172.21.15.131:0/1303789459 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948057070 con 0x5639413f4780 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc950b1c640 1 -- 172.21.15.131:0/1303789459 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc948052570 con 0x5639413f4780 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc950b1c640 1 -- 172.21.15.131:0/1303789459 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948052870 con 0x5639413f4780 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95401f800 1 -- 172.21.15.131:0/1303789459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 msgr2=0x563941488e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95401f800 1 --2- 172.21.15.131:0/1303789459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941488e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc94801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95401f800 1 -- 172.21.15.131:0/1303789459 shutdown_connections 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95401f800 1 --2- 172.21.15.131:0/1303789459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941488e70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95401f800 1 -- 172.21.15.131:0/1303789459 >> 172.21.15.131:0/1303789459 conn(0x56394147b550 msgr2=0x56394147d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95401f800 1 -- 172.21.15.131:0/1303789459 shutdown_connections 2024-04-24T01:43:02.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.209+0000 7fc95401f800 1 -- 172.21.15.131:0/1303789459 wait complete. 2024-04-24T01:43:02.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.221+0000 7fc95401f800 1 Processor -- start 2024-04-24T01:43:02.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.221+0000 7fc95401f800 1 -- start start 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.221+0000 7fc95401f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941573490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.221+0000 7fc95401f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5639413cb3e0 con 0x5639413f4780 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.221+0000 7fc951b1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941573490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.221+0000 7fc951b1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941573490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41814/0 (socket says 172.21.15.131:41814) 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.221+0000 7fc951b1e640 1 -- 172.21.15.131:0/1674597764 learned_addr learned my addr 172.21.15.131:0/1674597764 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.222+0000 7fc951b1e640 1 -- 172.21.15.131:0/1674597764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563941573a60 con 0x5639413f4780 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.222+0000 7fc951b1e640 1 --2- 172.21.15.131:0/1674597764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941573490 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc944001e00 tx=0x7fc94400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212314080764879a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.222+0000 7fc83fe07640 1 -- 172.21.15.131:0/1674597764 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc944012020 con 0x5639413f4780 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.222+0000 7fc83fe07640 1 -- 172.21.15.131:0/1674597764 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94400e5c0 con 0x5639413f4780 2024-04-24T01:43:02.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.222+0000 7fc83fe07640 1 -- 172.21.15.131:0/1674597764 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94400e8e0 con 0x5639413f4780 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 -- 172.21.15.131:0/1674597764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 msgr2=0x563941573490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 --2- 172.21.15.131:0/1674597764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941573490 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc944001e00 tx=0x7fc94400b780 comp rx=0 tx=0).stop 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 -- 172.21.15.131:0/1674597764 shutdown_connections 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 --2- 172.21.15.131:0/1674597764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x563941573490 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 -- 172.21.15.131:0/1674597764 >> 172.21.15.131:0/1674597764 conn(0x56394147b550 msgr2=0x56394156edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 -- 172.21.15.131:0/1674597764 shutdown_connections 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 -- 172.21.15.131:0/1674597764 wait complete. 2024-04-24T01:43:02.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 Processor -- start 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 -- start start 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x56394157b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc95401f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56394148b6c0 con 0x5639413f4780 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc951b1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x56394157b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc951b1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x56394157b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41826/0 (socket says 172.21.15.131:41826) 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.223+0000 7fc951b1e640 1 -- 172.21.15.131:0/935932875 learned_addr learned my addr 172.21.15.131:0/935932875 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.224+0000 7fc951b1e640 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394157b570 con 0x5639413f4780 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.224+0000 7fc951b1e640 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x56394157b030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x563941574220 tx=0x7fc944000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.224+0000 7fc83e604640 1 -- 172.21.15.131:0/935932875 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc944012030 con 0x5639413f4780 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.224+0000 7fc83e604640 1 -- 172.21.15.131:0/935932875 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94401a700 con 0x5639413f4780 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.224+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56394157b800 con 0x5639413f4780 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.224+0000 7fc83e604640 1 -- 172.21.15.131:0/935932875 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94401a9e0 con 0x5639413f4780 2024-04-24T01:43:02.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.224+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394157e4b0 con 0x5639413f4780 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc83e604640 1 -- 172.21.15.131:0/935932875 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc944015020 con 0x5639413f4780 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc83e604640 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc838036950 0x7fc838038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc83e604640 1 -- 172.21.15.131:0/935932875 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc944020030 con 0x5639413f4780 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc95131d640 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc838036950 0x7fc838038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc95401f800 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639413f5ac0 0x563941582270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415827b0 con 0x5639413f5ac0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc95231f640 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639413f5ac0 0x563941582270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.225+0000 7fc95131d640 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc838036950 0x7fc838038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc94804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.226+0000 7fc95231f640 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639413f5ac0 0x563941582270 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.226+0000 7fc95231f640 1 -- 172.21.15.131:0/935932875 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94c00a4a0 con 0x5639413f5ac0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.226+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394157f840 con 0x5639413f5ac0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.226+0000 7fc95231f640 1 -- 172.21.15.131:0/935932875 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc94c00a4a0 con 0x5639413f5ac0 2024-04-24T01:43:02.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.226+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563941584590 con 0x5639413f5ac0 2024-04-24T01:43:02.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.226+0000 7fc95231f640 1 -- 172.21.15.131:0/935932875 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc94c00a4a0 con 0x5639413f5ac0 2024-04-24T01:43:02.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.226+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415838d0 con 0x5639413f5ac0 2024-04-24T01:43:02.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.227+0000 7fc95231f640 1 -- 172.21.15.131:0/935932875 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc94c00a4a0 con 0x5639413f5ac0 2024-04-24T01:43:02.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.227+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563941583d20 con 0x5639413f5ac0 2024-04-24T01:43:02.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.227+0000 7fc95231f640 1 -- 172.21.15.131:0/935932875 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc94c00a4a0 con 0x5639413f5ac0 2024-04-24T01:43:02.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.227+0000 7fc95401f800 1 Processor -- start 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.227+0000 7fc95401f800 1 -- start start 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95401f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563941593360 0x563941593780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95401f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5639413716b0 con 0x563941593360 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95131d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563941593360 0x563941593780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95131d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563941593360 0x563941593780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41836/0 (socket says 172.21.15.131:41836) 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95131d640 1 -- 172.21.15.131:0/1646799687 learned_addr learned my addr 172.21.15.131:0/1646799687 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95131d640 1 -- 172.21.15.131:0/1646799687 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563941593cc0 con 0x563941593360 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95131d640 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563941593360 0x563941593780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc94801bb80 tx=0x7fc948002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc8377fe640 1 -- 172.21.15.131:0/1646799687 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948057040 con 0x563941593360 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc8377fe640 1 -- 172.21.15.131:0/1646799687 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94806d070 con 0x563941593360 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563941594730 con 0x563941593360 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.228+0000 7fc8377fe640 1 -- 172.21.15.131:0/1646799687 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94805daf0 con 0x563941593360 2024-04-24T01:43:02.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.229+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563941594bd0 con 0x563941593360 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.229+0000 7fc8377fe640 1 -- 172.21.15.131:0/1646799687 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc948067070 con 0x563941593360 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc8377fe640 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc82c036950 0x7fc82c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc8377fe640 1 -- 172.21.15.131:0/1646799687 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc94808f860 con 0x563941593360 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95231f640 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc82c036950 0x7fc82c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95401f800 1 Processor -- start 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95401f800 1 -- start start 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95231f640 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc82c036950 0x7fc82c038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5639415833f0 tx=0x7fc94c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95401f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95401f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563941573de0 con 0x5639415a05a0 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95131d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95131d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41842/0 (socket says 172.21.15.131:41842) 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.230+0000 7fc95131d640 1 -- 172.21.15.131:0/182201753 learned_addr learned my addr 172.21.15.131:0/182201753 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95131d640 1 -- 172.21.15.131:0/182201753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639415a0f90 con 0x5639415a05a0 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95131d640 1 --2- 172.21.15.131:0/182201753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a09c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc948072fd0 tx=0x7fc948067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a05209ba52daaa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc8357fa640 1 -- 172.21.15.131:0/182201753 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948072460 con 0x5639415a05a0 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc8357fa640 1 -- 172.21.15.131:0/182201753 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94805dc90 con 0x5639415a05a0 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc8357fa640 1 -- 172.21.15.131:0/182201753 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948072600 con 0x5639415a05a0 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95401f800 1 -- 172.21.15.131:0/182201753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 msgr2=0x5639415a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95401f800 1 --2- 172.21.15.131:0/182201753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a09c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc948072fd0 tx=0x7fc948067ab0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95401f800 1 -- 172.21.15.131:0/182201753 shutdown_connections 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95401f800 1 --2- 172.21.15.131:0/182201753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a09c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95401f800 1 -- 172.21.15.131:0/182201753 >> 172.21.15.131:0/182201753 conn(0x56394159c900 msgr2=0x56394159a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95401f800 1 -- 172.21.15.131:0/182201753 shutdown_connections 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.231+0000 7fc95401f800 1 -- 172.21.15.131:0/182201753 wait complete. 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95401f800 1 Processor -- start 2024-04-24T01:43:02.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95401f800 1 -- start start 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95401f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95401f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5639415a1700 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95131d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95131d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41848/0 (socket says 172.21.15.131:41848) 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 learned_addr learned my addr 172.21.15.131:0/1078118948 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639415a8140 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.232+0000 7fc95131d640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a7c00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc948007000 tx=0x7fc94808db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.233+0000 7fc8237fe640 1 -- 172.21.15.131:0/1078118948 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94805cce0 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.233+0000 7fc8237fe640 1 -- 172.21.15.131:0/1078118948 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc948094070 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.233+0000 7fc8237fe640 1 -- 172.21.15.131:0/1078118948 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94805cea0 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.233+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639415a83d0 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.233+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639415ab080 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc8237fe640 1 -- 172.21.15.131:0/1078118948 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc94808fab0 con 0x5639415a05a0 2024-04-24T01:43:02.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc8237fe640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc81c036950 0x7fc81c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc8237fe640 1 -- 172.21.15.131:0/1078118948 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc9480610d0 con 0x5639415a05a0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc95231f640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc81c036950 0x7fc81c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc95231f640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc81c036950 0x7fc81c038e10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x56394157f790 tx=0x7fc94c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639415b36d0 0x5639415b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b62e0 con 0x5639415b36d0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.234+0000 7fc951b1e640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639415b36d0 0x5639415b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc951b1e640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639415b36d0 0x5639415b5b90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 20 realm 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b66f0 con 0x5639415b36d0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b6fc0 con 0x5639415b36d0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.235+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b7360 con 0x5639415b36d0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95401f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b7bb0 con 0x5639415b36d0 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95401f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95401f800 20 searching for the correct realm 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5639415b9920 0x5639415bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639415bc2f0 con 0x5639415b9920 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95131d640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5639415b9920 0x5639415bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.236+0000 7fc95131d640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5639415b9920 0x5639415bbd10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95131d640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc948087030 0x7fc9480998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639415bc2f0 con 0x7fc948087030 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95231f640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc948087030 0x7fc9480998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95231f640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc948087030 0x7fc9480998a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c01f070 con 0x7fc948087030 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95231f640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc94c031040 0x7fc94c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.237+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639415bc2f0 con 0x7fc94c031040 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc94c031040 0x7fc94c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc94c031040 0x7fc94c032940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639415bc2f0 con 0x5639415b36d0 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b36d0 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.238+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc948087030 2024-04-24T01:43:02.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c01f070 con 0x7fc948087030 2024-04-24T01:43:02.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.239+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b36d0 2024-04-24T01:43:02.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b36d0 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc948087030 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc94c01f070 con 0x7fc948087030 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.240+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.241+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b36d0 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b36d0 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.242+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc948087030 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.243+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c01f070 con 0x7fc948087030 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.243+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b36d0 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.243+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.243+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.243+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.243+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc948087030 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c01f070 con 0x7fc948087030 2024-04-24T01:43:02.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b9920 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc94c031040 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.244+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x5639415b36d0 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc944038080 con 0x7fc948087030 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94c01f070 con 0x7fc948087030 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:02.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b8530 con 0x5639415b36d0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b8dd0 con 0x5639415b36d0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.245+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415b8dd0 con 0x5639415b36d0 2024-04-24T01:43:02.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 zone default found 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 4 Realm: () 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 zonegroup default 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415bc770 con 0x7fc94c031040 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415be180 con 0x5639415b9920 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.246+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415be6f0 con 0x5639415b9920 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.247+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.247+0000 7fc95401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.247+0000 7fc95401f800 20 started sync module instance, tier type = 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.247+0000 7fc95401f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.247+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415bd5f0 con 0x7fc948087030 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.248+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.248+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94803909663200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415bf000 con 0x7fc948087030 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.248+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415bf850 con 0x5639415b36d0 2024-04-24T01:43:02.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.249+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94803909663200] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.249+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.249+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94803909667664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415bf4c0 con 0x5639415b36d0 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.249+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415bffe0 con 0x5639415b9920 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.250+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94803909667664] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.250+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.250+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94803909671600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c03d0 con 0x5639415b9920 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.250+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c0dd0 con 0x7fc948087030 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.251+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.251+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94803909671600] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.251+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94803909675232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c1670 con 0x7fc948087030 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.251+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415bef90 con 0x5639415b36d0 2024-04-24T01:43:02.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.252+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94803909675232] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.253+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.253+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94803909677504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c15e0 con 0x5639415b36d0 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.253+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c2600 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.254+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.254+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94803909677504] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.254+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94803909681424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c2570 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.254+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c1c60 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.255+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.255+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94803909680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c3520 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.255+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c3f70 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94803909681424] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94803909680224] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94803909683744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c3520 con 0x7fc94c031040 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 20 add_watcher() i=0 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 20 add_watcher() i=1 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 20 add_watcher() i=2 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 20 add_watcher() i=3 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 20 add_watcher() i=4 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 20 add_watcher() i=5 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.256+0000 7fc95401f800 20 add_watcher() i=6 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.257+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94803909683744] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.257+0000 7fc95401f800 20 add_watcher() i=7 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.257+0000 7fc95401f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.257+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415c6f60 con 0x5639415b36d0 2024-04-24T01:43:02.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.258+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.258+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94803909685360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415c43e0 con 0x5639415b36d0 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.258+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94803909685360] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc8037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 5 note: GC not initialized 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc8027fc640 20 reqs_thread_entry: start 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 20 Filter name: none 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc773fff640 20 reqs_thread_entry: start 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:02.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.259+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415fa150 con 0x5639415b36d0 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.260+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.260+0000 7fc95401f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.260+0000 7fc95401f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.260+0000 7fc95401f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.260+0000 7fc95401f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.260+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639416008b0 con 0x5639415b36d0 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc95401f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc95401f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc95401f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94803909935904 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415fc020 con 0x5639415b36d0 2024-04-24T01:43:02.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94803909677504 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56394157e4b0 con 0x5639415b36d0 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(64 notify.4 [notify cookie 94803909935904 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc834ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94803909677504 notifier 4415 bl.length()=567 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc834ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc834ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc834ff9640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc77c003430 con 0x5639415b36d0 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.261+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 94803909935904 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56394157b800 con 0x5639415b36d0 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.262+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563941600320 con 0x7fc948087030 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc95401f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94803909935904 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639415fbb70 con 0x7fc948087030 2024-04-24T01:43:02.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== watch-notify(notify (1) cookie 94803909663200 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fc94c0247b0 con 0x7fc948087030 2024-04-24T01:43:02.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc834ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94803909663200 notifier 4415 bl.length()=159 2024-04-24T01:43:02.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc834ff9640 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc77c003430 con 0x7fc948087030 2024-04-24T01:43:02.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [notify cookie 94803909935904 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.263+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== watch-notify(notify_complete (2) cookie 94803909935904 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc94c024980 con 0x7fc948087030 2024-04-24T01:43:02.276 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:02.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.264+0000 7fc8037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.264+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94803909685360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415fc020 con 0x5639415b36d0 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.265+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94803909685360] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.265+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94803909663200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415fc020 con 0x7fc948087030 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.266+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94803909663200] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.266+0000 7fc95401f800 20 remove_watcher() i=0 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.266+0000 7fc95401f800 2 removed watcher, disabling cache 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.266+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94803909667664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415fc020 con 0x5639415b36d0 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.267+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94803909667664] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.267+0000 7fc95401f800 20 remove_watcher() i=1 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.267+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94803909671600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415fc020 con 0x5639415b9920 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.268+0000 7fc95131d640 1 -- 172.21.15.131:0/1078118948 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94803909671600] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc948066030 con 0x5639415b9920 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.268+0000 7fc95401f800 20 remove_watcher() i=2 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.268+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94803909675232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415bfab0 con 0x7fc948087030 2024-04-24T01:43:02.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.269+0000 7fc95231f640 1 -- 172.21.15.131:0/1078118948 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94803909675232] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94c040040 con 0x7fc948087030 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.269+0000 7fc95401f800 20 remove_watcher() i=3 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.269+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94803909677504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415beb50 con 0x5639415b36d0 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.270+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94803909677504] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x5639415b36d0 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.270+0000 7fc95401f800 20 remove_watcher() i=4 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.270+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94803909681424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415beb50 con 0x7fc94c031040 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.271+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94803909681424] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.271+0000 7fc95401f800 20 remove_watcher() i=5 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.271+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94803909680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415beb50 con 0x7fc94c031040 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.273+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94803909680224] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.273+0000 7fc95401f800 20 remove_watcher() i=6 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.273+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94803909683744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639415beb50 con 0x7fc94c031040 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.273+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94803909683744] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94400dcd0 con 0x7fc94c031040 2024-04-24T01:43:02.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.273+0000 7fc95401f800 20 remove_watcher() i=7 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc94c031040 msgr2=0x7fc94c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc94c031040 0x7fc94c032940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639415b36d0 msgr2=0x5639415b5b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639415b36d0 0x5639415b5b90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc948087030 msgr2=0x7fc9480998a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc948087030 0x7fc9480998a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5639415b9920 msgr2=0x5639415bbd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5639415b9920 0x5639415bbd10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc81c036950 msgr2=0x7fc81c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc81c036950 0x7fc81c038e10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x56394157f790 tx=0x7fc94c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 msgr2=0x5639415a7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc951b1e640 1 -- 172.21.15.131:0/1078118948 reap_dead start 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a7c00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc948007000 tx=0x7fc94808db40 comp rx=0 tx=0).stop 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 shutdown_connections 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1078118948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639415a05a0 0x5639415a7c00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 >> 172.21.15.131:0/1078118948 conn(0x56394159c900 msgr2=0x563941599f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 shutdown_connections 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1078118948 wait complete. 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc82c036950 msgr2=0x7fc82c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc82c036950 0x7fc82c038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5639415833f0 tx=0x7fc94c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563941593360 msgr2=0x563941593780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563941593360 0x563941593780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc94801bb80 tx=0x7fc948002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 shutdown_connections 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc82c036950 0x7fc82c038e10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 --2- 172.21.15.131:0/1646799687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563941593360 0x563941593780 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 >> 172.21.15.131:0/1646799687 conn(0x563941587400 msgr2=0x563941587800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 shutdown_connections 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.274+0000 7fc95401f800 1 -- 172.21.15.131:0/1646799687 wait complete. 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639413f5ac0 msgr2=0x563941582270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639413f5ac0 0x563941582270 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc838036950 msgr2=0x7fc838038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc838036950 0x7fc838038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc94804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 msgr2=0x56394157b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x56394157b030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x563941574220 tx=0x7fc944000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 shutdown_connections 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5639413f5ac0 0x563941582270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc838036950 0x7fc838038e10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 --2- 172.21.15.131:0/935932875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639413f4780 0x56394157b030 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 >> 172.21.15.131:0/935932875 conn(0x56394147b550 msgr2=0x56394156d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 shutdown_connections 2024-04-24T01:43:02.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.275+0000 7fc95401f800 1 -- 172.21.15.131:0/935932875 wait complete. 2024-04-24T01:43:02.290 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:02.290 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:43:02.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:43:02.290 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-24T01:43:02.333 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:02.333 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:02.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.332+0000 7f890b72d800 1 Processor -- start 2024-04-24T01:43:02.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.332+0000 7f890b72d800 1 -- start start 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.332+0000 7f890b72d800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556f9c44e4a0 0x556f9c450890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.332+0000 7f890b72d800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f9c308d40 con 0x556f9c44a990 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.332+0000 7f890b72d800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x556f9c2db4d0 con 0x556f9c44e4a0 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.333+0000 7f8906c2e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556f9c44e4a0 0x556f9c450890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.333+0000 7f8906c2e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556f9c44e4a0 0x556f9c450890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41856/0 (socket says 172.21.15.131:41856) 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.333+0000 7f8906c2e640 1 -- 172.21.15.131:0/1022965165 learned_addr learned my addr 172.21.15.131:0/1022965165 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.333+0000 7f890742f640 1 --1- 172.21.15.131:0/1022965165 >> v1:172.21.15.107:6789/0 conn(0x556f9c44a990 0x556f9c44cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56546/0 (socket says 172.21.15.131:56546) 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.333+0000 7f8906c2e640 1 -- 172.21.15.131:0/1022965165 >> v1:172.21.15.107:6789/0 conn(0x556f9c44a990 legacy=0x556f9c44cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.333+0000 7f890642d640 1 -- 172.21.15.131:0/1022965165 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244533471 0 0) 0x556f9c308d40 con 0x556f9c44a990 2024-04-24T01:43:02.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.333+0000 7f8906c2e640 1 -- 172.21.15.131:0/1022965165 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f9c307590 con 0x556f9c44e4a0 2024-04-24T01:43:02.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f8906c2e640 1 --2- 172.21.15.131:0/1022965165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44e4a0 0x556f9c450890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00a520 tx=0x7f88fc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf788b9aa8730bb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890642d640 1 -- 172.21.15.131:0/1022965165 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc057070 con 0x556f9c44e4a0 2024-04-24T01:43:02.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890642d640 1 -- 172.21.15.131:0/1022965165 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc052570 con 0x556f9c44e4a0 2024-04-24T01:43:02.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890642d640 1 -- 172.21.15.131:0/1022965165 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc04ae60 con 0x556f9c44e4a0 2024-04-24T01:43:02.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890b72d800 1 -- 172.21.15.131:0/1022965165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44e4a0 msgr2=0x556f9c450890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890b72d800 1 --2- 172.21.15.131:0/1022965165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44e4a0 0x556f9c450890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00a520 tx=0x7f88fc01d010 comp rx=0 tx=0).stop 2024-04-24T01:43:02.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890b72d800 1 -- 172.21.15.131:0/1022965165 shutdown_connections 2024-04-24T01:43:02.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890b72d800 1 --2- 172.21.15.131:0/1022965165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44e4a0 0x556f9c450890 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.335+0000 7f890b72d800 1 -- 172.21.15.131:0/1022965165 >> 172.21.15.131:0/1022965165 conn(0x556f9c444320 msgr2=0x556f9c446740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.336+0000 7f890b72d800 1 -- 172.21.15.131:0/1022965165 shutdown_connections 2024-04-24T01:43:02.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.336+0000 7f890b72d800 1 -- 172.21.15.131:0/1022965165 wait complete. 2024-04-24T01:43:02.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.347+0000 7f890b72d800 1 Processor -- start 2024-04-24T01:43:02.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.347+0000 7f890b72d800 1 -- start start 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.347+0000 7f890b72d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c53af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.347+0000 7f890b72d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f9c3953c0 con 0x556f9c44a990 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.347+0000 7f890742f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c53af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.348+0000 7f890742f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c53af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41872/0 (socket says 172.21.15.131:41872) 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.348+0000 7f890742f640 1 -- 172.21.15.131:0/2874439092 learned_addr learned my addr 172.21.15.131:0/2874439092 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.348+0000 7f890742f640 1 -- 172.21.15.131:0/2874439092 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f9c53b520 con 0x556f9c44a990 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.348+0000 7f890742f640 1 --2- 172.21.15.131:0/2874439092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c53af50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b210 tx=0x7f88f800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570b2f2f6262521d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.348+0000 7f87f560a640 1 -- 172.21.15.131:0/2874439092 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f8008070 con 0x556f9c44a990 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.348+0000 7f87f560a640 1 -- 172.21.15.131:0/2874439092 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f800d500 con 0x556f9c44a990 2024-04-24T01:43:02.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.348+0000 7f87f560a640 1 -- 172.21.15.131:0/2874439092 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f800d840 con 0x556f9c44a990 2024-04-24T01:43:02.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 -- 172.21.15.131:0/2874439092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 msgr2=0x556f9c53af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 --2- 172.21.15.131:0/2874439092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c53af50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b210 tx=0x7f88f800b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 -- 172.21.15.131:0/2874439092 shutdown_connections 2024-04-24T01:43:02.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 --2- 172.21.15.131:0/2874439092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c53af50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 -- 172.21.15.131:0/2874439092 >> 172.21.15.131:0/2874439092 conn(0x556f9c444320 msgr2=0x556f9c536870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 -- 172.21.15.131:0/2874439092 shutdown_connections 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 -- 172.21.15.131:0/2874439092 wait complete. 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 Processor -- start 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 -- start start 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c542ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890b72d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f9c4530e0 con 0x556f9c44a990 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890742f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c542ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890742f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c542ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41884/0 (socket says 172.21.15.131:41884) 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.349+0000 7f890742f640 1 -- 172.21.15.131:0/912709470 learned_addr learned my addr 172.21.15.131:0/912709470 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.350+0000 7f890742f640 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f9c543010 con 0x556f9c44a990 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.350+0000 7f890742f640 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c542ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b210 tx=0x7f88f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.350+0000 7f87f3e07640 1 -- 172.21.15.131:0/912709470 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f800f950 con 0x556f9c44a990 2024-04-24T01:43:02.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.350+0000 7f87f3e07640 1 -- 172.21.15.131:0/912709470 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f800faf0 con 0x556f9c44a990 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.350+0000 7f87f3e07640 1 -- 172.21.15.131:0/912709470 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f800fdd0 con 0x556f9c44a990 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.350+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f9c5432a0 con 0x556f9c44a990 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.350+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f9c545f50 con 0x556f9c44a990 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f87f3e07640 1 -- 172.21.15.131:0/912709470 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f88f8017040 con 0x556f9c44a990 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f87f3e07640 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87ec0368b0 0x7f87ec038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f87f3e07640 1 -- 172.21.15.131:0/912709470 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f88f8015020 con 0x556f9c44a990 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f8906c2e640 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87ec0368b0 0x7f87ec038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f890b72d800 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c44e4a0 0x556f9c549d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c54a2a0 con 0x556f9c44e4a0 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f8907c30640 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c44e4a0 0x556f9c549d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.351+0000 7f8906c2e640 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87ec0368b0 0x7f87ec038d70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f88fc054000 tx=0x7f88fc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.352+0000 7f8907c30640 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c44e4a0 0x556f9c549d10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.352+0000 7f8907c30640 1 -- 172.21.15.131:0/912709470 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f890000a4a0 con 0x556f9c44e4a0 2024-04-24T01:43:02.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.352+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5472e0 con 0x556f9c44e4a0 2024-04-24T01:43:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.352+0000 7f8907c30640 1 -- 172.21.15.131:0/912709470 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f890000a4a0 con 0x556f9c44e4a0 2024-04-24T01:43:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.352+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c54c0c0 con 0x556f9c44e4a0 2024-04-24T01:43:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.352+0000 7f8907c30640 1 -- 172.21.15.131:0/912709470 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f890000a4a0 con 0x556f9c44e4a0 2024-04-24T01:43:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.352+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c54b400 con 0x556f9c44e4a0 2024-04-24T01:43:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.353+0000 7f8907c30640 1 -- 172.21.15.131:0/912709470 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f890000a4a0 con 0x556f9c44e4a0 2024-04-24T01:43:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.353+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c54b850 con 0x556f9c44e4a0 2024-04-24T01:43:02.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.353+0000 7f8907c30640 1 -- 172.21.15.131:0/912709470 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f890000a4a0 con 0x556f9c44e4a0 2024-04-24T01:43:02.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.353+0000 7f890b72d800 1 Processor -- start 2024-04-24T01:43:02.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.353+0000 7f890b72d800 1 -- start start 2024-04-24T01:43:02.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.353+0000 7f890b72d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a550 0x556f9c4489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.353+0000 7f890b72d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f9c33b6b0 con 0x556f9c44a550 2024-04-24T01:43:02.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f8906c2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a550 0x556f9c4489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f8906c2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a550 0x556f9c4489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41886/0 (socket says 172.21.15.131:41886) 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f8906c2e640 1 -- 172.21.15.131:0/1275078718 learned_addr learned my addr 172.21.15.131:0/1275078718 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f8906c2e640 1 -- 172.21.15.131:0/1275078718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f9c448f00 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f8906c2e640 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a550 0x556f9c4489c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88fc005930 tx=0x7f88fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f87f1602640 1 -- 172.21.15.131:0/1275078718 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc057040 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f87f1602640 1 -- 172.21.15.131:0/1275078718 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc05d650 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f9c449130 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f87f1602640 1 -- 172.21.15.131:0/1275078718 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc05d950 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.354+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f9c4495d0 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.355+0000 7f87f1602640 1 -- 172.21.15.131:0/1275078718 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f88fc067070 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.355+0000 7f87f1602640 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87e0036900 0x7f87e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.355+0000 7f87f1602640 1 -- 172.21.15.131:0/1275078718 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f88fc08f6f0 con 0x556f9c44a550 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.355+0000 7f8907c30640 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87e0036900 0x7f87e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.355+0000 7f890b72d800 1 Processor -- start 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.355+0000 7f890b72d800 1 -- start start 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.355+0000 7f8907c30640 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87e0036900 0x7f87e0038dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x556f9c54af20 tx=0x7f8900005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f890b72d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c56a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f890b72d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f9c53b8a0 con 0x556f9c56a2b0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f8906c2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c56a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f8906c2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c56a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41894/0 (socket says 172.21.15.131:41894) 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f8906c2e640 1 -- 172.21.15.131:0/1536633483 learned_addr learned my addr 172.21.15.131:0/1536633483 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f8906c2e640 1 -- 172.21.15.131:0/1536633483 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f9c56aca0 con 0x556f9c56a2b0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f8906c2e640 1 --2- 172.21.15.131:0/1536633483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c56a6d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f88fc08da40 tx=0x7f88fc05df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214301c2e745af23 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f87eaffd640 1 -- 172.21.15.131:0/1536633483 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc082070 con 0x556f9c56a2b0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f87eaffd640 1 -- 172.21.15.131:0/1536633483 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc08de50 con 0x556f9c56a2b0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.356+0000 7f87eaffd640 1 -- 172.21.15.131:0/1536633483 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc08b070 con 0x556f9c56a2b0 2024-04-24T01:43:02.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 -- 172.21.15.131:0/1536633483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 msgr2=0x556f9c56a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 --2- 172.21.15.131:0/1536633483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c56a6d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f88fc08da40 tx=0x7f88fc05df50 comp rx=0 tx=0).stop 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 -- 172.21.15.131:0/1536633483 shutdown_connections 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 --2- 172.21.15.131:0/1536633483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c56a6d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 -- 172.21.15.131:0/1536633483 >> 172.21.15.131:0/1536633483 conn(0x556f9c566610 msgr2=0x556f9c564670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 -- 172.21.15.131:0/1536633483 shutdown_connections 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 -- 172.21.15.131:0/1536633483 wait complete. 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 Processor -- start 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 -- start start 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c5719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f890b72d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f9c56b410 con 0x556f9c56a2b0 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f8906c2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c5719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f8906c2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c5719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41896/0 (socket says 172.21.15.131:41896) 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 learned_addr learned my addr 172.21.15.131:0/1612921602 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.357+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f9c571ee0 con 0x556f9c56a2b0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.358+0000 7f8906c2e640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c5719a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88fc080040 tx=0x7f88fc08d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.358+0000 7f87e97fa640 1 -- 172.21.15.131:0/1612921602 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc093070 con 0x556f9c56a2b0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.358+0000 7f87e97fa640 1 -- 172.21.15.131:0/1612921602 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc083040 con 0x556f9c56a2b0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.358+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f9c572170 con 0x556f9c56a2b0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.358+0000 7f87e97fa640 1 -- 172.21.15.131:0/1612921602 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88fc082070 con 0x556f9c56a2b0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.358+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f9c574e20 con 0x556f9c56a2b0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.358+0000 7f87e97fa640 1 -- 172.21.15.131:0/1612921602 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f88fc096070 con 0x556f9c56a2b0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f87e97fa640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87d0036900 0x7f87d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f87e97fa640 1 -- 172.21.15.131:0/1612921602 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f88fc099c90 con 0x556f9c56a2b0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f8907c30640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87d0036900 0x7f87d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c57d4c0 0x556f9c57f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5800b0 con 0x556f9c57d4c0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f890742f640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c57d4c0 0x556f9c57f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f8907c30640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87d0036900 0x7f87d0038dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x556f9c5438f0 tx=0x7f890001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f890742f640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c57d4c0 0x556f9c57f960 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.359+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 realm 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5804c0 con 0x556f9c57d4c0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c580d90 con 0x556f9c57d4c0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c581130 con 0x556f9c57d4c0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c581590 con 0x556f9c57d4c0 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 20 searching for the correct realm 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556f9c583580 0x556f9c585990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.360+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c583580 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.361+0000 7f8906c2e640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556f9c583580 0x556f9c585990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.361+0000 7f8906c2e640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556f9c583580 0x556f9c585990 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.361+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.361+0000 7f8906c2e640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f88fc098070 0x7f88fc05c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.361+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x7f88fc098070 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.361+0000 7f8907c30640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f88fc098070 0x7f88fc05c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.361+0000 7f8907c30640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f88fc098070 0x7f88fc05c770 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.362+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890001f070 con 0x7f88fc098070 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.362+0000 7f8907c30640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8900031040 0x7f8900032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.362+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x7f8900031040 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.362+0000 7f890742f640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8900031040 0x7f8900032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.362+0000 7f890742f640 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8900031040 0x7f8900032940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c57d4c0 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c57d4c0 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x7f8900031040 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.363+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x7f8900031040 2024-04-24T01:43:02.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x7f88fc098070 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890001f070 con 0x7f88fc098070 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c583580 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c57d4c0 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x7f8900031040 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.364+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c57d4c0 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x7f88fc098070 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f890001f070 con 0x7f88fc098070 2024-04-24T01:43:02.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f9c586060 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.365+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f8900031040 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c57d4c0 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c57d4c0 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.366+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f8900031040 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c583580 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f88fc098070 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890001f070 con 0x7f88fc098070 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c57d4c0 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.367+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f8900031040 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.368+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.368+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c583580 2024-04-24T01:43:02.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.368+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.368+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f8900031040 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.368+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.368+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f88fc098070 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890001f070 con 0x7f88fc098070 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c583580 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f8900031040 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x556f9c57d4c0 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f88fc0af040 con 0x7f88fc098070 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.369+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890001f070 con 0x7f88fc098070 2024-04-24T01:43:02.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c581fd0 con 0x556f9c57d4c0 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c582870 con 0x556f9c57d4c0 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c581c10 con 0x556f9c57d4c0 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 zone default found 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 4 Realm: () 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 zonegroup default 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5864e0 con 0x7f8900031040 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.370+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c588370 con 0x556f9c583580 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c588710 con 0x556f9c583580 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 20 started sync module instance, tier type = 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.371+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5877b0 con 0x7f88fc098070 2024-04-24T01:43:02.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.372+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8900040040 con 0x7f88fc098070 2024-04-24T01:43:02.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.372+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93937852775376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c587410 con 0x7f88fc098070 2024-04-24T01:43:02.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.372+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c589450 con 0x556f9c57d4c0 2024-04-24T01:43:02.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.373+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93937852775376] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8900040040 con 0x7f88fc098070 2024-04-24T01:43:02.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.373+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.373+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93937852779184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c589380 con 0x556f9c57d4c0 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.373+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c589ef0 con 0x556f9c583580 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.374+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93937852779184] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.374+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.374+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93937852780240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5892f0 con 0x556f9c583580 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.374+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58adb0 con 0x7f88fc098070 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.375+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8900040040 con 0x7f88fc098070 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.375+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93937852787424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58b550 con 0x7f88fc098070 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.375+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58c050 con 0x556f9c57d4c0 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.375+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93937852780240] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.376+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.376+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93937852791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58c010 con 0x556f9c57d4c0 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.376+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93937852787424] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8900040040 con 0x7f88fc098070 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.376+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58afe0 con 0x7f8900031040 2024-04-24T01:43:02.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.377+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.377+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93937852791616] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.377+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93937852794336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58afa0 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.377+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58d020 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.378+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93937852794336] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.378+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.378+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93937852785376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58d020 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.379+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58d9e0 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93937852785376] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93937852795392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58d9e0 con 0x7f8900031040 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 20 add_watcher() i=0 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 20 add_watcher() i=1 2024-04-24T01:43:02.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 20 add_watcher() i=2 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 20 add_watcher() i=3 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 20 add_watcher() i=4 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 20 add_watcher() i=5 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.380+0000 7f890b72d800 20 add_watcher() i=6 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.381+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93937852795392] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.381+0000 7f890b72d800 20 add_watcher() i=7 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.381+0000 7f890b72d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.381+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c590ce0 con 0x556f9c57d4c0 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.381+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.381+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93937852798624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58df70 con 0x556f9c57d4c0 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.382+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93937852798624] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.382+0000 7f87bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.382+0000 7f890b72d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.382+0000 7f890b72d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.382+0000 7f890b72d800 5 note: GC not initialized 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f87bcfe1640 20 reqs_thread_entry: start 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890b72d800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890b72d800 20 Filter name: none 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f87367fc640 20 reqs_thread_entry: start 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5c3ba0 con 0x556f9c57d4c0 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890b72d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890b72d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.383+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5c4590 con 0x556f9c57d4c0 2024-04-24T01:43:02.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.384+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.384+0000 7f890b72d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.384+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f9c5c55a0 con 0x7f88fc098070 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.384+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f8900040040 con 0x7f88fc098070 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.385+0000 7f87bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.385+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93937852798624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c590060 con 0x556f9c57d4c0 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.386+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93937852798624] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.386+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93937852775376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58d6a0 con 0x7f88fc098070 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.387+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93937852775376] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8900040040 con 0x7f88fc098070 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.387+0000 7f890b72d800 20 remove_watcher() i=0 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.387+0000 7f890b72d800 2 removed watcher, disabling cache 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.387+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93937852779184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58d6a0 con 0x556f9c57d4c0 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.388+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93937852779184] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.388+0000 7f890b72d800 20 remove_watcher() i=1 2024-04-24T01:43:02.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.388+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93937852780240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58d6a0 con 0x556f9c583580 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.389+0000 7f8906c2e640 1 -- 172.21.15.131:0/1612921602 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93937852780240] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88fc09f070 con 0x556f9c583580 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.389+0000 7f890b72d800 20 remove_watcher() i=2 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.389+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93937852787424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c587bd0 con 0x7f88fc098070 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.390+0000 7f8907c30640 1 -- 172.21.15.131:0/1612921602 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93937852787424] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8900040040 con 0x7f88fc098070 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.390+0000 7f890b72d800 20 remove_watcher() i=3 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.390+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93937852791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58aae0 con 0x556f9c57d4c0 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.391+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93937852791616] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x556f9c57d4c0 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.391+0000 7f890b72d800 20 remove_watcher() i=4 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.391+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93937852794336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58aae0 con 0x7f8900031040 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.391+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93937852794336] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.391+0000 7f890b72d800 20 remove_watcher() i=5 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.391+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93937852785376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58c5e0 con 0x7f8900031040 2024-04-24T01:43:02.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.392+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93937852785376] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.392+0000 7f890b72d800 20 remove_watcher() i=6 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.392+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93937852795392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f9c58aae0 con 0x7f8900031040 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93937852795392] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f802d070 con 0x7f8900031040 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 20 remove_watcher() i=7 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8900031040 msgr2=0x7f8900032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8900031040 0x7f8900032940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c57d4c0 msgr2=0x556f9c57f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c57d4c0 0x556f9c57f960 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f88fc098070 msgr2=0x7f88fc05c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f88fc098070 0x7f88fc05c770 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556f9c583580 msgr2=0x556f9c585990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.393+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556f9c583580 0x556f9c585990 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87d0036900 msgr2=0x7f87d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87d0036900 0x7f87d0038dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x556f9c5438f0 tx=0x7f890001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 msgr2=0x556f9c5719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890742f640 1 -- 172.21.15.131:0/1612921602 reap_dead start 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c5719a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88fc080040 tx=0x7f88fc08d9d0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 shutdown_connections 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/1612921602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c56a2b0 0x556f9c5719a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 >> 172.21.15.131:0/1612921602 conn(0x556f9c566610 msgr2=0x556f9c563c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 shutdown_connections 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1612921602 wait complete. 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87e0036900 msgr2=0x7f87e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87e0036900 0x7f87e0038dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x556f9c54af20 tx=0x7f8900005840 comp rx=0 tx=0).stop 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a550 msgr2=0x556f9c4489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a550 0x556f9c4489c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88fc005930 tx=0x7f88fc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 shutdown_connections 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87e0036900 0x7f87e0038dc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/1275078718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a550 0x556f9c4489c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 >> 172.21.15.131:0/1275078718 conn(0x556f9c54ef30 msgr2=0x556f9c54f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 shutdown_connections 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/1275078718 wait complete. 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c44e4a0 msgr2=0x556f9c549d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.394+0000 7f890b72d800 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c44e4a0 0x556f9c549d10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87ec0368b0 msgr2=0x7f87ec038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87ec0368b0 0x7f87ec038d70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f88fc054000 tx=0x7f88fc04e000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 msgr2=0x556f9c542ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c542ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b210 tx=0x7f88f8000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 shutdown_connections 2024-04-24T01:43:02.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556f9c44e4a0 0x556f9c549d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f87ec0368b0 0x7f87ec038d70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 --2- 172.21.15.131:0/912709470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f9c44a990 0x556f9c542ad0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 >> 172.21.15.131:0/912709470 conn(0x556f9c444320 msgr2=0x556f9c5350b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 shutdown_connections 2024-04-24T01:43:02.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.395+0000 7f890b72d800 1 -- 172.21.15.131:0/912709470 wait complete. 2024-04-24T01:43:02.410 INFO:teuthology.orchestra.run.smithi131.stdout:[] 2024-04-24T01:43:02.410 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:43:02.410 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-24T01:43:02.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-24T01:43:02.411 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-24T01:43:02.493 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:02.493 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:02.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.492+0000 7ff598d1f800 1 Processor -- start 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.492+0000 7ff598d1f800 1 -- start start 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff598d1f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55babb9201b0 0x55babb9225a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff598d1f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55babb7dbd40 con 0x55babb91bd20 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff598d1f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55babb7ae4d0 con 0x55babb9201b0 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff58c1c9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55babb9201b0 0x55babb9225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff5949ca640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55babb91bd20 0x55babb91c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56548/0 (socket says 172.21.15.131:56548) 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff5949ca640 1 -- 172.21.15.131:0/1655262709 learned_addr learned my addr 172.21.15.131:0/1655262709 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff58c1c9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55babb9201b0 0x55babb9225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41908/0 (socket says 172.21.15.131:41908) 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff58c1c9640 1 -- 172.21.15.131:0/1655262709 >> v1:172.21.15.107:6789/0 conn(0x55babb91bd20 legacy=0x55babb91c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.493+0000 7ff58c1c9640 1 -- 172.21.15.131:0/1655262709 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babb7da590 con 0x55babb9201b0 2024-04-24T01:43:02.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.495+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/1655262709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb9201b0 0x55babb9225a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00a470 tx=0x7ff57c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e014c643e77991ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.495+0000 7ff58ffff640 1 -- 172.21.15.131:0/1655262709 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c057070 con 0x55babb9201b0 2024-04-24T01:43:02.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.495+0000 7ff58ffff640 1 -- 172.21.15.131:0/1655262709 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c052570 con 0x55babb9201b0 2024-04-24T01:43:02.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.495+0000 7ff58ffff640 1 -- 172.21.15.131:0/1655262709 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c052870 con 0x55babb9201b0 2024-04-24T01:43:02.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.496+0000 7ff598d1f800 1 -- 172.21.15.131:0/1655262709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb9201b0 msgr2=0x55babb9225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.496+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1655262709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb9201b0 0x55babb9225a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00a470 tx=0x7ff57c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:02.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.496+0000 7ff598d1f800 1 -- 172.21.15.131:0/1655262709 shutdown_connections 2024-04-24T01:43:02.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.496+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1655262709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb9201b0 0x55babb9225a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.496+0000 7ff598d1f800 1 -- 172.21.15.131:0/1655262709 >> 172.21.15.131:0/1655262709 conn(0x55babb917380 msgr2=0x55babb9197a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.496+0000 7ff598d1f800 1 -- 172.21.15.131:0/1655262709 shutdown_connections 2024-04-24T01:43:02.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.496+0000 7ff598d1f800 1 -- 172.21.15.131:0/1655262709 wait complete. 2024-04-24T01:43:02.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.507+0000 7ff598d1f800 1 Processor -- start 2024-04-24T01:43:02.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.507+0000 7ff598d1f800 1 -- start start 2024-04-24T01:43:02.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.508+0000 7ff598d1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba0e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.508+0000 7ff598d1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55babb8683c0 con 0x55babb91bd20 2024-04-24T01:43:02.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.508+0000 7ff5949ca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba0e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.508+0000 7ff5949ca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba0e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41916/0 (socket says 172.21.15.131:41916) 2024-04-24T01:43:02.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.508+0000 7ff5949ca640 1 -- 172.21.15.131:0/2019625767 learned_addr learned my addr 172.21.15.131:0/2019625767 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.508+0000 7ff5949ca640 1 -- 172.21.15.131:0/2019625767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babba0e6a0 con 0x55babb91bd20 2024-04-24T01:43:02.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff5949ca640 1 --2- 172.21.15.131:0/2019625767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba0e0d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff584001e10 tx=0x7ff58400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac6d21ffaff7a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff482e0d640 1 -- 172.21.15.131:0/2019625767 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584012020 con 0x55babb91bd20 2024-04-24T01:43:02.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff482e0d640 1 -- 172.21.15.131:0/2019625767 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58400e5a0 con 0x55babb91bd20 2024-04-24T01:43:02.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff482e0d640 1 -- 172.21.15.131:0/2019625767 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff58400e8e0 con 0x55babb91bd20 2024-04-24T01:43:02.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff598d1f800 1 -- 172.21.15.131:0/2019625767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 msgr2=0x55babba0e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff598d1f800 1 --2- 172.21.15.131:0/2019625767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba0e0d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff584001e10 tx=0x7ff58400b780 comp rx=0 tx=0).stop 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff598d1f800 1 -- 172.21.15.131:0/2019625767 shutdown_connections 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff598d1f800 1 --2- 172.21.15.131:0/2019625767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba0e0d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff598d1f800 1 -- 172.21.15.131:0/2019625767 >> 172.21.15.131:0/2019625767 conn(0x55babb917380 msgr2=0x55babba0c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff598d1f800 1 -- 172.21.15.131:0/2019625767 shutdown_connections 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.509+0000 7ff598d1f800 1 -- 172.21.15.131:0/2019625767 wait complete. 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff598d1f800 1 Processor -- start 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff598d1f800 1 -- start start 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff598d1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba15c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff598d1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55babb922e70 con 0x55babb91bd20 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff5949ca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba15c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff5949ca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba15c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41930/0 (socket says 172.21.15.131:41930) 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff5949ca640 1 -- 172.21.15.131:0/1737210327 learned_addr learned my addr 172.21.15.131:0/1737210327 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.510+0000 7ff5949ca640 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babba16160 con 0x55babb91bd20 2024-04-24T01:43:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.511+0000 7ff5949ca640 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba15c20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff58400b7c0 tx=0x7ff584000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.511+0000 7ff48160a640 1 -- 172.21.15.131:0/1737210327 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584012030 con 0x55babb91bd20 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.511+0000 7ff48160a640 1 -- 172.21.15.131:0/1737210327 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff584001470 con 0x55babb91bd20 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.511+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55babba163f0 con 0x55babb91bd20 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.511+0000 7ff48160a640 1 -- 172.21.15.131:0/1737210327 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff58401a8d0 con 0x55babb91bd20 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.511+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babba190a0 con 0x55babb91bd20 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.511+0000 7ff48160a640 1 -- 172.21.15.131:0/1737210327 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff584015020 con 0x55babb91bd20 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff48160a640 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff47c036900 0x7ff47c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff48160a640 1 -- 172.21.15.131:0/1737210327 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff584020030 con 0x55babb91bd20 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff47c036900 0x7ff47c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babb9201b0 0x55babba1ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba1d3f0 con 0x55babb9201b0 2024-04-24T01:43:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff5951cb640 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babb9201b0 0x55babba1ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff47c036900 0x7ff47c038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff57c054000 tx=0x7ff57c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.512+0000 7ff5951cb640 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babb9201b0 0x55babba1ce60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff5951cb640 1 -- 172.21.15.131:0/1737210327 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff59000a4a0 con 0x55babb9201b0 2024-04-24T01:43:02.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba1a430 con 0x55babb9201b0 2024-04-24T01:43:02.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff5951cb640 1 -- 172.21.15.131:0/1737210327 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff59000a4a0 con 0x55babb9201b0 2024-04-24T01:43:02.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba1f230 con 0x55babb9201b0 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff5951cb640 1 -- 172.21.15.131:0/1737210327 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff59000a4a0 con 0x55babb9201b0 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba1e570 con 0x55babb9201b0 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff5951cb640 1 -- 172.21.15.131:0/1737210327 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff59000a4a0 con 0x55babb9201b0 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.513+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba1e9c0 con 0x55babb9201b0 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff5951cb640 1 -- 172.21.15.131:0/1737210327 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff59000a4a0 con 0x55babb9201b0 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff598d1f800 1 Processor -- start 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff598d1f800 1 -- start start 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff598d1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba0a010 0x55babba08480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff598d1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55babb80e6b0 con 0x55babba0a010 2024-04-24T01:43:02.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff58c1c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba0a010 0x55babba08480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff58c1c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba0a010 0x55babba08480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41946/0 (socket says 172.21.15.131:41946) 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.514+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3358958149 learned_addr learned my addr 172.21.15.131:0/3358958149 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.515+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3358958149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babba089c0 con 0x55babba0a010 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.515+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba0a010 0x55babba08480 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff57c044840 tx=0x7ff57c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.515+0000 7ff47a7fc640 1 -- 172.21.15.131:0/3358958149 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c06f070 con 0x55babba0a010 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.515+0000 7ff47a7fc640 1 -- 172.21.15.131:0/3358958149 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c058040 con 0x55babba0a010 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.515+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55babba08bf0 con 0x55babba0a010 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.515+0000 7ff47a7fc640 1 -- 172.21.15.131:0/3358958149 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c057050 con 0x55babba0a010 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.515+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babba09090 con 0x55babba0a010 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff47a7fc640 1 -- 172.21.15.131:0/3358958149 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff57c072070 con 0x55babba0a010 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff47a7fc640 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff46c036950 0x7ff46c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff47a7fc640 1 -- 172.21.15.131:0/3358958149 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff57c08fa00 con 0x55babba0a010 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff5951cb640 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff46c036950 0x7ff46c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff598d1f800 1 Processor -- start 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff598d1f800 1 -- start start 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff5951cb640 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff46c036950 0x7ff46c038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55babba1e090 tx=0x7ff590005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff598d1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba3d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.516+0000 7ff598d1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55babba0ea20 con 0x55babba3d450 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff58c1c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba3d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff58c1c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba3d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41950/0 (socket says 172.21.15.131:41950) 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff58c1c9640 1 -- 172.21.15.131:0/2465228468 learned_addr learned my addr 172.21.15.131:0/2465228468 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff58c1c9640 1 -- 172.21.15.131:0/2465228468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babba3de40 con 0x55babba3d450 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/2465228468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba3d870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff57c05f4a0 tx=0x7ff57c08e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e06b5ae5cea9975 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff46bfff640 1 -- 172.21.15.131:0/2465228468 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c087070 con 0x55babba3d450 2024-04-24T01:43:02.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff46bfff640 1 -- 172.21.15.131:0/2465228468 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c05e480 con 0x55babba3d450 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.517+0000 7ff46bfff640 1 -- 172.21.15.131:0/2465228468 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c072360 con 0x55babba3d450 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 -- 172.21.15.131:0/2465228468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 msgr2=0x55babba3d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 --2- 172.21.15.131:0/2465228468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba3d870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff57c05f4a0 tx=0x7ff57c08e000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 -- 172.21.15.131:0/2465228468 shutdown_connections 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 --2- 172.21.15.131:0/2465228468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba3d870 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 -- 172.21.15.131:0/2465228468 >> 172.21.15.131:0/2465228468 conn(0x55babba397b0 msgr2=0x55babba37810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 -- 172.21.15.131:0/2465228468 shutdown_connections 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 -- 172.21.15.131:0/2465228468 wait complete. 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 Processor -- start 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 -- start start 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba44b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff598d1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55babba3e5b0 con 0x55babba3d450 2024-04-24T01:43:02.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff58c1c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba44b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff58c1c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba44b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41962/0 (socket says 172.21.15.131:41962) 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.518+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 learned_addr learned my addr 172.21.15.131:0/3772749852 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.519+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babba450a0 con 0x55babba3d450 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.519+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba44b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff57c073fd0 tx=0x7ff57c08dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.519+0000 7ff46a7fc640 1 -- 172.21.15.131:0/3772749852 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c087030 con 0x55babba3d450 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.519+0000 7ff46a7fc640 1 -- 172.21.15.131:0/3772749852 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c05fd50 con 0x55babba3d450 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.519+0000 7ff46a7fc640 1 -- 172.21.15.131:0/3772749852 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c0726e0 con 0x55babba3d450 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.519+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55babba45330 con 0x55babba3d450 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.519+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babba47fe0 con 0x55babba3d450 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff46a7fc640 1 -- 172.21.15.131:0/3772749852 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff57c072880 con 0x55babba3d450 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff46a7fc640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff460036900 0x7ff460038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff46a7fc640 1 -- 172.21.15.131:0/3772749852 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff57c088070 con 0x55babba3d450 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff5951cb640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff460036900 0x7ff460038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babba50630 0x55babba52ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba53220 con 0x55babba50630 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.520+0000 7ff5949ca640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babba50630 0x55babba52ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff5951cb640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff460036900 0x7ff460038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55babba16e40 tx=0x7ff59001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff5949ca640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babba50630 0x55babba52ad0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 20 realm 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba53630 con 0x55babba50630 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba53f00 con 0x55babba50630 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.521+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba542a0 con 0x55babba50630 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff598d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba54700 con 0x55babba50630 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff598d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:02.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff598d1f800 20 searching for the correct realm 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55babba56750 0x55babba58b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55babba56750 0x55babba58b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.522+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55babba56750 0x55babba58b40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff58c1c9640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff57c082070 0x7ff57c0693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff57c082070 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff5951cb640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff57c082070 0x7ff57c0693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff5951cb640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff57c082070 0x7ff57c0693a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff59001f070 con 0x7ff57c082070 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff5951cb640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff590031040 0x7ff590032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.523+0000 7ff5949ca640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff590031040 0x7ff590032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.524+0000 7ff5949ca640 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff590031040 0x7ff590032940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.524+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.524+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.524+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.524+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.524+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.524+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff57c082070 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff59001f070 con 0x7ff57c082070 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.525+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff57c082070 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff59001f070 con 0x7ff57c082070 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.526+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.527+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.527+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.527+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.527+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.527+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.527+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.528+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.529+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.529+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.529+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff57c082070 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.529+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff59001f070 con 0x7ff57c082070 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.529+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.529+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.529+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff57c082070 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff59001f070 con 0x7ff57c082070 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.530+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba56750 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.531+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.531+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff590031040 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.531+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.531+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x55babba50630 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.531+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.531+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55babba591f0 con 0x7ff57c082070 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff59001f070 con 0x7ff57c082070 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba551a0 con 0x55babba50630 2024-04-24T01:43:02.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba55a40 con 0x55babba50630 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba54de0 con 0x55babba50630 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 zone default found 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 4 Realm: () 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:02.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 zonegroup default 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.532+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba59650 con 0x7ff590031040 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba5b4e0 con 0x55babba56750 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba5b880 con 0x55babba56750 2024-04-24T01:43:02.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 20 started sync module instance, tier type = 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.533+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5a920 con 0x7ff57c082070 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.534+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590040040 con 0x7ff57c082070 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.534+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94260500475200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5c0d0 con 0x7ff57c082070 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.534+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5c920 con 0x55babba50630 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.535+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94260500475200] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590040040 con 0x7ff57c082070 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.536+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.536+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94260500479008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5c590 con 0x55babba50630 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.536+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5d0b0 con 0x55babba56750 2024-04-24T01:43:02.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.537+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94260500479008] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.537+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.537+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94260500482944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5d4a0 con 0x55babba56750 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.537+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5dea0 con 0x7ff57c082070 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.538+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590040040 con 0x7ff57c082070 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.538+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94260500486576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5e740 con 0x7ff57c082070 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.538+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5f240 con 0x55babba50630 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.538+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94260500482944] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.539+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.539+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94260500491568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5f200 con 0x55babba50630 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.539+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5fc80 con 0x7ff590031040 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.539+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94260500486576] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590040040 con 0x7ff57c082070 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.540+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.540+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94260500488848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5fc80 con 0x7ff590031040 2024-04-24T01:43:02.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.540+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba60680 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.540+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94260500491568] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.541+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94260500488848] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.541+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.541+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94260500480064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5f810 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.541+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba60d10 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94260500480064] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94260500498528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba61130 con 0x7ff590031040 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 20 add_watcher() i=0 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 20 add_watcher() i=1 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 20 add_watcher() i=2 2024-04-24T01:43:02.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 20 add_watcher() i=3 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 20 add_watcher() i=4 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 20 add_watcher() i=5 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.542+0000 7ff598d1f800 20 add_watcher() i=6 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.543+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94260500498528] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.543+0000 7ff598d1f800 20 add_watcher() i=7 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.543+0000 7ff598d1f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.543+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba64160 con 0x55babba50630 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.543+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.543+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94260500499584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba61550 con 0x55babba50630 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.544+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94260500499584] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.544+0000 7ff44afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.544+0000 7ff598d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.544+0000 7ff598d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:02.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.544+0000 7ff598d1f800 5 note: GC not initialized 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff449fe3640 20 reqs_thread_entry: start 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff598d1f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff598d1f800 20 Filter name: none 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff3bb7fe640 20 reqs_thread_entry: start 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba96d30 con 0x55babba50630 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff598d1f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff598d1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.545+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba97720 con 0x55babba50630 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.546+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.546+0000 7ff598d1f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:02.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.546+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55babba98730 con 0x7ff57c082070 2024-04-24T01:43:02.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.546+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff590040040 con 0x7ff57c082070 2024-04-24T01:43:02.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.547+0000 7ff44afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.547+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94260500499584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba61550 con 0x55babba50630 2024-04-24T01:43:02.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.548+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94260500499584] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.548+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94260500475200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba61130 con 0x7ff57c082070 2024-04-24T01:43:02.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.548+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94260500475200] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590040040 con 0x7ff57c082070 2024-04-24T01:43:02.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.549+0000 7ff598d1f800 20 remove_watcher() i=0 2024-04-24T01:43:02.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.549+0000 7ff598d1f800 2 removed watcher, disabling cache 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.549+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94260500479008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5ad40 con 0x55babba50630 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.550+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94260500479008] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.550+0000 7ff598d1f800 20 remove_watcher() i=1 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.550+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94260500482944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5ad40 con 0x55babba56750 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.550+0000 7ff58c1c9640 1 -- 172.21.15.131:0/3772749852 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94260500482944] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071030 con 0x55babba56750 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.551+0000 7ff598d1f800 20 remove_watcher() i=2 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.551+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94260500486576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5cb80 con 0x7ff57c082070 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.551+0000 7ff5951cb640 1 -- 172.21.15.131:0/3772749852 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94260500486576] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590040040 con 0x7ff57c082070 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.551+0000 7ff598d1f800 20 remove_watcher() i=3 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.551+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94260500491568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5bc20 con 0x55babba50630 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.553+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94260500491568] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x55babba50630 2024-04-24T01:43:02.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.553+0000 7ff598d1f800 20 remove_watcher() i=4 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.553+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94260500488848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5bc20 con 0x7ff590031040 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.554+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94260500488848] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.554+0000 7ff598d1f800 20 remove_watcher() i=5 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.554+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94260500480064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5e290 con 0x7ff590031040 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.555+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94260500480064] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.555+0000 7ff598d1f800 20 remove_watcher() i=6 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.555+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94260500498528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55babba5e290 con 0x7ff590031040 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94260500498528] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584018950 con 0x7ff590031040 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 20 remove_watcher() i=7 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff590031040 msgr2=0x7ff590032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff590031040 0x7ff590032940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babba50630 msgr2=0x55babba52ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babba50630 0x55babba52ad0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff57c082070 msgr2=0x7ff57c0693a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff57c082070 0x7ff57c0693a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55babba56750 msgr2=0x55babba58b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55babba56750 0x55babba58b40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff460036900 msgr2=0x7ff460038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff460036900 0x7ff460038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55babba16e40 tx=0x7ff59001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 msgr2=0x55babba44b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff5949ca640 1 -- 172.21.15.131:0/3772749852 reap_dead start 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba44b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff57c073fd0 tx=0x7ff57c08dce0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 shutdown_connections 2024-04-24T01:43:02.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3772749852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba3d450 0x55babba44b60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 >> 172.21.15.131:0/3772749852 conn(0x55babba397b0 msgr2=0x55babba36e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 shutdown_connections 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3772749852 wait complete. 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff46c036950 msgr2=0x7ff46c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff46c036950 0x7ff46c038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55babba1e090 tx=0x7ff590005840 comp rx=0 tx=0).stop 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba0a010 msgr2=0x55babba08480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba0a010 0x55babba08480 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff57c044840 tx=0x7ff57c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 shutdown_connections 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff46c036950 0x7ff46c038e10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 --2- 172.21.15.131:0/3358958149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babba0a010 0x55babba08480 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 >> 172.21.15.131:0/3358958149 conn(0x55babba220a0 msgr2=0x55babba224a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.556+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 shutdown_connections 2024-04-24T01:43:02.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/3358958149 wait complete. 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babb9201b0 msgr2=0x55babba1ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babb9201b0 0x55babba1ce60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff47c036900 msgr2=0x7ff47c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff47c036900 0x7ff47c038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff57c054000 tx=0x7ff57c04e000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 msgr2=0x55babba15c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba15c20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff58400b7c0 tx=0x7ff584000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 shutdown_connections 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55babb9201b0 0x55babba1ce60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff47c036900 0x7ff47c038dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 --2- 172.21.15.131:0/1737210327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55babb91bd20 0x55babba15c20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 >> 172.21.15.131:0/1737210327 conn(0x55babb917380 msgr2=0x55babba0a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 shutdown_connections 2024-04-24T01:43:02.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.557+0000 7ff598d1f800 1 -- 172.21.15.131:0/1737210327 wait complete. 2024-04-24T01:43:02.571 INFO:teuthology.orchestra.run.smithi131.stdout:[] 2024-04-24T01:43:02.571 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:43:02.586 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:02.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-24T01:43:02.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-24T01:43:02.586 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-24T01:43:02.655 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:02.655 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:02.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.654+0000 7f37a0e2f800 1 Processor -- start 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.654+0000 7f37a0e2f800 1 -- start start 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.654+0000 7f37a0e2f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5555ef719d20 0x5555ef71a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.654+0000 7f37a0e2f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555ef5d9d40 con 0x5555ef71af80 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.654+0000 7f37a0e2f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5555ef5ac4d0 con 0x5555ef719d20 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.655+0000 7f379c1c0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5555ef719d20 0x5555ef71a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.655+0000 7f3793fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5555ef71af80 0x5555ef71b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56564/0 (socket says 172.21.15.131:56564) 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.655+0000 7f379c1c0640 1 --2- 172.21.15.131:0/2491825441 >> v2:172.21.15.107:3300/0 conn(0x5555ef719d20 0x5555ef71a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41966/0 (socket says 172.21.15.131:41966) 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.655+0000 7f3793fff640 1 -- 172.21.15.131:0/2491825441 learned_addr learned my addr 172.21.15.131:0/2491825441 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.655+0000 7f379c1c0640 1 -- 172.21.15.131:0/2491825441 >> v1:172.21.15.107:6789/0 conn(0x5555ef71af80 legacy=0x5555ef71b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.655+0000 7f379b9bf640 1 -- 172.21.15.131:0/2491825441 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835086850 0 0) 0x5555ef5d9d40 con 0x5555ef71af80 2024-04-24T01:43:02.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.655+0000 7f379c1c0640 1 -- 172.21.15.131:0/2491825441 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ef5d8590 con 0x5555ef719d20 2024-04-24T01:43:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f379c1c0640 1 --2- 172.21.15.131:0/2491825441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef71a140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f378c00a470 tx=0x7f378c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1737b8eb39bc500b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f379b9bf640 1 -- 172.21.15.131:0/2491825441 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c057070 con 0x5555ef719d20 2024-04-24T01:43:02.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f379b9bf640 1 -- 172.21.15.131:0/2491825441 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c052570 con 0x5555ef719d20 2024-04-24T01:43:02.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f379b9bf640 1 -- 172.21.15.131:0/2491825441 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c052870 con 0x5555ef719d20 2024-04-24T01:43:02.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2491825441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 msgr2=0x5555ef71a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/2491825441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef71a140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f378c00a470 tx=0x7f378c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:02.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2491825441 shutdown_connections 2024-04-24T01:43:02.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/2491825441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef71a140 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.657+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2491825441 >> 172.21.15.131:0/2491825441 conn(0x5555ef715380 msgr2=0x5555ef7177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.658+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2491825441 shutdown_connections 2024-04-24T01:43:02.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.658+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2491825441 wait complete. 2024-04-24T01:43:02.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.669+0000 7f37a0e2f800 1 Processor -- start 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.669+0000 7f37a0e2f800 1 -- start start 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.669+0000 7f37a0e2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef68dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.669+0000 7f37a0e2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5555ef6663c0 con 0x5555ef719d20 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f379c1c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef68dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f379c1c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef68dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41976/0 (socket says 172.21.15.131:41976) 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f379c1c0640 1 -- 172.21.15.131:0/1432272449 learned_addr learned my addr 172.21.15.131:0/1432272449 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f379c1c0640 1 -- 172.21.15.131:0/1432272449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ef80efb0 con 0x5555ef719d20 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f379c1c0640 1 --2- 172.21.15.131:0/1432272449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef68dff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f378c055040 tx=0x7f378c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19edf1f44199f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f368a60c640 1 -- 172.21.15.131:0/1432272449 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c063070 con 0x5555ef719d20 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f368a60c640 1 -- 172.21.15.131:0/1432272449 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c058040 con 0x5555ef719d20 2024-04-24T01:43:02.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.670+0000 7f368a60c640 1 -- 172.21.15.131:0/1432272449 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c057070 con 0x5555ef719d20 2024-04-24T01:43:02.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1432272449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 msgr2=0x5555ef68dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/1432272449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef68dff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f378c055040 tx=0x7f378c04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1432272449 shutdown_connections 2024-04-24T01:43:02.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/1432272449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef68dff0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1432272449 >> 172.21.15.131:0/1432272449 conn(0x5555ef715380 msgr2=0x5555ef806aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1432272449 shutdown_connections 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1432272449 wait complete. 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 Processor -- start 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 -- start start 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.671+0000 7f37a0e2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef813c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f37a0e2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5555ef723420 con 0x5555ef719d20 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f379c1c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef813c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f379c1c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef813c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41984/0 (socket says 172.21.15.131:41984) 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f379c1c0640 1 -- 172.21.15.131:0/894535848 learned_addr learned my addr 172.21.15.131:0/894535848 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f379c1c0640 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ef8141c0 con 0x5555ef719d20 2024-04-24T01:43:02.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f379c1c0640 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef813c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f378c005870 tx=0x7f378c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f3688e09640 1 -- 172.21.15.131:0/894535848 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c063030 con 0x5555ef719d20 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f3688e09640 1 -- 172.21.15.131:0/894535848 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c052b60 con 0x5555ef719d20 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555ef814450 con 0x5555ef719d20 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f3688e09640 1 -- 172.21.15.131:0/894535848 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c052e40 con 0x5555ef719d20 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.672+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ef817100 con 0x5555ef719d20 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.673+0000 7f3688e09640 1 -- 172.21.15.131:0/894535848 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f378c05e480 con 0x5555ef719d20 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.673+0000 7f3688e09640 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3684036900 0x7f3684038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.673+0000 7f3688e09640 1 -- 172.21.15.131:0/894535848 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f378c064070 con 0x5555ef719d20 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.673+0000 7f3793fff640 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3684036900 0x7f3684038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef71af80 0x5555ef81aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef81b400 con 0x5555ef71af80 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f379c9c1640 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef71af80 0x5555ef81aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f3793fff640 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3684036900 0x7f3684038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3784000c00 tx=0x7f37840013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f379c9c1640 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef71af80 0x5555ef81aec0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f379c9c1640 1 -- 172.21.15.131:0/894535848 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f379400a4a0 con 0x5555ef71af80 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef818470 con 0x5555ef71af80 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.674+0000 7f379c9c1640 1 -- 172.21.15.131:0/894535848 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f379400a4a0 con 0x5555ef71af80 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.675+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef81d1c0 con 0x5555ef71af80 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.675+0000 7f379c9c1640 1 -- 172.21.15.131:0/894535848 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f379400a4a0 con 0x5555ef71af80 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.675+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef81c500 con 0x5555ef71af80 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.675+0000 7f379c9c1640 1 -- 172.21.15.131:0/894535848 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f379400a4a0 con 0x5555ef71af80 2024-04-24T01:43:02.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.675+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef81c920 con 0x5555ef71af80 2024-04-24T01:43:02.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.675+0000 7f379c9c1640 1 -- 172.21.15.131:0/894535848 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f379400a4a0 con 0x5555ef71af80 2024-04-24T01:43:02.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f37a0e2f800 1 Processor -- start 2024-04-24T01:43:02.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f37a0e2f800 1 -- start start 2024-04-24T01:43:02.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f37a0e2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef80cb20 0x5555ef80af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f37a0e2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5555ef60c6b0 con 0x5555ef80cb20 2024-04-24T01:43:02.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f3793fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef80cb20 0x5555ef80af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f3793fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef80cb20 0x5555ef80af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41994/0 (socket says 172.21.15.131:41994) 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f3793fff640 1 -- 172.21.15.131:0/2247064187 learned_addr learned my addr 172.21.15.131:0/2247064187 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.676+0000 7f3793fff640 1 -- 172.21.15.131:0/2247064187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ef80b4d0 con 0x5555ef80cb20 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.677+0000 7f3793fff640 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef80cb20 0x5555ef80af90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f378400e610 tx=0x7f378400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.677+0000 7f3681ffb640 1 -- 172.21.15.131:0/2247064187 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3784022070 con 0x5555ef80cb20 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.677+0000 7f3681ffb640 1 -- 172.21.15.131:0/2247064187 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3784009050 con 0x5555ef80cb20 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.677+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555ef80b700 con 0x5555ef80cb20 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.677+0000 7f3681ffb640 1 -- 172.21.15.131:0/2247064187 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378400d500 con 0x5555ef80cb20 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.677+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ef80bc00 con 0x5555ef80cb20 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.677+0000 7f3681ffb640 1 -- 172.21.15.131:0/2247064187 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3784025070 con 0x5555ef80cb20 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f3681ffb640 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3674036950 0x7f3674038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f3681ffb640 1 -- 172.21.15.131:0/2247064187 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f378404db70 con 0x5555ef80cb20 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f379c9c1640 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3674036950 0x7f3674038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f37a0e2f800 1 Processor -- start 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f37a0e2f800 1 -- start start 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f379c9c1640 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3674036950 0x7f3674038e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5555ef81c8a0 tx=0x7f3794005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f37a0e2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef83b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f37a0e2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5555ef80f240 con 0x5555ef83b510 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f3793fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef83b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f3793fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef83b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42000/0 (socket says 172.21.15.131:42000) 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.678+0000 7f3793fff640 1 -- 172.21.15.131:0/1453793958 learned_addr learned my addr 172.21.15.131:0/1453793958 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f3793fff640 1 -- 172.21.15.131:0/1453793958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ef83bf00 con 0x5555ef83b510 2024-04-24T01:43:02.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f3793fff640 1 --2- 172.21.15.131:0/1453793958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef83b930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3784026fd0 tx=0x7f3784024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644a9013a5494f41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f367b7fe640 1 -- 172.21.15.131:0/1453793958 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378404a030 con 0x5555ef83b510 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f367b7fe640 1 -- 172.21.15.131:0/1453793958 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3784025e30 con 0x5555ef83b510 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f367b7fe640 1 -- 172.21.15.131:0/1453793958 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378401ad50 con 0x5555ef83b510 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1453793958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 msgr2=0x5555ef83b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/1453793958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef83b930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3784026fd0 tx=0x7f3784024eb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1453793958 shutdown_connections 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/1453793958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef83b930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1453793958 >> 172.21.15.131:0/1453793958 conn(0x5555ef837870 msgr2=0x5555ef8358d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1453793958 shutdown_connections 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.679+0000 7f37a0e2f800 1 -- 172.21.15.131:0/1453793958 wait complete. 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f37a0e2f800 1 Processor -- start 2024-04-24T01:43:02.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f37a0e2f800 1 -- start start 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f37a0e2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef842bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f37a0e2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5555ef83c670 con 0x5555ef83b510 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f3793fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef842bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f3793fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef842bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42002/0 (socket says 172.21.15.131:42002) 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 learned_addr learned my addr 172.21.15.131:0/3711118160 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ef843110 con 0x5555ef83b510 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.680+0000 7f3793fff640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef842bd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3784026fd0 tx=0x7f378404be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f3679ffb640 1 -- 172.21.15.131:0/3711118160 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378404a050 con 0x5555ef83b510 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f3679ffb640 1 -- 172.21.15.131:0/3711118160 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378400d6a0 con 0x5555ef83b510 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555ef8433a0 con 0x5555ef83b510 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f3679ffb640 1 -- 172.21.15.131:0/3711118160 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378400d9e0 con 0x5555ef83b510 2024-04-24T01:43:02.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ef846050 con 0x5555ef83b510 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f3679ffb640 1 -- 172.21.15.131:0/3711118160 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f378404d370 con 0x5555ef83b510 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f3679ffb640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f366c0369a0 0x7f366c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.681+0000 7f3679ffb640 1 -- 172.21.15.131:0/3711118160 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3784045880 con 0x5555ef83b510 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f379c9c1640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f366c0369a0 0x7f366c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef84e6d0 0x5555ef850b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8512e0 con 0x5555ef84e6d0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f379c1c0640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef84e6d0 0x5555ef850b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f379c9c1640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f366c0369a0 0x7f366c038e60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5555ef81c020 tx=0x7f379401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f379c1c0640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef84e6d0 0x5555ef850b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f37a0e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f37a0e2f800 20 realm 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.682+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8516f0 con 0x5555ef84e6d0 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef851fc0 con 0x5555ef84e6d0 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef852360 con 0x5555ef84e6d0 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8527c0 con 0x5555ef84e6d0 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 20 searching for the correct realm 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5555ef854810 0x5555ef856c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.683+0000 7f3793fff640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5555ef854810 0x5555ef856c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.684+0000 7f3793fff640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5555ef854810 0x5555ef856c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.684+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.684+0000 7f3793fff640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3784027060 0x7f37840450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.684+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3784027060 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.684+0000 7f379c9c1640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3784027060 0x7f37840450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.684+0000 7f379c9c1640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3784027060 0x7f37840450b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.685+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379401f070 con 0x7f3784027060 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.685+0000 7f379c9c1640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3794031040 0x7f3794032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.685+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.685+0000 7f379c1c0640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3794031040 0x7f3794032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.685+0000 7f379c1c0640 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3794031040 0x7f3794032940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.685+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.685+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef84e6d0 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef84e6d0 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3784027060 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379401f070 con 0x7f3784027060 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.686+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef84e6d0 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef84e6d0 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3784027060 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f379401f070 con 0x7f3784027060 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.687+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.688+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.688+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.688+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.688+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef84e6d0 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef84e6d0 2024-04-24T01:43:02.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.689+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3784027060 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379401f070 con 0x7f3784027060 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef84e6d0 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.690+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3784027060 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379401f070 con 0x7f3784027060 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.691+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x5555ef854810 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.692+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.692+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8572b0 con 0x7f3794031040 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.692+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.692+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0a0040 con 0x5555ef84e6d0 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.692+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.692+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0a0040 con 0x7f3784027060 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.692+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379401f070 con 0x7f3784027060 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef853260 con 0x5555ef84e6d0 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef853b00 con 0x5555ef84e6d0 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef852ea0 con 0x5555ef84e6d0 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 zone default found 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 4 Realm: () 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:02.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 zonegroup default 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.693+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef853b00 con 0x7f3794031040 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f37a0e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef8590f0 con 0x5555ef854810 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f37a0e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef859490 con 0x5555ef854810 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.694+0000 7f37a0e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.695+0000 7f37a0e2f800 20 started sync module instance, tier type = 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.695+0000 7f37a0e2f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.695+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef858590 con 0x7f3784027060 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.695+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3794040040 con 0x7f3784027060 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.696+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93827579087232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef859ce0 con 0x7f3784027060 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.696+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85a530 con 0x5555ef84e6d0 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.696+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93827579087232] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3794040040 con 0x7f3784027060 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.697+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.697+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93827579090992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85a200 con 0x5555ef84e6d0 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.697+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85ad20 con 0x5555ef854810 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.698+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.698+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93827579095024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85b5c0 con 0x5555ef854810 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.698+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85c070 con 0x7f3784027060 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.698+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93827579090992] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.699+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3794040040 con 0x7f3784027060 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.699+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93827579095024] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.699+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93827579097360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef859c50 con 0x7f3784027060 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.699+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85ca80 con 0x5555ef84e6d0 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.700+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.700+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93827579102672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85cea0 con 0x5555ef84e6d0 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.700+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85d910 con 0x7f3794031040 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.700+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93827579097360] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3794040040 con 0x7f3784027060 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.701+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.701+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93827579102672] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.701+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93827579106272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85d8d0 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.701+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85d8d0 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.702+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93827579106272] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.702+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.702+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93827579103728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85d8d0 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.702+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85e780 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93827579103728] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93827579108528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85e780 con 0x7f3794031040 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 20 add_watcher() i=0 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 20 add_watcher() i=1 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 20 add_watcher() i=2 2024-04-24T01:43:02.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 20 add_watcher() i=3 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 20 add_watcher() i=4 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 20 add_watcher() i=5 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.703+0000 7f37a0e2f800 20 add_watcher() i=6 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.704+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93827579108528] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.704+0000 7f37a0e2f800 20 add_watcher() i=7 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.704+0000 7f37a0e2f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.704+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef861ba0 con 0x5555ef84e6d0 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.704+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.704+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93827579110560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85f0a0 con 0x5555ef84e6d0 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.705+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93827579110560] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.705+0000 7f3652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.705+0000 7f37a0e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.705+0000 7f37a0e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.705+0000 7f37a0e2f800 5 note: GC not initialized 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.705+0000 7f3651fe3640 20 reqs_thread_entry: start 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f37a0e2f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f37a0e2f800 20 Filter name: none 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f364b7fe640 20 reqs_thread_entry: start 2024-04-24T01:43:02.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef894a70 con 0x5555ef84e6d0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f37a0e2f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f37a0e2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.706+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef895460 con 0x5555ef84e6d0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.707+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.707+0000 7f37a0e2f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.707+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555ef896470 con 0x7f3784027060 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.707+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3794040040 con 0x7f3784027060 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.708+0000 7f3652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.708+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93827579110560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef861560 con 0x5555ef84e6d0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.709+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93827579110560] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.709+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93827579087232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85e470 con 0x7f3784027060 2024-04-24T01:43:02.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.709+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93827579087232] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3794040040 con 0x7f3784027060 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.710+0000 7f37a0e2f800 20 remove_watcher() i=0 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.710+0000 7f37a0e2f800 2 removed watcher, disabling cache 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.710+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93827579090992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef858980 con 0x5555ef84e6d0 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.710+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93827579090992] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.710+0000 7f37a0e2f800 20 remove_watcher() i=1 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.710+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93827579095024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef859830 con 0x5555ef854810 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.711+0000 7f3793fff640 1 -- 172.21.15.131:0/3711118160 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93827579095024] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3784024030 con 0x5555ef854810 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.711+0000 7f37a0e2f800 20 remove_watcher() i=2 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.711+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93827579097360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85e470 con 0x7f3784027060 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.712+0000 7f379c9c1640 1 -- 172.21.15.131:0/3711118160 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93827579097360] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3794040040 con 0x7f3784027060 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.712+0000 7f37a0e2f800 20 remove_watcher() i=3 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.712+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93827579102672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85b110 con 0x5555ef84e6d0 2024-04-24T01:43:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.713+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93827579102672] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x5555ef84e6d0 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.713+0000 7f37a0e2f800 20 remove_watcher() i=4 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.713+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93827579106272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85b110 con 0x7f3794031040 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.714+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93827579106272] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.714+0000 7f37a0e2f800 20 remove_watcher() i=5 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.714+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93827579103728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85d3e0 con 0x7f3794031040 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.715+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93827579103728] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.715+0000 7f37a0e2f800 20 remove_watcher() i=6 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.715+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93827579108528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555ef85b110 con 0x7f3794031040 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93827579108528] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c070020 con 0x7f3794031040 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 20 remove_watcher() i=7 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3794031040 msgr2=0x7f3794032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3794031040 0x7f3794032940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef84e6d0 msgr2=0x5555ef850b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef84e6d0 0x5555ef850b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3784027060 msgr2=0x7f37840450b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3784027060 0x7f37840450b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5555ef854810 msgr2=0x5555ef856c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5555ef854810 0x5555ef856c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f366c0369a0 msgr2=0x7f366c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f366c0369a0 0x7f366c038e60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5555ef81c020 tx=0x7f379401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f379c1c0640 1 -- 172.21.15.131:0/3711118160 reap_dead start 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 msgr2=0x5555ef842bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef842bd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3784026fd0 tx=0x7f378404be50 comp rx=0 tx=0).stop 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 shutdown_connections 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/3711118160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef83b510 0x5555ef842bd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 >> 172.21.15.131:0/3711118160 conn(0x5555ef837870 msgr2=0x5555ef834ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 shutdown_connections 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/3711118160 wait complete. 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3674036950 msgr2=0x7f3674038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3674036950 0x7f3674038e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5555ef81c8a0 tx=0x7f3794005840 comp rx=0 tx=0).stop 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef80cb20 msgr2=0x5555ef80af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.716+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef80cb20 0x5555ef80af90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f378400e610 tx=0x7f378400ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 shutdown_connections 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3674036950 0x7f3674038e10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/2247064187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef80cb20 0x5555ef80af90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 >> 172.21.15.131:0/2247064187 conn(0x5555ef820070 msgr2=0x5555ef820470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 shutdown_connections 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/2247064187 wait complete. 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef71af80 msgr2=0x5555ef81aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef71af80 0x5555ef81aec0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3684036900 msgr2=0x7f3684038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3684036900 0x7f3684038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3784000c00 tx=0x7f37840013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 msgr2=0x5555ef813c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef813c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f378c005870 tx=0x7f378c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 shutdown_connections 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5555ef71af80 0x5555ef81aec0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3684036900 0x7f3684038dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 --2- 172.21.15.131:0/894535848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5555ef719d20 0x5555ef813c80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 >> 172.21.15.131:0/894535848 conn(0x5555ef715380 msgr2=0x5555ef805320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 shutdown_connections 2024-04-24T01:43:02.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.717+0000 7f37a0e2f800 1 -- 172.21.15.131:0/894535848 wait complete. 2024-04-24T01:43:02.741 INFO:teuthology.orchestra.run.smithi131.stdout:["myfoo"] 2024-04-24T01:43:02.741 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-24T01:43:02.746 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:02.747 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-24T01:43:02.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-24T01:43:02.747 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-24T01:43:02.822 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:02.822 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:02.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c2122f800 1 Processor -- start 2024-04-24T01:43:02.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c2122f800 1 -- start start 2024-04-24T01:43:02.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c2122f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ad3164aa90 0x55ad31649040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c2122f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad31593d40 con 0x55ad31649580 2024-04-24T01:43:02.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c2122f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55ad315664d0 con 0x55ad3164aa90 2024-04-24T01:43:02.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c1c5c0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ad3164aa90 0x55ad31649040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c1bdbf640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55ad31649580 0x55ad316dce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56566/0 (socket says 172.21.15.131:56566) 2024-04-24T01:43:02.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.821+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/4034477604 learned_addr learned my addr 172.21.15.131:0/4034477604 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:02.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.822+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/4034477604 >> v1:172.21.15.107:6789/0 conn(0x55ad31649580 legacy=0x55ad316dce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.822+0000 7f2c1b5be640 1 -- 172.21.15.131:0/4034477604 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502495632 0 0) 0x55ad31593d40 con 0x55ad31649580 2024-04-24T01:43:02.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.822+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/4034477604 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad31592590 con 0x55ad3164aa90 2024-04-24T01:43:02.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c1c5c0640 1 --2- 172.21.15.131:0/4034477604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad3164aa90 0x55ad31649040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400a470 tx=0x7f2c0401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae6506761bd0e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c1b5be640 1 -- 172.21.15.131:0/4034477604 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04057070 con 0x55ad3164aa90 2024-04-24T01:43:02.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c1b5be640 1 -- 172.21.15.131:0/4034477604 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04052570 con 0x55ad3164aa90 2024-04-24T01:43:02.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c1b5be640 1 -- 172.21.15.131:0/4034477604 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04052870 con 0x55ad3164aa90 2024-04-24T01:43:02.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c2122f800 1 -- 172.21.15.131:0/4034477604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad3164aa90 msgr2=0x55ad31649040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c2122f800 1 --2- 172.21.15.131:0/4034477604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad3164aa90 0x55ad31649040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400a470 tx=0x7f2c0401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:02.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c2122f800 1 -- 172.21.15.131:0/4034477604 shutdown_connections 2024-04-24T01:43:02.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c2122f800 1 --2- 172.21.15.131:0/4034477604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad3164aa90 0x55ad31649040 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c2122f800 1 -- 172.21.15.131:0/4034477604 >> 172.21.15.131:0/4034477604 conn(0x55ad316d0520 msgr2=0x55ad316d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c2122f800 1 -- 172.21.15.131:0/4034477604 shutdown_connections 2024-04-24T01:43:02.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.824+0000 7f2c2122f800 1 -- 172.21.15.131:0/4034477604 wait complete. 2024-04-24T01:43:02.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.836+0000 7f2c2122f800 1 Processor -- start 2024-04-24T01:43:02.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.836+0000 7f2c2122f800 1 -- start start 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.836+0000 7f2c2122f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.836+0000 7f2c2122f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ad316203b0 con 0x55ad31649580 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.836+0000 7f2c1c5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.836+0000 7f2c1c5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42024/0 (socket says 172.21.15.131:42024) 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.836+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/3799715743 learned_addr learned my addr 172.21.15.131:0/3799715743 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.837+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/3799715743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad317c8b50 con 0x55ad31649580 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.837+0000 7f2c1c5c0640 1 --2- 172.21.15.131:0/3799715743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317c8580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c04055040 tx=0x7f2c0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261f72de1cdf7893 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.837+0000 7f2b0a60c640 1 -- 172.21.15.131:0/3799715743 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04063070 con 0x55ad31649580 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.837+0000 7f2b0a60c640 1 -- 172.21.15.131:0/3799715743 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04058040 con 0x55ad31649580 2024-04-24T01:43:02.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.837+0000 7f2b0a60c640 1 -- 172.21.15.131:0/3799715743 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04057070 con 0x55ad31649580 2024-04-24T01:43:02.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 -- 172.21.15.131:0/3799715743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 msgr2=0x55ad317c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 --2- 172.21.15.131:0/3799715743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317c8580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c04055040 tx=0x7f2c0404c000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 -- 172.21.15.131:0/3799715743 shutdown_connections 2024-04-24T01:43:02.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 --2- 172.21.15.131:0/3799715743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317c8580 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 -- 172.21.15.131:0/3799715743 >> 172.21.15.131:0/3799715743 conn(0x55ad316d0520 msgr2=0x55ad317c3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 -- 172.21.15.131:0/3799715743 shutdown_connections 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 -- 172.21.15.131:0/3799715743 wait complete. 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 Processor -- start 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 -- start start 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c2122f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ad316e0860 con 0x55ad31649580 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c1c5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c1c5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42028/0 (socket says 172.21.15.131:42028) 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.838+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/1050545482 learned_addr learned my addr 172.21.15.131:0/1050545482 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.839+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad317d0610 con 0x55ad31649580 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.839+0000 7f2c1c5c0640 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317d00d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2c04005870 tx=0x7f2c04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.839+0000 7f2b08e09640 1 -- 172.21.15.131:0/1050545482 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04063030 con 0x55ad31649580 2024-04-24T01:43:02.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.839+0000 7f2b08e09640 1 -- 172.21.15.131:0/1050545482 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04052b20 con 0x55ad31649580 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.839+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad317d08a0 con 0x55ad31649580 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.839+0000 7f2b08e09640 1 -- 172.21.15.131:0/1050545482 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04052e00 con 0x55ad31649580 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.839+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad317d3500 con 0x55ad31649580 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.840+0000 7f2b08e09640 1 -- 172.21.15.131:0/1050545482 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c0405e480 con 0x55ad31649580 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.840+0000 7f2b08e09640 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2b04036900 0x7f2b04038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.840+0000 7f2b08e09640 1 -- 172.21.15.131:0/1050545482 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2c04064070 con 0x55ad31649580 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.840+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2b04036900 0x7f2b04038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.840+0000 7f2c2122f800 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad3164aa90 0x55ad317d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.840+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad317d7840 con 0x55ad3164aa90 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.840+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad3164aa90 0x55ad317d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.841+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2b04036900 0x7f2b04038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c000c00 tx=0x7f2c0c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.841+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad3164aa90 0x55ad317d72c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.841+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/1050545482 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400a4a0 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.841+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad317d4870 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.841+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/1050545482 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c1400a4a0 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.841+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad317d9650 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.842+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/1050545482 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c1400a4a0 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.842+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad317d8990 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.842+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/1050545482 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c1400a4a0 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.842+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad317d8db0 con 0x55ad3164aa90 2024-04-24T01:43:02.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.842+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/1050545482 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c1400a4a0 con 0x55ad3164aa90 2024-04-24T01:43:02.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.842+0000 7f2c2122f800 1 Processor -- start 2024-04-24T01:43:02.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.842+0000 7f2c2122f800 1 -- start start 2024-04-24T01:43:02.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2c2122f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317e8440 0x55ad317e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2c2122f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ad315c66b0 con 0x55ad317e8440 2024-04-24T01:43:02.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2c1bdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317e8440 0x55ad317e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2c1bdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317e8440 0x55ad317e8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42032/0 (socket says 172.21.15.131:42032) 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/633511250 learned_addr learned my addr 172.21.15.131:0/633511250 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/633511250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad317e8da0 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317e8440 0x55ad317e8860 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00e610 tx=0x7f2c0c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.843+0000 7f2b01ffb640 1 -- 172.21.15.131:0/633511250 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c022070 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.844+0000 7f2b01ffb640 1 -- 172.21.15.131:0/633511250 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c009050 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.844+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad317e9810 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.844+0000 7f2b01ffb640 1 -- 172.21.15.131:0/633511250 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c00d500 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.844+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad317e9d10 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.844+0000 7f2b01ffb640 1 -- 172.21.15.131:0/633511250 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c0c025070 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.844+0000 7f2b01ffb640 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2af4036950 0x7f2af4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.844+0000 7f2b01ffb640 1 -- 172.21.15.131:0/633511250 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2c0c04dab0 con 0x55ad317e8440 2024-04-24T01:43:02.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2af4036950 0x7f2af4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c2122f800 1 Processor -- start 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2af4036950 0x7f2af4038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55ad317d8d30 tx=0x7f2c14005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c2122f800 1 -- start start 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c2122f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317f5780 0x55ad317f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c2122f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ad317c8e10 con 0x55ad317f5780 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c1bdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317f5780 0x55ad317f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c1bdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317f5780 0x55ad317f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42040/0 (socket says 172.21.15.131:42040) 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/3730447437 learned_addr learned my addr 172.21.15.131:0/3730447437 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.845+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/3730447437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad317f6170 con 0x55ad317f5780 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/3730447437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317f5780 0x55ad317f5ba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c026fd0 tx=0x7f2c0c026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa692672b115c93d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2afb7fe640 1 -- 172.21.15.131:0/3730447437 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c01ac20 con 0x55ad317f5780 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2afb7fe640 1 -- 172.21.15.131:0/3730447437 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c01adc0 con 0x55ad317f5780 2024-04-24T01:43:02.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2afb7fe640 1 -- 172.21.15.131:0/3730447437 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c0254d0 con 0x55ad317f5780 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 -- 172.21.15.131:0/3730447437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317f5780 msgr2=0x55ad317f5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 --2- 172.21.15.131:0/3730447437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317f5780 0x55ad317f5ba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c026fd0 tx=0x7f2c0c026680 comp rx=0 tx=0).stop 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 -- 172.21.15.131:0/3730447437 shutdown_connections 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 --2- 172.21.15.131:0/3730447437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317f5780 0x55ad317f5ba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 -- 172.21.15.131:0/3730447437 >> 172.21.15.131:0/3730447437 conn(0x55ad317f1ae0 msgr2=0x55ad317efb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 -- 172.21.15.131:0/3730447437 shutdown_connections 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 -- 172.21.15.131:0/3730447437 wait complete. 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 Processor -- start 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.846+0000 7f2c2122f800 1 -- start start 2024-04-24T01:43:02.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c2122f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317fcff0 0x55ad317fd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c2122f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ad317f68e0 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c1bdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317fcff0 0x55ad317fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c1bdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317fcff0 0x55ad317fd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42046/0 (socket says 172.21.15.131:42046) 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 learned_addr learned my addr 172.21.15.131:0/2693722685 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad317fd950 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317fcff0 0x55ad317fd410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c04ae30 tx=0x7f2c0c04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2af9ffb640 1 -- 172.21.15.131:0/2693722685 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c02f030 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2af9ffb640 1 -- 172.21.15.131:0/2693722685 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c00d8b0 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad317fdbe0 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2af9ffb640 1 -- 172.21.15.131:0/2693722685 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c01ac20 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.847+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad31800720 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.848+0000 7f2af9ffb640 1 -- 172.21.15.131:0/2693722685 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c0c01a320 con 0x55ad317fcff0 2024-04-24T01:43:02.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.848+0000 7f2af9ffb640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2aec036900 0x7f2aec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.848+0000 7f2af9ffb640 1 -- 172.21.15.131:0/2693722685 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2c0c030070 con 0x55ad317fcff0 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.848+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2aec036900 0x7f2aec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.848+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.848+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad31808f60 0x55ad3180b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180bb70 con 0x55ad31808f60 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c1c5c0640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad31808f60 0x55ad3180b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2aec036900 0x7f2aec038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55ad317d84b0 tx=0x7f2c1401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c1c5c0640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad31808f60 0x55ad3180b420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 20 realm 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180bf80 con 0x55ad31808f60 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.849+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180c850 con 0x55ad31808f60 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180cbf0 con 0x55ad31808f60 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180d050 con 0x55ad31808f60 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 20 searching for the correct realm 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ad3180f0a0 0x55ad31811490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad3180f0a0 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ad3180f0a0 0x55ad31811490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.850+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ad3180f0a0 0x55ad31811490 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1bdbf640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x55ad317f5780 0x7f2c0c01a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad317f5780 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x55ad317f5780 0x7f2c0c01a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x55ad317f5780 0x7f2c0c01a610 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1401f070 con 0x55ad317f5780 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1cdc1640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2c14031040 0x7f2c14032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.851+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x7f2c14031040 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.852+0000 7f2c1c5c0640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2c14031040 0x7f2c14032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:02.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.852+0000 7f2c1c5c0640 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2c14031040 0x7f2c14032430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.852+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.852+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad31808f60 2024-04-24T01:43:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.852+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.852+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad31808f60 2024-04-24T01:43:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x7f2c14031040 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x7f2c14031040 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad317f5780 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1401f070 con 0x55ad317f5780 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.853+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad3180f0a0 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad31808f60 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x7f2c14031040 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad31808f60 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.854+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad317f5780 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c1401f070 con 0x55ad317f5780 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad3180f0a0 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad3180f0a0 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x7f2c14031040 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad3180f0a0 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.855+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad3180f0a0 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad31808f60 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad31808f60 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x7f2c14031040 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.856+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad3180f0a0 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad317f5780 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1401f070 con 0x55ad317f5780 2024-04-24T01:43:02.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x55ad31808f60 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31811b40 con 0x7f2c14031040 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.857+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2c04097040 con 0x55ad3180f0a0 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2c04097040 con 0x7f2c14031040 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2c04097040 con 0x55ad317f5780 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1401f070 con 0x55ad317f5780 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2c04097040 con 0x55ad3180f0a0 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.858+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2c04097040 con 0x7f2c14031040 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2c04097040 con 0x55ad31808f60 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2c04097040 con 0x55ad317f5780 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1401f070 con 0x55ad317f5780 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.859+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180daf0 con 0x55ad31808f60 2024-04-24T01:43:02.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180e390 con 0x55ad31808f60 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180d730 con 0x55ad31808f60 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 zone default found 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 4 Realm: () 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:02.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 zonegroup default 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180e390 con 0x7f2c14031040 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.860+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad31813980 con 0x55ad3180f0a0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad31813d20 con 0x55ad3180f0a0 2024-04-24T01:43:02.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:02.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 20 started sync module instance, tier type = 2024-04-24T01:43:02.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:02.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.861+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad317f5780 2024-04-24T01:43:02.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.862+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.862+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94202348253712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812a80 con 0x55ad317f5780 2024-04-24T01:43:02.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.862+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31814be0 con 0x55ad31808f60 2024-04-24T01:43:02.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.863+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94202348253712] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.863+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.863+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94202348257552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31814be0 con 0x55ad31808f60 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.864+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31815680 con 0x55ad3180f0a0 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.865+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94202348257552] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.865+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.865+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94202348261744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31815a20 con 0x55ad3180f0a0 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.865+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad318164a0 con 0x55ad317f5780 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.866+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.866+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94202348265360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31816d40 con 0x55ad317f5780 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.866+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31817840 con 0x55ad31808f60 2024-04-24T01:43:02.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.866+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94202348261744] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.867+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.867+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94202348270384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31817800 con 0x55ad31808f60 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.867+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31818290 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.867+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94202348265360] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.868+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.868+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94202348273056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31818290 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.868+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31818ca0 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.868+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94202348270384] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.869+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94202348273056] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.869+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.869+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94202348267664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad318187f0 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.869+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad318191b0 con 0x7f2c14031040 2024-04-24T01:43:02.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.870+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94202348267664] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94202348259120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad318191b0 con 0x7f2c14031040 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 20 add_watcher() i=0 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 20 add_watcher() i=1 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 20 add_watcher() i=2 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 20 add_watcher() i=3 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 20 add_watcher() i=4 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 20 add_watcher() i=5 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.871+0000 7f2c2122f800 20 add_watcher() i=6 2024-04-24T01:43:02.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.872+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94202348259120] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.872+0000 7f2c2122f800 20 add_watcher() i=7 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.872+0000 7f2c2122f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.872+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad3181c490 con 0x55ad31808f60 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.872+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.873+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94202348277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31819740 con 0x55ad31808f60 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94202348277360] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2ad27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2c2122f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2c2122f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:02.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2c2122f800 5 note: GC not initialized 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2ad17e2640 20 reqs_thread_entry: start 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2c2122f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2c2122f800 20 Filter name: none 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2a42ffd640 20 reqs_thread_entry: start 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.874+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad3184efd0 con 0x55ad3180f0a0 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad3184efd0 con 0x55ad3180f0a0 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad3184efd0 con 0x55ad31808f60 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180daf0 con 0x55ad31808f60 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.875+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180daf0 con 0x55ad317f5780 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad31808f60 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad317f5780 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.876+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.877+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.877+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad31808f60 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.877+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.877+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.877+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.877+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.878+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad317f5780 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad31808f60 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad31808f60 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.879+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.880+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.880+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.880+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad317f5780 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.880+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.880+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.880+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.880+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad31808f60 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad317f5780 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.881+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x7f2c14031040 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad31808f60 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad3180f0a0 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad31812e20 con 0x55ad317f5780 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c2122f800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.882+0000 7f2c2122f800 20 RGWRados::pool_iterate: got myfoo 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.883+0000 7f2ad27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.883+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94202348277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad3180daf0 con 0x55ad31808f60 2024-04-24T01:43:02.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.884+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94202348277360] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.884+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94202348253712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31818e70 con 0x55ad317f5780 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.885+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94202348253712] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.885+0000 7f2c2122f800 20 remove_watcher() i=0 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.885+0000 7f2c2122f800 2 removed watcher, disabling cache 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.885+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94202348257552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31818e70 con 0x55ad31808f60 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.886+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94202348257552] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.886+0000 7f2c2122f800 20 remove_watcher() i=1 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.886+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94202348261744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31818e70 con 0x55ad3180f0a0 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.887+0000 7f2c1bdbf640 1 -- 172.21.15.131:0/2693722685 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94202348261744] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c024030 con 0x55ad3180f0a0 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.887+0000 7f2c2122f800 20 remove_watcher() i=2 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.887+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94202348265360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31815170 con 0x55ad317f5780 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.888+0000 7f2c1cdc1640 1 -- 172.21.15.131:0/2693722685 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94202348265360] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14040040 con 0x55ad317f5780 2024-04-24T01:43:02.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.888+0000 7f2c2122f800 20 remove_watcher() i=3 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.888+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94202348270384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31815170 con 0x55ad31808f60 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.890+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94202348270384] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x55ad31808f60 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.890+0000 7f2c2122f800 20 remove_watcher() i=4 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.890+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94202348273056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31817330 con 0x7f2c14031040 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.891+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94202348273056] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.891+0000 7f2c2122f800 20 remove_watcher() i=5 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.891+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94202348267664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31815170 con 0x7f2c14031040 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.891+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94202348267664] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.891+0000 7f2c2122f800 20 remove_watcher() i=6 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.891+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94202348259120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad31816890 con 0x7f2c14031040 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94202348259120] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04070020 con 0x7f2c14031040 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 20 remove_watcher() i=7 2024-04-24T01:43:02.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2c14031040 msgr2=0x7f2c14032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2c14031040 0x7f2c14032430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad31808f60 msgr2=0x55ad3180b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad31808f60 0x55ad3180b420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x55ad317f5780 msgr2=0x7f2c0c01a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x55ad317f5780 0x7f2c0c01a610 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ad3180f0a0 msgr2=0x55ad31811490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.892+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ad3180f0a0 0x55ad31811490 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2aec036900 msgr2=0x7f2aec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2aec036900 0x7f2aec038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55ad317d84b0 tx=0x7f2c1401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c1c5c0640 1 -- 172.21.15.131:0/2693722685 reap_dead start 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317fcff0 msgr2=0x55ad317fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317fcff0 0x55ad317fd410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c04ae30 tx=0x7f2c0c04be50 comp rx=0 tx=0).stop 2024-04-24T01:43:02.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 shutdown_connections 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/2693722685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317fcff0 0x55ad317fd410 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 >> 172.21.15.131:0/2693722685 conn(0x55ad317f1ae0 msgr2=0x55ad317ef140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 shutdown_connections 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/2693722685 wait complete. 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2af4036950 msgr2=0x7f2af4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2af4036950 0x7f2af4038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55ad317d8d30 tx=0x7f2c14005840 comp rx=0 tx=0).stop 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317e8440 msgr2=0x55ad317e8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317e8440 0x55ad317e8860 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00e610 tx=0x7f2c0c00ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 shutdown_connections 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2af4036950 0x7f2af4038e10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/633511250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad317e8440 0x55ad317e8860 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 >> 172.21.15.131:0/633511250 conn(0x55ad317dc4e0 msgr2=0x55ad317dc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 shutdown_connections 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/633511250 wait complete. 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad3164aa90 msgr2=0x55ad317d72c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad3164aa90 0x55ad317d72c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2b04036900 msgr2=0x7f2b04038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2b04036900 0x7f2b04038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c000c00 tx=0x7f2c0c0013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 msgr2=0x55ad317d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.893+0000 7f2c2122f800 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317d00d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2c04005870 tx=0x7f2c04002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.894+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 shutdown_connections 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.894+0000 7f2c2122f800 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ad3164aa90 0x55ad317d72c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.894+0000 7f2c2122f800 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2b04036900 0x7f2b04038dc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.894+0000 7f2c2122f800 1 --2- 172.21.15.131:0/1050545482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ad31649580 0x55ad317d00d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.894+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 >> 172.21.15.131:0/1050545482 conn(0x55ad316d0520 msgr2=0x55ad317c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:02.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.894+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 shutdown_connections 2024-04-24T01:43:02.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:02.894+0000 7f2c2122f800 1 -- 172.21.15.131:0/1050545482 wait complete. 2024-04-24T01:43:02.914 INFO:teuthology.orchestra.run.smithi131.stdout:["myfoo"] 2024-04-24T01:43:02.914 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-24T01:43:02.926 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:02.940 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:02.949 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:02.995 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-24T01:43:03.022 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:03.049 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:03.074 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:03.075 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:43:03.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:43:03.075 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T01:43:03.117 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:03.117 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.116+0000 7f5ccb010800 1 Processor -- start 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5ccb010800 1 -- start start 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5ccb010800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fe7cd20780 0x55fe7cd20ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5ccb010800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe7cbe0d40 con 0x55fe7cd210e0 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5ccb010800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55fe7cbb34d0 con 0x55fe7cd20780 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5cc67b9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fe7cd20780 0x55fe7cd20ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5cc5fb8640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55fe7cd210e0 0x55fe7cd21590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56580/0 (socket says 172.21.15.131:56580) 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5cc67b9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fe7cd20780 0x55fe7cd20ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42058/0 (socket says 172.21.15.131:42058) 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/3348361904 learned_addr learned my addr 172.21.15.131:0/3348361904 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:03.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5cc67b9640 1 -- 172.21.15.131:0/3348361904 >> v1:172.21.15.107:6789/0 conn(0x55fe7cd210e0 legacy=0x55fe7cd21590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5cc67b9640 1 -- 172.21.15.131:0/3348361904 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7cbdf590 con 0x55fe7cd20780 2024-04-24T01:43:03.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.117+0000 7f5cc57b7640 1 -- 172.21.15.131:0/3348361904 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169632587 0 0) 0x55fe7cbe0d40 con 0x55fe7cd210e0 2024-04-24T01:43:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.119+0000 7f5cc67b9640 1 --2- 172.21.15.131:0/3348361904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7cd20ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800a470 tx=0x7f5cb801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bba000611f9a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.119+0000 7f5cc57b7640 1 -- 172.21.15.131:0/3348361904 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb8057070 con 0x55fe7cd20780 2024-04-24T01:43:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.119+0000 7f5cc57b7640 1 -- 172.21.15.131:0/3348361904 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb804adc0 con 0x55fe7cd20780 2024-04-24T01:43:03.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.119+0000 7f5cc57b7640 1 -- 172.21.15.131:0/3348361904 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb8052590 con 0x55fe7cd20780 2024-04-24T01:43:03.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.120+0000 7f5ccb010800 1 -- 172.21.15.131:0/3348361904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 msgr2=0x55fe7cd20ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.120+0000 7f5ccb010800 1 --2- 172.21.15.131:0/3348361904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7cd20ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800a470 tx=0x7f5cb801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.120+0000 7f5ccb010800 1 -- 172.21.15.131:0/3348361904 shutdown_connections 2024-04-24T01:43:03.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.120+0000 7f5ccb010800 1 --2- 172.21.15.131:0/3348361904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7cd20ba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.120+0000 7f5ccb010800 1 -- 172.21.15.131:0/3348361904 >> 172.21.15.131:0/3348361904 conn(0x55fe7cd1c320 msgr2=0x55fe7cd1e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.120+0000 7f5ccb010800 1 -- 172.21.15.131:0/3348361904 shutdown_connections 2024-04-24T01:43:03.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.120+0000 7f5ccb010800 1 -- 172.21.15.131:0/3348361904 wait complete. 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.131+0000 7f5ccb010800 1 Processor -- start 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5ccb010800 1 -- start start 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5ccb010800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce15230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5ccb010800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fe7cc6d3c0 con 0x55fe7cd20780 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5cc67b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce15230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5cc67b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce15230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42074/0 (socket says 172.21.15.131:42074) 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5cc67b9640 1 -- 172.21.15.131:0/590716118 learned_addr learned my addr 172.21.15.131:0/590716118 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5cc67b9640 1 -- 172.21.15.131:0/590716118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7ce15800 con 0x55fe7cd20780 2024-04-24T01:43:03.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5cc67b9640 1 --2- 172.21.15.131:0/590716118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce15230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8055040 tx=0x7f5cb804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00ad9f270acd95d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5bb4608640 1 -- 172.21.15.131:0/590716118 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb8057040 con 0x55fe7cd20780 2024-04-24T01:43:03.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.132+0000 7f5bb4608640 1 -- 172.21.15.131:0/590716118 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb8062070 con 0x55fe7cd20780 2024-04-24T01:43:03.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5bb4608640 1 -- 172.21.15.131:0/590716118 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb805d470 con 0x55fe7cd20780 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 -- 172.21.15.131:0/590716118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 msgr2=0x55fe7ce15230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 --2- 172.21.15.131:0/590716118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce15230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8055040 tx=0x7f5cb804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 -- 172.21.15.131:0/590716118 shutdown_connections 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 --2- 172.21.15.131:0/590716118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce15230 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 -- 172.21.15.131:0/590716118 >> 172.21.15.131:0/590716118 conn(0x55fe7cd1c320 msgr2=0x55fe7ce10b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 -- 172.21.15.131:0/590716118 shutdown_connections 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 -- 172.21.15.131:0/590716118 wait complete. 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.133+0000 7f5ccb010800 1 Processor -- start 2024-04-24T01:43:03.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.134+0000 7f5ccb010800 1 -- start start 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.134+0000 7f5ccb010800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce1cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.134+0000 7f5ccb010800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fe7cd21fa0 con 0x55fe7cd20780 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.134+0000 7f5cc67b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce1cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.134+0000 7f5cc67b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce1cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42084/0 (socket says 172.21.15.131:42084) 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.134+0000 7f5cc67b9640 1 -- 172.21.15.131:0/2482445191 learned_addr learned my addr 172.21.15.131:0/2482445191 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.134+0000 7f5cc67b9640 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7ce1d220 con 0x55fe7cd20780 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.135+0000 7f5cc67b9640 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce1cce0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5cb801ce60 tx=0x7f5cb8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.135+0000 7f5bb2e05640 1 -- 172.21.15.131:0/2482445191 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb806b070 con 0x55fe7cd20780 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.135+0000 7f5bb2e05640 1 -- 172.21.15.131:0/2482445191 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb805d970 con 0x55fe7cd20780 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.135+0000 7f5bb2e05640 1 -- 172.21.15.131:0/2482445191 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb8057070 con 0x55fe7cd20780 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.135+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe7ce1d4b0 con 0x55fe7cd20780 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.135+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7ce20110 con 0x55fe7cd20780 2024-04-24T01:43:03.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5bb2e05640 1 -- 172.21.15.131:0/2482445191 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5cb805dc90 con 0x55fe7cd20780 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5bb2e05640 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5bac036950 0x7f5bac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5bb2e05640 1 -- 172.21.15.131:0/2482445191 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5cb808e0b0 con 0x55fe7cd20780 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5bac036950 0x7f5bac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5ccb010800 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7cd210e0 0x55fe7ce23ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce24410 con 0x55fe7cd210e0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7cd210e0 0x55fe7ce23ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5bac036950 0x7f5bac038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc000c00 tx=0x7f5cbc0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.136+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7cd210e0 0x55fe7ce23ed0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5cc6fba640 1 -- 172.21.15.131:0/2482445191 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cc000a4a0 con 0x55fe7cd210e0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce21440 con 0x55fe7cd210e0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5cc6fba640 1 -- 172.21.15.131:0/2482445191 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cc000a4a0 con 0x55fe7cd210e0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce261d0 con 0x55fe7cd210e0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5cc6fba640 1 -- 172.21.15.131:0/2482445191 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5cc000a4a0 con 0x55fe7cd210e0 2024-04-24T01:43:03.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce25510 con 0x55fe7cd210e0 2024-04-24T01:43:03.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5cc6fba640 1 -- 172.21.15.131:0/2482445191 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cc000a4a0 con 0x55fe7cd210e0 2024-04-24T01:43:03.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.137+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce25960 con 0x55fe7cd210e0 2024-04-24T01:43:03.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5cc6fba640 1 -- 172.21.15.131:0/2482445191 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5cc000a4a0 con 0x55fe7cd210e0 2024-04-24T01:43:03.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5ccb010800 1 Processor -- start 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5ccb010800 1 -- start start 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5ccb010800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce34f80 0x55fe7ce353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5ccb010800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fe7cc136b0 con 0x55fe7ce34f80 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5cc5fb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce34f80 0x55fe7ce353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5cc5fb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce34f80 0x55fe7ce353a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42098/0 (socket says 172.21.15.131:42098) 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.138+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/236759726 learned_addr learned my addr 172.21.15.131:0/236759726 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.139+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/236759726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7ce358e0 con 0x55fe7ce34f80 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.139+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce34f80 0x55fe7ce353a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00e610 tx=0x7f5cbc00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.139+0000 7f5babfff640 1 -- 172.21.15.131:0/236759726 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cbc022070 con 0x55fe7ce34f80 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.139+0000 7f5babfff640 1 -- 172.21.15.131:0/236759726 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc009050 con 0x55fe7ce34f80 2024-04-24T01:43:03.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.139+0000 7f5babfff640 1 -- 172.21.15.131:0/236759726 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cbc00d500 con 0x55fe7ce34f80 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.139+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe7ce36350 con 0x55fe7ce34f80 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.139+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7ce36850 con 0x55fe7ce34f80 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5babfff640 1 -- 172.21.15.131:0/236759726 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5cbc025070 con 0x55fe7ce34f80 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5babfff640 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5ba0036950 0x7f5ba0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5babfff640 1 -- 172.21.15.131:0/236759726 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5cbc04db30 con 0x55fe7ce34f80 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5ba0036950 0x7f5ba0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5ccb010800 1 Processor -- start 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5ba0036950 0x7f5ba0038e10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55fe7ce25030 tx=0x7f5cc0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5ccb010800 1 -- start start 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5ccb010800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce426e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.140+0000 7f5ccb010800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fe7ce15ac0 con 0x55fe7ce422c0 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5cc5fb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5cc5fb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42106/0 (socket says 172.21.15.131:42106) 2024-04-24T01:43:03.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/3153715624 learned_addr learned my addr 172.21.15.131:0/3153715624 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/3153715624 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7ce42cb0 con 0x55fe7ce422c0 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/3153715624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce426e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc026fd0 tx=0x7f5cbc024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6802aca370c4db server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5ba9ffb640 1 -- 172.21.15.131:0/3153715624 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cbc04a030 con 0x55fe7ce422c0 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5ba9ffb640 1 -- 172.21.15.131:0/3153715624 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc025e30 con 0x55fe7ce422c0 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.141+0000 7f5ba9ffb640 1 -- 172.21.15.131:0/3153715624 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cbc01ad50 con 0x55fe7ce422c0 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 -- 172.21.15.131:0/3153715624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 msgr2=0x55fe7ce426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 --2- 172.21.15.131:0/3153715624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce426e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc026fd0 tx=0x7f5cbc024eb0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 -- 172.21.15.131:0/3153715624 shutdown_connections 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 --2- 172.21.15.131:0/3153715624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce426e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 -- 172.21.15.131:0/3153715624 >> 172.21.15.131:0/3153715624 conn(0x55fe7ce3e620 msgr2=0x55fe7ce3c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 -- 172.21.15.131:0/3153715624 shutdown_connections 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 -- 172.21.15.131:0/3153715624 wait complete. 2024-04-24T01:43:03.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 Processor -- start 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 -- start start 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce49980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5ccb010800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fe7ce43420 con 0x55fe7ce422c0 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5cc5fb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce49980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5cc5fb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce49980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42112/0 (socket says 172.21.15.131:42112) 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 learned_addr learned my addr 172.21.15.131:0/4069037012 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.142+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7ce49ec0 con 0x55fe7ce422c0 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.143+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce49980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc026fd0 tx=0x7f5cbc04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.143+0000 7f5b97fff640 1 -- 172.21.15.131:0/4069037012 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cbc04a050 con 0x55fe7ce422c0 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.143+0000 7f5b97fff640 1 -- 172.21.15.131:0/4069037012 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00d6a0 con 0x55fe7ce422c0 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.143+0000 7f5b97fff640 1 -- 172.21.15.131:0/4069037012 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cbc00d9e0 con 0x55fe7ce422c0 2024-04-24T01:43:03.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.143+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe7ce4a150 con 0x55fe7ce422c0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.143+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7ce4ce00 con 0x55fe7ce422c0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.143+0000 7f5b97fff640 1 -- 172.21.15.131:0/4069037012 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5cbc04d330 con 0x55fe7ce422c0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5b97fff640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5b90036950 0x7f5b90038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5b97fff640 1 -- 172.21.15.131:0/4069037012 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5cbc045880 con 0x55fe7ce422c0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5b90036950 0x7f5b90038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7ce55470 0x55fe7ce57930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce58080 con 0x55fe7ce55470 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5cc67b9640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7ce55470 0x55fe7ce57930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5b90036950 0x7f5b90038e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55fe7ce213f0 tx=0x7f5cc001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.144+0000 7f5cc67b9640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7ce55470 0x55fe7ce57930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 realm 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce58490 con 0x55fe7ce55470 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce58d60 con 0x55fe7ce55470 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce59100 con 0x55fe7ce55470 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.145+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce595a0 con 0x55fe7ce55470 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5ccb010800 20 searching for the correct realm 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fe7ce5b5a0 0x55fe7ce5d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fe7ce5b5a0 0x55fe7ce5d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fe7ce5b5a0 0x55fe7ce5d9b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5cc5fb8640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5cbc027060 0x7f5cbc01e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cbc027060 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.146+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5cbc027060 0x7f5cbc01e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.147+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5cbc027060 0x7f5cbc01e990 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.147+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc001f070 con 0x7f5cbc027060 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.147+0000 7f5cc6fba640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5cc0031040 0x7f5cc0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.147+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.147+0000 7f5cc67b9640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5cc0031040 0x7f5cc0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.147+0000 7f5cc67b9640 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5cc0031040 0x7f5cc0032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce55470 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce55470 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.148+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.149+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.149+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cbc027060 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.149+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc001f070 con 0x7f5cbc027060 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.149+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.149+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.149+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce55470 2024-04-24T01:43:03.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce55470 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cbc027060 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5cc001f070 con 0x7f5cbc027060 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.150+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.151+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.151+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.151+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.151+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.151+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.151+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.151+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce55470 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce55470 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.152+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cbc027060 2024-04-24T01:43:03.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc001f070 con 0x7f5cbc027060 2024-04-24T01:43:03.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce55470 2024-04-24T01:43:03.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.153+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cbc027060 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc001f070 con 0x7f5cbc027060 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.154+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5e080 con 0x7f5cc0031040 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cb8097040 con 0x55fe7ce55470 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cb8097040 con 0x7f5cbc027060 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc001f070 con 0x7f5cbc027060 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce59f10 con 0x55fe7ce55470 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.155+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5a300 con 0x55fe7ce55470 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5a300 con 0x55fe7ce55470 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 zone default found 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 4 Realm: () 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 zonegroup default 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5a720 con 0x7f5cc0031040 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.156+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5a720 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5ccb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5fee0 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5ccb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5ccb010800 20 started sync module instance, tier type = 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5ccb010800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.157+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce5f380 con 0x7f5cbc027060 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.158+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.158+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94551505500064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce60730 con 0x7f5cbc027060 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.158+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce60f80 con 0x55fe7ce55470 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.159+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94551505500064] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.159+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.159+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94551505502848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce60c30 con 0x55fe7ce55470 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.159+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce61750 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.160+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94551505502848] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.161+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.161+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94551505506848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce61b40 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.161+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce62540 con 0x7f5cbc027060 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.161+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94551505506848] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.162+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.162+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94551505503904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce62930 con 0x7f5cbc027060 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.162+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce63370 con 0x55fe7ce55470 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.163+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94551505503904] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.163+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.163+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94551505514048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce63330 con 0x55fe7ce55470 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.163+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce63d80 con 0x7f5cc0031040 2024-04-24T01:43:03.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.164+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.164+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94551505514048] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.164+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94551505516752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce641e0 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.164+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce62090 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.165+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94551505516752] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.165+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.165+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94551505517808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce64110 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.165+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce65140 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94551505517808] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94551505520544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce65070 con 0x7f5cc0031040 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 20 add_watcher() i=0 2024-04-24T01:43:03.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 20 add_watcher() i=1 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 20 add_watcher() i=2 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 20 add_watcher() i=3 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 20 add_watcher() i=4 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 20 add_watcher() i=5 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.166+0000 7f5ccb010800 20 add_watcher() i=6 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.167+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94551505520544] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.167+0000 7f5ccb010800 20 add_watcher() i=7 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.167+0000 7f5ccb010800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.167+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce68580 con 0x55fe7ce55470 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.167+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.167+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94551505522064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce65a40 con 0x55fe7ce55470 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94551505522064] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5b7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5ccb010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5ccb010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5ccb010800 5 note: GC not initialized 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5af77fe640 20 reqs_thread_entry: start 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5ccb010800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5ccb010800 20 Filter name: none 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5af57fa640 20 reqs_thread_entry: start 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.168+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce9b9e0 con 0x7f5cbc027060 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.169+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.169+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.169+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.169+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce9c270 con 0x7f5cc0031040 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5ccb010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce9ad80 con 0x7f5cbc027060 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5ccb010800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.170+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce9add0 con 0x7f5cc0031040 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(65 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:03.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 4.f 4:f304a00f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ce9ee20 con 0x55fe7ce55470 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 4.d 4:b205e15f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7cea19a0 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 4.2a 4:57091848:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7cea45c0 con 0x55fe7ce55470 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 4.25 4:a7334b03:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7cea6eb0 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 4.1e 4:797afb18:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7cea9760 con 0x7f5cc0031040 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 4.1e 4:785e71a1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceac540 con 0x7f5cc0031040 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 4.11 4:8b3156cf:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x7f5cc0031040 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 4.25 4:a4be0969:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceb2230 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:74 4.2e 4:7455b879:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceb4f70 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 4.8 4:1174bd7f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceb79a0 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:76 4.3e 4:7d91042a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceba3d0 con 0x7f5cbc027060 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(66 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.171+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(68 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(70 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(76 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(72 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(69 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(73 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(74 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(75 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(71 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5b7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.172+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94551505522064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceac540 con 0x55fe7ce55470 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.173+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94551505522064] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.173+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94551505500064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x7f5cbc027060 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.174+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94551505500064] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.174+0000 7f5ccb010800 20 remove_watcher() i=0 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.174+0000 7f5ccb010800 2 removed watcher, disabling cache 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.174+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94551505502848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x55fe7ce55470 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.176+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94551505502848] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.176+0000 7f5ccb010800 20 remove_watcher() i=1 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.176+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94551505506848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.177+0000 7f5cc5fb8640 1 -- 172.21.15.131:0/4069037012 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94551505506848] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cbc024030 con 0x55fe7ce5b5a0 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.177+0000 7f5ccb010800 20 remove_watcher() i=2 2024-04-24T01:43:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.177+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94551505503904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x7f5cbc027060 2024-04-24T01:43:03.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.178+0000 7f5cc6fba640 1 -- 172.21.15.131:0/4069037012 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94551505503904] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc0040040 con 0x7f5cbc027060 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.178+0000 7f5ccb010800 20 remove_watcher() i=3 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.178+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94551505514048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x55fe7ce55470 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.179+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94551505514048] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x55fe7ce55470 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.179+0000 7f5ccb010800 20 remove_watcher() i=4 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.179+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94551505516752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x7f5cc0031040 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.180+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94551505516752] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.180+0000 7f5ccb010800 20 remove_watcher() i=5 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.180+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94551505517808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x7f5cc0031040 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.181+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94551505517808] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.181+0000 7f5ccb010800 20 remove_watcher() i=6 2024-04-24T01:43:03.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.181+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94551505520544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe7ceaf400 con 0x7f5cc0031040 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94551505520544] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb805a040 con 0x7f5cc0031040 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 20 remove_watcher() i=7 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5cc0031040 msgr2=0x7f5cc0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5cc0031040 0x7f5cc0032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7ce55470 msgr2=0x55fe7ce57930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7ce55470 0x55fe7ce57930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5cbc027060 msgr2=0x7f5cbc01e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5cbc027060 0x7f5cbc01e990 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fe7ce5b5a0 msgr2=0x55fe7ce5d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fe7ce5b5a0 0x55fe7ce5d9b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5b90036950 msgr2=0x7f5b90038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5b90036950 0x7f5b90038e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55fe7ce213f0 tx=0x7f5cc001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 msgr2=0x55fe7ce49980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce49980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc026fd0 tx=0x7f5cbc04be50 comp rx=0 tx=0).stop 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5cc67b9640 1 -- 172.21.15.131:0/4069037012 reap_dead start 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 shutdown_connections 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/4069037012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce422c0 0x55fe7ce49980 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 >> 172.21.15.131:0/4069037012 conn(0x55fe7ce3e620 msgr2=0x55fe7ce3bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 shutdown_connections 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/4069037012 wait complete. 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5ba0036950 msgr2=0x7f5ba0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5ba0036950 0x7f5ba0038e10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55fe7ce25030 tx=0x7f5cc0005840 comp rx=0 tx=0).stop 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce34f80 msgr2=0x55fe7ce353a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce34f80 0x55fe7ce353a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00e610 tx=0x7f5cbc00ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 shutdown_connections 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5ba0036950 0x7f5ba0038e10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 --2- 172.21.15.131:0/236759726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7ce34f80 0x55fe7ce353a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.182+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 >> 172.21.15.131:0/236759726 conn(0x55fe7ce29020 msgr2=0x55fe7ce29420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 shutdown_connections 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/236759726 wait complete. 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7cd210e0 msgr2=0x55fe7ce23ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7cd210e0 0x55fe7ce23ed0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5bac036950 msgr2=0x7f5bac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5bac036950 0x7f5bac038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc000c00 tx=0x7f5cbc0013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 msgr2=0x55fe7ce1cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce1cce0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5cb801ce60 tx=0x7f5cb8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 shutdown_connections 2024-04-24T01:43:03.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fe7cd210e0 0x55fe7ce23ed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5bac036950 0x7f5bac038e10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 --2- 172.21.15.131:0/2482445191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe7cd20780 0x55fe7ce1cce0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 >> 172.21.15.131:0/2482445191 conn(0x55fe7cd1c320 msgr2=0x55fe7ce0f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 shutdown_connections 2024-04-24T01:43:03.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.183+0000 7f5ccb010800 1 -- 172.21.15.131:0/2482445191 wait complete. 2024-04-24T01:43:03.201 INFO:teuthology.orchestra.run.smithi131.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"e8007cb0-7095-49ae-9c09-cc804d4cc0c2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","marker":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:43:02.582047Z","creation_time":"2024-04-24T01:43:02.579344Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T01:43:03.201 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:43:02.582047Z', 'creation_time': '2024-04-24T01:43:02.579344Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:43:03.201 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:43:03.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:43:03.201 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-24T01:43:03.288 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:03.288 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:03.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.287+0000 7f381a1a2800 1 Processor -- start 2024-04-24T01:43:03.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.287+0000 7f381a1a2800 1 -- start start 2024-04-24T01:43:03.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.287+0000 7f381a1a2800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d2fceeed20 0x55d2fceef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.287+0000 7f381a1a2800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d2fcdaed40 con 0x55d2fceeff80 2024-04-24T01:43:03.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.287+0000 7f381a1a2800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55d2fcd814d0 con 0x55d2fceeed20 2024-04-24T01:43:03.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.288+0000 7f3817ca8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d2fceeed20 0x55d2fceef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.288+0000 7f380ffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55d2fceeff80 0x55d2fcef0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56590/0 (socket says 172.21.15.131:56590) 2024-04-24T01:43:03.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.288+0000 7f380ffff640 1 -- 172.21.15.131:0/3016648854 learned_addr learned my addr 172.21.15.131:0/3016648854 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:03.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.288+0000 7f3817ca8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d2fceeed20 0x55d2fceef140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42120/0 (socket says 172.21.15.131:42120) 2024-04-24T01:43:03.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.288+0000 7f3817ca8640 1 -- 172.21.15.131:0/3016648854 >> v1:172.21.15.107:6789/0 conn(0x55d2fceeff80 legacy=0x55d2fcef0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.288+0000 7f3817ca8640 1 -- 172.21.15.131:0/3016648854 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fcdad590 con 0x55d2fceeed20 2024-04-24T01:43:03.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.290+0000 7f3817ca8640 1 --2- 172.21.15.131:0/3016648854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fceef140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f380800a470 tx=0x7f380801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a195f6a0728fdd2f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.290+0000 7f38174a7640 1 -- 172.21.15.131:0/3016648854 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808057070 con 0x55d2fceeed20 2024-04-24T01:43:03.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.290+0000 7f38174a7640 1 -- 172.21.15.131:0/3016648854 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3808052570 con 0x55d2fceeed20 2024-04-24T01:43:03.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.290+0000 7f38174a7640 1 -- 172.21.15.131:0/3016648854 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808052870 con 0x55d2fceeed20 2024-04-24T01:43:03.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.291+0000 7f381a1a2800 1 -- 172.21.15.131:0/3016648854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 msgr2=0x55d2fceef140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.291+0000 7f381a1a2800 1 --2- 172.21.15.131:0/3016648854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fceef140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f380800a470 tx=0x7f380801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.291+0000 7f381a1a2800 1 -- 172.21.15.131:0/3016648854 shutdown_connections 2024-04-24T01:43:03.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.291+0000 7f381a1a2800 1 --2- 172.21.15.131:0/3016648854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fceef140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.291+0000 7f381a1a2800 1 -- 172.21.15.131:0/3016648854 >> 172.21.15.131:0/3016648854 conn(0x55d2fceea380 msgr2=0x55d2fceec7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.291+0000 7f381a1a2800 1 -- 172.21.15.131:0/3016648854 shutdown_connections 2024-04-24T01:43:03.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.291+0000 7f381a1a2800 1 -- 172.21.15.131:0/3016648854 wait complete. 2024-04-24T01:43:03.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.302+0000 7f381a1a2800 1 Processor -- start 2024-04-24T01:43:03.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.302+0000 7f381a1a2800 1 -- start start 2024-04-24T01:43:03.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f381a1a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfdd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f381a1a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d2fce3b3c0 con 0x55d2fceeed20 2024-04-24T01:43:03.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3817ca8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfdd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3817ca8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfdd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42122/0 (socket says 172.21.15.131:42122) 2024-04-24T01:43:03.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3817ca8640 1 -- 172.21.15.131:0/3645296029 learned_addr learned my addr 172.21.15.131:0/3645296029 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3817ca8640 1 -- 172.21.15.131:0/3645296029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fcfdb7f0 con 0x55d2fceeed20 2024-04-24T01:43:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3817ca8640 1 --2- 172.21.15.131:0/3645296029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfdd230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3808055040 tx=0x7f380804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c69cd473aa30718 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3705e0b640 1 -- 172.21.15.131:0/3645296029 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808057070 con 0x55d2fceeed20 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3705e0b640 1 -- 172.21.15.131:0/3645296029 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3808063070 con 0x55d2fceeed20 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.303+0000 7f3705e0b640 1 -- 172.21.15.131:0/3645296029 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808052720 con 0x55d2fceeed20 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 -- 172.21.15.131:0/3645296029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 msgr2=0x55d2fcfdd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 --2- 172.21.15.131:0/3645296029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfdd230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3808055040 tx=0x7f380804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 -- 172.21.15.131:0/3645296029 shutdown_connections 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 --2- 172.21.15.131:0/3645296029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfdd230 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 -- 172.21.15.131:0/3645296029 >> 172.21.15.131:0/3645296029 conn(0x55d2fceea380 msgr2=0x55d2fcfdf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 -- 172.21.15.131:0/3645296029 shutdown_connections 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 -- 172.21.15.131:0/3645296029 wait complete. 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.304+0000 7f381a1a2800 1 Processor -- start 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f381a1a2800 1 -- start start 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f381a1a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfeb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f381a1a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d2fcef83f0 con 0x55d2fceeed20 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f3817ca8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfeb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f3817ca8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfeb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42134/0 (socket says 172.21.15.131:42134) 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f3817ca8640 1 -- 172.21.15.131:0/1412491914 learned_addr learned my addr 172.21.15.131:0/1412491914 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f3817ca8640 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fcfeb750 con 0x55d2fceeed20 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f3817ca8640 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfeb210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3808060040 tx=0x7f3808002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f36fffff640 1 -- 172.21.15.131:0/1412491914 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808052c70 con 0x55d2fceeed20 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f36fffff640 1 -- 172.21.15.131:0/1412491914 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380806c070 con 0x55d2fceeed20 2024-04-24T01:43:03.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.305+0000 7f36fffff640 1 -- 172.21.15.131:0/1412491914 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f380805e480 con 0x55d2fceeed20 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.306+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2fcfeb9e0 con 0x55d2fceeed20 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.306+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2fcfee690 con 0x55d2fceeed20 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.306+0000 7f36fffff640 1 -- 172.21.15.131:0/1412491914 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f380805e620 con 0x55d2fceeed20 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.306+0000 7f36fffff640 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3700036950 0x7f3700038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.306+0000 7f36fffff640 1 -- 172.21.15.131:0/1412491914 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f380808e700 con 0x55d2fceeed20 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f380ffff640 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3700036950 0x7f3700038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f381a1a2800 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fceeff80 0x55d2fcff2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fcff2990 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f38184a9640 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fceeff80 0x55d2fcff2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f380ffff640 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3700036950 0x7f3700038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3800000f60 tx=0x7f38000012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f38184a9640 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fceeff80 0x55d2fcff2450 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f38184a9640 1 -- 172.21.15.131:0/1412491914 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f381000a4a0 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.307+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fcfefa20 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.308+0000 7f38184a9640 1 -- 172.21.15.131:0/1412491914 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f381000a4a0 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.308+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fcff47d0 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.308+0000 7f38184a9640 1 -- 172.21.15.131:0/1412491914 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f381000a4a0 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.308+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fcff3b10 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.308+0000 7f38184a9640 1 -- 172.21.15.131:0/1412491914 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f381000a4a0 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.308+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fcff3f60 con 0x55d2fceeff80 2024-04-24T01:43:03.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.308+0000 7f38184a9640 1 -- 172.21.15.131:0/1412491914 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f381000a4a0 con 0x55d2fceeff80 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f381a1a2800 1 Processor -- start 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f381a1a2800 1 -- start start 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f381a1a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd003540 0x55d2fd003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f381a1a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d2fcde16b0 con 0x55d2fd003540 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f380ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd003540 0x55d2fd003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f380ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd003540 0x55d2fd003960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42136/0 (socket says 172.21.15.131:42136) 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f380ffff640 1 -- 172.21.15.131:0/2571342490 learned_addr learned my addr 172.21.15.131:0/2571342490 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.309+0000 7f380ffff640 1 -- 172.21.15.131:0/2571342490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fd003ea0 con 0x55d2fd003540 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.310+0000 7f380ffff640 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd003540 0x55d2fd003960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3800001ed0 tx=0x7f380000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.310+0000 7f36fd7fa640 1 -- 172.21.15.131:0/2571342490 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f380001b550 con 0x55d2fd003540 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.310+0000 7f36fd7fa640 1 -- 172.21.15.131:0/2571342490 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380001b6f0 con 0x55d2fd003540 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.310+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2fd004910 con 0x55d2fd003540 2024-04-24T01:43:03.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.310+0000 7f36fd7fa640 1 -- 172.21.15.131:0/2571342490 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f380001b9d0 con 0x55d2fd003540 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.310+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2fd004e10 con 0x55d2fd003540 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.310+0000 7f36fd7fa640 1 -- 172.21.15.131:0/2571342490 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3800023020 con 0x55d2fd003540 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f36fd7fa640 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36f0036950 0x7f36f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f36fd7fa640 1 -- 172.21.15.131:0/2571342490 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3800021020 con 0x55d2fd003540 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f38184a9640 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36f0036950 0x7f36f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f381a1a2800 1 Processor -- start 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f38184a9640 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36f0036950 0x7f36f0038e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55d2fcff3630 tx=0x7f3810005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f381a1a2800 1 -- start start 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f381a1a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd010ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f381a1a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d2fcfdbab0 con 0x55d2fd010880 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f380ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd010ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f380ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd010ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42138/0 (socket says 172.21.15.131:42138) 2024-04-24T01:43:03.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.311+0000 7f380ffff640 1 -- 172.21.15.131:0/2403073631 learned_addr learned my addr 172.21.15.131:0/2403073631 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f380ffff640 1 -- 172.21.15.131:0/2403073631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fd011270 con 0x55d2fd010880 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f380ffff640 1 --2- 172.21.15.131:0/2403073631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd010ca0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f380004ce10 tx=0x7f3800019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4755554bc9519a17 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f36f6ffd640 1 -- 172.21.15.131:0/2403073631 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38000258e0 con 0x55d2fd010880 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f36f6ffd640 1 -- 172.21.15.131:0/2403073631 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3800025410 con 0x55d2fd010880 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f36f6ffd640 1 -- 172.21.15.131:0/2403073631 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3800025a80 con 0x55d2fd010880 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f381a1a2800 1 -- 172.21.15.131:0/2403073631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 msgr2=0x55d2fd010ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f381a1a2800 1 --2- 172.21.15.131:0/2403073631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd010ca0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f380004ce10 tx=0x7f3800019ce0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f381a1a2800 1 -- 172.21.15.131:0/2403073631 shutdown_connections 2024-04-24T01:43:03.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f381a1a2800 1 --2- 172.21.15.131:0/2403073631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd010ca0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f381a1a2800 1 -- 172.21.15.131:0/2403073631 >> 172.21.15.131:0/2403073631 conn(0x55d2fd00cbe0 msgr2=0x55d2fd00ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f381a1a2800 1 -- 172.21.15.131:0/2403073631 shutdown_connections 2024-04-24T01:43:03.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.312+0000 7f381a1a2800 1 -- 172.21.15.131:0/2403073631 wait complete. 2024-04-24T01:43:03.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f381a1a2800 1 Processor -- start 2024-04-24T01:43:03.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f381a1a2800 1 -- start start 2024-04-24T01:43:03.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f381a1a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd017f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f381a1a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d2fd0119e0 con 0x55d2fd010880 2024-04-24T01:43:03.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f380ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd017f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f380ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd017f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42140/0 (socket says 172.21.15.131:42140) 2024-04-24T01:43:03.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 learned_addr learned my addr 172.21.15.131:0/4173263872 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.313+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fd018450 con 0x55d2fd010880 2024-04-24T01:43:03.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.314+0000 7f380ffff640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd017f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3800019f50 tx=0x7f380004cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.314+0000 7f36f57fa640 1 -- 172.21.15.131:0/4173263872 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f380000cc60 con 0x55d2fd010880 2024-04-24T01:43:03.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.314+0000 7f36f57fa640 1 -- 172.21.15.131:0/4173263872 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380000ce00 con 0x55d2fd010880 2024-04-24T01:43:03.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.314+0000 7f36f57fa640 1 -- 172.21.15.131:0/4173263872 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f380000c360 con 0x55d2fd010880 2024-04-24T01:43:03.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.314+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2fd0186e0 con 0x55d2fd010880 2024-04-24T01:43:03.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.314+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2fd0186e0 con 0x55d2fd010880 2024-04-24T01:43:03.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.314+0000 7f36f57fa640 1 -- 172.21.15.131:0/4173263872 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f380004eb20 con 0x55d2fd010880 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f36f57fa640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36e0036900 0x7f36e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f36f57fa640 1 -- 172.21.15.131:0/4173263872 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f380003ac40 con 0x55d2fd010880 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f38184a9640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36e0036900 0x7f36e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fd023820 0x55d2fd025cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd026410 con 0x55d2fd023820 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f3817ca8640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fd023820 0x55d2fd025cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f38184a9640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36e0036900 0x7f36e0038dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55d2fcfef970 tx=0x7f381001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f3817ca8640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fd023820 0x55d2fd025cc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f381a1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f381a1a2800 20 realm 2024-04-24T01:43:03.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.315+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd026820 con 0x55d2fd023820 2024-04-24T01:43:03.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:03.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd0270f0 con 0x55d2fd023820 2024-04-24T01:43:03.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd027490 con 0x55d2fd023820 2024-04-24T01:43:03.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd0278f0 con 0x55d2fd023820 2024-04-24T01:43:03.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:03.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 20 searching for the correct realm 2024-04-24T01:43:03.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d2fd029940 0x55d2fd02bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.316+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.317+0000 7f380ffff640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d2fd029940 0x55d2fd02bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.317+0000 7f380ffff640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d2fd029940 0x55d2fd02bd30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.317+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.317+0000 7f380ffff640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f380003cb90 0x7f3800044640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.317+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f380003cb90 2024-04-24T01:43:03.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.317+0000 7f38184a9640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f380003cb90 0x7f3800044640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.318+0000 7f38184a9640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f380003cb90 0x7f3800044640 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.318+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381001f070 con 0x7f380003cb90 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.318+0000 7f38184a9640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3810031040 0x7f3810032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.318+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.318+0000 7f3817ca8640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3810031040 0x7f3810032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.318+0000 7f3817ca8640 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3810031040 0x7f3810032940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.319+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f380003cb90 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381001f070 con 0x7f380003cb90 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.320+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.321+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.321+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.321+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.321+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f380003cb90 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.321+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f381001f070 con 0x7f380003cb90 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.321+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.322+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.323+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.324+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.324+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f380003cb90 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.324+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381001f070 con 0x7f380003cb90 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.324+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.324+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.324+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f380003cb90 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381001f070 con 0x7f380003cb90 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.325+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd029940 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.326+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.326+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f3810031040 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.326+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.326+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x55d2fd023820 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.326+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.326+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02c400 con 0x7f380003cb90 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381001f070 con 0x7f380003cb90 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:03.376 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd0283c0 con 0x55d2fd023820 2024-04-24T01:43:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd028c60 con 0x55d2fd023820 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd028000 con 0x55d2fd023820 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 zone default found 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 4 Realm: () 2024-04-24T01:43:03.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 zonegroup default 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.327+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd028c60 con 0x7f3810031040 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02e260 con 0x55d2fd029940 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02e600 con 0x55d2fd029940 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 20 started sync module instance, tier type = 2024-04-24T01:43:03.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.328+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02d700 con 0x7f380003cb90 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.330+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.330+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94364676315936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02ee50 con 0x7f380003cb90 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.330+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02f6a0 con 0x55d2fd023820 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.331+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94364676315936] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.331+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.331+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94364676319648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02f3d0 con 0x55d2fd023820 2024-04-24T01:43:03.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.331+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02fe90 con 0x55d2fd029940 2024-04-24T01:43:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.332+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94364676319648] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.332+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.332+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94364676323680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd030280 con 0x55d2fd029940 2024-04-24T01:43:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.332+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd030c40 con 0x7f380003cb90 2024-04-24T01:43:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.333+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.333+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94364676327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd031510 con 0x7f380003cb90 2024-04-24T01:43:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.333+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd031ff0 con 0x55d2fd023820 2024-04-24T01:43:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.333+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94364676323680] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.334+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.334+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94364676320800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd031fb0 con 0x55d2fd023820 2024-04-24T01:43:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.334+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd032a70 con 0x7f3810031040 2024-04-24T01:43:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.334+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94364676327824] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.335+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94364676320800] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.335+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.335+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94364676329568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd031b00 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.335+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd033310 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.336+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94364676329568] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.337+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.337+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94364676334976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd033120 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.337+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd033970 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94364676334976] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94364676337024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd033770 con 0x7f3810031040 2024-04-24T01:43:03.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 20 add_watcher() i=0 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 20 add_watcher() i=1 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 20 add_watcher() i=2 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 20 add_watcher() i=3 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 20 add_watcher() i=4 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 20 add_watcher() i=5 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.338+0000 7f381a1a2800 20 add_watcher() i=6 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.339+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94364676337024] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.339+0000 7f381a1a2800 20 add_watcher() i=7 2024-04-24T01:43:03.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.339+0000 7f381a1a2800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.339+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd036ce0 con 0x55d2fd023820 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.340+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.340+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94364676338208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd0341d0 con 0x55d2fd023820 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94364676338208] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f36cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f381a1a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f381a1a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:03.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f381a1a2800 5 note: GC not initialized 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f36ccfe1640 20 reqs_thread_entry: start 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f381a1a2800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f381a1a2800 20 Filter name: none 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f36467fc640 20 reqs_thread_entry: start 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.341+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd069b50 con 0x55d2fd023820 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:03.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd06a540 con 0x55d2fd023820 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd06b550 con 0x7f380003cb90 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.342+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd068e00 con 0x7f380003cb90 2024-04-24T01:43:03.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd06b550 con 0x7f3810031040 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(66 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 4.f 4:f304a00f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd06aed0 con 0x55d2fd023820 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 4.d 4:b205e15f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd06fc00 con 0x55d2fd029940 2024-04-24T01:43:03.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 4.2a 4:57091848:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd072620 con 0x55d2fd023820 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:70 4.25 4:a7334b03:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd074f10 con 0x55d2fd029940 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 4.1e 4:797afb18:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd077990 con 0x7f3810031040 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 4.1e 4:785e71a1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd07a3b0 con 0x7f3810031040 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 4.11 4:8b3156cf:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd07d270 con 0x7f3810031040 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.343+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:74 4.25 4:a4be0969:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd0800a0 con 0x55d2fd029940 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 4.2e 4:7455b879:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd082a60 con 0x55d2fd029940 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:76 4.8 4:1174bd7f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd0854b0 con 0x55d2fd029940 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:77 4.3e 4:7d91042a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd088350 con 0x7f380003cb90 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(67 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(77 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(68 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(70 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(71 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(74 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(76 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(75 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.344+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(72 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.345+0000 7f36cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.345+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94364676338208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd07a3b0 con 0x55d2fd023820 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.346+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94364676338208] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.346+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94364676315936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd0331e0 con 0x7f380003cb90 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.347+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94364676315936] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.347+0000 7f381a1a2800 20 remove_watcher() i=0 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.347+0000 7f381a1a2800 2 removed watcher, disabling cache 2024-04-24T01:43:03.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.347+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94364676319648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02db20 con 0x55d2fd023820 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.348+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94364676319648] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.349+0000 7f381a1a2800 20 remove_watcher() i=1 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.349+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94364676323680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02e9a0 con 0x55d2fd029940 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.350+0000 7f380ffff640 1 -- 172.21.15.131:0/4173263872 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94364676323680] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3800009050 con 0x55d2fd029940 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.350+0000 7f381a1a2800 20 remove_watcher() i=2 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.350+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94364676327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02e9a0 con 0x7f380003cb90 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.350+0000 7f38184a9640 1 -- 172.21.15.131:0/4173263872 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94364676327824] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3810040040 con 0x7f380003cb90 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.351+0000 7f381a1a2800 20 remove_watcher() i=3 2024-04-24T01:43:03.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.351+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94364676320800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02e9a0 con 0x55d2fd023820 2024-04-24T01:43:03.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.351+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94364676320800] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x55d2fd023820 2024-04-24T01:43:03.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.352+0000 7f381a1a2800 20 remove_watcher() i=4 2024-04-24T01:43:03.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.352+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94364676329568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02e9a0 con 0x7f3810031040 2024-04-24T01:43:03.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.352+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94364676329568] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.352+0000 7f381a1a2800 20 remove_watcher() i=5 2024-04-24T01:43:03.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.352+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94364676334976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd031060 con 0x7f3810031040 2024-04-24T01:43:03.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.353+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94364676334976] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.353+0000 7f381a1a2800 20 remove_watcher() i=6 2024-04-24T01:43:03.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.353+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94364676337024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2fd02e9a0 con 0x7f3810031040 2024-04-24T01:43:03.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.354+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94364676337024] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808009d10 con 0x7f3810031040 2024-04-24T01:43:03.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.354+0000 7f381a1a2800 20 remove_watcher() i=7 2024-04-24T01:43:03.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3810031040 msgr2=0x7f3810032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3810031040 0x7f3810032940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fd023820 msgr2=0x55d2fd025cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fd023820 0x55d2fd025cc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f380003cb90 msgr2=0x7f3800044640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f380003cb90 0x7f3800044640 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d2fd029940 msgr2=0x55d2fd02bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d2fd029940 0x55d2fd02bd30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36e0036900 msgr2=0x7f36e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36e0036900 0x7f36e0038dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55d2fcfef970 tx=0x7f381001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f3817ca8640 1 -- 172.21.15.131:0/4173263872 reap_dead start 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 msgr2=0x55d2fd017f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd017f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3800019f50 tx=0x7f380004cda0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 shutdown_connections 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/4173263872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd010880 0x55d2fd017f10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 >> 172.21.15.131:0/4173263872 conn(0x55d2fd00cbe0 msgr2=0x55d2fd00a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 shutdown_connections 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/4173263872 wait complete. 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36f0036950 msgr2=0x7f36f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36f0036950 0x7f36f0038e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55d2fcff3630 tx=0x7f3810005840 comp rx=0 tx=0).stop 2024-04-24T01:43:03.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd003540 msgr2=0x55d2fd003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd003540 0x55d2fd003960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3800001ed0 tx=0x7f380000d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 shutdown_connections 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f36f0036950 0x7f36f0038e10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/2571342490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fd003540 0x55d2fd003960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 >> 172.21.15.131:0/2571342490 conn(0x55d2fcff75e0 msgr2=0x55d2fcff79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 shutdown_connections 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/2571342490 wait complete. 2024-04-24T01:43:03.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fceeff80 msgr2=0x55d2fcff2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fceeff80 0x55d2fcff2450 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.355+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3700036950 msgr2=0x7f3700038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3700036950 0x7f3700038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3800000f60 tx=0x7f38000012b0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 msgr2=0x55d2fcfeb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfeb210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3808060040 tx=0x7f3808002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 shutdown_connections 2024-04-24T01:43:03.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d2fceeff80 0x55d2fcff2450 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3700036950 0x7f3700038e10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 --2- 172.21.15.131:0/1412491914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2fceeed20 0x55d2fcfeb210 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 >> 172.21.15.131:0/1412491914 conn(0x55d2fceea380 msgr2=0x55d2fcfda5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 shutdown_connections 2024-04-24T01:43:03.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.356+0000 7f381a1a2800 1 -- 172.21.15.131:0/1412491914 wait complete. 2024-04-24T01:43:03.401 INFO:teuthology.orchestra.run.smithi131.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"e8007cb0-7095-49ae-9c09-cc804d4cc0c2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","marker":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:43:02.582047Z","creation_time":"2024-04-24T01:43:02.579344Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-04-24T01:43:03.402 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:43:02.582047Z', 'creation_time': '2024-04-24T01:43:02.579344Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-24T01:43:03.411 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:43:03.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:43:03.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:43:03.412 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T01:43:03.486 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:03.486 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f972d800 1 Processor -- start 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f972d800 1 -- start start 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f972d800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5636d0664d20 0x5636d0665140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f972d800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636d0524d40 con 0x5636d0665f80 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f972d800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5636d04f74d0 con 0x5636d0664d20 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f537f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5636d0664d20 0x5636d0665140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f4b7e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5636d0665f80 0x5636d0666400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56604/0 (socket says 172.21.15.131:56604) 2024-04-24T01:43:03.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/4106520259 learned_addr learned my addr 172.21.15.131:0/4106520259 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:03.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f537f640 1 -- 172.21.15.131:0/4106520259 >> v1:172.21.15.107:6789/0 conn(0x5636d0665f80 legacy=0x5636d0666400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8e7fff640 1 -- 172.21.15.131:0/4106520259 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285667117 0 0) 0x5636d0524d40 con 0x5636d0665f80 2024-04-24T01:43:03.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.485+0000 7fd8f537f640 1 -- 172.21.15.131:0/4106520259 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d0523590 con 0x5636d0664d20 2024-04-24T01:43:03.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.487+0000 7fd8f537f640 1 --2- 172.21.15.131:0/4106520259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d0665140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800a470 tx=0x7fd8e801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dbf7794f39bd1a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.487+0000 7fd8e7fff640 1 -- 172.21.15.131:0/4106520259 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e8057070 con 0x5636d0664d20 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8e7fff640 1 -- 172.21.15.131:0/4106520259 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8052570 con 0x5636d0664d20 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8e7fff640 1 -- 172.21.15.131:0/4106520259 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e8052870 con 0x5636d0664d20 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8f972d800 1 -- 172.21.15.131:0/4106520259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 msgr2=0x5636d0665140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8f972d800 1 --2- 172.21.15.131:0/4106520259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d0665140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800a470 tx=0x7fd8e801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8f972d800 1 -- 172.21.15.131:0/4106520259 shutdown_connections 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8f972d800 1 --2- 172.21.15.131:0/4106520259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d0665140 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8f972d800 1 -- 172.21.15.131:0/4106520259 >> 172.21.15.131:0/4106520259 conn(0x5636d0660380 msgr2=0x5636d06627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8f972d800 1 -- 172.21.15.131:0/4106520259 shutdown_connections 2024-04-24T01:43:03.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.488+0000 7fd8f972d800 1 -- 172.21.15.131:0/4106520259 wait complete. 2024-04-24T01:43:03.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f972d800 1 Processor -- start 2024-04-24T01:43:03.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f972d800 1 -- start start 2024-04-24T01:43:03.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f972d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d07572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f972d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5636d05b13c0 con 0x5636d0664d20 2024-04-24T01:43:03.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f537f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d07572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f537f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d07572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42150/0 (socket says 172.21.15.131:42150) 2024-04-24T01:43:03.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f537f640 1 -- 172.21.15.131:0/2293612318 learned_addr learned my addr 172.21.15.131:0/2293612318 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.500+0000 7fd8f537f640 1 -- 172.21.15.131:0/2293612318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d0757890 con 0x5636d0664d20 2024-04-24T01:43:03.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.501+0000 7fd8f537f640 1 --2- 172.21.15.131:0/2293612318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d07572c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8055040 tx=0x7fd8e804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2672f815722f6174 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.501+0000 7fd7e3606640 1 -- 172.21.15.131:0/2293612318 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e8063070 con 0x5636d0664d20 2024-04-24T01:43:03.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.501+0000 7fd7e3606640 1 -- 172.21.15.131:0/2293612318 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8058040 con 0x5636d0664d20 2024-04-24T01:43:03.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.501+0000 7fd7e3606640 1 -- 172.21.15.131:0/2293612318 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e8057070 con 0x5636d0664d20 2024-04-24T01:43:03.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.501+0000 7fd8f972d800 1 -- 172.21.15.131:0/2293612318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 msgr2=0x5636d07572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.501+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2293612318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d07572c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8055040 tx=0x7fd8e804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 -- 172.21.15.131:0/2293612318 shutdown_connections 2024-04-24T01:43:03.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2293612318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d07572c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 -- 172.21.15.131:0/2293612318 >> 172.21.15.131:0/2293612318 conn(0x5636d0660380 msgr2=0x5636d0752be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 -- 172.21.15.131:0/2293612318 shutdown_connections 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 -- 172.21.15.131:0/2293612318 wait complete. 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 Processor -- start 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 -- start start 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d075ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f972d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5636d066e420 con 0x5636d0664d20 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f537f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d075ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f537f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d075ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42162/0 (socket says 172.21.15.131:42162) 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f537f640 1 -- 172.21.15.131:0/2718866870 learned_addr learned my addr 172.21.15.131:0/2718866870 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.502+0000 7fd8f537f640 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d075f3a0 con 0x5636d0664d20 2024-04-24T01:43:03.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.503+0000 7fd8f537f640 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d075ee60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8061040 tx=0x7fd8e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.503+0000 7fd7e1e03640 1 -- 172.21.15.131:0/2718866870 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e8063030 con 0x5636d0664d20 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.503+0000 7fd7e1e03640 1 -- 172.21.15.131:0/2718866870 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8052a60 con 0x5636d0664d20 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.503+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636d075f630 con 0x5636d0664d20 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.503+0000 7fd7e1e03640 1 -- 172.21.15.131:0/2718866870 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e8052d40 con 0x5636d0664d20 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.503+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d0762290 con 0x5636d0664d20 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd7e1e03640 1 -- 172.21.15.131:0/2718866870 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd8e805e480 con 0x5636d0664d20 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd7e1e03640 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7dc036950 0x7fd7dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd7e1e03640 1 -- 172.21.15.131:0/2718866870 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd8e8064070 con 0x5636d0664d20 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7dc036950 0x7fd7dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0665f80 0x5636d0766050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d0766590 con 0x5636d0665f80 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0665f80 0x5636d0766050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7dc036950 0x7fd7dc038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec000c00 tx=0x7fd8ec0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.504+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0665f80 0x5636d0766050 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.505+0000 7fd8f5b80640 1 -- 172.21.15.131:0/2718866870 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8f000a4a0 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.505+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d0763600 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.505+0000 7fd8f5b80640 1 -- 172.21.15.131:0/2718866870 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8f000a4a0 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.505+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d0768370 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.505+0000 7fd8f5b80640 1 -- 172.21.15.131:0/2718866870 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8f000a4a0 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.505+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07676b0 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.506+0000 7fd8f5b80640 1 -- 172.21.15.131:0/2718866870 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8f000a4a0 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.506+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d0767ad0 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.506+0000 7fd8f5b80640 1 -- 172.21.15.131:0/2718866870 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8f000a4a0 con 0x5636d0665f80 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.506+0000 7fd8f972d800 1 Processor -- start 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.506+0000 7fd8f972d800 1 -- start start 2024-04-24T01:43:03.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.506+0000 7fd8f972d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0777120 0x5636d0777540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.506+0000 7fd8f972d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5636d05576b0 con 0x5636d0777120 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd8f4b7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0777120 0x5636d0777540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd8f4b7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0777120 0x5636d0777540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42164/0 (socket says 172.21.15.131:42164) 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/1778469906 learned_addr learned my addr 172.21.15.131:0/1778469906 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/1778469906 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d0777a80 con 0x5636d0777120 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0777120 0x5636d0777540 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e610 tx=0x7fd8ec00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd7daffd640 1 -- 172.21.15.131:0/1778469906 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ec022070 con 0x5636d0777120 2024-04-24T01:43:03.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd7daffd640 1 -- 172.21.15.131:0/1778469906 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec009050 con 0x5636d0777120 2024-04-24T01:43:03.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636d07784f0 con 0x5636d0777120 2024-04-24T01:43:03.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd7daffd640 1 -- 172.21.15.131:0/1778469906 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ec00d500 con 0x5636d0777120 2024-04-24T01:43:03.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.507+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d07789f0 con 0x5636d0777120 2024-04-24T01:43:03.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.508+0000 7fd7daffd640 1 -- 172.21.15.131:0/1778469906 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd8ec025070 con 0x5636d0777120 2024-04-24T01:43:03.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.508+0000 7fd7daffd640 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7cc036950 0x7fd7cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.508+0000 7fd7daffd640 1 -- 172.21.15.131:0/1778469906 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd8ec04db30 con 0x5636d0777120 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.508+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7cc036950 0x7fd7cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.508+0000 7fd8f972d800 1 Processor -- start 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7cc036950 0x7fd7cc038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5636d0767a50 tx=0x7fd8f0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f972d800 1 -- start start 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f972d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d0784880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f972d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5636d0757b50 con 0x5636d0784460 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f4b7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d0784880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f4b7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d0784880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42180/0 (socket says 172.21.15.131:42180) 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/1629566313 learned_addr learned my addr 172.21.15.131:0/1629566313 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/1629566313 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d0784e50 con 0x5636d0784460 2024-04-24T01:43:03.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/1629566313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d0784880 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec026fd0 tx=0x7fd8ec024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23927ee23f80efb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd7d8ff9640 1 -- 172.21.15.131:0/1629566313 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ec04a030 con 0x5636d0784460 2024-04-24T01:43:03.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.509+0000 7fd7d8ff9640 1 -- 172.21.15.131:0/1629566313 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec025e30 con 0x5636d0784460 2024-04-24T01:43:03.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd7d8ff9640 1 -- 172.21.15.131:0/1629566313 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ec01ad50 con 0x5636d0784460 2024-04-24T01:43:03.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 -- 172.21.15.131:0/1629566313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 msgr2=0x5636d0784880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 --2- 172.21.15.131:0/1629566313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d0784880 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec026fd0 tx=0x7fd8ec024eb0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 -- 172.21.15.131:0/1629566313 shutdown_connections 2024-04-24T01:43:03.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 --2- 172.21.15.131:0/1629566313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d0784880 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 -- 172.21.15.131:0/1629566313 >> 172.21.15.131:0/1629566313 conn(0x5636d07807c0 msgr2=0x5636d077e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 -- 172.21.15.131:0/1629566313 shutdown_connections 2024-04-24T01:43:03.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 -- 172.21.15.131:0/1629566313 wait complete. 2024-04-24T01:43:03.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 Processor -- start 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 -- start start 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d078bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.510+0000 7fd8f972d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5636d07855c0 con 0x5636d0784460 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd8f4b7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d078bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd8f4b7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d078bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42194/0 (socket says 172.21.15.131:42194) 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 learned_addr learned my addr 172.21.15.131:0/990691598 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d078c060 con 0x5636d0784460 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d078bb20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec026fd0 tx=0x7fd8ec04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd7caffd640 1 -- 172.21.15.131:0/990691598 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ec04a050 con 0x5636d0784460 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd7caffd640 1 -- 172.21.15.131:0/990691598 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00d6a0 con 0x5636d0784460 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636d078c2f0 con 0x5636d0784460 2024-04-24T01:43:03.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd7caffd640 1 -- 172.21.15.131:0/990691598 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ec00d9e0 con 0x5636d0784460 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.511+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d078efa0 con 0x5636d0784460 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.512+0000 7fd7caffd640 1 -- 172.21.15.131:0/990691598 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd8ec04d330 con 0x5636d0784460 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.512+0000 7fd7caffd640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7c0036950 0x7fd7c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.512+0000 7fd7caffd640 1 -- 172.21.15.131:0/990691598 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd8ec045880 con 0x5636d0784460 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.512+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7c0036950 0x7fd7c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.512+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.512+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0797620 0x5636d0799ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.512+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079a230 con 0x5636d0797620 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f537f640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0797620 0x5636d0799ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7c0036950 0x7fd7c0038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5636d07671d0 tx=0x7fd8f001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f537f640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0797620 0x5636d0799ae0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 20 realm 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079a640 con 0x5636d0797620 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079af10 con 0x5636d0797620 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.513+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079b2b0 con 0x5636d0797620 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079b710 con 0x5636d0797620 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f972d800 20 searching for the correct realm 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5636d079d760 0x5636d079fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d079d760 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5636d079d760 0x5636d079fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.514+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5636d079d760 0x5636d079fb50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f4b7e640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd8ec027060 0x7fd8ec01e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8ec027060 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd8ec027060 0x7fd8ec01e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd8ec027060 0x7fd8ec01e990 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8f001f070 con 0x7fd8ec027060 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f5b80640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd8f0031040 0x7fd8f0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.515+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8f0031040 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.516+0000 7fd8f537f640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd8f0031040 0x7fd8f0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.516+0000 7fd8f537f640 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd8f0031040 0x7fd8f0032940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.516+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.516+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d0797620 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.516+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.516+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d0797620 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8f0031040 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8f0031040 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8ec027060 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8f001f070 con 0x7fd8ec027060 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.517+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d079d760 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d0797620 2024-04-24T01:43:03.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8f0031040 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d0797620 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.518+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8ec027060 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8f001f070 con 0x7fd8ec027060 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d079d760 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d079d760 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8f0031040 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.519+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d079d760 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d079d760 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d0797620 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d0797620 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.520+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8f0031040 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d079d760 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8ec027060 2024-04-24T01:43:03.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8f001f070 con 0x7fd8ec027060 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x5636d0797620 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.521+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0200 con 0x7fd8f0031040 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd8e8097040 con 0x5636d079d760 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd8e8097040 con 0x7fd8f0031040 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd8e8097040 con 0x7fd8ec027060 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8f001f070 con 0x7fd8ec027060 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.522+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd8e8097040 con 0x5636d079d760 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd8e8097040 con 0x7fd8f0031040 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd8e8097040 con 0x5636d0797620 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd8e8097040 con 0x7fd8ec027060 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8f001f070 con 0x7fd8ec027060 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f972d800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f972d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f972d800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f972d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f972d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f972d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.523+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079c1b0 con 0x5636d0797620 2024-04-24T01:43:03.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079bdf0 con 0x5636d0797620 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d079be00 con 0x5636d0797620 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 zone default found 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 4 Realm: () 2024-04-24T01:43:03.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 zonegroup default 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.524+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a0660 con 0x7fd8f0031040 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a24f0 con 0x5636d079d760 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a2890 con 0x5636d079d760 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 20 started sync module instance, tier type = 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.525+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a1930 con 0x7fd8ec027060 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.526+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.526+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94793425886544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a30e0 con 0x7fd8ec027060 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.526+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a3930 con 0x5636d0797620 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.527+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94793425886544] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.527+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.527+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94793425890352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a3580 con 0x5636d0797620 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.527+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a4080 con 0x5636d079d760 2024-04-24T01:43:03.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.528+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94793425890352] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.529+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.529+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94793425894256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a44a0 con 0x5636d079d760 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.529+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a4ea0 con 0x7fd8ec027060 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.529+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.530+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94793425897904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a5740 con 0x7fd8ec027060 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.530+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a6240 con 0x5636d0797620 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.530+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94793425894256] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.531+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.531+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94793425902896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a6200 con 0x5636d0797620 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.531+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a6ca0 con 0x7fd8f0031040 2024-04-24T01:43:03.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.531+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94793425897904] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.532+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.532+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94793425905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a6ca0 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.532+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a76e0 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.532+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94793425902896] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.532+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94793425905616] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.533+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.533+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94793425900176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a7230 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.533+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a7bf0 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94793425909568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a8010 con 0x7fd8f0031040 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 20 add_watcher() i=0 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 20 add_watcher() i=1 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 20 add_watcher() i=2 2024-04-24T01:43:03.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 20 add_watcher() i=3 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 20 add_watcher() i=4 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 20 add_watcher() i=5 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94793425900176] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.534+0000 7fd8f972d800 20 add_watcher() i=6 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.535+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94793425909568] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.535+0000 7fd8f972d800 20 add_watcher() i=7 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.535+0000 7fd8f972d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.535+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a3050 con 0x5636d0797620 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.535+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.535+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94793425891408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a8520 con 0x5636d0797620 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.536+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94793425891408] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.536+0000 7fd7ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.536+0000 7fd8f972d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.536+0000 7fd8f972d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.536+0000 7fd8f972d800 5 note: GC not initialized 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.536+0000 7fd7aa7e4640 20 reqs_thread_entry: start 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.536+0000 7fd8f972d800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd8f972d800 20 Filter name: none 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd71bfff640 20 reqs_thread_entry: start 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07de380 con 0x7fd8ec027060 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.537+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07debf0 con 0x7fd8f0031040 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07dd860 con 0x7fd8ec027060 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07dd8b0 con 0x7fd8f0031040 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(65 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 4.f 4:f304a00f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07e1900 con 0x5636d0797620 2024-04-24T01:43:03.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.538+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 4.d 4:b205e15f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07e4310 con 0x5636d079d760 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 4.2a 4:57091848:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07e6c50 con 0x5636d0797620 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 4.25 4:a7334b03:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07e9810 con 0x5636d079d760 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 4.1e 4:797afb18:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07ec130 con 0x7fd8f0031040 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 4.1e 4:785e71a1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07eea50 con 0x7fd8f0031040 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 4.11 4:8b3156cf:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07f1480 con 0x7fd8f0031040 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(66 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 4.25 4:a4be0969:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07f1940 con 0x5636d079d760 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:74 4.2e 4:7455b879:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07e3d60 con 0x5636d079d760 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(68 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(69 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 4.8 4:1174bd7f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07e91e0 con 0x5636d079d760 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:76 4.3e 4:7d91042a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5636d07e4780 con 0x7fd8ec027060 2024-04-24T01:43:03.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(70 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(72 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(71 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(74 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(76 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(73 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.539+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(75 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.540+0000 7fd7ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.540+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94793425891408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07c6a90 con 0x5636d0797620 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.541+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94793425891408] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.541+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94793425886544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07c6a90 con 0x7fd8ec027060 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.542+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94793425886544] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.542+0000 7fd8f972d800 20 remove_watcher() i=0 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.542+0000 7fd8f972d800 2 removed watcher, disabling cache 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.542+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94793425890352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07c6a90 con 0x5636d0797620 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.543+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94793425890352] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.543+0000 7fd8f972d800 20 remove_watcher() i=1 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.543+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94793425894256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07c6a90 con 0x5636d079d760 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.544+0000 7fd8f4b7e640 1 -- 172.21.15.131:0/990691598 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94793425894256] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8ec024030 con 0x5636d079d760 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.544+0000 7fd8f972d800 20 remove_watcher() i=2 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.544+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94793425897904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a3b70 con 0x7fd8ec027060 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.545+0000 7fd8f5b80640 1 -- 172.21.15.131:0/990691598 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94793425897904] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8f0040040 con 0x7fd8ec027060 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.545+0000 7fd8f972d800 20 remove_watcher() i=3 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.545+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94793425902896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07c6a90 con 0x5636d0797620 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.546+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94793425902896] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x5636d0797620 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.546+0000 7fd8f972d800 20 remove_watcher() i=4 2024-04-24T01:43:03.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.546+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94793425905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a5d30 con 0x7fd8f0031040 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.547+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94793425905616] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.547+0000 7fd8f972d800 20 remove_watcher() i=5 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.547+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94793425900176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07c6a90 con 0x7fd8f0031040 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.548+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94793425900176] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.548+0000 7fd8f972d800 20 remove_watcher() i=6 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.548+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94793425909568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5636d07a5d30 con 0x7fd8f0031040 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94793425909568] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e8070020 con 0x7fd8f0031040 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 20 remove_watcher() i=7 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd8f0031040 msgr2=0x7fd8f0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd8f0031040 0x7fd8f0032940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0797620 msgr2=0x5636d0799ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0797620 0x5636d0799ae0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd8ec027060 msgr2=0x7fd8ec01e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd8ec027060 0x7fd8ec01e990 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5636d079d760 msgr2=0x5636d079fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5636d079d760 0x5636d079fb50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7c0036950 msgr2=0x7fd7c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7c0036950 0x7fd7c0038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5636d07671d0 tx=0x7fd8f001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 msgr2=0x5636d078bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d078bb20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec026fd0 tx=0x7fd8ec04be50 comp rx=0 tx=0).stop 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.549+0000 7fd8f537f640 1 -- 172.21.15.131:0/990691598 reap_dead start 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 shutdown_connections 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/990691598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0784460 0x5636d078bb20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 >> 172.21.15.131:0/990691598 conn(0x5636d07807c0 msgr2=0x5636d077de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 shutdown_connections 2024-04-24T01:43:03.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/990691598 wait complete. 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7cc036950 msgr2=0x7fd7cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7cc036950 0x7fd7cc038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5636d0767a50 tx=0x7fd8f0005840 comp rx=0 tx=0).stop 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0777120 msgr2=0x5636d0777540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0777120 0x5636d0777540 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e610 tx=0x7fd8ec00ff90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 shutdown_connections 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7cc036950 0x7fd7cc038e10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/1778469906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0777120 0x5636d0777540 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 >> 172.21.15.131:0/1778469906 conn(0x5636d076b1c0 msgr2=0x5636d076b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 shutdown_connections 2024-04-24T01:43:03.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/1778469906 wait complete. 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0665f80 msgr2=0x5636d0766050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0665f80 0x5636d0766050 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7dc036950 msgr2=0x7fd7dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7dc036950 0x7fd7dc038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec000c00 tx=0x7fd8ec0013b0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 msgr2=0x5636d075ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d075ee60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8061040 tx=0x7fd8e8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 shutdown_connections 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5636d0665f80 0x5636d0766050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd7dc036950 0x7fd7dc038e10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 --2- 172.21.15.131:0/2718866870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5636d0664d20 0x5636d075ee60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 >> 172.21.15.131:0/2718866870 conn(0x5636d0660380 msgr2=0x5636d0751440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 shutdown_connections 2024-04-24T01:43:03.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.550+0000 7fd8f972d800 1 -- 172.21.15.131:0/2718866870 wait complete. 2024-04-24T01:43:03.572 INFO:teuthology.orchestra.run.smithi131.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"e8007cb0-7095-49ae-9c09-cc804d4cc0c2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","marker":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:43:02.582047Z","creation_time":"2024-04-24T01:43:02.579344Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T01:43:03.573 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:43:02.582047Z', 'creation_time': '2024-04-24T01:43:02.579344Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:43:03.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-24T01:43:03.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-24T01:43:03.573 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-24T01:43:03.657 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:03.657 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:03.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.656+0000 7f171ee98800 1 Processor -- start 2024-04-24T01:43:03.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.656+0000 7f171ee98800 1 -- start start 2024-04-24T01:43:03.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.656+0000 7f171ee98800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5603da5e9300 0x5603da5f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.656+0000 7f171ee98800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5603da4a7d40 con 0x5603da5e77c0 2024-04-24T01:43:03.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.656+0000 7f171ee98800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5603da47a4d0 con 0x5603da5e9300 2024-04-24T01:43:03.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.657+0000 7f171c19d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5603da5e9300 0x5603da5f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.657+0000 7f171c99e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5603da5e77c0 0x5603da5e7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56616/0 (socket says 172.21.15.131:56616) 2024-04-24T01:43:03.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.657+0000 7f171c99e640 1 -- 172.21.15.131:0/769880618 learned_addr learned my addr 172.21.15.131:0/769880618 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:03.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.657+0000 7f171c19d640 1 -- 172.21.15.131:0/769880618 >> v1:172.21.15.107:6789/0 conn(0x5603da5e77c0 legacy=0x5603da5e7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.657+0000 7f171c19d640 1 -- 172.21.15.131:0/769880618 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603da4a6590 con 0x5603da5e9300 2024-04-24T01:43:03.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.657+0000 7f171b99c640 1 -- 172.21.15.131:0/769880618 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550966314 0 0) 0x5603da4a7d40 con 0x5603da5e77c0 2024-04-24T01:43:03.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171c19d640 1 --2- 172.21.15.131:0/769880618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e9300 0x5603da5f1e00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f170400a470 tx=0x7f170401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9715af9dc5250431 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171b99c640 1 -- 172.21.15.131:0/769880618 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1704057070 con 0x5603da5e9300 2024-04-24T01:43:03.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171b99c640 1 -- 172.21.15.131:0/769880618 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1704052440 con 0x5603da5e9300 2024-04-24T01:43:03.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171b99c640 1 -- 172.21.15.131:0/769880618 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1704052740 con 0x5603da5e9300 2024-04-24T01:43:03.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171ee98800 1 -- 172.21.15.131:0/769880618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e9300 msgr2=0x5603da5f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171ee98800 1 --2- 172.21.15.131:0/769880618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e9300 0x5603da5f1e00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f170400a470 tx=0x7f170401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171ee98800 1 -- 172.21.15.131:0/769880618 shutdown_connections 2024-04-24T01:43:03.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171ee98800 1 --2- 172.21.15.131:0/769880618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e9300 0x5603da5f1e00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171ee98800 1 -- 172.21.15.131:0/769880618 >> 172.21.15.131:0/769880618 conn(0x5603da5e3340 msgr2=0x5603da5e5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171ee98800 1 -- 172.21.15.131:0/769880618 shutdown_connections 2024-04-24T01:43:03.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.659+0000 7f171ee98800 1 -- 172.21.15.131:0/769880618 wait complete. 2024-04-24T01:43:03.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.671+0000 7f171ee98800 1 Processor -- start 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.671+0000 7f171ee98800 1 -- start start 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.671+0000 7f171ee98800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6dc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.671+0000 7f171ee98800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5603da5343b0 con 0x5603da5e77c0 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.671+0000 7f171c99e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6dc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.671+0000 7f171c99e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6dc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42224/0 (socket says 172.21.15.131:42224) 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.671+0000 7f171c99e640 1 -- 172.21.15.131:0/1369181215 learned_addr learned my addr 172.21.15.131:0/1369181215 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.672+0000 7f171c99e640 1 -- 172.21.15.131:0/1369181215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603da6dc930 con 0x5603da5e77c0 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.672+0000 7f171c99e640 1 --2- 172.21.15.131:0/1369181215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6dc360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f171400b210 tx=0x7f171400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948952a434fe74f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.672+0000 7f160ae0d640 1 -- 172.21.15.131:0/1369181215 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1714008070 con 0x5603da5e77c0 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.672+0000 7f160ae0d640 1 -- 172.21.15.131:0/1369181215 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171400d500 con 0x5603da5e77c0 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.672+0000 7f160ae0d640 1 -- 172.21.15.131:0/1369181215 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171400d840 con 0x5603da5e77c0 2024-04-24T01:43:03.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 -- 172.21.15.131:0/1369181215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 msgr2=0x5603da6dc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 --2- 172.21.15.131:0/1369181215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6dc360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f171400b210 tx=0x7f171400b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 -- 172.21.15.131:0/1369181215 shutdown_connections 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 --2- 172.21.15.131:0/1369181215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6dc360 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 -- 172.21.15.131:0/1369181215 >> 172.21.15.131:0/1369181215 conn(0x5603da5e3340 msgr2=0x5603da6d7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 -- 172.21.15.131:0/1369181215 shutdown_connections 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 -- 172.21.15.131:0/1369181215 wait complete. 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 Processor -- start 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 -- start start 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171ee98800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5603da5f4620 con 0x5603da5e77c0 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171c99e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171c99e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6e3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42228/0 (socket says 172.21.15.131:42228) 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.673+0000 7f171c99e640 1 -- 172.21.15.131:0/3419333885 learned_addr learned my addr 172.21.15.131:0/3419333885 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.674+0000 7f171c99e640 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603da6e4440 con 0x5603da5e77c0 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.674+0000 7f171c99e640 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6e3f00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f171400b210 tx=0x7f1714000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.674+0000 7f160960a640 1 -- 172.21.15.131:0/3419333885 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171400f950 con 0x5603da5e77c0 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.674+0000 7f160960a640 1 -- 172.21.15.131:0/3419333885 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171400faf0 con 0x5603da5e77c0 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.674+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603da6e46d0 con 0x5603da5e77c0 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.674+0000 7f160960a640 1 -- 172.21.15.131:0/3419333885 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171400fdd0 con 0x5603da5e77c0 2024-04-24T01:43:03.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.674+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603da6e7380 con 0x5603da5e77c0 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f160960a640 1 -- 172.21.15.131:0/3419333885 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1714017040 con 0x5603da5e77c0 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f160960a640 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f16040368b0 0x7f1604038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f160960a640 1 -- 172.21.15.131:0/3419333885 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1714015020 con 0x5603da5e77c0 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f171c19d640 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f16040368b0 0x7f1604038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f171ee98800 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da5e9300 0x5603da6eb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da6eb680 con 0x5603da5e9300 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f171d19f640 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da5e9300 0x5603da6eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.675+0000 7f171c19d640 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f16040368b0 0x7f1604038d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1704054000 tx=0x7f170404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.676+0000 7f171d19f640 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da5e9300 0x5603da6eb140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.676+0000 7f171d19f640 1 -- 172.21.15.131:0/3419333885 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170c00a4a0 con 0x5603da5e9300 2024-04-24T01:43:03.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.676+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da6e8710 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.676+0000 7f171d19f640 1 -- 172.21.15.131:0/3419333885 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f170c00a4a0 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.676+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da6ed480 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.676+0000 7f171d19f640 1 -- 172.21.15.131:0/3419333885 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f170c00a4a0 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.676+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da6ec7c0 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.677+0000 7f171d19f640 1 -- 172.21.15.131:0/3419333885 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f170c00a4a0 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.677+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da6ecc10 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.677+0000 7f171d19f640 1 -- 172.21.15.131:0/3419333885 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f170c00a4a0 con 0x5603da5e9300 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.677+0000 7f171ee98800 1 Processor -- start 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.677+0000 7f171ee98800 1 -- start start 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.677+0000 7f171ee98800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da6fc250 0x5603da6fc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.677+0000 7f171ee98800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5603da4da6b0 con 0x5603da6fc250 2024-04-24T01:43:03.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.678+0000 7f171c19d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da6fc250 0x5603da6fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.678+0000 7f171c19d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da6fc250 0x5603da6fc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42242/0 (socket says 172.21.15.131:42242) 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.678+0000 7f171c19d640 1 -- 172.21.15.131:0/2865146403 learned_addr learned my addr 172.21.15.131:0/2865146403 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.678+0000 7f171c19d640 1 -- 172.21.15.131:0/2865146403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603da6fcbb0 con 0x5603da6fc250 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.678+0000 7f171c19d640 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da6fc250 0x5603da6fc670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1704044840 tx=0x7f1704002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.678+0000 7f16027fc640 1 -- 172.21.15.131:0/2865146403 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170406f070 con 0x5603da6fc250 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.679+0000 7f16027fc640 1 -- 172.21.15.131:0/2865146403 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1704058040 con 0x5603da6fc250 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.679+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603da6fd620 con 0x5603da6fc250 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.679+0000 7f16027fc640 1 -- 172.21.15.131:0/2865146403 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1704057050 con 0x5603da6fc250 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.679+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603da6fdac0 con 0x5603da6fc250 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.679+0000 7f16027fc640 1 -- 172.21.15.131:0/2865146403 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1704072070 con 0x5603da6fc250 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.679+0000 7f16027fc640 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15f4036950 0x7f15f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.679+0000 7f16027fc640 1 -- 172.21.15.131:0/2865146403 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f170408f7e0 con 0x5603da6fc250 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171d19f640 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15f4036950 0x7f15f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171ee98800 1 Processor -- start 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171ee98800 1 -- start start 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171d19f640 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15f4036950 0x7f15f4038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5603da6ec2e0 tx=0x7f170c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171ee98800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da7098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171ee98800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5603da6dccb0 con 0x5603da709490 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171c19d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da7098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171c19d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da7098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42252/0 (socket says 172.21.15.131:42252) 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171c19d640 1 -- 172.21.15.131:0/4144456478 learned_addr learned my addr 172.21.15.131:0/4144456478 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.680+0000 7f171c19d640 1 -- 172.21.15.131:0/4144456478 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603da709e80 con 0x5603da709490 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171c19d640 1 --2- 172.21.15.131:0/4144456478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da7098b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f170408dbf0 tx=0x7f1704069c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d9bab3477d4c98 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f15f3fff640 1 -- 172.21.15.131:0/4144456478 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1704084070 con 0x5603da709490 2024-04-24T01:43:03.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f15f3fff640 1 -- 172.21.15.131:0/4144456478 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170405eb20 con 0x5603da709490 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f15f3fff640 1 -- 172.21.15.131:0/4144456478 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170405d510 con 0x5603da709490 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 -- 172.21.15.131:0/4144456478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 msgr2=0x5603da7098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 --2- 172.21.15.131:0/4144456478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da7098b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f170408dbf0 tx=0x7f1704069c00 comp rx=0 tx=0).stop 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 -- 172.21.15.131:0/4144456478 shutdown_connections 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 --2- 172.21.15.131:0/4144456478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da7098b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 -- 172.21.15.131:0/4144456478 >> 172.21.15.131:0/4144456478 conn(0x5603da7057f0 msgr2=0x5603da703850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 -- 172.21.15.131:0/4144456478 shutdown_connections 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 -- 172.21.15.131:0/4144456478 wait complete. 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 Processor -- start 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.681+0000 7f171ee98800 1 -- start start 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171ee98800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da710ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171ee98800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5603da70a5f0 con 0x5603da709490 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171c19d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da710ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171c19d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da710ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42268/0 (socket says 172.21.15.131:42268) 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 learned_addr learned my addr 172.21.15.131:0/773225862 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603da711010 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171c19d640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da710ad0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x5603da705ef0 tx=0x7f170408db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f15f27fc640 1 -- 172.21.15.131:0/773225862 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1704093020 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f15f27fc640 1 -- 172.21.15.131:0/773225862 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1704085040 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603da7112a0 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f15f27fc640 1 -- 172.21.15.131:0/773225862 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1704084070 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.682+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603da713f50 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.683+0000 7f15f27fc640 1 -- 172.21.15.131:0/773225862 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1704096020 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.683+0000 7f15f27fc640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15e8036950 0x7f15e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.683+0000 7f15f27fc640 1 -- 172.21.15.131:0/773225862 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1704099c40 con 0x5603da709490 2024-04-24T01:43:03.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.683+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171d19f640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15e8036950 0x7f15e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da71c5b0 0x5603da71ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da71f1a0 con 0x5603da71c5b0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171c99e640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da71c5b0 0x5603da71ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171d19f640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15e8036950 0x7f15e8038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5603da6e8660 tx=0x7f170c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171c99e640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da71c5b0 0x5603da71ea50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 20 realm 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da71f5b0 con 0x5603da71c5b0 2024-04-24T01:43:03.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.684+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da71fe80 con 0x5603da71c5b0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da720220 con 0x5603da71c5b0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da7206c0 con 0x5603da71c5b0 2024-04-24T01:43:03.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 20 searching for the correct realm 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5603da7226c0 0x5603da724ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.685+0000 7f171c19d640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5603da7226c0 0x5603da724ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.686+0000 7f171c19d640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5603da7226c0 0x5603da724ad0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.686+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.686+0000 7f171c19d640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1704098020 0x7f1704072990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.686+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f1704098020 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.686+0000 7f171d19f640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1704098020 0x7f1704072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.686+0000 7f171d19f640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1704098020 0x7f1704072990 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.687+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c01f070 con 0x7f1704098020 2024-04-24T01:43:03.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.687+0000 7f171d19f640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f170c031040 0x7f170c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.687+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.687+0000 7f171c99e640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f170c031040 0x7f170c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.687+0000 7f171c99e640 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f170c031040 0x7f170c032940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.688+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f1704098020 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c01f070 con 0x7f1704098020 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.689+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f1704098020 2024-04-24T01:43:03.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f170c01f070 con 0x7f1704098020 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.690+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.691+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.692+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.692+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.692+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.692+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f1704098020 2024-04-24T01:43:03.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c01f070 con 0x7f1704098020 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.693+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f1704098020 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c01f070 con 0x7f1704098020 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da7226c0 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f170c031040 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.694+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x5603da71c5b0 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5603da7251a0 con 0x7f1704098020 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c01f070 con 0x7f1704098020 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:03.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da721190 con 0x5603da71c5b0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da721a30 con 0x5603da71c5b0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.695+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da720dd0 con 0x5603da71c5b0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 zone default found 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 4 Realm: () 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 zonegroup default 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da725620 con 0x7f170c031040 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da7274b0 con 0x5603da7226c0 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.696+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da727850 con 0x5603da7226c0 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.697+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.697+0000 7f171ee98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.697+0000 7f171ee98800 20 started sync module instance, tier type = 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.697+0000 7f171ee98800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.697+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da7268f0 con 0x7f1704098020 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.698+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.698+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94574549822736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da7280a0 con 0x7f1704098020 2024-04-24T01:43:03.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.698+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da7288f0 con 0x5603da71c5b0 2024-04-24T01:43:03.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.699+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94574549822736] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.699+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.699+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94574549826544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da728520 con 0x5603da71c5b0 2024-04-24T01:43:03.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.699+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da729030 con 0x5603da7226c0 2024-04-24T01:43:03.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.700+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94574549826544] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.700+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.700+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94574549830368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da729420 con 0x5603da7226c0 2024-04-24T01:43:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.700+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da729e20 con 0x7f1704098020 2024-04-24T01:43:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.701+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.701+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94574549834032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72a6c0 con 0x7f1704098020 2024-04-24T01:43:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.701+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72b1c0 con 0x5603da71c5b0 2024-04-24T01:43:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.701+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94574549830368] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.702+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.702+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94574549839024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72b180 con 0x5603da71c5b0 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.702+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72bc20 con 0x7f170c031040 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.702+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94574549834032] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.703+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.703+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94574549839024] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.703+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94574549841744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72bc20 con 0x7f170c031040 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.703+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da728010 con 0x7f170c031040 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.704+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94574549841744] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.704+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94574549827600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72c180 con 0x7f170c031040 2024-04-24T01:43:03.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72cb40 con 0x7f170c031040 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94574549845648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72cf60 con 0x7f170c031040 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 20 add_watcher() i=0 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 20 add_watcher() i=1 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 20 add_watcher() i=2 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 20 add_watcher() i=3 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 20 add_watcher() i=4 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.705+0000 7f171ee98800 20 add_watcher() i=5 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.706+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94574549827600] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.706+0000 7f171ee98800 20 add_watcher() i=6 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.706+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94574549845648] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.706+0000 7f171ee98800 20 add_watcher() i=7 2024-04-24T01:43:03.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.706+0000 7f171ee98800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.706+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da72cf60 con 0x5603da71c5b0 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.707+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.707+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94574549846704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da72ced0 con 0x5603da71c5b0 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94574549846704] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f15d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171ee98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171ee98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171ee98800 5 note: GC not initialized 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f15d1fe3640 20 reqs_thread_entry: start 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171ee98800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171ee98800 20 Filter name: none 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f15437fe640 20 reqs_thread_entry: start 2024-04-24T01:43:03.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.708+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da762da0 con 0x5603da71c5b0 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.709+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.709+0000 7f171ee98800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.709+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da7642f0 con 0x7f1704098020 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.709+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.709+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.709+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da7642f0 con 0x7f170c031040 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(64 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 4.f 4:f304a00f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da765db0 con 0x5603da71c5b0 2024-04-24T01:43:03.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 4.d 4:b205e15f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da768a60 con 0x5603da7226c0 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 4.2a 4:57091848:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da76b4c0 con 0x5603da71c5b0 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 4.25 4:a7334b03:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da76dfa0 con 0x5603da7226c0 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 4.1e 4:797afb18:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da770810 con 0x7f170c031040 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 4.1e 4:785e71a1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da773530 con 0x7f170c031040 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 4.11 4:8b3156cf:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da776050 con 0x7f170c031040 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:72 4.25 4:a4be0969:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da7788c0 con 0x5603da7226c0 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 4.2e 4:7455b879:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da7788c0 con 0x5603da7226c0 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:74 4.8 4:1174bd7f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da77d890 con 0x5603da7226c0 2024-04-24T01:43:03.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:75 4.3e 4:7d91042a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da77d890 con 0x7f1704098020 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.710+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(67 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(70 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(75 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(73 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(74 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(72 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.711+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x7f1704098020 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.712+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.712+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x7f1704098020 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.713+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.713+0000 7f171ee98800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.713+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x5603da71c5b0 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.713+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.713+0000 7f171ee98800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.713+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x7f1704098020 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.713+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.714+0000 7f15d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.714+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94574549846704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x5603da71c5b0 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.715+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94574549846704] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.715+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94574549822736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x7f1704098020 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.716+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94574549822736] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.716+0000 7f171ee98800 20 remove_watcher() i=0 2024-04-24T01:43:03.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.716+0000 7f171ee98800 2 removed watcher, disabling cache 2024-04-24T01:43:03.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.716+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94574549826544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x5603da71c5b0 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.717+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94574549826544] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.717+0000 7f171ee98800 20 remove_watcher() i=1 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.717+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94574549830368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x5603da7226c0 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.718+0000 7f171c19d640 1 -- 172.21.15.131:0/773225862 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94574549830368] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1704071030 con 0x5603da7226c0 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.718+0000 7f171ee98800 20 remove_watcher() i=2 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.718+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94574549834032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x7f1704098020 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.719+0000 7f171d19f640 1 -- 172.21.15.131:0/773225862 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94574549834032] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c040040 con 0x7f1704098020 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.719+0000 7f171ee98800 20 remove_watcher() i=3 2024-04-24T01:43:03.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.719+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94574549839024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x5603da71c5b0 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.720+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94574549839024] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x5603da71c5b0 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.720+0000 7f171ee98800 20 remove_watcher() i=4 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.720+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94574549841744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da772f40 con 0x7f170c031040 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.721+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94574549841744] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.721+0000 7f171ee98800 20 remove_watcher() i=5 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.721+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94574549827600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da74ba10 con 0x7f170c031040 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.722+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94574549827600] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.722+0000 7f171ee98800 20 remove_watcher() i=6 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.722+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94574549845648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603da74ba10 con 0x7f170c031040 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94574549845648] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171402d070 con 0x7f170c031040 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 20 remove_watcher() i=7 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f170c031040 msgr2=0x7f170c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f170c031040 0x7f170c032940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da71c5b0 msgr2=0x5603da71ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da71c5b0 0x5603da71ea50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1704098020 msgr2=0x7f1704072990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1704098020 0x7f1704072990 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5603da7226c0 msgr2=0x5603da724ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5603da7226c0 0x5603da724ad0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15e8036950 msgr2=0x7f15e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15e8036950 0x7f15e8038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5603da6e8660 tx=0x7f170c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 msgr2=0x5603da710ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171c99e640 1 -- 172.21.15.131:0/773225862 reap_dead start 2024-04-24T01:43:03.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.723+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da710ad0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x5603da705ef0 tx=0x7f170408db80 comp rx=0 tx=0).stop 2024-04-24T01:43:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 shutdown_connections 2024-04-24T01:43:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/773225862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da709490 0x5603da710ad0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 >> 172.21.15.131:0/773225862 conn(0x5603da7057f0 msgr2=0x5603da702e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 shutdown_connections 2024-04-24T01:43:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/773225862 wait complete. 2024-04-24T01:43:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15f4036950 msgr2=0x7f15f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15f4036950 0x7f15f4038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5603da6ec2e0 tx=0x7f170c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da6fc250 msgr2=0x5603da6fc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da6fc250 0x5603da6fc670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1704044840 tx=0x7f1704002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 shutdown_connections 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15f4036950 0x7f15f4038e10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/2865146403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da6fc250 0x5603da6fc670 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 >> 172.21.15.131:0/2865146403 conn(0x5603da6f02f0 msgr2=0x5603da6f06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 shutdown_connections 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/2865146403 wait complete. 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da5e9300 msgr2=0x5603da6eb140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da5e9300 0x5603da6eb140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f16040368b0 msgr2=0x7f1604038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f16040368b0 0x7f1604038d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1704054000 tx=0x7f170404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 msgr2=0x5603da6e3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6e3f00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f171400b210 tx=0x7f1714000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 shutdown_connections 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5603da5e9300 0x5603da6eb140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f16040368b0 0x7f1604038d70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 --2- 172.21.15.131:0/3419333885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5603da5e77c0 0x5603da6e3f00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 >> 172.21.15.131:0/3419333885 conn(0x5603da5e3340 msgr2=0x5603da6d6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 shutdown_connections 2024-04-24T01:43:03.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.724+0000 7f171ee98800 1 -- 172.21.15.131:0/3419333885 wait complete. 2024-04-24T01:43:03.745 INFO:teuthology.orchestra.run.smithi131.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-04-24T01:43:03.714274Z","last_stats_update":"2024-04-24T01:43:03.713256Z"} 2024-04-24T01:43:03.745 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-24T01:43:03.714274Z', 'last_stats_update': '2024-04-24T01:43:03.713256Z'} 2024-04-24T01:43:03.751 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:03.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-24T01:43:03.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-24T01:43:03.752 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-24T01:43:03.796 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:03.797 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8aa332b800 1 Processor -- start 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8aa332b800 1 -- start start 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8aa332b800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56292014e7a0 0x5629201e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8aa332b800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562920098d40 con 0x56292014fae0 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8aa332b800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x56292006b4d0 con 0x56292014e7a0 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8a9e751640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56292014e7a0 0x5629201e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8a9ef52640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x56292014fae0 0x56292014e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56620/0 (socket says 172.21.15.131:56620) 2024-04-24T01:43:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8a9e751640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56292014e7a0 0x5629201e2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42282/0 (socket says 172.21.15.131:42282) 2024-04-24T01:43:03.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8a9ef52640 1 -- 172.21.15.131:0/2752454423 learned_addr learned my addr 172.21.15.131:0/2752454423 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:03.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8a9e751640 1 -- 172.21.15.131:0/2752454423 >> v1:172.21.15.107:6789/0 conn(0x56292014fae0 legacy=0x56292014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.796+0000 7f8a9e751640 1 -- 172.21.15.131:0/2752454423 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562920097590 con 0x56292014e7a0 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.798+0000 7f8a9e751640 1 --2- 172.21.15.131:0/2752454423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629201e2e50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800a470 tx=0x7f8a8801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e586b2964909bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.798+0000 7f8a9df50640 1 -- 172.21.15.131:0/2752454423 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88057070 con 0x56292014e7a0 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.798+0000 7f8a9df50640 1 -- 172.21.15.131:0/2752454423 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88052570 con 0x56292014e7a0 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.798+0000 7f8a9df50640 1 -- 172.21.15.131:0/2752454423 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88052870 con 0x56292014e7a0 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.799+0000 7f8aa332b800 1 -- 172.21.15.131:0/2752454423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 msgr2=0x5629201e2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.799+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2752454423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629201e2e50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800a470 tx=0x7f8a8801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.799+0000 7f8aa332b800 1 -- 172.21.15.131:0/2752454423 shutdown_connections 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.799+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2752454423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629201e2e50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.799+0000 7f8aa332b800 1 -- 172.21.15.131:0/2752454423 >> 172.21.15.131:0/2752454423 conn(0x5629201d5550 msgr2=0x5629201d7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.799+0000 7f8aa332b800 1 -- 172.21.15.131:0/2752454423 shutdown_connections 2024-04-24T01:43:03.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.799+0000 7f8aa332b800 1 -- 172.21.15.131:0/2752454423 wait complete. 2024-04-24T01:43:03.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8aa332b800 1 Processor -- start 2024-04-24T01:43:03.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8aa332b800 1 -- start start 2024-04-24T01:43:03.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8aa332b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8aa332b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5629201253b0 con 0x56292014e7a0 2024-04-24T01:43:03.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8a9ef52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8a9ef52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42294/0 (socket says 172.21.15.131:42294) 2024-04-24T01:43:03.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8a9ef52640 1 -- 172.21.15.131:0/1779881739 learned_addr learned my addr 172.21.15.131:0/1779881739 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8a9ef52640 1 -- 172.21.15.131:0/1779881739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629202cdc30 con 0x56292014e7a0 2024-04-24T01:43:03.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.811+0000 7f8a9ef52640 1 --2- 172.21.15.131:0/1779881739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202cd660 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a98001640 tx=0x7f8a98001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf77ee89180728 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f898ce09640 1 -- 172.21.15.131:0/1779881739 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a98004520 con 0x56292014e7a0 2024-04-24T01:43:03.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f898ce09640 1 -- 172.21.15.131:0/1779881739 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a980046c0 con 0x56292014e7a0 2024-04-24T01:43:03.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f898ce09640 1 -- 172.21.15.131:0/1779881739 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a98004a40 con 0x56292014e7a0 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f8aa332b800 1 -- 172.21.15.131:0/1779881739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 msgr2=0x5629202cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f8aa332b800 1 --2- 172.21.15.131:0/1779881739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202cd660 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a98001640 tx=0x7f8a98001b00 comp rx=0 tx=0).stop 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f8aa332b800 1 -- 172.21.15.131:0/1779881739 shutdown_connections 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f8aa332b800 1 --2- 172.21.15.131:0/1779881739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202cd660 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f8aa332b800 1 -- 172.21.15.131:0/1779881739 >> 172.21.15.131:0/1779881739 conn(0x5629201d5550 msgr2=0x5629202c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f8aa332b800 1 -- 172.21.15.131:0/1779881739 shutdown_connections 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.812+0000 7f8aa332b800 1 -- 172.21.15.131:0/1779881739 wait complete. 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8aa332b800 1 Processor -- start 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8aa332b800 1 -- start start 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8aa332b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8aa332b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5629201e56a0 con 0x56292014e7a0 2024-04-24T01:43:03.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8a9ef52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8a9ef52640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202d5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42296/0 (socket says 172.21.15.131:42296) 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8a9ef52640 1 -- 172.21.15.131:0/2861562989 learned_addr learned my addr 172.21.15.131:0/2861562989 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8a9ef52640 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629202d5780 con 0x56292014e7a0 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.813+0000 7f8a9ef52640 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202d5240 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8a98001b40 tx=0x7f8a98001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.814+0000 7f898b606640 1 -- 172.21.15.131:0/2861562989 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a98022020 con 0x56292014e7a0 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.814+0000 7f898b606640 1 -- 172.21.15.131:0/2861562989 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a980148b0 con 0x56292014e7a0 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.814+0000 7f898b606640 1 -- 172.21.15.131:0/2861562989 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a98014bf0 con 0x56292014e7a0 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.814+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629202d5a10 con 0x56292014e7a0 2024-04-24T01:43:03.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.814+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629202d8620 con 0x56292014e7a0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.814+0000 7f898b606640 1 -- 172.21.15.131:0/2861562989 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a98025020 con 0x56292014e7a0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f898b606640 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8984036950 0x7f8984038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f898b606640 1 -- 172.21.15.131:0/2861562989 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8a98018030 con 0x56292014e7a0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8a9e751640 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8984036950 0x7f8984038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292014fae0 0x5629202dc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629202dc960 con 0x56292014fae0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8a9f753640 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292014fae0 0x5629202dc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8a9e751640 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8984036950 0x7f8984038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a88054000 tx=0x7f8a8804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8a9f753640 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292014fae0 0x5629202dc3e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8a9f753640 1 -- 172.21.15.131:0/2861562989 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a900083e0 con 0x56292014fae0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.815+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629202d9990 con 0x56292014fae0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.816+0000 7f8a9f753640 1 -- 172.21.15.131:0/2861562989 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a900083e0 con 0x56292014fae0 2024-04-24T01:43:03.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.816+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629202de780 con 0x56292014fae0 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.816+0000 7f8a9f753640 1 -- 172.21.15.131:0/2861562989 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a900083e0 con 0x56292014fae0 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.816+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629202ddac0 con 0x56292014fae0 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.816+0000 7f8a9f753640 1 -- 172.21.15.131:0/2861562989 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a900083e0 con 0x56292014fae0 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.816+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629202ddeb0 con 0x56292014fae0 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8a9f753640 1 -- 172.21.15.131:0/2861562989 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a900083e0 con 0x56292014fae0 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8aa332b800 1 Processor -- start 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8aa332b800 1 -- start start 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8aa332b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202ed590 0x5629202ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8aa332b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5629200cb6b0 con 0x5629202ed590 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8a9e751640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202ed590 0x5629202ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8a9e751640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202ed590 0x5629202ed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42306/0 (socket says 172.21.15.131:42306) 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.817+0000 7f8a9e751640 1 -- 172.21.15.131:0/2185947997 learned_addr learned my addr 172.21.15.131:0/2185947997 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.818+0000 7f8a9e751640 1 -- 172.21.15.131:0/2185947997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629202edef0 con 0x5629202ed590 2024-04-24T01:43:03.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.818+0000 7f8a9e751640 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202ed590 0x5629202ed9b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a8801ced0 tx=0x7f8a88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.818+0000 7f8988e01640 1 -- 172.21.15.131:0/2185947997 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a8806f070 con 0x5629202ed590 2024-04-24T01:43:03.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.818+0000 7f8988e01640 1 -- 172.21.15.131:0/2185947997 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a88058040 con 0x5629202ed590 2024-04-24T01:43:03.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.818+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629202ee960 con 0x5629202ed590 2024-04-24T01:43:03.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.818+0000 7f8988e01640 1 -- 172.21.15.131:0/2185947997 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88057050 con 0x5629202ed590 2024-04-24T01:43:03.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.818+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629202eee00 con 0x5629202ed590 2024-04-24T01:43:03.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8988e01640 1 -- 172.21.15.131:0/2185947997 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a88072070 con 0x5629202ed590 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8988e01640 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8978036970 0x7f8978038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8988e01640 1 -- 172.21.15.131:0/2185947997 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8a8808f830 con 0x5629202ed590 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8a9f753640 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8978036970 0x7f8978038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8aa332b800 1 Processor -- start 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8a9f753640 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8978036970 0x7f8978038e30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5629202dd5e0 tx=0x7f8a90000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8aa332b800 1 -- start start 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8aa332b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x5629202fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.819+0000 7f8aa332b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5629202cdfb0 con 0x5629202fa7d0 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f8a9e751640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x5629202fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f8a9e751640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x5629202fabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42314/0 (socket says 172.21.15.131:42314) 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f8a9e751640 1 -- 172.21.15.131:0/626531251 learned_addr learned my addr 172.21.15.131:0/626531251 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f8a9e751640 1 -- 172.21.15.131:0/626531251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629202fb1c0 con 0x5629202fa7d0 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f8a9e751640 1 --2- 172.21.15.131:0/626531251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x5629202fabf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a8808dec0 tx=0x7f8a88069620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96338ed0ccfea107 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f89827fc640 1 -- 172.21.15.131:0/626531251 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a8805f9d0 con 0x5629202fa7d0 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f89827fc640 1 -- 172.21.15.131:0/626531251 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8805e520 con 0x5629202fa7d0 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.820+0000 7f89827fc640 1 -- 172.21.15.131:0/626531251 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a8805fc20 con 0x5629202fa7d0 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 -- 172.21.15.131:0/626531251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 msgr2=0x5629202fabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 --2- 172.21.15.131:0/626531251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x5629202fabf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a8808dec0 tx=0x7f8a88069620 comp rx=0 tx=0).stop 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 -- 172.21.15.131:0/626531251 shutdown_connections 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 --2- 172.21.15.131:0/626531251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x5629202fabf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 -- 172.21.15.131:0/626531251 >> 172.21.15.131:0/626531251 conn(0x5629202f6b30 msgr2=0x5629202f4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 -- 172.21.15.131:0/626531251 shutdown_connections 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 -- 172.21.15.131:0/626531251 wait complete. 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 Processor -- start 2024-04-24T01:43:03.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 -- start start 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x562920301e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8aa332b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5629202fb930 con 0x5629202fa7d0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8a9e751640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x562920301e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8a9e751640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x562920301e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42328/0 (socket says 172.21.15.131:42328) 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 learned_addr learned my addr 172.21.15.131:0/4293003695 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.821+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562920302340 con 0x5629202fa7d0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.822+0000 7f8a9e751640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x562920301e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a8808cae0 tx=0x7f8a8808db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.822+0000 7f8980ff9640 1 -- 172.21.15.131:0/4293003695 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88093020 con 0x5629202fa7d0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.822+0000 7f8980ff9640 1 -- 172.21.15.131:0/4293003695 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8805d3e0 con 0x5629202fa7d0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.822+0000 7f8980ff9640 1 -- 172.21.15.131:0/4293003695 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a8805c700 con 0x5629202fa7d0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.822+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629203025d0 con 0x5629202fa7d0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.822+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562920305280 con 0x5629202fa7d0 2024-04-24T01:43:03.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.822+0000 7f8980ff9640 1 -- 172.21.15.131:0/4293003695 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a88096020 con 0x5629202fa7d0 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8980ff9640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8968036860 0x7f8968038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8980ff9640 1 -- 172.21.15.131:0/4293003695 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8a88099c40 con 0x5629202fa7d0 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8a9f753640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8968036860 0x7f8968038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8a9f753640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8968036860 0x7f8968038d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000f010 tx=0x7f8a9000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292030d8c0 0x56292030fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629203104d0 con 0x56292030d8c0 2024-04-24T01:43:03.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.823+0000 7f8a9ef52640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292030d8c0 0x56292030fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8a9ef52640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292030d8c0 0x56292030fd80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 20 realm 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629203108e0 con 0x56292030d8c0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629203111b0 con 0x56292030d8c0 2024-04-24T01:43:03.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.824+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920311550 con 0x56292030d8c0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920311da0 con 0x56292030d8c0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8aa332b800 20 searching for the correct realm 2024-04-24T01:43:03.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562920313b10 0x562920315f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8a9e751640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562920313b10 0x562920315f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8a9e751640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562920313b10 0x562920315f00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.825+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9e751640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f8a88098020 0x7f8a88082410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a88098020 2024-04-24T01:43:03.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9f753640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f8a88098020 0x7f8a88082410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9f753640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f8a88098020 0x7f8a88082410 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9f753640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8a90019040 0x7f8a90019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.826+0000 7f8a9ef52640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8a90019040 0x7f8a90019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8a90019040 0x7f8a90019930 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.827+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a88098020 2024-04-24T01:43:03.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.828+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a88098020 2024-04-24T01:43:03.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.829+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.830+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.831+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.831+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.831+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.831+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.831+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a88098020 2024-04-24T01:43:03.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.832+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.833+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.833+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.833+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a88098020 2024-04-24T01:43:03.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.833+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.833+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x562920313b10 2024-04-24T01:43:03.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.833+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.833+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a90019040 2024-04-24T01:43:03.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x56292030d8c0 2024-04-24T01:43:03.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5629203164e0 con 0x7f8a88098020 2024-04-24T01:43:03.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:03.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:03.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:03.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:03.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:03.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:03.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920312720 con 0x56292030d8c0 2024-04-24T01:43:03.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.834+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920312fc0 con 0x56292030d8c0 2024-04-24T01:43:03.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:03.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920312fc0 con 0x56292030d8c0 2024-04-24T01:43:03.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:03.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 zone default found 2024-04-24T01:43:03.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 4 Realm: () 2024-04-24T01:43:03.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:03.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:03.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:03.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 zonegroup default 2024-04-24T01:43:03.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920316960 con 0x7f8a90019040 2024-04-24T01:43:03.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.835+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920318370 con 0x562920313b10 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8aa332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920318860 con 0x562920313b10 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8aa332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8aa332b800 20 started sync module instance, tier type = 2024-04-24T01:43:03.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8aa332b800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.836+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629203177e0 con 0x7f8a88098020 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.837+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.837+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94734633762016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629203177e0 con 0x7f8a88098020 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.837+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562920319340 con 0x56292030d8c0 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.838+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94734633762016] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.838+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.838+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94734633766448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5629203177e0 con 0x56292030d8c0 2024-04-24T01:43:03.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.838+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562920319df0 con 0x562920313b10 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.839+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.839+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94734633769216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031a6c0 con 0x562920313b10 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.839+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031b180 con 0x7f8a88098020 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.840+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94734633766448] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.840+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94734633769216] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.841+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.841+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94734633771536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562920317330 con 0x7f8a88098020 2024-04-24T01:43:03.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.841+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031ba50 con 0x56292030d8c0 2024-04-24T01:43:03.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.841+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94734633771536] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.842+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.842+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94734633774160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031ba50 con 0x56292030d8c0 2024-04-24T01:43:03.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.842+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031c4a0 con 0x7f8a90019040 2024-04-24T01:43:03.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.843+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.843+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94734633779120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031c3d0 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.843+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031d3f0 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.843+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94734633774160] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.844+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94734633779120] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.844+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.844+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94734633783008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031d3b0 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.844+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031dc90 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.845+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94734633783008] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94734633776544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031d3b0 con 0x7f8a90019040 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 20 add_watcher() i=0 2024-04-24T01:43:03.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 20 add_watcher() i=1 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 20 add_watcher() i=2 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 20 add_watcher() i=3 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 20 add_watcher() i=4 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 20 add_watcher() i=5 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.846+0000 7f8aa332b800 20 add_watcher() i=6 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.847+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94734633776544] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.847+0000 7f8aa332b800 20 add_watcher() i=7 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.847+0000 7f8aa332b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.847+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920320c70 con 0x56292030d8c0 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.847+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.847+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94734633785232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031e130 con 0x56292030d8c0 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94734633785232] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f89557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f8aa332b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f8aa332b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f8aa332b800 5 note: GC not initialized 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f88cffff640 20 reqs_thread_entry: start 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f8aa332b800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.848+0000 7f8aa332b800 20 Filter name: none 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f88cdffb640 20 reqs_thread_entry: start 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920353f80 con 0x56292030d8c0 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:03.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562920356060 con 0x7f8a88098020 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.849+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5629203578e0 con 0x7f8a90019040 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(64 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.850+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292035b000 con 0x7f8a88098020 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.851+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.851+0000 7f8aa332b800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.851+0000 7f8aa332b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.851+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56292035a1a0 con 0x7f8a88098020 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.852+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.852+0000 7f8aa332b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.852+0000 7f8aa332b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.852+0000 7f8aa332b800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.852+0000 7f8aa332b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.852+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292035eda0 con 0x7f8a88098020 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f8aa332b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f8aa332b800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f8aa332b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94734634051632 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56292035bb80 con 0x7f8a90019040 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== watch-notify(notify (1) cookie 94734633783008 notify 137438953474 ret 0) ==== 380+0+0 (crc 0 0 0) 0x562920357cd0 con 0x7f8a90019040 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f89827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94734633783008 notifier 4478 bl.length()=338 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f89827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f89827fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:03.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(68 notify.6 [notify cookie 94734634051632 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.853+0000 7f89827fc640 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8964003ea0 con 0x7f8a90019040 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.854+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.854+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== watch-notify(notify_complete (2) cookie 94734634051632 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562920356e50 con 0x7f8a90019040 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.854+0000 7f89557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.854+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94734633785232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292035e830 con 0x56292030d8c0 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.855+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94734633785232] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.855+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94734633762016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292035e830 con 0x7f8a88098020 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.856+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94734633762016] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.856+0000 7f8aa332b800 20 remove_watcher() i=0 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.856+0000 7f8aa332b800 2 removed watcher, disabling cache 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.856+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94734633766448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292035e830 con 0x56292030d8c0 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.858+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94734633766448] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.858+0000 7f8aa332b800 20 remove_watcher() i=1 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.858+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94734633769216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292035e830 con 0x562920313b10 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.859+0000 7f8a9e751640 1 -- 172.21.15.131:0/4293003695 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94734633769216] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a88071030 con 0x562920313b10 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.859+0000 7f8aa332b800 20 remove_watcher() i=2 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.859+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94734633771536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562920318e30 con 0x7f8a88098020 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.860+0000 7f8a9f753640 1 -- 172.21.15.131:0/4293003695 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94734633771536] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9002f040 con 0x7f8a88098020 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.860+0000 7f8aa332b800 20 remove_watcher() i=3 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.860+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94734633774160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031a210 con 0x56292030d8c0 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.861+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94734633774160] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x56292030d8c0 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.861+0000 7f8aa332b800 20 remove_watcher() i=4 2024-04-24T01:43:03.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.861+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94734633779120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031a210 con 0x7f8a90019040 2024-04-24T01:43:03.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.862+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94734633779120] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.862+0000 7f8aa332b800 20 remove_watcher() i=5 2024-04-24T01:43:03.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.862+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94734633783008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031a210 con 0x7f8a90019040 2024-04-24T01:43:03.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.863+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94734633783008] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.863+0000 7f8aa332b800 20 remove_watcher() i=6 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.863+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94734633776544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56292031cee0 con 0x7f8a90019040 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.863+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94734633776544] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a9801b070 con 0x7f8a90019040 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 20 remove_watcher() i=7 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8a90019040 msgr2=0x7f8a90019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8a90019040 0x7f8a90019930 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292030d8c0 msgr2=0x56292030fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292030d8c0 0x56292030fd80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f8a88098020 msgr2=0x7f8a88082410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f8a88098020 0x7f8a88082410 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562920313b10 msgr2=0x562920315f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562920313b10 0x562920315f00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8968036860 msgr2=0x7f8968038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8968036860 0x7f8968038d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000f010 tx=0x7f8a9000c040 comp rx=0 tx=0).stop 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 msgr2=0x562920301e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/4293003695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202fa7d0 0x562920301e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a8808cae0 tx=0x7f8a8808db50 comp rx=0 tx=0).stop 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 reap_dead start 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8a9ef52640 1 -- 172.21.15.131:0/4293003695 reap_dead start 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 shutdown_connections 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 >> 172.21.15.131:0/4293003695 conn(0x5629202f6b30 msgr2=0x5629202f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 shutdown_connections 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/4293003695 wait complete. 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8978036970 msgr2=0x7f8978038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8978036970 0x7f8978038e30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5629202dd5e0 tx=0x7f8a90000f90 comp rx=0 tx=0).stop 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202ed590 msgr2=0x5629202ed9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202ed590 0x5629202ed9b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a8801ced0 tx=0x7f8a88002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 shutdown_connections 2024-04-24T01:43:03.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8978036970 0x7f8978038e30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2185947997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629202ed590 0x5629202ed9b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 >> 172.21.15.131:0/2185947997 conn(0x5629202e1630 msgr2=0x5629202e1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 shutdown_connections 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.864+0000 7f8aa332b800 1 -- 172.21.15.131:0/2185947997 wait complete. 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292014fae0 msgr2=0x5629202dc3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292014fae0 0x5629202dc3e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8984036950 msgr2=0x7f8984038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8984036950 0x7f8984038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a88054000 tx=0x7f8a8804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 msgr2=0x5629202d5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202d5240 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8a98001b40 tx=0x7f8a98001250 comp rx=0 tx=0).stop 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 shutdown_connections 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56292014fae0 0x5629202dc3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8984036950 0x7f8984038e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 --2- 172.21.15.131:0/2861562989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56292014e7a0 0x5629202d5240 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 >> 172.21.15.131:0/2861562989 conn(0x5629201d5550 msgr2=0x5629202c7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 shutdown_connections 2024-04-24T01:43:03.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.865+0000 7f8aa332b800 1 -- 172.21.15.131:0/2861562989 wait complete. 2024-04-24T01:43:03.907 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:43:03.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:43:03.907 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-24T01:43:03.958 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:03.959 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:03.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f4527810800 1 Processor -- start 2024-04-24T01:43:03.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f4527810800 1 -- start start 2024-04-24T01:43:03.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f4527810800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556d78aaa4f0 0x556d78aac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f4527810800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556d78964d40 con 0x556d78aa69e0 2024-04-24T01:43:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f4527810800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x556d789374d0 con 0x556d78aaa4f0 2024-04-24T01:43:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f45227b8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556d78aaa4f0 0x556d78aac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f45227b8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556d78aaa4f0 0x556d78aac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42338/0 (socket says 172.21.15.131:42338) 2024-04-24T01:43:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f45227b8640 1 -- 172.21.15.131:0/1032104368 learned_addr learned my addr 172.21.15.131:0/1032104368 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.958+0000 7f4522fb9640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x556d78aa69e0 0x556d78aa8dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56634/0 (socket says 172.21.15.131:56634) 2024-04-24T01:43:03.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.959+0000 7f45227b8640 1 -- 172.21.15.131:0/1032104368 >> v1:172.21.15.107:6789/0 conn(0x556d78aa69e0 legacy=0x556d78aa8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.959+0000 7f45227b8640 1 -- 172.21.15.131:0/1032104368 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d78963590 con 0x556d78aaa4f0 2024-04-24T01:43:03.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.959+0000 7f4521fb7640 1 -- 172.21.15.131:0/1032104368 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398894148 0 0) 0x556d78964d40 con 0x556d78aa69e0 2024-04-24T01:43:03.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f45227b8640 1 --2- 172.21.15.131:0/1032104368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aaa4f0 0x556d78aac8e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f451800a520 tx=0x7f451801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7286abf104ebc462 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4521fb7640 1 -- 172.21.15.131:0/1032104368 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4518057070 con 0x556d78aaa4f0 2024-04-24T01:43:03.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4521fb7640 1 -- 172.21.15.131:0/1032104368 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4518052570 con 0x556d78aaa4f0 2024-04-24T01:43:03.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4521fb7640 1 -- 172.21.15.131:0/1032104368 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f451804ae60 con 0x556d78aaa4f0 2024-04-24T01:43:03.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4527810800 1 -- 172.21.15.131:0/1032104368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aaa4f0 msgr2=0x556d78aac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4527810800 1 --2- 172.21.15.131:0/1032104368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aaa4f0 0x556d78aac8e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f451800a520 tx=0x7f451801d010 comp rx=0 tx=0).stop 2024-04-24T01:43:03.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4527810800 1 -- 172.21.15.131:0/1032104368 shutdown_connections 2024-04-24T01:43:03.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4527810800 1 --2- 172.21.15.131:0/1032104368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aaa4f0 0x556d78aac8e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4527810800 1 -- 172.21.15.131:0/1032104368 >> 172.21.15.131:0/1032104368 conn(0x556d78aa0370 msgr2=0x556d78aa2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4527810800 1 -- 172.21.15.131:0/1032104368 shutdown_connections 2024-04-24T01:43:03.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.961+0000 7f4527810800 1 -- 172.21.15.131:0/1032104368 wait complete. 2024-04-24T01:43:03.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.973+0000 7f4527810800 1 Processor -- start 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.973+0000 7f4527810800 1 -- start start 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.973+0000 7f4527810800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b96fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.973+0000 7f4527810800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d789f13e0 con 0x556d78aa69e0 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.973+0000 7f4522fb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b96fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.973+0000 7f4522fb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b96fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42344/0 (socket says 172.21.15.131:42344) 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.973+0000 7f4522fb9640 1 -- 172.21.15.131:0/2694501810 learned_addr learned my addr 172.21.15.131:0/2694501810 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.974+0000 7f4522fb9640 1 -- 172.21.15.131:0/2694501810 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d78b97570 con 0x556d78aa69e0 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.974+0000 7f4522fb9640 1 --2- 172.21.15.131:0/2694501810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b96fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f451400b210 tx=0x7f451400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b592b5538f34ec13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.974+0000 7f4410e09640 1 -- 172.21.15.131:0/2694501810 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4514008070 con 0x556d78aa69e0 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.974+0000 7f4410e09640 1 -- 172.21.15.131:0/2694501810 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451400d500 con 0x556d78aa69e0 2024-04-24T01:43:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.974+0000 7f4410e09640 1 -- 172.21.15.131:0/2694501810 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f451400d840 con 0x556d78aa69e0 2024-04-24T01:43:03.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 -- 172.21.15.131:0/2694501810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 msgr2=0x556d78b96fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:03.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 --2- 172.21.15.131:0/2694501810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b96fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f451400b210 tx=0x7f451400b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 -- 172.21.15.131:0/2694501810 shutdown_connections 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 --2- 172.21.15.131:0/2694501810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b96fa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 -- 172.21.15.131:0/2694501810 >> 172.21.15.131:0/2694501810 conn(0x556d78aa0370 msgr2=0x556d78b928c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 -- 172.21.15.131:0/2694501810 shutdown_connections 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 -- 172.21.15.131:0/2694501810 wait complete. 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 Processor -- start 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 -- start start 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b9eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4527810800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d78aaf130 con 0x556d78aa69e0 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4522fb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b9eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4522fb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b9eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42358/0 (socket says 172.21.15.131:42358) 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.975+0000 7f4522fb9640 1 -- 172.21.15.131:0/2074620333 learned_addr learned my addr 172.21.15.131:0/2074620333 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.976+0000 7f4522fb9640 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d78b9f0b0 con 0x556d78aa69e0 2024-04-24T01:43:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.976+0000 7f4522fb9640 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b9eb70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f451400b210 tx=0x7f4514000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.976+0000 7f440f606640 1 -- 172.21.15.131:0/2074620333 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f451400f950 con 0x556d78aa69e0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.976+0000 7f440f606640 1 -- 172.21.15.131:0/2074620333 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451400faf0 con 0x556d78aa69e0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.976+0000 7f440f606640 1 -- 172.21.15.131:0/2074620333 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f451400fdd0 con 0x556d78aa69e0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.976+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d78b9f340 con 0x556d78aa69e0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.976+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d78ba1ff0 con 0x556d78aa69e0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f440f606640 1 -- 172.21.15.131:0/2074620333 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4514017040 con 0x556d78aa69e0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f440f606640 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44080368b0 0x7f4408038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f440f606640 1 -- 172.21.15.131:0/2074620333 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4514015020 con 0x556d78aa69e0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f45227b8640 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44080368b0 0x7f4408038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f4527810800 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78aaa4f0 0x556d78ba5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78ba6340 con 0x556d78aaa4f0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f45237ba640 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78aaa4f0 0x556d78ba5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.977+0000 7f45227b8640 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44080368b0 0x7f4408038d70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4518054000 tx=0x7f451804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.978+0000 7f45237ba640 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78aaa4f0 0x556d78ba5db0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.978+0000 7f45237ba640 1 -- 172.21.15.131:0/2074620333 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451c00a4a0 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.978+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78ba3380 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.978+0000 7f45237ba640 1 -- 172.21.15.131:0/2074620333 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f451c00a4a0 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.978+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78ba8160 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.978+0000 7f45237ba640 1 -- 172.21.15.131:0/2074620333 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f451c00a4a0 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.978+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78ba74a0 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.979+0000 7f45237ba640 1 -- 172.21.15.131:0/2074620333 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f451c00a4a0 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.979+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78ba78f0 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.979+0000 7f45237ba640 1 -- 172.21.15.131:0/2074620333 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f451c00a4a0 con 0x556d78aaa4f0 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.979+0000 7f4527810800 1 Processor -- start 2024-04-24T01:43:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.979+0000 7f4527810800 1 -- start start 2024-04-24T01:43:03.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.979+0000 7f4527810800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa65a0 0x556d78aa4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:03.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.979+0000 7f4527810800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d789976b0 con 0x556d78aa65a0 2024-04-24T01:43:03.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f45227b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa65a0 0x556d78aa4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:03.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f45227b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa65a0 0x556d78aa4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42364/0 (socket says 172.21.15.131:42364) 2024-04-24T01:43:03.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f45227b8640 1 -- 172.21.15.131:0/3420466653 learned_addr learned my addr 172.21.15.131:0/3420466653 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:03.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f45227b8640 1 -- 172.21.15.131:0/3420466653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d78aa4f50 con 0x556d78aa65a0 2024-04-24T01:43:04.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f45227b8640 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa65a0 0x556d78aa4a10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4518055040 tx=0x7f4518002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f440ce01640 1 -- 172.21.15.131:0/3420466653 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4518057040 con 0x556d78aa65a0 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f440ce01640 1 -- 172.21.15.131:0/3420466653 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451806d070 con 0x556d78aa65a0 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d78aa5180 con 0x556d78aa65a0 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f440ce01640 1 -- 172.21.15.131:0/3420466653 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f451805d650 con 0x556d78aa65a0 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.980+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d78aa5620 con 0x556d78aa65a0 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.981+0000 7f440ce01640 1 -- 172.21.15.131:0/3420466653 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4518067070 con 0x556d78aa65a0 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.981+0000 7f440ce01640 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43fc036950 0x7f43fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.981+0000 7f440ce01640 1 -- 172.21.15.131:0/3420466653 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f451808f720 con 0x556d78aa65a0 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.981+0000 7f45237ba640 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43fc036950 0x7f43fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.981+0000 7f4527810800 1 Processor -- start 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.981+0000 7f45237ba640 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43fc036950 0x7f43fc038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x556d78ba6fc0 tx=0x7f451c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.981+0000 7f4527810800 1 -- start start 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f4527810800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bc67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f4527810800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d78b978f0 con 0x556d78bc63b0 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f45227b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bc67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f45227b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bc67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42370/0 (socket says 172.21.15.131:42370) 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f45227b8640 1 -- 172.21.15.131:0/4002479996 learned_addr learned my addr 172.21.15.131:0/4002479996 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f45227b8640 1 -- 172.21.15.131:0/4002479996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d78bc6da0 con 0x556d78bc63b0 2024-04-24T01:43:04.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f45227b8640 1 --2- 172.21.15.131:0/4002479996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bc67d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f451808da70 tx=0x7f4518067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf46b60a79da28 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f44067fc640 1 -- 172.21.15.131:0/4002479996 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4518081070 con 0x556d78bc63b0 2024-04-24T01:43:04.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f44067fc640 1 -- 172.21.15.131:0/4002479996 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451805cc70 con 0x556d78bc63b0 2024-04-24T01:43:04.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.982+0000 7f44067fc640 1 -- 172.21.15.131:0/4002479996 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4518072910 con 0x556d78bc63b0 2024-04-24T01:43:04.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 -- 172.21.15.131:0/4002479996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 msgr2=0x556d78bc67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 --2- 172.21.15.131:0/4002479996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bc67d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f451808da70 tx=0x7f4518067ab0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 -- 172.21.15.131:0/4002479996 shutdown_connections 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 --2- 172.21.15.131:0/4002479996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bc67d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 -- 172.21.15.131:0/4002479996 >> 172.21.15.131:0/4002479996 conn(0x556d78bc2710 msgr2=0x556d78bc0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 -- 172.21.15.131:0/4002479996 shutdown_connections 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 -- 172.21.15.131:0/4002479996 wait complete. 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 Processor -- start 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 -- start start 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bcdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f4527810800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d78bc7510 con 0x556d78bc63b0 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f45227b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bcdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f45227b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bcdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42378/0 (socket says 172.21.15.131:42378) 2024-04-24T01:43:04.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.983+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 learned_addr learned my addr 172.21.15.131:0/4057651971 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.984+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d78bcdfe0 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.984+0000 7f45227b8640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bcdaa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f451808c990 tx=0x7f451808da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.984+0000 7f4404ff9640 1 -- 172.21.15.131:0/4057651971 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4518081040 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.984+0000 7f4404ff9640 1 -- 172.21.15.131:0/4057651971 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4518094070 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.984+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d78bce270 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.984+0000 7f4404ff9640 1 -- 172.21.15.131:0/4057651971 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f451808b040 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.984+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d78bd0f20 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f4404ff9640 1 -- 172.21.15.131:0/4057651971 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4518084070 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f4404ff9640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43ec036900 0x7f43ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f4404ff9640 1 -- 172.21.15.131:0/4057651971 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f45180610d0 con 0x556d78bc63b0 2024-04-24T01:43:04.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f45237ba640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43ec036900 0x7f43ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f45237ba640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43ec036900 0x7f43ec038dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556d78b9f990 tx=0x7f451c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78bd9590 0x556d78bdba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bdc1a0 con 0x556d78bd9590 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.985+0000 7f4522fb9640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78bd9590 0x556d78bdba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4522fb9640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78bd9590 0x556d78bdba50 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 20 realm 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bdc5b0 con 0x556d78bd9590 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bdce80 con 0x556d78bd9590 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.986+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bdd220 con 0x556d78bd9590 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4527810800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bdda70 con 0x556d78bd9590 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4527810800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4527810800 20 searching for the correct realm 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556d78bdf7e0 0x556d78be1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f45227b8640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556d78bdf7e0 0x556d78be1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.987+0000 7f45227b8640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556d78bdf7e0 0x556d78be1bd0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45227b8640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4518069c10 0x7f451808c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f4518069c10 2024-04-24T01:43:04.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45237ba640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4518069c10 0x7f451808c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45237ba640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4518069c10 0x7f451808c130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451c01f070 con 0x7f4518069c10 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45237ba640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f451c031040 0x7f451c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.988+0000 7f4522fb9640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f451c031040 0x7f451c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.989+0000 7f4522fb9640 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f451c031040 0x7f451c032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.989+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.989+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.989+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.989+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.989+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.989+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f4518069c10 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451c01f070 con 0x7f4518069c10 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.990+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f4518069c10 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f451c01f070 con 0x7f4518069c10 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.991+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.992+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.993+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.993+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.993+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.993+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.993+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.993+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f4518069c10 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451c01f070 con 0x7f4518069c10 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.994+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.995+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.995+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.995+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.995+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.995+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.995+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f4518069c10 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.996+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451c01f070 con 0x7f4518069c10 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.996+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bdf7e0 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.996+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.996+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f451c031040 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.996+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.996+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x556d78bd9590 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2190 con 0x7f4518069c10 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451c01f070 con 0x7f4518069c10 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:04.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bde3f0 con 0x556d78bd9590 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bdec90 con 0x556d78bd9590 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.997+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78be2610 con 0x556d78bd9590 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 zone default found 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 4 Realm: () 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 zonegroup default 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bde8f0 con 0x7f451c031040 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78be4520 con 0x556d78bdf7e0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.998+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78be4910 con 0x556d78bdf7e0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.999+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.999+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.999+0000 7f4527810800 20 started sync module instance, tier type = 2024-04-24T01:43:04.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.999+0000 7f4527810800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:03.999+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be39c0 con 0x7f4518069c10 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.000+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451c040040 con 0x7f4518069c10 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.000+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93928665529776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be3620 con 0x7f4518069c10 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.000+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be5750 con 0x556d78bd9590 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.001+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93928665529776] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451c040040 con 0x7f4518069c10 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.001+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.001+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93928665533808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be5710 con 0x556d78bd9590 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.001+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be61c0 con 0x556d78bdf7e0 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.002+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.002+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93928665537712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be6a60 con 0x556d78bdf7e0 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.002+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be7520 con 0x7f4518069c10 2024-04-24T01:43:04.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.002+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93928665533808] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.003+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93928665537712] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.003+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451c040040 con 0x7f4518069c10 2024-04-24T01:43:04.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.003+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93928665540016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be5190 con 0x7f4518069c10 2024-04-24T01:43:04.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.003+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be7f30 con 0x556d78bd9590 2024-04-24T01:43:04.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.004+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.004+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93928665545344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be8350 con 0x556d78bd9590 2024-04-24T01:43:04.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.004+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93928665540016] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451c040040 con 0x7f4518069c10 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.004+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be7010 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.005+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93928665545344] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.005+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.005+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93928665546400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be82c0 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.005+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be9390 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.007+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93928665546400] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.007+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.007+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93928665548992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be9390 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.007+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be9c20 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93928665548992] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93928665550560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be97b0 con 0x7f451c031040 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 20 add_watcher() i=0 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 20 add_watcher() i=1 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 20 add_watcher() i=2 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 20 add_watcher() i=3 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 20 add_watcher() i=4 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 20 add_watcher() i=5 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.008+0000 7f4527810800 20 add_watcher() i=6 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.009+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93928665550560] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.009+0000 7f4527810800 20 add_watcher() i=7 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.009+0000 7f4527810800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.009+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78bed0a0 con 0x556d78bd9590 2024-04-24T01:43:04.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.009+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.009+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93928665552080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78bea550 con 0x556d78bd9590 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.010+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93928665552080] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.010+0000 7f43d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.010+0000 7f4527810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.010+0000 7f4527810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 5 note: GC not initialized 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4353fff640 20 reqs_thread_entry: start 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 20 Filter name: none 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4351ffb640 20 reqs_thread_entry: start 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78c20430 con 0x7f451c031040 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.011+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78c1ebd0 con 0x7f451c031040 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.012+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.012+0000 7f4527810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.012+0000 7f4527810800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.012+0000 7f4527810800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.012+0000 7f4527810800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:43:04.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.012+0000 7f4527810800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.012+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78c1f4a0 con 0x7f451c031040 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4527810800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4527810800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4527810800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93928665772016 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78c23ed0 con 0x7f451c031040 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== watch-notify(notify (1) cookie 93928665546400 notify 137438953475 ret 0) ==== 598+0+0 (crc 0 0 0) 0x556d78c1f840 con 0x7f451c031040 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f44067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 93928665546400 notifier 4485 bl.length()=556 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(65 notify.5 [notify cookie 93928665772016 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f44067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f44067fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:43:04.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f44067fc640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f43e8003ea0 con 0x7f451c031040 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== watch-notify(notify_complete (2) cookie 93928665772016 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556d78c1fe80 con 0x7f451c031040 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.013+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78c21a00 con 0x7f451c031040 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.014+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.014+0000 7f4527810800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.014+0000 7f4527810800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.014+0000 7f4527810800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.014+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93928665771856 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d78c23ed0 con 0x556d78bdf7e0 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== watch-notify(notify (1) cookie 93928665537712 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x556d78bce270 con 0x556d78bdf7e0 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f4405ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93928665537712 notifier 4485 bl.length()=177 2024-04-24T01:43:04.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f4405ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:43:04.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f4405ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:04.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f4405ffb640 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4358003400 con 0x556d78bdf7e0 2024-04-24T01:43:04.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 notify.2 [notify cookie 93928665771856 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.015+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== watch-notify(notify_complete (2) cookie 93928665771856 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556d78bcdfe0 con 0x556d78bdf7e0 2024-04-24T01:43:04.035 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:43:04.014050Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:43:04.014035Z","tags":[],"group_ids":[]} 2024-04-24T01:43:04.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.016+0000 7f43d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.016+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93928665552080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78bd57b0 con 0x556d78bd9590 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.017+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93928665552080] v32'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.017+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93928665529776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be94a0 con 0x7f4518069c10 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.018+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93928665529776] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451c040040 con 0x7f4518069c10 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.018+0000 7f4527810800 20 remove_watcher() i=0 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.018+0000 7f4527810800 2 removed watcher, disabling cache 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.018+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93928665533808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be3db0 con 0x556d78bd9590 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.019+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93928665533808] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.019+0000 7f4527810800 20 remove_watcher() i=1 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.019+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93928665537712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be3db0 con 0x556d78bdf7e0 2024-04-24T01:43:04.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.020+0000 7f45227b8640 1 -- 172.21.15.131:0/4057651971 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93928665537712] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4518066030 con 0x556d78bdf7e0 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.020+0000 7f4527810800 20 remove_watcher() i=2 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.020+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93928665540016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be5cb0 con 0x7f4518069c10 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.021+0000 7f45237ba640 1 -- 172.21.15.131:0/4057651971 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93928665540016] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451c040040 con 0x7f4518069c10 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.021+0000 7f4527810800 20 remove_watcher() i=3 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.021+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93928665545344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be5cb0 con 0x556d78bd9590 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.022+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93928665545344] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x556d78bd9590 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.022+0000 7f4527810800 20 remove_watcher() i=4 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.022+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93928665546400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be7a80 con 0x7f451c031040 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.023+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93928665546400] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.023+0000 7f4527810800 20 remove_watcher() i=5 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.023+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93928665548992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be5cb0 con 0x7f451c031040 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.024+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93928665548992] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.024+0000 7f4527810800 20 remove_watcher() i=6 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.024+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93928665550560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d78be88c0 con 0x7f451c031040 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93928665550560] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451402d070 con 0x7f451c031040 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 20 remove_watcher() i=7 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f451c031040 msgr2=0x7f451c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f451c031040 0x7f451c032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78bd9590 msgr2=0x556d78bdba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78bd9590 0x556d78bdba50 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4518069c10 msgr2=0x7f451808c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4518069c10 0x7f451808c130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556d78bdf7e0 msgr2=0x556d78be1bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556d78bdf7e0 0x556d78be1bd0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43ec036900 msgr2=0x7f43ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43ec036900 0x7f43ec038dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556d78b9f990 tx=0x7f451c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 msgr2=0x556d78bcdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4522fb9640 1 -- 172.21.15.131:0/4057651971 reap_dead start 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bcdaa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f451808c990 tx=0x7f451808da00 comp rx=0 tx=0).stop 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 shutdown_connections 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/4057651971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78bc63b0 0x556d78bcdaa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 >> 172.21.15.131:0/4057651971 conn(0x556d78bc2710 msgr2=0x556d78bbfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 shutdown_connections 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/4057651971 wait complete. 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43fc036950 msgr2=0x7f43fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43fc036950 0x7f43fc038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x556d78ba6fc0 tx=0x7f451c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa65a0 msgr2=0x556d78aa4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.025+0000 7f4527810800 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa65a0 0x556d78aa4a10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4518055040 tx=0x7f4518002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 shutdown_connections 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f43fc036950 0x7f43fc038e10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/3420466653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa65a0 0x556d78aa4a10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 >> 172.21.15.131:0/3420466653 conn(0x556d78baafd0 msgr2=0x556d78bab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 shutdown_connections 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/3420466653 wait complete. 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78aaa4f0 msgr2=0x556d78ba5db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78aaa4f0 0x556d78ba5db0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44080368b0 msgr2=0x7f4408038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44080368b0 0x7f4408038d70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4518054000 tx=0x7f451804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 msgr2=0x556d78b9eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b9eb70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f451400b210 tx=0x7f4514000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 shutdown_connections 2024-04-24T01:43:04.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556d78aaa4f0 0x556d78ba5db0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44080368b0 0x7f4408038d70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 --2- 172.21.15.131:0/2074620333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d78aa69e0 0x556d78b9eb70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 >> 172.21.15.131:0/2074620333 conn(0x556d78aa0370 msgr2=0x556d78b910c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 shutdown_connections 2024-04-24T01:43:04.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.026+0000 7f4527810800 1 -- 172.21.15.131:0/2074620333 wait complete. 2024-04-24T01:43:04.047 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:43:04.014050Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:43:04.014035Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:04.053 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:43:04.059 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:04.059 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-24T01:43:04.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-24T01:43:04.060 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-24T01:43:04.101 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:04.101 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:04.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.100+0000 7f0ccb638800 1 Processor -- start 2024-04-24T01:43:04.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.100+0000 7f0ccb638800 1 -- start start 2024-04-24T01:43:04.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0ccb638800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55da567f3d20 0x55da567f4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0ccb638800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da566b3d40 con 0x55da567f4f80 2024-04-24T01:43:04.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0ccb638800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55da566864d0 con 0x55da567f3d20 2024-04-24T01:43:04.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0cc9137640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55da567f3d20 0x55da567f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0cc0936640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55da567f4f80 0x55da567f5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56646/0 (socket says 172.21.15.131:56646) 2024-04-24T01:43:04.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0cc0936640 1 -- 172.21.15.131:0/1180853711 learned_addr learned my addr 172.21.15.131:0/1180853711 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:04.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0cc9137640 1 -- 172.21.15.131:0/1180853711 >> v1:172.21.15.107:6789/0 conn(0x55da567f4f80 legacy=0x55da567f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.101+0000 7f0cc9137640 1 -- 172.21.15.131:0/1180853711 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da566b2590 con 0x55da567f3d20 2024-04-24T01:43:04.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.103+0000 7f0cc9137640 1 --2- 172.21.15.131:0/1180853711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da567f4140 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00a470 tx=0x7f0cbc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdca807f7c715bb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.103+0000 7f0cc8936640 1 -- 172.21.15.131:0/1180853711 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc057070 con 0x55da567f3d20 2024-04-24T01:43:04.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.103+0000 7f0cc8936640 1 -- 172.21.15.131:0/1180853711 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc052570 con 0x55da567f3d20 2024-04-24T01:43:04.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.103+0000 7f0cc8936640 1 -- 172.21.15.131:0/1180853711 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc052870 con 0x55da567f3d20 2024-04-24T01:43:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.104+0000 7f0ccb638800 1 -- 172.21.15.131:0/1180853711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 msgr2=0x55da567f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.104+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1180853711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da567f4140 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00a470 tx=0x7f0cbc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.104+0000 7f0ccb638800 1 -- 172.21.15.131:0/1180853711 shutdown_connections 2024-04-24T01:43:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.104+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1180853711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da567f4140 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.104+0000 7f0ccb638800 1 -- 172.21.15.131:0/1180853711 >> 172.21.15.131:0/1180853711 conn(0x55da567ef380 msgr2=0x55da567f17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.104+0000 7f0ccb638800 1 -- 172.21.15.131:0/1180853711 shutdown_connections 2024-04-24T01:43:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.104+0000 7f0ccb638800 1 -- 172.21.15.131:0/1180853711 wait complete. 2024-04-24T01:43:04.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0ccb638800 1 Processor -- start 2024-04-24T01:43:04.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0ccb638800 1 -- start start 2024-04-24T01:43:04.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0ccb638800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da568e5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0ccb638800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55da567403c0 con 0x55da567f3d20 2024-04-24T01:43:04.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0cc9137640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da568e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0cc9137640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da568e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42388/0 (socket says 172.21.15.131:42388) 2024-04-24T01:43:04.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0cc9137640 1 -- 172.21.15.131:0/2645106550 learned_addr learned my addr 172.21.15.131:0/2645106550 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.116+0000 7f0cc9137640 1 -- 172.21.15.131:0/2645106550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da568e5a40 con 0x55da567f3d20 2024-04-24T01:43:04.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0cc9137640 1 --2- 172.21.15.131:0/2645106550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da568e5470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc055040 tx=0x7f0cbc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658b95a247ecd73b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0bb7606640 1 -- 172.21.15.131:0/2645106550 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc057070 con 0x55da567f3d20 2024-04-24T01:43:04.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0bb7606640 1 -- 172.21.15.131:0/2645106550 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc063070 con 0x55da567f3d20 2024-04-24T01:43:04.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0bb7606640 1 -- 172.21.15.131:0/2645106550 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc052720 con 0x55da567f3d20 2024-04-24T01:43:04.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0ccb638800 1 -- 172.21.15.131:0/2645106550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 msgr2=0x55da568e5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2645106550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da568e5470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc055040 tx=0x7f0cbc04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0ccb638800 1 -- 172.21.15.131:0/2645106550 shutdown_connections 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2645106550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da568e5470 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0ccb638800 1 -- 172.21.15.131:0/2645106550 >> 172.21.15.131:0/2645106550 conn(0x55da567ef380 msgr2=0x55da568e0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0ccb638800 1 -- 172.21.15.131:0/2645106550 shutdown_connections 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.117+0000 7f0ccb638800 1 -- 172.21.15.131:0/2645106550 wait complete. 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0ccb638800 1 Processor -- start 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0ccb638800 1 -- start start 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0ccb638800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da56767ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0ccb638800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55da567fd3f0 con 0x55da567f3d20 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0cc9137640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da56767ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0cc9137640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da56767ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42396/0 (socket says 172.21.15.131:42396) 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0cc9137640 1 -- 172.21.15.131:0/2378832992 learned_addr learned my addr 172.21.15.131:0/2378832992 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.118+0000 7f0cc9137640 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da568ee9a0 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.119+0000 7f0cc9137640 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da56767ff0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc055040 tx=0x7f0cbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.119+0000 7f0bb5e03640 1 -- 172.21.15.131:0/2378832992 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc052cd0 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.119+0000 7f0bb5e03640 1 -- 172.21.15.131:0/2378832992 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc06c070 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.119+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da568f2fb0 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.119+0000 7f0bb5e03640 1 -- 172.21.15.131:0/2378832992 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc05e480 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.119+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da568f34d0 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.119+0000 7f0bb5e03640 1 -- 172.21.15.131:0/2378832992 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0cbc05e620 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0bb5e03640 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0bb0036900 0x7f0bb0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0bb5e03640 1 -- 172.21.15.131:0/2378832992 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0cbc08e820 con 0x55da567f3d20 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0cc0936640 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0bb0036900 0x7f0bb0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da567f4f80 0x55da568f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da568f7910 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0cc9938640 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da567f4f80 0x55da568f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0cc0936640 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0bb0036900 0x7f0bb0038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4000f60 tx=0x7f0cb40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.120+0000 7f0cc9938640 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da567f4f80 0x55da568f7340 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0cc9938640 1 -- 172.21.15.131:0/2378832992 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da568f4910 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0cc9938640 1 -- 172.21.15.131:0/2378832992 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da568f9730 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0cc9938640 1 -- 172.21.15.131:0/2378832992 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da568f8a70 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0cc9938640 1 -- 172.21.15.131:0/2378832992 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55da567f4f80 2024-04-24T01:43:04.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.121+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da568f8ec0 con 0x55da567f4f80 2024-04-24T01:43:04.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0cc9938640 1 -- 172.21.15.131:0/2378832992 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55da567f4f80 2024-04-24T01:43:04.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0ccb638800 1 Processor -- start 2024-04-24T01:43:04.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0ccb638800 1 -- start start 2024-04-24T01:43:04.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0ccb638800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56908500 0x55da56908920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0ccb638800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55da566e66b0 con 0x55da56908500 2024-04-24T01:43:04.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0cc0936640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56908500 0x55da56908920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0cc0936640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56908500 0x55da56908920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42402/0 (socket says 172.21.15.131:42402) 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.122+0000 7f0cc0936640 1 -- 172.21.15.131:0/1467577833 learned_addr learned my addr 172.21.15.131:0/1467577833 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.123+0000 7f0cc0936640 1 -- 172.21.15.131:0/1467577833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da56908e60 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.123+0000 7f0cc0936640 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56908500 0x55da56908920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4001ed0 tx=0x7f0cb400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.123+0000 7f0baeffd640 1 -- 172.21.15.131:0/1467577833 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb401b550 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.123+0000 7f0baeffd640 1 -- 172.21.15.131:0/1467577833 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb401b6f0 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.123+0000 7f0baeffd640 1 -- 172.21.15.131:0/1467577833 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb401b9d0 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.123+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da569098d0 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.123+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da56909dd0 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0baeffd640 1 -- 172.21.15.131:0/1467577833 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0cb4023020 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0baeffd640 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ba0036950 0x7f0ba0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0baeffd640 1 -- 172.21.15.131:0/1467577833 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0cb4021020 con 0x55da56908500 2024-04-24T01:43:04.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0cc9938640 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ba0036950 0x7f0ba0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0ccb638800 1 Processor -- start 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0cc9938640 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ba0036950 0x7f0ba0038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55da568f8590 tx=0x7f0cc4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0ccb638800 1 -- start start 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0ccb638800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da56915c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.124+0000 7f0ccb638800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55da568e5d00 con 0x55da56915840 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0cc0936640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da56915c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0cc0936640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da56915c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42416/0 (socket says 172.21.15.131:42416) 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0cc0936640 1 -- 172.21.15.131:0/1801831184 learned_addr learned my addr 172.21.15.131:0/1801831184 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0cc0936640 1 -- 172.21.15.131:0/1801831184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da56916230 con 0x55da56915840 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0cc0936640 1 --2- 172.21.15.131:0/1801831184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da56915c60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0cb404ce10 tx=0x7f0cb4019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de530b4842cad0ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0bacff9640 1 -- 172.21.15.131:0/1801831184 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4041070 con 0x55da56915840 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0bacff9640 1 -- 172.21.15.131:0/1801831184 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb40258e0 con 0x55da56915840 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.125+0000 7f0bacff9640 1 -- 172.21.15.131:0/1801831184 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4025410 con 0x55da56915840 2024-04-24T01:43:04.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 -- 172.21.15.131:0/1801831184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 msgr2=0x55da56915c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1801831184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da56915c60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0cb404ce10 tx=0x7f0cb4019ce0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 -- 172.21.15.131:0/1801831184 shutdown_connections 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1801831184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da56915c60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 -- 172.21.15.131:0/1801831184 >> 172.21.15.131:0/1801831184 conn(0x55da56911ba0 msgr2=0x55da5690fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 -- 172.21.15.131:0/1801831184 shutdown_connections 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 -- 172.21.15.131:0/1801831184 wait complete. 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 Processor -- start 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 -- start start 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da5691ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0ccb638800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55da569169a0 con 0x55da56915840 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.126+0000 7f0cc0936640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da5691ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0cc0936640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da5691ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42426/0 (socket says 172.21.15.131:42426) 2024-04-24T01:43:04.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 learned_addr learned my addr 172.21.15.131:0/3755742084 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da5691d3f0 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0cc0936640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da5691ceb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4048010 tx=0x7f0cb404cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0b9effd640 1 -- 172.21.15.131:0/3755742084 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4041070 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0b9effd640 1 -- 172.21.15.131:0/3755742084 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb400cc60 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da5691d680 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0b9effd640 1 -- 172.21.15.131:0/3755742084 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb400ce50 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.127+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da5691d680 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0b9effd640 1 -- 172.21.15.131:0/3755742084 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0cb404eb60 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0b9effd640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b94036af0 0x7f0b94038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0b9effd640 1 -- 172.21.15.131:0/3755742084 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0cb404f060 con 0x55da56915840 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0cc9938640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b94036af0 0x7f0b94038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da56928700 0x55da5692abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692b310 con 0x55da56928700 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.128+0000 7f0cc9137640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da56928700 0x55da5692abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0cc9938640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b94036af0 0x7f0b94038fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55da56767b50 tx=0x7f0cc401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0cc9137640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da56928700 0x55da5692abc0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 20 realm 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692b720 con 0x55da56928700 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692bff0 con 0x55da56928700 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c390 con 0x55da56928700 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.129+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0ccb638800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0ccb638800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0ccb638800 20 searching for the correct realm 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55da5692e840 0x55da56930c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da569312e0 con 0x55da5692e840 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0cc0936640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55da5692e840 0x55da56930c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0cc0936640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55da5692e840 0x55da56930c30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0cc0936640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0cb4044860 0x7f0cb4051870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.130+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da569312e0 con 0x7f0cb4044860 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.131+0000 7f0cc9938640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0cb4044860 0x7f0cb4051870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.131+0000 7f0cc9938640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0cb4044860 0x7f0cb4051870 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.131+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc401f070 con 0x7f0cb4044860 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.131+0000 7f0cc9938640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0cc4031040 0x7f0cc4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.131+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da569312e0 con 0x7f0cc4031040 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.131+0000 7f0cc9137640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0cc4031040 0x7f0cc4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0cc4031040 0x7f0cc4032940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.132+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cb4044860 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc401f070 con 0x7f0cb4044860 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.133+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.134+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.134+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.134+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.134+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cb4044860 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.134+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0cc401f070 con 0x7f0cb4044860 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.134+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.135+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.136+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cb4044860 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc401f070 con 0x7f0cb4044860 2024-04-24T01:43:04.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.137+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cb4044860 2024-04-24T01:43:04.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc401f070 con 0x7f0cb4044860 2024-04-24T01:43:04.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da5692e840 2024-04-24T01:43:04.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.138+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x7f0cc4031040 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0cbc0ab040 con 0x7f0cb4044860 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc401f070 con 0x7f0cb4044860 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692c7f0 con 0x55da56928700 2024-04-24T01:43:04.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.139+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692d160 con 0x55da56928700 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692d160 con 0x55da56928700 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 20 zone default found 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 4 Realm: () 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:04.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 20 zonegroup default 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692d5d0 con 0x7f0cc4031040 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.140+0000 7f0ccb638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5692d9f0 con 0x55da5692e840 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da56933120 con 0x55da5692e840 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 20 started sync module instance, tier type = 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.141+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da569325c0 con 0x7f0cb4044860 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.142+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc4040040 con 0x7f0cb4044860 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.142+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396243714320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da569334c0 con 0x7f0cb4044860 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.142+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56933d10 con 0x55da56928700 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.143+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396243714320] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc4040040 con 0x7f0cb4044860 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.143+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.143+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396243719360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56933d90 con 0x55da56928700 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.143+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56934750 con 0x55da5692e840 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.144+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396243719360] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.144+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.144+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396243720416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56933d00 con 0x55da5692e840 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.144+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da569355c0 con 0x7f0cb4044860 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.145+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc4040040 con 0x7f0cb4044860 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.145+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396243727088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56935d40 con 0x7f0cb4044860 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.145+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396243720416] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.145+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56936840 con 0x55da56928700 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.146+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.146+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396243725120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56936800 con 0x55da56928700 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.146+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56937260 con 0x7f0cc4031040 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.147+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396243727088] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc4040040 con 0x7f0cb4044860 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.147+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396243725120] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.147+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.147+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396243731248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56937260 con 0x7f0cc4031040 2024-04-24T01:43:04.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.147+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56937b00 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.148+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396243731248] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.149+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.149+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396243733824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56937710 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.149+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56937710 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396243733824] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396243735616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da569380d0 con 0x7f0cc4031040 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 20 add_watcher() i=0 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 20 add_watcher() i=1 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 20 add_watcher() i=2 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 20 add_watcher() i=3 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 20 add_watcher() i=4 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 20 add_watcher() i=5 2024-04-24T01:43:04.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.150+0000 7f0ccb638800 20 add_watcher() i=6 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.151+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396243735616] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.151+0000 7f0ccb638800 20 add_watcher() i=7 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.151+0000 7f0ccb638800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.151+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5693b440 con 0x55da56928700 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.152+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.152+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396243750448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56938240 con 0x55da56928700 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396243750448] v32'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0b7ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0ccb638800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0ccb638800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0ccb638800 5 note: GC not initialized 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0b7efe5640 20 reqs_thread_entry: start 2024-04-24T01:43:04.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0ccb638800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0ccb638800 20 Filter name: none 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.153+0000 7f0b7cfe1640 20 reqs_thread_entry: start 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.154+0000 7f0ccb638800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.154+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da5696e270 con 0x7f0cb4044860 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.154+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f0cc4040040 con 0x7f0cb4044860 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.154+0000 7f0ccb638800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.155+0000 7f0b7ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.155+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396243750448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da5696c1f0 con 0x55da56928700 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.156+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94396243750448] v32'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.156+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396243714320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da5696c1f0 con 0x7f0cb4044860 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.156+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94396243714320] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc4040040 con 0x7f0cb4044860 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.157+0000 7f0ccb638800 20 remove_watcher() i=0 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.157+0000 7f0ccb638800 2 removed watcher, disabling cache 2024-04-24T01:43:04.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.157+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396243719360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da5696c1f0 con 0x55da56928700 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.158+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94396243719360] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.158+0000 7f0ccb638800 20 remove_watcher() i=1 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.158+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396243720416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da569334c0 con 0x55da5692e840 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.158+0000 7f0cc0936640 1 -- 172.21.15.131:0/3755742084 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94396243720416] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4009050 con 0x55da5692e840 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.158+0000 7f0ccb638800 20 remove_watcher() i=2 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.158+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396243727088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da5696c1f0 con 0x7f0cb4044860 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.159+0000 7f0cc9938640 1 -- 172.21.15.131:0/3755742084 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94396243727088] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc4040040 con 0x7f0cb4044860 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.159+0000 7f0ccb638800 20 remove_watcher() i=3 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.159+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396243725120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da569352f0 con 0x55da56928700 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.161+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94396243725120] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x55da56928700 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.161+0000 7f0ccb638800 20 remove_watcher() i=4 2024-04-24T01:43:04.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.161+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396243731248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da5696c1f0 con 0x7f0cc4031040 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.162+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94396243731248] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.162+0000 7f0ccb638800 20 remove_watcher() i=5 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.162+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396243733824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56936330 con 0x7f0cc4031040 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.162+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94396243733824] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.162+0000 7f0ccb638800 20 remove_watcher() i=6 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.162+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396243735616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da56936330 con 0x7f0cc4031040 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94396243735616] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc07aef0 con 0x7f0cc4031040 2024-04-24T01:43:04.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 20 remove_watcher() i=7 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0cc4031040 msgr2=0x7f0cc4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0cc4031040 0x7f0cc4032940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da56928700 msgr2=0x55da5692abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da56928700 0x55da5692abc0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0cb4044860 msgr2=0x7f0cb4051870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0cb4044860 0x7f0cb4051870 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55da5692e840 msgr2=0x55da56930c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.163+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55da5692e840 0x55da56930c30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b94036af0 msgr2=0x7f0b94038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b94036af0 0x7f0b94038fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55da56767b50 tx=0x7f0cc401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 msgr2=0x55da5691ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0cc9137640 1 -- 172.21.15.131:0/3755742084 reap_dead start 2024-04-24T01:43:04.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da5691ceb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4048010 tx=0x7f0cb404cda0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 shutdown_connections 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/3755742084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56915840 0x55da5691ceb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 >> 172.21.15.131:0/3755742084 conn(0x55da56911ba0 msgr2=0x55da5690f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 shutdown_connections 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/3755742084 wait complete. 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ba0036950 msgr2=0x7f0ba0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ba0036950 0x7f0ba0038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55da568f8590 tx=0x7f0cc4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56908500 msgr2=0x55da56908920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56908500 0x55da56908920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4001ed0 tx=0x7f0cb400d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 shutdown_connections 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ba0036950 0x7f0ba0038e10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/1467577833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da56908500 0x55da56908920 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 >> 172.21.15.131:0/1467577833 conn(0x55da568fc5a0 msgr2=0x55da568fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 shutdown_connections 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/1467577833 wait complete. 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da567f4f80 msgr2=0x55da568f7340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da567f4f80 0x55da568f7340 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.164+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0bb0036900 msgr2=0x7f0bb0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0bb0036900 0x7f0bb0038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4000f60 tx=0x7f0cb40012b0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 msgr2=0x55da56767ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da56767ff0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc055040 tx=0x7f0cbc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 shutdown_connections 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55da567f4f80 0x55da568f7340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0bb0036900 0x7f0bb0038dc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 --2- 172.21.15.131:0/2378832992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da567f3d20 0x55da56767ff0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 >> 172.21.15.131:0/2378832992 conn(0x55da567ef380 msgr2=0x55da568df610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 shutdown_connections 2024-04-24T01:43:04.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.165+0000 7f0ccb638800 1 -- 172.21.15.131:0/2378832992 wait complete. 2024-04-24T01:43:04.179 INFO:teuthology.orchestra.run.smithi131.stdout:{"key":"bucket:myfoo","ver":{"tag":"_5A05IARziznQvNJQFQXJqNp","ver":2},"mtime":"2024-04-24T01:43:03.854029Z","data":{"bucket":{"name":"myfoo","marker":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","bucket_id":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-04-24T01:43:02.579344Z","linked":false,"has_bucket_info":false}} 2024-04-24T01:43:04.180 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_5A05IARziznQvNJQFQXJqNp', 'ver': 2}, 'mtime': '2024-04-24T01:43:03.854029Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'bucket_id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-24T01:43:02.579344Z', 'linked': False, 'has_bucket_info': False}} 2024-04-24T01:43:04.180 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1'] 2024-04-24T01:43:04.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1'] 2024-04-24T01:43:04.180 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:04.267 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:04.268 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff80a411800 1 Processor -- start 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff80a411800 1 -- start start 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff80a411800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560e617702e0 0x560e61778de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff80a411800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e6162ed40 con 0x560e6176e7a0 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff80a411800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x560e616014d0 con 0x560e617702e0 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff805346640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560e617702e0 0x560e61778de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff805346640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560e617702e0 0x560e61778de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42442/0 (socket says 172.21.15.131:42442) 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff805346640 1 -- 172.21.15.131:0/1208339807 learned_addr learned my addr 172.21.15.131:0/1208339807 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff805346640 1 -- 172.21.15.131:0/1208339807 >> v1:172.21.15.107:6789/0 conn(0x560e6176e7a0 legacy=0x560e6176ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.267+0000 7ff805346640 1 -- 172.21.15.131:0/1208339807 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6162d590 con 0x560e617702e0 2024-04-24T01:43:04.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.269+0000 7ff805346640 1 --2- 172.21.15.131:0/1208339807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e617702e0 0x560e61778de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00a520 tx=0x7ff7fc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1aed2f0529a8db server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.269+0000 7ff804b45640 1 -- 172.21.15.131:0/1208339807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc057070 con 0x560e617702e0 2024-04-24T01:43:04.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.269+0000 7ff804b45640 1 -- 172.21.15.131:0/1208339807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc052570 con 0x560e617702e0 2024-04-24T01:43:04.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.269+0000 7ff804b45640 1 -- 172.21.15.131:0/1208339807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc052870 con 0x560e617702e0 2024-04-24T01:43:04.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.270+0000 7ff80a411800 1 -- 172.21.15.131:0/1208339807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e617702e0 msgr2=0x560e61778de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.270+0000 7ff80a411800 1 --2- 172.21.15.131:0/1208339807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e617702e0 0x560e61778de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00a520 tx=0x7ff7fc01d010 comp rx=0 tx=0).stop 2024-04-24T01:43:04.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.270+0000 7ff80a411800 1 -- 172.21.15.131:0/1208339807 shutdown_connections 2024-04-24T01:43:04.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.270+0000 7ff80a411800 1 --2- 172.21.15.131:0/1208339807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e617702e0 0x560e61778de0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.270+0000 7ff80a411800 1 -- 172.21.15.131:0/1208339807 >> 172.21.15.131:0/1208339807 conn(0x560e6176a340 msgr2=0x560e6176c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.270+0000 7ff80a411800 1 -- 172.21.15.131:0/1208339807 shutdown_connections 2024-04-24T01:43:04.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.270+0000 7ff80a411800 1 -- 172.21.15.131:0/1208339807 wait complete. 2024-04-24T01:43:04.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.281+0000 7ff80a411800 1 Processor -- start 2024-04-24T01:43:04.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff80a411800 1 -- start start 2024-04-24T01:43:04.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff80a411800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e618636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff80a411800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560e616bb3e0 con 0x560e6176e7a0 2024-04-24T01:43:04.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff805b47640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e618636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff805b47640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e618636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42446/0 (socket says 172.21.15.131:42446) 2024-04-24T01:43:04.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff805b47640 1 -- 172.21.15.131:0/4032245706 learned_addr learned my addr 172.21.15.131:0/4032245706 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff805b47640 1 -- 172.21.15.131:0/4032245706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e61863c80 con 0x560e6176e7a0 2024-04-24T01:43:04.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.282+0000 7ff805b47640 1 --2- 172.21.15.131:0/4032245706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e618636b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8001cd0 tx=0x7ff7f800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6794e075203bd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff6f3e07640 1 -- 172.21.15.131:0/4032245706 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f800be10 con 0x560e6176e7a0 2024-04-24T01:43:04.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff6f3e07640 1 -- 172.21.15.131:0/4032245706 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f800f400 con 0x560e6176e7a0 2024-04-24T01:43:04.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff6f3e07640 1 -- 172.21.15.131:0/4032245706 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f800f720 con 0x560e6176e7a0 2024-04-24T01:43:04.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff80a411800 1 -- 172.21.15.131:0/4032245706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 msgr2=0x560e618636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff80a411800 1 --2- 172.21.15.131:0/4032245706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e618636b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8001cd0 tx=0x7ff7f800b5b0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff80a411800 1 -- 172.21.15.131:0/4032245706 shutdown_connections 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff80a411800 1 --2- 172.21.15.131:0/4032245706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e618636b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff80a411800 1 -- 172.21.15.131:0/4032245706 >> 172.21.15.131:0/4032245706 conn(0x560e6176a340 msgr2=0x560e6185efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff80a411800 1 -- 172.21.15.131:0/4032245706 shutdown_connections 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.283+0000 7ff80a411800 1 -- 172.21.15.131:0/4032245706 wait complete. 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff80a411800 1 Processor -- start 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff80a411800 1 -- start start 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff80a411800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e6186b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff80a411800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560e6177b600 con 0x560e6176e7a0 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff805b47640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e6186b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff805b47640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e6186b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42450/0 (socket says 172.21.15.131:42450) 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff805b47640 1 -- 172.21.15.131:0/3307147767 learned_addr learned my addr 172.21.15.131:0/3307147767 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff805b47640 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6186b740 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.284+0000 7ff805b47640 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e6186b200 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8000fb0 tx=0x7ff7f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.285+0000 7ff6f2604640 1 -- 172.21.15.131:0/3307147767 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f801a690 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.285+0000 7ff6f2604640 1 -- 172.21.15.131:0/3307147767 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f801a830 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.285+0000 7ff6f2604640 1 -- 172.21.15.131:0/3307147767 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f801ab50 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.285+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e6186b9d0 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.285+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6186e680 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.285+0000 7ff6f2604640 1 -- 172.21.15.131:0/3307147767 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff7f8017070 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.285+0000 7ff6f2604640 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6ec036900 0x7ff6ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff6f2604640 1 -- 172.21.15.131:0/3307147767 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff7f8015020 con 0x560e6176e7a0 2024-04-24T01:43:04.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff805346640 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6ec036900 0x7ff6ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff80a411800 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e617702e0 0x560e61872440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e61872980 con 0x560e617702e0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff806348640 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e617702e0 0x560e61872440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff805346640 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6ec036900 0x7ff6ec038dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc054000 tx=0x7ff7fc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff806348640 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e617702e0 0x560e61872440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff806348640 1 -- 172.21.15.131:0/3307147767 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff80000a4a0 con 0x560e617702e0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.286+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e6186fa10 con 0x560e617702e0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.287+0000 7ff806348640 1 -- 172.21.15.131:0/3307147767 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff80000a4a0 con 0x560e617702e0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.287+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618747f0 con 0x560e617702e0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.287+0000 7ff806348640 1 -- 172.21.15.131:0/3307147767 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff80000a4a0 con 0x560e617702e0 2024-04-24T01:43:04.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.287+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e61873b30 con 0x560e617702e0 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.287+0000 7ff806348640 1 -- 172.21.15.131:0/3307147767 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff80000a4a0 con 0x560e617702e0 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.287+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e61873f50 con 0x560e617702e0 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff806348640 1 -- 172.21.15.131:0/3307147767 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff80000a4a0 con 0x560e617702e0 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff80a411800 1 Processor -- start 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff80a411800 1 -- start start 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff80a411800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61883600 0x560e61883a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff80a411800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560e616616b0 con 0x560e61883600 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff805346640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61883600 0x560e61883a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff805346640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61883600 0x560e61883a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42462/0 (socket says 172.21.15.131:42462) 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff805346640 1 -- 172.21.15.131:0/3118458011 learned_addr learned my addr 172.21.15.131:0/3118458011 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.288+0000 7ff805346640 1 -- 172.21.15.131:0/3118458011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e61883f60 con 0x560e61883600 2024-04-24T01:43:04.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.289+0000 7ff805346640 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61883600 0x560e61883a20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc055040 tx=0x7ff7fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.289+0000 7ff6eb7fe640 1 -- 172.21.15.131:0/3118458011 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc057040 con 0x560e61883600 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.289+0000 7ff6eb7fe640 1 -- 172.21.15.131:0/3118458011 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc06d070 con 0x560e61883600 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.289+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e618849d0 con 0x560e61883600 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.289+0000 7ff6eb7fe640 1 -- 172.21.15.131:0/3118458011 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc05d740 con 0x560e61883600 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.289+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e61884e70 con 0x560e61883600 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.289+0000 7ff6eb7fe640 1 -- 172.21.15.131:0/3118458011 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff7fc067070 con 0x560e61883600 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff6eb7fe640 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e0036950 0x7ff6e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff6eb7fe640 1 -- 172.21.15.131:0/3118458011 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff7fc08f6f0 con 0x560e61883600 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff806348640 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e0036950 0x7ff6e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff80a411800 1 Processor -- start 2024-04-24T01:43:04.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff80a411800 1 -- start start 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff806348640 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e0036950 0x7ff6e0038e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x560e61873ed0 tx=0x7ff800005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff80a411800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61890c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff80a411800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560e61864000 con 0x560e61890840 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff805346640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61890c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff805346640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61890c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42476/0 (socket says 172.21.15.131:42476) 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.290+0000 7ff805346640 1 -- 172.21.15.131:0/2284175958 learned_addr learned my addr 172.21.15.131:0/2284175958 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff805346640 1 -- 172.21.15.131:0/2284175958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e61891230 con 0x560e61890840 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff805346640 1 --2- 172.21.15.131:0/2284175958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61890c60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc08da80 tx=0x7ff7fc067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dd44a234166140 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff6e97fa640 1 -- 172.21.15.131:0/2284175958 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc0727e0 con 0x560e61890840 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff6e97fa640 1 -- 172.21.15.131:0/2284175958 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc08de50 con 0x560e61890840 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff6e97fa640 1 -- 172.21.15.131:0/2284175958 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc067360 con 0x560e61890840 2024-04-24T01:43:04.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff80a411800 1 -- 172.21.15.131:0/2284175958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 msgr2=0x560e61890c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff80a411800 1 --2- 172.21.15.131:0/2284175958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61890c60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc08da80 tx=0x7ff7fc067ab0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff80a411800 1 -- 172.21.15.131:0/2284175958 shutdown_connections 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff80a411800 1 --2- 172.21.15.131:0/2284175958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61890c60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff80a411800 1 -- 172.21.15.131:0/2284175958 >> 172.21.15.131:0/2284175958 conn(0x560e6188cba0 msgr2=0x560e6188ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff80a411800 1 -- 172.21.15.131:0/2284175958 shutdown_connections 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.291+0000 7ff80a411800 1 -- 172.21.15.131:0/2284175958 wait complete. 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff80a411800 1 Processor -- start 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff80a411800 1 -- start start 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff80a411800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61897e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff80a411800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560e61891940 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff805346640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61897e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff805346640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61897e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42488/0 (socket says 172.21.15.131:42488) 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 learned_addr learned my addr 172.21.15.131:0/1806936972 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e61898340 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff805346640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61897e00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc067f90 tx=0x7ff7fc08da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.292+0000 7ff6d77fe640 1 -- 172.21.15.131:0/1806936972 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc093070 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.293+0000 7ff6d77fe640 1 -- 172.21.15.131:0/1806936972 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc05c3e0 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.293+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e618985d0 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.293+0000 7ff6d77fe640 1 -- 172.21.15.131:0/1806936972 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7fc067bf0 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.293+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6189b280 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.293+0000 7ff6d77fe640 1 -- 172.21.15.131:0/1806936972 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff7fc096070 con 0x560e61890840 2024-04-24T01:43:04.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.293+0000 7ff6d77fe640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6d0036950 0x7ff6d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.293+0000 7ff6d77fe640 1 -- 172.21.15.131:0/1806936972 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ff7fc082040 con 0x560e61890840 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.294+0000 7ff806348640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6d0036950 0x7ff6d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.294+0000 7ff806348640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6d0036950 0x7ff6d0038e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560e61873650 tx=0x7ff80001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.294+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.294+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e618a3940 0x560e618a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.294+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a6550 con 0x560e618a3940 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.294+0000 7ff805b47640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e618a3940 0x560e618a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.294+0000 7ff805b47640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e618a3940 0x560e618a5e00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 realm 2024-04-24T01:43:04.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a6960 con 0x560e618a3940 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a7230 con 0x560e618a3940 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a75d0 con 0x560e618a3940 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a7e20 con 0x560e618a3940 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.295+0000 7ff80a411800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff80a411800 20 searching for the correct realm 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560e618a9b90 0x560e618abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a9b90 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff805346640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560e618a9b90 0x560e618abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff805346640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560e618a9b90 0x560e618abf80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff805346640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff7fc098070 0x7ff7fc075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x7ff7fc098070 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.296+0000 7ff806348640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff7fc098070 0x7ff7fc075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.297+0000 7ff806348640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff7fc098070 0x7ff7fc075860 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.297+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80001f070 con 0x7ff7fc098070 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.297+0000 7ff806348640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff800031040 0x7ff800032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.297+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x7ff800031040 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.297+0000 7ff805b47640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff800031040 0x7ff800032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.297+0000 7ff805b47640 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff800031040 0x7ff800032430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a3940 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a3940 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x7ff800031040 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.298+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x7ff800031040 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x7ff7fc098070 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80001f070 con 0x7ff7fc098070 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a9b90 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a3940 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.299+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x7ff800031040 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a3940 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x7ff7fc098070 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff80001f070 con 0x7ff7fc098070 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a9b90 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.300+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac540 con 0x560e618a9b90 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x7ff800031040 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a9b90 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a9b90 2024-04-24T01:43:04.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a3940 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.301+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a3940 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.302+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.302+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x7ff800031040 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.302+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.302+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a9b90 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.302+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.302+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x7ff7fc098070 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80001f070 con 0x7ff7fc098070 2024-04-24T01:43:04.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a3940 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x7ff800031040 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a9b90 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.303+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x7ff800031040 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x7ff7fc098070 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80001f070 con 0x7ff7fc098070 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x560e618a9b90 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7fc0ae040 con 0x7ff800031040 2024-04-24T01:43:04.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.304+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7f8055040 con 0x560e618a3940 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff7f8055040 con 0x7ff7fc098070 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff80001f070 con 0x7ff7fc098070 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a87a0 con 0x560e618a3940 2024-04-24T01:43:04.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a9040 con 0x560e618a3940 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.305+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618a9040 con 0x560e618a3940 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 20 zone default found 2024-04-24T01:43:04.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 4 Realm: () 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 20 zonegroup default 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618ac9c0 con 0x7ff800031040 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.306+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618ae3d0 con 0x560e618a9b90 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff80a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618ae8a0 con 0x560e618a9b90 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff80a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff80a411800 20 started sync module instance, tier type = 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff80a411800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.307+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618ad840 con 0x7ff7fc098070 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.308+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.308+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619766021168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618ad4a0 con 0x7ff7fc098070 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.308+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618af7d0 con 0x560e618a3940 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.309+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619766021168] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.309+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.309+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619766025472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618af7d0 con 0x560e618a3940 2024-04-24T01:43:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.309+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b0190 con 0x560e618a9b90 2024-04-24T01:43:04.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.310+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619766025472] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.310+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.310+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619766029536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b0530 con 0x560e618a9b90 2024-04-24T01:43:04.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.310+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b0f80 con 0x7ff7fc098070 2024-04-24T01:43:04.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.311+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619766029536] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.311+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.311+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619766033008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b13a0 con 0x7ff7fc098070 2024-04-24T01:43:04.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.311+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b1dc0 con 0x560e618a3940 2024-04-24T01:43:04.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.312+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619766033008] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.312+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.312+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619766036656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b1d80 con 0x560e618a3940 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.312+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b2840 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.313+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619766036656] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.313+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.313+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619766027040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b2800 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.313+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b3250 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.314+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619766027040] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.314+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.314+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619766039856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b3250 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.314+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b3c10 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619766039856] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619766044512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b4030 con 0x7ff800031040 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 20 add_watcher() i=0 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 20 add_watcher() i=1 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 20 add_watcher() i=2 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 20 add_watcher() i=3 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 20 add_watcher() i=4 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 20 add_watcher() i=5 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.315+0000 7ff80a411800 20 add_watcher() i=6 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.316+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619766044512] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.316+0000 7ff80a411800 20 add_watcher() i=7 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.316+0000 7ff80a411800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:04.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.316+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618b4030 con 0x560e618a3940 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.316+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.316+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619766045568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b4010 con 0x560e618a3940 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.317+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619766045568] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff6b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 5 note: GC not initialized 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff6b67fc640 20 reqs_thread_entry: start 2024-04-24T01:43:04.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 20 Filter name: none 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff627fff640 20 reqs_thread_entry: start 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.318+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618ea3b0 con 0x7ff800031040 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618ec490 con 0x7ff7fc098070 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.319+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618edf30 con 0x7ff800031040 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(64 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.320+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618f2380 con 0x7ff7fc098070 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.321+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.321+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618f82c0 con 0x7ff800031040 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.322+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(66 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.322+0000 7ff80a411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.322+0000 7ff80a411800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.322+0000 7ff80a411800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.322+0000 7ff80a411800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.322+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94619766283936 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618f27b0 con 0x7ff800031040 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== watch-notify(notify (1) cookie 94619766027040 notify 137438953476 ret 0) ==== 794+0+0 (crc 0 0 0) 0x560e618ed450 con 0x7ff800031040 2024-04-24T01:43:04.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff6e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94619766027040 notifier 4499 bl.length()=752 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff6e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff6e97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff6e97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(67 notify.5 [notify cookie 94619766283936 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff6e97fa640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff6c8003ea0 con 0x7ff800031040 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== watch-notify(notify_complete (2) cookie 94619766283936 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e6186e680 con 0x7ff800031040 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff80a411800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_sources= new_sources= 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff80a411800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential sources added=[] removed=[] 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff80a411800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_dests= new_dests= 2024-04-24T01:43:04.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff80a411800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential dests added=[] removed=[] 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.323+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618edea0 con 0x7ff800031040 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.324+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.324+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618edea0 con 0x7ff7fc098070 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.325+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.325+0000 7ff80a411800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.325+0000 7ff80a411800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.325+0000 7ff80a411800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.325+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94619766283936 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e618f6f50 con 0x7ff800031040 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== watch-notify(notify (1) cookie 94619766039856 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x560e6186b9d0 con 0x7ff800031040 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff6e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94619766039856 notifier 4499 bl.length()=314 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff6e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:43:04.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff6e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(71 notify.6 [notify cookie 94619766283936 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff6e8ff9640 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff630003400 con 0x7ff800031040 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.326+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== watch-notify(notify_complete (2) cookie 94619766283936 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e6186b740 con 0x7ff800031040 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.327+0000 7ff6b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.327+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619766045568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618edea0 con 0x560e618a3940 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.328+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94619766045568] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.328+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619766021168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b3b80 con 0x7ff7fc098070 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.329+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94619766021168] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.329+0000 7ff80a411800 20 remove_watcher() i=0 2024-04-24T01:43:04.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.329+0000 7ff80a411800 2 removed watcher, disabling cache 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.329+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619766025472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b3b80 con 0x560e618a3940 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.330+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94619766025472] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.330+0000 7ff80a411800 20 remove_watcher() i=1 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.330+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619766029536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618aed00 con 0x560e618a9b90 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.331+0000 7ff805346640 1 -- 172.21.15.131:0/1806936972 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94619766029536] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc09f070 con 0x560e618a9b90 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.331+0000 7ff80a411800 20 remove_watcher() i=2 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.331+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619766033008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b3b80 con 0x7ff7fc098070 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.332+0000 7ff806348640 1 -- 172.21.15.131:0/1806936972 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94619766033008] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff800040040 con 0x7ff7fc098070 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.332+0000 7ff80a411800 20 remove_watcher() i=3 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.332+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619766036656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b0a70 con 0x560e618a3940 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.333+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94619766036656] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x560e618a3940 2024-04-24T01:43:04.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.333+0000 7ff80a411800 20 remove_watcher() i=4 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.333+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619766027040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b3b80 con 0x7ff800031040 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.334+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94619766027040] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.334+0000 7ff80a411800 20 remove_watcher() i=5 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.334+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619766039856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b18b0 con 0x7ff800031040 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.335+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94619766039856] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.335+0000 7ff80a411800 20 remove_watcher() i=6 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.335+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619766044512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e618b0a70 con 0x7ff800031040 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94619766044512] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f802e070 con 0x7ff800031040 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 20 remove_watcher() i=7 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff800031040 msgr2=0x7ff800032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff800031040 0x7ff800032430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e618a3940 msgr2=0x560e618a5e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e618a3940 0x560e618a5e00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff7fc098070 msgr2=0x7ff7fc075860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff7fc098070 0x7ff7fc075860 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560e618a9b90 msgr2=0x560e618abf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560e618a9b90 0x560e618abf80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6d0036950 msgr2=0x7ff6d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6d0036950 0x7ff6d0038e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560e61873650 tx=0x7ff80001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 msgr2=0x560e61897e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/1806936972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61890840 0x560e61897e00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc067f90 tx=0x7ff7fc08da10 comp rx=0 tx=0).stop 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff805b47640 1 -- 172.21.15.131:0/1806936972 reap_dead start 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 shutdown_connections 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 >> 172.21.15.131:0/1806936972 conn(0x560e6188cba0 msgr2=0x560e6188a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 shutdown_connections 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/1806936972 wait complete. 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e0036950 msgr2=0x7ff6e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e0036950 0x7ff6e0038e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x560e61873ed0 tx=0x7ff800005840 comp rx=0 tx=0).stop 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61883600 msgr2=0x560e61883a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61883600 0x560e61883a20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc055040 tx=0x7ff7fc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 shutdown_connections 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e0036950 0x7ff6e0038e10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 --2- 172.21.15.131:0/3118458011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e61883600 0x560e61883a20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 >> 172.21.15.131:0/3118458011 conn(0x560e618776a0 msgr2=0x560e61877aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 shutdown_connections 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.336+0000 7ff80a411800 1 -- 172.21.15.131:0/3118458011 wait complete. 2024-04-24T01:43:04.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e617702e0 msgr2=0x560e61872440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e617702e0 0x560e61872440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6ec036900 msgr2=0x7ff6ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6ec036900 0x7ff6ec038dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc054000 tx=0x7ff7fc04e000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 msgr2=0x560e6186b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e6186b200 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8000fb0 tx=0x7ff7f8000bc0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 shutdown_connections 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560e617702e0 0x560e61872440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6ec036900 0x7ff6ec038dc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 --2- 172.21.15.131:0/3307147767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560e6176e7a0 0x560e6186b200 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 >> 172.21.15.131:0/3307147767 conn(0x560e6176a340 msgr2=0x560e6185d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 shutdown_connections 2024-04-24T01:43:04.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.337+0000 7ff80a411800 1 -- 172.21.15.131:0/3307147767 wait complete. 2024-04-24T01:43:04.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T01:43:04.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T01:43:04.362 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T01:43:04.405 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:04.405 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:04.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.404+0000 7f7a9e119800 1 Processor -- start 2024-04-24T01:43:04.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.404+0000 7f7a9e119800 1 -- start start 2024-04-24T01:43:04.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.404+0000 7f7a9e119800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557d06d71280 0x557d06d79d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.404+0000 7f7a9e119800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d06c2fd40 con 0x557d06d6f740 2024-04-24T01:43:04.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.404+0000 7f7a9e119800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x557d06c024d0 con 0x557d06d71280 2024-04-24T01:43:04.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.405+0000 7f7a9b417640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557d06d71280 0x557d06d79d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.405+0000 7f7a9bc18640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x557d06d6f740 0x557d06d6fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56668/0 (socket says 172.21.15.131:56668) 2024-04-24T01:43:04.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.405+0000 7f7a9bc18640 1 -- 172.21.15.131:0/11493251 learned_addr learned my addr 172.21.15.131:0/11493251 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:04.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.405+0000 7f7a9b417640 1 -- 172.21.15.131:0/11493251 >> v1:172.21.15.107:6789/0 conn(0x557d06d6f740 legacy=0x557d06d6fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.405+0000 7f7a9b417640 1 -- 172.21.15.131:0/11493251 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d06c2e590 con 0x557d06d71280 2024-04-24T01:43:04.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9b417640 1 --2- 172.21.15.131:0/11493251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d71280 0x557d06d79d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000a470 tx=0x7f7a9001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e8f58132f8982a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9ac16640 1 -- 172.21.15.131:0/11493251 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90057070 con 0x557d06d71280 2024-04-24T01:43:04.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9ac16640 1 -- 172.21.15.131:0/11493251 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9004adc0 con 0x557d06d71280 2024-04-24T01:43:04.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9ac16640 1 -- 172.21.15.131:0/11493251 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90052590 con 0x557d06d71280 2024-04-24T01:43:04.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9e119800 1 -- 172.21.15.131:0/11493251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d71280 msgr2=0x557d06d79d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9e119800 1 --2- 172.21.15.131:0/11493251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d71280 0x557d06d79d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000a470 tx=0x7f7a9001ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:04.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9e119800 1 -- 172.21.15.131:0/11493251 shutdown_connections 2024-04-24T01:43:04.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9e119800 1 --2- 172.21.15.131:0/11493251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d71280 0x557d06d79d80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9e119800 1 -- 172.21.15.131:0/11493251 >> 172.21.15.131:0/11493251 conn(0x557d06d6b380 msgr2=0x557d06d6d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9e119800 1 -- 172.21.15.131:0/11493251 shutdown_connections 2024-04-24T01:43:04.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.407+0000 7f7a9e119800 1 -- 172.21.15.131:0/11493251 wait complete. 2024-04-24T01:43:04.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.419+0000 7f7a9e119800 1 Processor -- start 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.419+0000 7f7a9e119800 1 -- start start 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.419+0000 7f7a9e119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.419+0000 7f7a9e119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557d06cbc3c0 con 0x557d06d6f740 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.419+0000 7f7a9bc18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.419+0000 7f7a9bc18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42502/0 (socket says 172.21.15.131:42502) 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.419+0000 7f7a9bc18640 1 -- 172.21.15.131:0/2257837292 learned_addr learned my addr 172.21.15.131:0/2257837292 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.420+0000 7f7a9bc18640 1 -- 172.21.15.131:0/2257837292 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d06e64bb0 con 0x557d06d6f740 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.420+0000 7f7a9bc18640 1 --2- 172.21.15.131:0/2257837292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e645e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c001de0 tx=0x7f7a8c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573abe4ac65cc2c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.420+0000 7f7989e0b640 1 -- 172.21.15.131:0/2257837292 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8c012020 con 0x557d06d6f740 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.420+0000 7f7989e0b640 1 -- 172.21.15.131:0/2257837292 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c00e5a0 con 0x557d06d6f740 2024-04-24T01:43:04.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.420+0000 7f7989e0b640 1 -- 172.21.15.131:0/2257837292 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8c00e8c0 con 0x557d06d6f740 2024-04-24T01:43:04.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 -- 172.21.15.131:0/2257837292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 msgr2=0x557d06e645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 --2- 172.21.15.131:0/2257837292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e645e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c001de0 tx=0x7f7a8c00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 -- 172.21.15.131:0/2257837292 shutdown_connections 2024-04-24T01:43:04.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 --2- 172.21.15.131:0/2257837292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e645e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 -- 172.21.15.131:0/2257837292 >> 172.21.15.131:0/2257837292 conn(0x557d06d6b380 msgr2=0x557d06e5ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 -- 172.21.15.131:0/2257837292 shutdown_connections 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 -- 172.21.15.131:0/2257837292 wait complete. 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 Processor -- start 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 -- start start 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e6c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9e119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557d06d7c5a0 con 0x557d06d6f740 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9bc18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e6c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9bc18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e6c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42506/0 (socket says 172.21.15.131:42506) 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.421+0000 7f7a9bc18640 1 -- 172.21.15.131:0/1948082939 learned_addr learned my addr 172.21.15.131:0/1948082939 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.422+0000 7f7a9bc18640 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d06e6c640 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.422+0000 7f7a9bc18640 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e6c100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c001de0 tx=0x7f7a8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.422+0000 7f7983fff640 1 -- 172.21.15.131:0/1948082939 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8c012030 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.422+0000 7f7983fff640 1 -- 172.21.15.131:0/1948082939 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c01a7a0 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.422+0000 7f7983fff640 1 -- 172.21.15.131:0/1948082939 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8c01aac0 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.422+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d06e6c8d0 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.422+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d06e6f580 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.423+0000 7f7983fff640 1 -- 172.21.15.131:0/1948082939 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7a8c015020 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.423+0000 7f7983fff640 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7984036900 0x7f7984038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.423+0000 7f7983fff640 1 -- 172.21.15.131:0/1948082939 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7a8c020070 con 0x557d06d6f740 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.423+0000 7f7a9b417640 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7984036900 0x7f7984038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.423+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06d71280 0x557d06e73340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.423+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06e738c0 con 0x557d06d71280 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.423+0000 7f7a9c419640 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06d71280 0x557d06e73340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.424+0000 7f7a9b417640 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7984036900 0x7f7984038dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a90054000 tx=0x7f7a9004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.424+0000 7f7a9c419640 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06d71280 0x557d06e73340 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.424+0000 7f7a9c419640 1 -- 172.21.15.131:0/1948082939 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a9400a4a0 con 0x557d06d71280 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.424+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06e70910 con 0x557d06d71280 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.424+0000 7f7a9c419640 1 -- 172.21.15.131:0/1948082939 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a9400a4a0 con 0x557d06d71280 2024-04-24T01:43:04.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.424+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06e75710 con 0x557d06d71280 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.425+0000 7f7a9c419640 1 -- 172.21.15.131:0/1948082939 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a9400a4a0 con 0x557d06d71280 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.425+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06e74a50 con 0x557d06d71280 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.425+0000 7f7a9c419640 1 -- 172.21.15.131:0/1948082939 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a9400a4a0 con 0x557d06d71280 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.425+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06e74ea0 con 0x557d06d71280 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.425+0000 7f7a9c419640 1 -- 172.21.15.131:0/1948082939 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a9400a4a0 con 0x557d06d71280 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.425+0000 7f7a9e119800 1 Processor -- start 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9e119800 1 -- start start 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9e119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e844e0 0x557d06e84900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9e119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557d06c626b0 con 0x557d06e844e0 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9b417640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e844e0 0x557d06e84900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9b417640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e844e0 0x557d06e84900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42520/0 (socket says 172.21.15.131:42520) 2024-04-24T01:43:04.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9b417640 1 -- 172.21.15.131:0/541402819 learned_addr learned my addr 172.21.15.131:0/541402819 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9b417640 1 -- 172.21.15.131:0/541402819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d06e84e40 con 0x557d06e844e0 2024-04-24T01:43:04.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.426+0000 7f7a9b417640 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e844e0 0x557d06e84900 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7a90044730 tx=0x7f7a90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f79817fa640 1 -- 172.21.15.131:0/541402819 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a9006d070 con 0x557d06e844e0 2024-04-24T01:43:04.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f79817fa640 1 -- 172.21.15.131:0/541402819 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9005dda0 con 0x557d06e844e0 2024-04-24T01:43:04.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d06e858b0 con 0x557d06e844e0 2024-04-24T01:43:04.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f79817fa640 1 -- 172.21.15.131:0/541402819 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90057040 con 0x557d06e844e0 2024-04-24T01:43:04.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d06e85d50 con 0x557d06e844e0 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f79817fa640 1 -- 172.21.15.131:0/541402819 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7a90070070 con 0x557d06e844e0 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f79817fa640 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7974036950 0x7f7974038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.427+0000 7f79817fa640 1 -- 172.21.15.131:0/541402819 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7a9008f230 con 0x557d06e844e0 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9c419640 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7974036950 0x7f7974038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9e119800 1 Processor -- start 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9c419640 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7974036950 0x7f7974038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x557d06e74570 tx=0x7f7a94005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9e119800 1 -- start start 2024-04-24T01:43:04.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9e119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e91b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9e119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557d06e64f30 con 0x557d06e91720 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9b417640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e91b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9b417640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e91b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42528/0 (socket says 172.21.15.131:42528) 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9b417640 1 -- 172.21.15.131:0/1952749296 learned_addr learned my addr 172.21.15.131:0/1952749296 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.428+0000 7f7a9b417640 1 -- 172.21.15.131:0/1952749296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d06e92110 con 0x557d06e91720 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9b417640 1 --2- 172.21.15.131:0/1952749296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e91b40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7a900705f0 tx=0x7f7a9005be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150addcc24a3d834 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f797affd640 1 -- 172.21.15.131:0/1952749296 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a900095d0 con 0x557d06e91720 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f797affd640 1 -- 172.21.15.131:0/1952749296 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9008c160 con 0x557d06e91720 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f797affd640 1 -- 172.21.15.131:0/1952749296 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a9008d990 con 0x557d06e91720 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 -- 172.21.15.131:0/1952749296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 msgr2=0x557d06e91b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1952749296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e91b40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7a900705f0 tx=0x7f7a9005be90 comp rx=0 tx=0).stop 2024-04-24T01:43:04.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 -- 172.21.15.131:0/1952749296 shutdown_connections 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1952749296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e91b40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 -- 172.21.15.131:0/1952749296 >> 172.21.15.131:0/1952749296 conn(0x557d06e8da80 msgr2=0x557d06e8bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 -- 172.21.15.131:0/1952749296 shutdown_connections 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 -- 172.21.15.131:0/1952749296 wait complete. 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 Processor -- start 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.429+0000 7f7a9e119800 1 -- start start 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9e119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e98d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9e119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557d06e92880 con 0x557d06e91720 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9b417640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e98d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9b417640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e98d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42530/0 (socket says 172.21.15.131:42530) 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 learned_addr learned my addr 172.21.15.131:0/3561699912 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d06e99290 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9b417640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e98d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7a900705f0 tx=0x7f7a9008d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f79797fa640 1 -- 172.21.15.131:0/3561699912 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90052570 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f79797fa640 1 -- 172.21.15.131:0/3561699912 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a90052710 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d06e99520 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f79797fa640 1 -- 172.21.15.131:0/3561699912 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a90052a10 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.430+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d06e9c1d0 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.431+0000 7f79797fa640 1 -- 172.21.15.131:0/3561699912 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7a90096030 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.431+0000 7f79797fa640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7964036950 0x7f7964038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.431+0000 7f79797fa640 1 -- 172.21.15.131:0/3561699912 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7a90094070 con 0x557d06e91720 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.431+0000 7f7a9c419640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7964036950 0x7f7964038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9c419640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7964036950 0x7f7964038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x557d06e6d320 tx=0x7f7a9401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06ea4820 0x557d06ea6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea7430 con 0x557d06ea4820 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9bc18640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06ea4820 0x557d06ea6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9bc18640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06ea4820 0x557d06ea6ce0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9e119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9e119800 20 realm 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.432+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea7800 con 0x557d06ea4820 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea80d0 con 0x557d06ea4820 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea8470 con 0x557d06ea4820 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea8cc0 con 0x557d06ea4820 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.433+0000 7f7a9e119800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:04.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9e119800 20 searching for the correct realm 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557d06eaaa30 0x557d06eace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06eaaa30 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9b417640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557d06eaaa30 0x557d06eace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9b417640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557d06eaaa30 0x557d06eace20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9b417640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7a90080040 0x7f7a900610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a90080040 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.434+0000 7f7a9c419640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7a90080040 0x7f7a900610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.435+0000 7f7a9c419640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7a90080040 0x7f7a900610c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.435+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9401f070 con 0x7f7a90080040 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.435+0000 7f7a9c419640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7a94031040 0x7f7a94032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.435+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a94031040 2024-04-24T01:43:04.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.435+0000 7f7a9bc18640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7a94031040 0x7f7a94032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.435+0000 7f7a9bc18640 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7a94031040 0x7f7a94032430 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06ea4820 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06ea4820 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a94031040 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.436+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a94031040 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a90080040 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9401f070 con 0x7f7a90080040 2024-04-24T01:43:04.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06eaaa30 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06ea4820 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a94031040 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.437+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06ea4820 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a90080040 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7a9401f070 con 0x7f7a90080040 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06eaaa30 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06eaaa30 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.438+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a94031040 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06eaaa30 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06eaaa30 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06ea4820 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.439+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06ea4820 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a94031040 2024-04-24T01:43:04.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06eaaa30 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a90080040 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9401f070 con 0x7f7a90080040 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.440+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x557d06ea4820 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.441+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.441+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead430 con 0x7f7a94031040 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.441+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.441+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7a8c055040 con 0x557d06eaaa30 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.441+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.441+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7a8c055040 con 0x7f7a94031040 2024-04-24T01:43:04.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7a8c055040 con 0x7f7a90080040 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9401f070 con 0x7f7a90080040 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7a8c055040 con 0x557d06eaaa30 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7a8c055040 con 0x7f7a94031040 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.442+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7a8c055040 con 0x557d06ea4820 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7a8c055040 con 0x7f7a90080040 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9401f070 con 0x7f7a90080040 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:04.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea9670 con 0x557d06ea4820 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea9f10 con 0x557d06ea4820 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.443+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea9f10 con 0x557d06ea4820 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 zone default found 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 4 Realm: () 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 zonegroup default 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ead8b0 con 0x7f7a94031040 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06eaf320 con 0x557d06eaaa30 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06eaf7f0 con 0x557d06eaaa30 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 started sync module instance, tier type = 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.444+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eae730 con 0x7f7a90080040 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.445+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.445+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93995475331872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eaef40 con 0x7f7a90080040 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.445+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb0630 con 0x557d06ea4820 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.446+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93995475331872] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.446+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.447+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93995475336272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb0a20 con 0x557d06ea4820 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.447+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb1480 con 0x557d06eaaa30 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.448+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.448+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93995475341104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb1d20 con 0x557d06eaaa30 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.448+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb27e0 con 0x7f7a90080040 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.448+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93995475336272] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.449+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93995475341104] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.449+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.449+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93995475343472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb0070 con 0x7f7a90080040 2024-04-24T01:43:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.449+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb31f0 con 0x557d06ea4820 2024-04-24T01:43:04.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.451+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.451+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93995475348800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb3610 con 0x557d06ea4820 2024-04-24T01:43:04.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.451+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb4060 con 0x7f7a94031040 2024-04-24T01:43:04.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.451+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93995475343472] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.452+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.452+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93995475352400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb4020 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.452+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb4a50 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.452+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93995475348800] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.453+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93995475352400] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.453+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.453+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93995475346096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb3160 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.453+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb4f00 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93995475346096] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93995475354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb4f00 con 0x7f7a94031040 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 20 add_watcher() i=0 2024-04-24T01:43:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 20 add_watcher() i=1 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 20 add_watcher() i=2 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 20 add_watcher() i=3 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 20 add_watcher() i=4 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 20 add_watcher() i=5 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.454+0000 7f7a9e119800 20 add_watcher() i=6 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.455+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93995475354976] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.455+0000 7f7a9e119800 20 add_watcher() i=7 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.455+0000 7f7a9e119800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.455+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb8360 con 0x557d06ea4820 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.455+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.455+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93995475356704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb5880 con 0x557d06ea4820 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.456+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93995475356704] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.457+0000 7f7951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.457+0000 7f7a9e119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.457+0000 7f7a9e119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.457+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb8050 con 0x557d06ea4820 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.458+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'46 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.458+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec13b0 con 0x7f7a94031040 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.459+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.459+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec13b0 con 0x557d06eaaa30 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.460+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.460+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec17d0 con 0x557d06ea4820 2024-04-24T01:43:04.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.461+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'119 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.461+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec1800 con 0x7f7a90080040 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.462+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.462+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec1e50 con 0x557d06eaaa30 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.462+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.463+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec1ee0 con 0x557d06ea4820 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.464+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.464+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec1ee0 con 0x7f7a94031040 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.465+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.465+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec1ee0 con 0x7f7a90080040 2024-04-24T01:43:04.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.466+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.466+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2470 con 0x557d06eaaa30 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.467+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.467+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2470 con 0x7f7a90080040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.468+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.468+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec29e0 con 0x7f7a94031040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.469+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.469+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec29e0 con 0x7f7a90080040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.470+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.470+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x7f7a94031040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.471+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'39 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.471+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06ea4820 2024-04-24T01:43:04.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.472+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'120 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.472+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.473+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.473+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x7f7a90080040 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.474+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.474+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.475+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.475+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06ea4820 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.476+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.476+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06ea4820 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.477+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'121 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.477+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.478+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.478+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x7f7a90080040 2024-04-24T01:43:04.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.479+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.479+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.479+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.479+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.480+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.480+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.481+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.481+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.482+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.482+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x7f7a94031040 2024-04-24T01:43:04.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.483+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.483+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.484+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.485+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x7f7a94031040 2024-04-24T01:43:04.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.486+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.486+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x557d06eaaa30 2024-04-24T01:43:04.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.487+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.487+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x7f7a94031040 2024-04-24T01:43:04.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.488+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'40 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.489+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ec2de0 con 0x7f7a90080040 2024-04-24T01:43:04.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7950fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7a9e119800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7a9e119800 20 Filter name: none 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f78ca7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7a9e119800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7a9e119800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06eedb10 con 0x7f7a94031040 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.490+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.491+0000 7f7a9e119800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.491+0000 7f7a9e119800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.491+0000 7f7a9e119800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:43:04.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.491+0000 7f7a9e119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.491+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d06ef0560 con 0x7f7a94031040 2024-04-24T01:43:04.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.491+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.496 INFO:teuthology.orchestra.run.smithi131.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T01:43:04.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.492+0000 7f7951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.492+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93995475356704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06ea0f40 con 0x557d06ea4820 2024-04-24T01:43:04.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.493+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93995475356704] v32'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.493+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93995475331872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb4bf0 con 0x7f7a90080040 2024-04-24T01:43:04.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.494+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93995475331872] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.494+0000 7f7a9e119800 20 remove_watcher() i=0 2024-04-24T01:43:04.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.494+0000 7f7a9e119800 2 removed watcher, disabling cache 2024-04-24T01:43:04.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.494+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93995475336272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eaeb20 con 0x557d06ea4820 2024-04-24T01:43:04.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.495+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93995475336272] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.495+0000 7f7a9e119800 20 remove_watcher() i=1 2024-04-24T01:43:04.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.495+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93995475341104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eaeb20 con 0x557d06eaaa30 2024-04-24T01:43:04.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.496+0000 7f7a9b417640 1 -- 172.21.15.131:0/3561699912 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93995475341104] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9006f030 con 0x557d06eaaa30 2024-04-24T01:43:04.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.496+0000 7f7a9e119800 20 remove_watcher() i=2 2024-04-24T01:43:04.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.496+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93995475343472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb0f30 con 0x7f7a90080040 2024-04-24T01:43:04.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.497+0000 7f7a9c419640 1 -- 172.21.15.131:0/3561699912 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93995475343472] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94040040 con 0x7f7a90080040 2024-04-24T01:43:04.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.497+0000 7f7a9e119800 20 remove_watcher() i=3 2024-04-24T01:43:04.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.497+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93995475348800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eaeb20 con 0x557d06ea4820 2024-04-24T01:43:04.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.499+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93995475348800] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x557d06ea4820 2024-04-24T01:43:04.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.499+0000 7f7a9e119800 20 remove_watcher() i=4 2024-04-24T01:43:04.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.499+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93995475352400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb0f30 con 0x7f7a94031040 2024-04-24T01:43:04.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.500+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93995475352400] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.500+0000 7f7a9e119800 20 remove_watcher() i=5 2024-04-24T01:43:04.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.500+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93995475346096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eb2d40 con 0x7f7a94031040 2024-04-24T01:43:04.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.500+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93995475346096] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.501+0000 7f7a9e119800 20 remove_watcher() i=6 2024-04-24T01:43:04.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.501+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93995475354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d06eaeb20 con 0x7f7a94031040 2024-04-24T01:43:04.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.501+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93995475354976] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a8c024980 con 0x7f7a94031040 2024-04-24T01:43:04.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.501+0000 7f7a9e119800 20 remove_watcher() i=7 2024-04-24T01:43:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7a94031040 msgr2=0x7f7a94032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7a94031040 0x7f7a94032430 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06ea4820 msgr2=0x557d06ea6ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06ea4820 0x557d06ea6ce0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7a90080040 msgr2=0x7f7a900610c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7a90080040 0x7f7a900610c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557d06eaaa30 msgr2=0x557d06eace20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x557d06eaaa30 0x557d06eace20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7964036950 msgr2=0x7f7964038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7964036950 0x7f7964038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x557d06e6d320 tx=0x7f7a9401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 msgr2=0x557d06e98d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e98d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7a900705f0 tx=0x7f7a9008d510 comp rx=0 tx=0).stop 2024-04-24T01:43:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9bc18640 1 -- 172.21.15.131:0/3561699912 reap_dead start 2024-04-24T01:43:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 shutdown_connections 2024-04-24T01:43:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/3561699912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e91720 0x557d06e98d50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 >> 172.21.15.131:0/3561699912 conn(0x557d06e8da80 msgr2=0x557d06e8b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 shutdown_connections 2024-04-24T01:43:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/3561699912 wait complete. 2024-04-24T01:43:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7974036950 msgr2=0x7f7974038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7974036950 0x7f7974038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x557d06e74570 tx=0x7f7a94005840 comp rx=0 tx=0).stop 2024-04-24T01:43:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e844e0 msgr2=0x557d06e84900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e844e0 0x557d06e84900 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7a90044730 tx=0x7f7a90002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 shutdown_connections 2024-04-24T01:43:04.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7974036950 0x7f7974038e10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 --2- 172.21.15.131:0/541402819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06e844e0 0x557d06e84900 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 >> 172.21.15.131:0/541402819 conn(0x557d06e78580 msgr2=0x557d06e78980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 shutdown_connections 2024-04-24T01:43:04.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.502+0000 7f7a9e119800 1 -- 172.21.15.131:0/541402819 wait complete. 2024-04-24T01:43:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06d71280 msgr2=0x557d06e73340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06d71280 0x557d06e73340 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7984036900 msgr2=0x7f7984038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7984036900 0x7f7984038dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a90054000 tx=0x7f7a9004e000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 msgr2=0x557d06e6c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e6c100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c001de0 tx=0x7f7a8c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 shutdown_connections 2024-04-24T01:43:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557d06d71280 0x557d06e73340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7984036900 0x7f7984038dc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 --2- 172.21.15.131:0/1948082939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d06d6f740 0x557d06e6c100 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 >> 172.21.15.131:0/1948082939 conn(0x557d06d6b380 msgr2=0x557d06e5e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 shutdown_connections 2024-04-24T01:43:04.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.503+0000 7f7a9e119800 1 -- 172.21.15.131:0/1948082939 wait complete. 2024-04-24T01:43:04.518 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:43:04.519 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-24T01:43:04.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-24T01:43:04.519 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-24T01:43:04.603 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:04.603 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:04.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.602+0000 7f4632d2f800 1 Processor -- start 2024-04-24T01:43:04.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.602+0000 7f4632d2f800 1 -- start start 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.602+0000 7f4632d2f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ecd2650480 0x55ecd2652870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.602+0000 7f4632d2f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ecd250ad40 con 0x55ecd264c970 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.602+0000 7f4632d2f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55ecd24dd4d0 con 0x55ecd2650480 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.603+0000 7f462e1ad640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ecd2650480 0x55ecd2652870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.603+0000 7f462e9ae640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55ecd264c970 0x55ecd264ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56684/0 (socket says 172.21.15.131:56684) 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.603+0000 7f462e1ad640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ecd2650480 0x55ecd2652870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42542/0 (socket says 172.21.15.131:42542) 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.603+0000 7f462e9ae640 1 -- 172.21.15.131:0/575146271 learned_addr learned my addr 172.21.15.131:0/575146271 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.603+0000 7f462e1ad640 1 -- 172.21.15.131:0/575146271 >> v1:172.21.15.107:6789/0 conn(0x55ecd264c970 legacy=0x55ecd264ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.603+0000 7f462e1ad640 1 -- 172.21.15.131:0/575146271 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd2509590 con 0x55ecd2650480 2024-04-24T01:43:04.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f462e1ad640 1 --2- 172.21.15.131:0/575146271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd2650480 0x55ecd2652870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f462400a470 tx=0x7f462401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260f37c449f014fe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f462d9ac640 1 -- 172.21.15.131:0/575146271 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4624057070 con 0x55ecd2650480 2024-04-24T01:43:04.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f462d9ac640 1 -- 172.21.15.131:0/575146271 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4624052570 con 0x55ecd2650480 2024-04-24T01:43:04.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f462d9ac640 1 -- 172.21.15.131:0/575146271 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4624052870 con 0x55ecd2650480 2024-04-24T01:43:04.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f4632d2f800 1 -- 172.21.15.131:0/575146271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd2650480 msgr2=0x55ecd2652870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f4632d2f800 1 --2- 172.21.15.131:0/575146271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd2650480 0x55ecd2652870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f462400a470 tx=0x7f462401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:04.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f4632d2f800 1 -- 172.21.15.131:0/575146271 shutdown_connections 2024-04-24T01:43:04.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f4632d2f800 1 --2- 172.21.15.131:0/575146271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd2650480 0x55ecd2652870 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f4632d2f800 1 -- 172.21.15.131:0/575146271 >> 172.21.15.131:0/575146271 conn(0x55ecd26463a0 msgr2=0x55ecd26487c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f4632d2f800 1 -- 172.21.15.131:0/575146271 shutdown_connections 2024-04-24T01:43:04.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.605+0000 7f4632d2f800 1 -- 172.21.15.131:0/575146271 wait complete. 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.617+0000 7f4632d2f800 1 Processor -- start 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.617+0000 7f4632d2f800 1 -- start start 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.617+0000 7f4632d2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd264c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.617+0000 7f4632d2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ecd25973b0 con 0x55ecd264c970 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.617+0000 7f462e9ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd264c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.617+0000 7f462e9ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd264c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42558/0 (socket says 172.21.15.131:42558) 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.617+0000 7f462e9ae640 1 -- 172.21.15.131:0/2354862613 learned_addr learned my addr 172.21.15.131:0/2354862613 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.618+0000 7f462e9ae640 1 -- 172.21.15.131:0/2354862613 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd264a870 con 0x55ecd264c970 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.618+0000 7f462e9ae640 1 --2- 172.21.15.131:0/2354862613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd264c2b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4620001de0 tx=0x7f462000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1f6606c84c3238 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.618+0000 7f451ce09640 1 -- 172.21.15.131:0/2354862613 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4620012020 con 0x55ecd264c970 2024-04-24T01:43:04.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.618+0000 7f451ce09640 1 -- 172.21.15.131:0/2354862613 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462000e5a0 con 0x55ecd264c970 2024-04-24T01:43:04.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.618+0000 7f451ce09640 1 -- 172.21.15.131:0/2354862613 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f462000e8c0 con 0x55ecd264c970 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 -- 172.21.15.131:0/2354862613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 msgr2=0x55ecd264c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 --2- 172.21.15.131:0/2354862613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd264c2b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4620001de0 tx=0x7f462000b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 -- 172.21.15.131:0/2354862613 shutdown_connections 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 --2- 172.21.15.131:0/2354862613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd264c2b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 -- 172.21.15.131:0/2354862613 >> 172.21.15.131:0/2354862613 conn(0x55ecd26463a0 msgr2=0x55ecd2738a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 -- 172.21.15.131:0/2354862613 shutdown_connections 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 -- 172.21.15.131:0/2354862613 wait complete. 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 Processor -- start 2024-04-24T01:43:04.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 -- start start 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd2746ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f4632d2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ecd26550c0 con 0x55ecd264c970 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f462e9ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd2746ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f462e9ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd2746ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42570/0 (socket says 172.21.15.131:42570) 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.619+0000 7f462e9ae640 1 -- 172.21.15.131:0/234600354 learned_addr learned my addr 172.21.15.131:0/234600354 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.620+0000 7f462e9ae640 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd2747400 con 0x55ecd264c970 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.620+0000 7f462e9ae640 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd2746ec0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4620001de0 tx=0x7f4620000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.620+0000 7f451b606640 1 -- 172.21.15.131:0/234600354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4620012030 con 0x55ecd264c970 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.620+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecd2747690 con 0x55ecd264c970 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.620+0000 7f451b606640 1 -- 172.21.15.131:0/234600354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462001a7a0 con 0x55ecd264c970 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.620+0000 7f451b606640 1 -- 172.21.15.131:0/234600354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f462001aa80 con 0x55ecd264c970 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.620+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecd274a340 con 0x55ecd264c970 2024-04-24T01:43:04.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f451b606640 1 -- 172.21.15.131:0/234600354 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4620015020 con 0x55ecd264c970 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f451b606640 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4514036900 0x7f4514038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f451b606640 1 -- 172.21.15.131:0/234600354 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4620020070 con 0x55ecd264c970 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f462e1ad640 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4514036900 0x7f4514038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f4632d2f800 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd2650480 0x55ecd274e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd274e640 con 0x55ecd2650480 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f462f1af640 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd2650480 0x55ecd274e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f462e1ad640 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4514036900 0x7f4514038dc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4624054000 tx=0x7f462404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.621+0000 7f462f1af640 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd2650480 0x55ecd274e100 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.622+0000 7f462f1af640 1 -- 172.21.15.131:0/234600354 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f462800a4a0 con 0x55ecd2650480 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.622+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd274b6d0 con 0x55ecd2650480 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.622+0000 7f462f1af640 1 -- 172.21.15.131:0/234600354 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f462800a4a0 con 0x55ecd2650480 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.622+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2750470 con 0x55ecd2650480 2024-04-24T01:43:04.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.622+0000 7f462f1af640 1 -- 172.21.15.131:0/234600354 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f462800a4a0 con 0x55ecd2650480 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.622+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd274f7b0 con 0x55ecd2650480 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.623+0000 7f462f1af640 1 -- 172.21.15.131:0/234600354 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f462800a4a0 con 0x55ecd2650480 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.623+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd274fc00 con 0x55ecd2650480 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.623+0000 7f462f1af640 1 -- 172.21.15.131:0/234600354 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f462800a4a0 con 0x55ecd2650480 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.623+0000 7f4632d2f800 1 Processor -- start 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.623+0000 7f4632d2f800 1 -- start start 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f4632d2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd275f1e0 0x55ecd275f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f4632d2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ecd253d6b0 con 0x55ecd275f1e0 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f462e1ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd275f1e0 0x55ecd275f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f462e1ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd275f1e0 0x55ecd275f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42576/0 (socket says 172.21.15.131:42576) 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f462e1ad640 1 -- 172.21.15.131:0/13169616 learned_addr learned my addr 172.21.15.131:0/13169616 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f462e1ad640 1 -- 172.21.15.131:0/13169616 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd275fb40 con 0x55ecd275f1e0 2024-04-24T01:43:04.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f462e1ad640 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd275f1e0 0x55ecd275f600 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4624044840 tx=0x7f4624002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f4518e01640 1 -- 172.21.15.131:0/13169616 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f462406f070 con 0x55ecd275f1e0 2024-04-24T01:43:04.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f4518e01640 1 -- 172.21.15.131:0/13169616 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4624058040 con 0x55ecd275f1e0 2024-04-24T01:43:04.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecd27605b0 con 0x55ecd275f1e0 2024-04-24T01:43:04.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f4518e01640 1 -- 172.21.15.131:0/13169616 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4624057050 con 0x55ecd275f1e0 2024-04-24T01:43:04.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.624+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecd2760a50 con 0x55ecd275f1e0 2024-04-24T01:43:04.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.625+0000 7f4518e01640 1 -- 172.21.15.131:0/13169616 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4624072070 con 0x55ecd275f1e0 2024-04-24T01:43:04.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.625+0000 7f4518e01640 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4508036950 0x7f4508038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.625+0000 7f4518e01640 1 -- 172.21.15.131:0/13169616 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f462408f9c0 con 0x55ecd275f1e0 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.625+0000 7f462f1af640 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4508036950 0x7f4508038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f4632d2f800 1 Processor -- start 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f4632d2f800 1 -- start start 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f462f1af640 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4508036950 0x7f4508038e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55ecd274f2d0 tx=0x7f4628005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f4632d2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd276c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f4632d2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ecd264abf0 con 0x55ecd276c420 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f462e1ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd276c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f462e1ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd276c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42580/0 (socket says 172.21.15.131:42580) 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f462e1ad640 1 -- 172.21.15.131:0/253393799 learned_addr learned my addr 172.21.15.131:0/253393799 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f462e1ad640 1 -- 172.21.15.131:0/253393799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd276ce10 con 0x55ecd276c420 2024-04-24T01:43:04.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.626+0000 7f462e1ad640 1 --2- 172.21.15.131:0/253393799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd276c840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f462408dd50 tx=0x7f462408df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0aca048e7ee7284 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f45127fc640 1 -- 172.21.15.131:0/253393799 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f462408b030 con 0x55ecd276c420 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f45127fc640 1 -- 172.21.15.131:0/253393799 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462405e480 con 0x55ecd276c420 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f45127fc640 1 -- 172.21.15.131:0/253393799 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4624087b40 con 0x55ecd276c420 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 -- 172.21.15.131:0/253393799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 msgr2=0x55ecd276c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 --2- 172.21.15.131:0/253393799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd276c840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f462408dd50 tx=0x7f462408df50 comp rx=0 tx=0).stop 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 -- 172.21.15.131:0/253393799 shutdown_connections 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 --2- 172.21.15.131:0/253393799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd276c840 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 -- 172.21.15.131:0/253393799 >> 172.21.15.131:0/253393799 conn(0x55ecd2768780 msgr2=0x55ecd27667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 -- 172.21.15.131:0/253393799 shutdown_connections 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 -- 172.21.15.131:0/253393799 wait complete. 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 Processor -- start 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.627+0000 7f4632d2f800 1 -- start start 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f4632d2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd2773ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f4632d2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ecd276d580 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f462e1ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd2773ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f462e1ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd2773ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42586/0 (socket says 172.21.15.131:42586) 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 learned_addr learned my addr 172.21.15.131:0/1196457582 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd2774010 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f462e1ad640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd2773ad0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f462408dd50 tx=0x7f462408dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f4510ff9640 1 -- 172.21.15.131:0/1196457582 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4624072660 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.628+0000 7f4510ff9640 1 -- 172.21.15.131:0/1196457582 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462405fe10 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.629+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecd27742a0 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.629+0000 7f4510ff9640 1 -- 172.21.15.131:0/1196457582 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f462405de50 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.629+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecd27742a0 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.629+0000 7f4510ff9640 1 -- 172.21.15.131:0/1196457582 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f462407b020 con 0x55ecd276c420 2024-04-24T01:43:04.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.629+0000 7f4510ff9640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44f8036950 0x7f44f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.629+0000 7f4510ff9640 1 -- 172.21.15.131:0/1196457582 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f462408c070 con 0x55ecd276c420 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f462f1af640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44f8036950 0x7f44f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f462f1af640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44f8036950 0x7f44f8038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55ecd274b620 tx=0x7f462801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd277f3b0 0x55ecd2781870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2781fc0 con 0x55ecd277f3b0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f462e9ae640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd277f3b0 0x55ecd2781870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f462e9ae640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd277f3b0 0x55ecd2781870 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f4632d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f4632d2f800 20 realm 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.630+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27823d0 con 0x55ecd277f3b0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2782ca0 con 0x55ecd277f3b0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2783040 con 0x55ecd277f3b0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2783890 con 0x55ecd277f3b0 2024-04-24T01:43:04.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:04.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 20 searching for the correct realm 2024-04-24T01:43:04.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ecd2785600 0x55ecd27879f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2787fd0 con 0x55ecd2785600 2024-04-24T01:43:04.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.631+0000 7f462e1ad640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ecd2785600 0x55ecd27879f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.632+0000 7f462e1ad640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ecd2785600 0x55ecd27879f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.632+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.632+0000 7f462e1ad640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4624074060 0x7f4624002830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.632+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2787fd0 con 0x7f4624074060 2024-04-24T01:43:04.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.632+0000 7f462f1af640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4624074060 0x7f4624002830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.632+0000 7f462f1af640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4624074060 0x7f4624002830 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.633+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462801f070 con 0x7f4624074060 2024-04-24T01:43:04.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.633+0000 7f462f1af640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4628031040 0x7f4628032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.633+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2787fd0 con 0x7f4628031040 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.633+0000 7f462e9ae640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4628031040 0x7f4628032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.633+0000 7f462e9ae640 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4628031040 0x7f4628032430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.633+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x7f4628031040 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.633+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x7f4628031040 2024-04-24T01:43:04.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x7f4628031040 2024-04-24T01:43:04.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4624074060 2024-04-24T01:43:04.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.634+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462801f070 con 0x7f4624074060 2024-04-24T01:43:04.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x7f4628031040 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.635+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4624074060 2024-04-24T01:43:04.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f462801f070 con 0x7f4624074060 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x7f4628031040 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.636+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4620024980 con 0x55ecd277f3b0 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.637+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4620024980 con 0x7f4628031040 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4624074060 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462801f070 con 0x7f4624074060 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.638+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4624074060 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462801f070 con 0x7f4624074060 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd2785600 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.639+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4628031040 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x55ecd277f3b0 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4620038040 con 0x7f4624074060 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462801f070 con 0x7f4624074060 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:04.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2784210 con 0x55ecd277f3b0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.640+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2784ab0 con 0x55ecd277f3b0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2784ab0 con 0x55ecd277f3b0 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 zone default found 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 4 Realm: () 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 zonegroup default 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.641+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2788450 con 0x7f4628031040 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2789e60 con 0x55ecd2785600 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278a340 con 0x55ecd2785600 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 20 started sync module instance, tier type = 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.642+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27892d0 con 0x7f4624074060 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.643+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.643+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94475631761136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd2788f30 con 0x7f4624074060 2024-04-24T01:43:04.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.643+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278b270 con 0x55ecd277f3b0 2024-04-24T01:43:04.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.644+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94475631761136] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.644+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.644+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94475631765408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278b270 con 0x55ecd277f3b0 2024-04-24T01:43:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.645+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278bc30 con 0x55ecd2785600 2024-04-24T01:43:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.645+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.646+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94475631769472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278c500 con 0x55ecd2785600 2024-04-24T01:43:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.646+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278cfc0 con 0x7f4624074060 2024-04-24T01:43:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.646+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94475631765408] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.647+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94475631769472] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.647+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.647+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94475631771728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278adc0 con 0x7f4624074060 2024-04-24T01:43:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.647+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278d890 con 0x55ecd277f3b0 2024-04-24T01:43:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.648+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.648+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94475631776736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278d800 con 0x55ecd277f3b0 2024-04-24T01:43:04.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.648+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278e7f0 con 0x7f4628031040 2024-04-24T01:43:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.648+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94475631771728] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.649+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.649+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94475631776736] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.649+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94475631774448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278e7f0 con 0x7f4628031040 2024-04-24T01:43:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.649+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278dca0 con 0x7f4628031040 2024-04-24T01:43:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.649+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94475631774448] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.650+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.650+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94475631778976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278ed50 con 0x7f4628031040 2024-04-24T01:43:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.650+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278f710 con 0x7f4628031040 2024-04-24T01:43:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94475631778976] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94475631784544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278fb30 con 0x7f4628031040 2024-04-24T01:43:04.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 20 add_watcher() i=0 2024-04-24T01:43:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 20 add_watcher() i=1 2024-04-24T01:43:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 20 add_watcher() i=2 2024-04-24T01:43:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 20 add_watcher() i=3 2024-04-24T01:43:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 20 add_watcher() i=4 2024-04-24T01:43:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 20 add_watcher() i=5 2024-04-24T01:43:04.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.651+0000 7f4632d2f800 20 add_watcher() i=6 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.653+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94475631784544] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.653+0000 7f4632d2f800 20 add_watcher() i=7 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.653+0000 7f4632d2f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.653+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278fb30 con 0x55ecd277f3b0 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.654+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.654+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94475631785600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278faa0 con 0x55ecd277f3b0 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94475631785600] v32'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f44e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:04.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 5 note: GC not initialized 2024-04-24T01:43:04.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f445ffff640 20 reqs_thread_entry: start 2024-04-24T01:43:04.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:04.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 20 Filter name: none 2024-04-24T01:43:04.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f445dffb640 20 reqs_thread_entry: start 2024-04-24T01:43:04.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:43:04.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.655+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27c5df0 con 0x7f4628031040 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f4632d2f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f4632d2f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f4632d2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f4632d2f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.656+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27c7ed0 con 0x7f4624074060 2024-04-24T01:43:04.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27c98f0 con 0x7f4628031040 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(64 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:04.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.657+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27cae20 con 0x7f4628031040 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.658+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.658+0000 7f4632d2f800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.658+0000 7f4632d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.658+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27cb220 con 0x7f4624074060 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.659+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.659+0000 7f4632d2f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.659+0000 7f4632d2f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.659+0000 7f4632d2f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.659+0000 7f4632d2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.659+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27d0e10 con 0x7f4624074060 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f4632d2f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f4632d2f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f4632d2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94475632036128 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27ce320 con 0x7f4628031040 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== watch-notify(notify (1) cookie 94475631778976 notify 137438953478 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55ecd27c9ce0 con 0x7f4628031040 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f45127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94475631778976 notifier 4513 bl.length()=338 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f45127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f45127fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(68 notify.6 [notify cookie 94475632036128 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f45127fc640 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f44f4003ea0 con 0x7f4628031040 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.660+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== watch-notify(notify_complete (2) cookie 94475632036128 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ecd27c8e10 con 0x7f4628031040 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.661+0000 7f44e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.661+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94475631785600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd27c6840 con 0x55ecd277f3b0 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.662+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94475631785600] v32'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.662+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94475631761136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278f680 con 0x7f4624074060 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.663+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94475631761136] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.663+0000 7f4632d2f800 20 remove_watcher() i=0 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.663+0000 7f4632d2f800 2 removed watcher, disabling cache 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.663+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94475631765408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278f680 con 0x55ecd277f3b0 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.664+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94475631765408] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.664+0000 7f4632d2f800 20 remove_watcher() i=1 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.664+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94475631769472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278a7a0 con 0x55ecd2785600 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.665+0000 7f462e1ad640 1 -- 172.21.15.131:0/1196457582 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94475631769472] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4624071030 con 0x55ecd2785600 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.665+0000 7f4632d2f800 20 remove_watcher() i=2 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.665+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94475631771728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278f680 con 0x7f4624074060 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.666+0000 7f462f1af640 1 -- 172.21.15.131:0/1196457582 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94475631771728] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4628040040 con 0x7f4624074060 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.666+0000 7f4632d2f800 20 remove_watcher() i=3 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.666+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94475631776736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278c050 con 0x55ecd277f3b0 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.667+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94475631776736] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x55ecd277f3b0 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.667+0000 7f4632d2f800 20 remove_watcher() i=4 2024-04-24T01:43:04.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.667+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94475631774448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278f680 con 0x7f4628031040 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.668+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94475631774448] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.668+0000 7f4632d2f800 20 remove_watcher() i=5 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.668+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94475631778976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278d3e0 con 0x7f4628031040 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.669+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94475631778976] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.669+0000 7f4632d2f800 20 remove_watcher() i=6 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.669+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94475631784544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecd278c050 con 0x7f4628031040 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94475631784544] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462005c040 con 0x7f4628031040 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 20 remove_watcher() i=7 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4628031040 msgr2=0x7f4628032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4628031040 0x7f4628032430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd277f3b0 msgr2=0x55ecd2781870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd277f3b0 0x55ecd2781870 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4624074060 msgr2=0x7f4624002830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4624074060 0x7f4624002830 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ecd2785600 msgr2=0x55ecd27879f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.670+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ecd2785600 0x55ecd27879f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44f8036950 msgr2=0x7f44f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f44f8036950 0x7f44f8038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55ecd274b620 tx=0x7f462801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 msgr2=0x55ecd2773ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd2773ad0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f462408dd50 tx=0x7f462408dce0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f462e9ae640 1 -- 172.21.15.131:0/1196457582 reap_dead start 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 shutdown_connections 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/1196457582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd276c420 0x55ecd2773ad0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 >> 172.21.15.131:0/1196457582 conn(0x55ecd2768780 msgr2=0x55ecd2765de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 shutdown_connections 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/1196457582 wait complete. 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4508036950 msgr2=0x7f4508038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4508036950 0x7f4508038e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55ecd274f2d0 tx=0x7f4628005840 comp rx=0 tx=0).stop 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd275f1e0 msgr2=0x55ecd275f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd275f1e0 0x55ecd275f600 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4624044840 tx=0x7f4624002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 shutdown_connections 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4508036950 0x7f4508038e10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/13169616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd275f1e0 0x55ecd275f600 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 >> 172.21.15.131:0/13169616 conn(0x55ecd2753280 msgr2=0x55ecd2753680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 shutdown_connections 2024-04-24T01:43:04.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/13169616 wait complete. 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd2650480 msgr2=0x55ecd274e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd2650480 0x55ecd274e100 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4514036900 msgr2=0x7f4514038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4514036900 0x7f4514038dc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4624054000 tx=0x7f462404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 msgr2=0x55ecd2746ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.671+0000 7f4632d2f800 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd2746ec0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4620001de0 tx=0x7f4620000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.672+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 shutdown_connections 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.672+0000 7f4632d2f800 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ecd2650480 0x55ecd274e100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.672+0000 7f4632d2f800 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4514036900 0x7f4514038dc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.672+0000 7f4632d2f800 1 --2- 172.21.15.131:0/234600354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ecd264c970 0x55ecd2746ec0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.672+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 >> 172.21.15.131:0/234600354 conn(0x55ecd26463a0 msgr2=0x55ecd264b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.672+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 shutdown_connections 2024-04-24T01:43:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.672+0000 7f4632d2f800 1 -- 172.21.15.131:0/234600354 wait complete. 2024-04-24T01:43:04.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1'] 2024-04-24T01:43:04.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1'] 2024-04-24T01:43:04.701 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:04.748 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:04.748 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.747+0000 7f3ef4719800 1 Processor -- start 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.747+0000 7f3ef4719800 1 -- start start 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.747+0000 7f3ef4719800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ba527c9420 0x55ba527cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.747+0000 7f3ef4719800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba52683d40 con 0x55ba527c5910 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.747+0000 7f3ef4719800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55ba526564d0 con 0x55ba527c9420 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.748+0000 7f3ee9a1e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ba527c9420 0x55ba527cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.748+0000 7f3ef221f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55ba527c5910 0x55ba527c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56692/0 (socket says 172.21.15.131:56692) 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.748+0000 7f3ef221f640 1 -- 172.21.15.131:0/2872345385 learned_addr learned my addr 172.21.15.131:0/2872345385 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.748+0000 7f3ee9a1e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ba527c9420 0x55ba527cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42594/0 (socket says 172.21.15.131:42594) 2024-04-24T01:43:04.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.748+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/2872345385 >> v1:172.21.15.107:6789/0 conn(0x55ba527c5910 legacy=0x55ba527c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.748+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/2872345385 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba52682590 con 0x55ba527c9420 2024-04-24T01:43:04.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/2872345385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba527cb810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00a470 tx=0x7f3edc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7012ad57f446b1f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef1a1e640 1 -- 172.21.15.131:0/2872345385 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc057070 con 0x55ba527c9420 2024-04-24T01:43:04.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef1a1e640 1 -- 172.21.15.131:0/2872345385 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc052570 con 0x55ba527c9420 2024-04-24T01:43:04.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef1a1e640 1 -- 172.21.15.131:0/2872345385 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc052870 con 0x55ba527c9420 2024-04-24T01:43:04.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef4719800 1 -- 172.21.15.131:0/2872345385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 msgr2=0x55ba527cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef4719800 1 --2- 172.21.15.131:0/2872345385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba527cb810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00a470 tx=0x7f3edc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:04.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef4719800 1 -- 172.21.15.131:0/2872345385 shutdown_connections 2024-04-24T01:43:04.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef4719800 1 --2- 172.21.15.131:0/2872345385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba527cb810 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef4719800 1 -- 172.21.15.131:0/2872345385 >> 172.21.15.131:0/2872345385 conn(0x55ba527bf340 msgr2=0x55ba527c1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef4719800 1 -- 172.21.15.131:0/2872345385 shutdown_connections 2024-04-24T01:43:04.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.750+0000 7f3ef4719800 1 -- 172.21.15.131:0/2872345385 wait complete. 2024-04-24T01:43:04.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.762+0000 7f3ef4719800 1 Processor -- start 2024-04-24T01:43:04.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.762+0000 7f3ef4719800 1 -- start start 2024-04-24T01:43:04.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.762+0000 7f3ef4719800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c5910 0x55ba528b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.762+0000 7f3ef4719800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ba527103e0 con 0x55ba527c5910 2024-04-24T01:43:04.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3ef221f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c5910 0x55ba528b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3ef221f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c5910 0x55ba528b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42606/0 (socket says 172.21.15.131:42606) 2024-04-24T01:43:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3ef221f640 1 -- 172.21.15.131:0/2289046788 learned_addr learned my addr 172.21.15.131:0/2289046788 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3ef221f640 1 -- 172.21.15.131:0/2289046788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba528b6740 con 0x55ba527c5910 2024-04-24T01:43:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3ef221f640 1 --2- 172.21.15.131:0/2289046788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c5910 0x55ba528b6170 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4001d50 tx=0x7f3ee400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c90f77b10bf755 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3de0608640 1 -- 172.21.15.131:0/2289046788 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ee4013030 con 0x55ba527c5910 2024-04-24T01:43:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3de0608640 1 -- 172.21.15.131:0/2289046788 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee400e470 con 0x55ba527c5910 2024-04-24T01:43:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.763+0000 7f3de0608640 1 -- 172.21.15.131:0/2289046788 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ee400e810 con 0x55ba527c5910 2024-04-24T01:43:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 -- 172.21.15.131:0/2289046788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c5910 msgr2=0x55ba528b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 --2- 172.21.15.131:0/2289046788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c5910 0x55ba528b6170 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4001d50 tx=0x7f3ee400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 -- 172.21.15.131:0/2289046788 shutdown_connections 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 --2- 172.21.15.131:0/2289046788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c5910 0x55ba528b6170 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 -- 172.21.15.131:0/2289046788 >> 172.21.15.131:0/2289046788 conn(0x55ba527bf340 msgr2=0x55ba528b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 -- 172.21.15.131:0/2289046788 shutdown_connections 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 -- 172.21.15.131:0/2289046788 wait complete. 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 Processor -- start 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 -- start start 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.764+0000 7f3ef4719800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba528bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef4719800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ba527cc050 con 0x55ba527c9420 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef221f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba528bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef221f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba528bdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42618/0 (socket says 172.21.15.131:42618) 2024-04-24T01:43:04.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef221f640 1 -- 172.21.15.131:0/1762200876 learned_addr learned my addr 172.21.15.131:0/1762200876 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef221f640 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba528be430 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef221f640 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba528bdef0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55ba528b6f00 tx=0x7f3ee4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ddee05640 1 -- 172.21.15.131:0/1762200876 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ee4027070 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ddee05640 1 -- 172.21.15.131:0/1762200876 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee40013d0 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ddee05640 1 -- 172.21.15.131:0/1762200876 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ee40199e0 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba528be6c0 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.765+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba528c1370 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.766+0000 7f3ddee05640 1 -- 172.21.15.131:0/1762200876 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ee402a070 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.766+0000 7f3ddee05640 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dd8036900 0x7f3dd8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.766+0000 7f3ddee05640 1 -- 172.21.15.131:0/1762200876 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3ee401f070 con 0x55ba527c9420 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.766+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dd8036900 0x7f3dd8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.766+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528c3120 0x55ba528c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.767+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528c5a50 con 0x55ba528c3120 2024-04-24T01:43:04.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.767+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528c3120 0x55ba528c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.767+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dd8036900 0x7f3dd8038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3edc054000 tx=0x7f3edc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.767+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528c3120 0x55ba528c5510 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.767+0000 7f3ef2a20640 1 -- 172.21.15.131:0/1762200876 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3eec00a4a0 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.767+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528c2700 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.768+0000 7f3ef2a20640 1 -- 172.21.15.131:0/1762200876 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3eec00a4a0 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.768+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528c7890 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.768+0000 7f3ef2a20640 1 -- 172.21.15.131:0/1762200876 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3eec00a4a0 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.768+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528c6bd0 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.768+0000 7f3ef2a20640 1 -- 172.21.15.131:0/1762200876 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3eec00a4a0 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.768+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528c7020 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ef2a20640 1 -- 172.21.15.131:0/1762200876 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3eec00a4a0 con 0x55ba528c3120 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ef4719800 1 Processor -- start 2024-04-24T01:43:04.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ef4719800 1 -- start start 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ef4719800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528d6660 0x55ba528d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ef4719800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ba526b66b0 con 0x55ba528d6660 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ee9a1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528d6660 0x55ba528d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ee9a1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528d6660 0x55ba528d6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42628/0 (socket says 172.21.15.131:42628) 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.769+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/1893869910 learned_addr learned my addr 172.21.15.131:0/1893869910 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.770+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/1893869910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba528d6fc0 con 0x55ba528d6660 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.770+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528d6660 0x55ba528d6a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3edc01ced0 tx=0x7f3edc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.770+0000 7f3dd7fff640 1 -- 172.21.15.131:0/1893869910 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc06f070 con 0x55ba528d6660 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.770+0000 7f3dd7fff640 1 -- 172.21.15.131:0/1893869910 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc058040 con 0x55ba528d6660 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.770+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba528d7a30 con 0x55ba528d6660 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.770+0000 7f3dd7fff640 1 -- 172.21.15.131:0/1893869910 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc057050 con 0x55ba528d6660 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.770+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba528d7ed0 con 0x55ba528d6660 2024-04-24T01:43:04.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3dd7fff640 1 -- 172.21.15.131:0/1893869910 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3edc072070 con 0x55ba528d6660 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3dd7fff640 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dcc036950 0x7f3dcc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3dd7fff640 1 -- 172.21.15.131:0/1893869910 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3edc08f900 con 0x55ba528d6660 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dcc036950 0x7f3dcc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ef4719800 1 Processor -- start 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ef4719800 1 -- start start 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dcc036950 0x7f3dcc038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ba528c66f0 tx=0x7f3eec005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ef4719800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ef4719800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ba528b6ac0 con 0x55ba528e38c0 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ee9a1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ee9a1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528e3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42636/0 (socket says 172.21.15.131:42636) 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.771+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/2115218481 learned_addr learned my addr 172.21.15.131:0/2115218481 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/2115218481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba528e42b0 con 0x55ba528e38c0 2024-04-24T01:43:04.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/2115218481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528e3ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3edc05f450 tx=0x7f3edc05da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308255e8b7a383c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3dd5ffb640 1 -- 172.21.15.131:0/2115218481 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc07f040 con 0x55ba528e38c0 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3dd5ffb640 1 -- 172.21.15.131:0/2115218481 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc08de50 con 0x55ba528e38c0 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3dd5ffb640 1 -- 172.21.15.131:0/2115218481 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc05e800 con 0x55ba528e38c0 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ef4719800 1 -- 172.21.15.131:0/2115218481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 msgr2=0x55ba528e3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ef4719800 1 --2- 172.21.15.131:0/2115218481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528e3ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3edc05f450 tx=0x7f3edc05da10 comp rx=0 tx=0).stop 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ef4719800 1 -- 172.21.15.131:0/2115218481 shutdown_connections 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ef4719800 1 --2- 172.21.15.131:0/2115218481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528e3ce0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ef4719800 1 -- 172.21.15.131:0/2115218481 >> 172.21.15.131:0/2115218481 conn(0x55ba528dfc20 msgr2=0x55ba528ddc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.772+0000 7f3ef4719800 1 -- 172.21.15.131:0/2115218481 shutdown_connections 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ef4719800 1 -- 172.21.15.131:0/2115218481 wait complete. 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ef4719800 1 Processor -- start 2024-04-24T01:43:04.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ef4719800 1 -- start start 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ef4719800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ef4719800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ba528e4a20 con 0x55ba528e38c0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ee9a1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ee9a1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42648/0 (socket says 172.21.15.131:42648) 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 learned_addr learned my addr 172.21.15.131:0/786334675 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.773+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba528eb400 con 0x55ba528e38c0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.774+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528eaec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3edc08cc80 tx=0x7f3edc08dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.774+0000 7f3dc3fff640 1 -- 172.21.15.131:0/786334675 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc08fcc0 con 0x55ba528e38c0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.774+0000 7f3dc3fff640 1 -- 172.21.15.131:0/786334675 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc094070 con 0x55ba528e38c0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.774+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba528eb690 con 0x55ba528e38c0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.774+0000 7f3dc3fff640 1 -- 172.21.15.131:0/786334675 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc06aab0 con 0x55ba528e38c0 2024-04-24T01:43:04.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.774+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba528ee340 con 0x55ba528e38c0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3dc3fff640 1 -- 172.21.15.131:0/786334675 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3edc06ac50 con 0x55ba528e38c0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3dc3fff640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dbc036950 0x7f3dbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3dc3fff640 1 -- 172.21.15.131:0/786334675 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3edc08c050 con 0x55ba528e38c0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dbc036950 0x7f3dbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528f69c0 0x55ba528f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528f95d0 con 0x55ba528f69c0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dbc036950 0x7f3dbc038e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55ba528c2650 tx=0x7f3eec01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.775+0000 7f3ef221f640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528f69c0 0x55ba528f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef221f640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528f69c0 0x55ba528f8e80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 20 realm 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528f99e0 con 0x55ba528f69c0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.776+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528fa2b0 con 0x55ba528f69c0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528fa650 con 0x55ba528f69c0 2024-04-24T01:43:04.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528faea0 con 0x55ba528f69c0 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 20 searching for the correct realm 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ba528fcc10 0x55ba528ff000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.777+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ba528fcc10 0x55ba528ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.778+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ba528fcc10 0x55ba528ff000 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.778+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.778+0000 7f3ee9a1e640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3edc074060 0x7f3edc098820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.778+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3edc074060 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.778+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3edc074060 0x7f3edc098820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.778+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3edc074060 0x7f3edc098820 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.779+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eec01f070 con 0x7f3edc074060 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.779+0000 7f3ef2a20640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3eec031040 0x7f3eec032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.779+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.779+0000 7f3ef221f640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3eec031040 0x7f3eec032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.779+0000 7f3ef221f640 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3eec031040 0x7f3eec032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.780+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3edc074060 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eec01f070 con 0x7f3edc074060 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.781+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.782+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.782+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.782+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.782+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3edc074060 2024-04-24T01:43:04.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.782+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3eec01f070 con 0x7f3edc074060 2024-04-24T01:43:04.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.782+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.783+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.784+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.784+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.785+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.785+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.785+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.785+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.786+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.786+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.786+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.786+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3edc074060 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.786+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eec01f070 con 0x7f3edc074060 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.786+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.787+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3edc074060 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.788+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eec01f070 con 0x7f3edc074060 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.788+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528fcc10 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.788+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.788+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3eec031040 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.788+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.788+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x55ba528f69c0 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ff610 con 0x7f3edc074060 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eec01f070 con 0x7f3edc074060 2024-04-24T01:43:04.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.789+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528fb820 con 0x55ba528f69c0 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528fc0c0 con 0x55ba528f69c0 2024-04-24T01:43:04.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528fc0c0 con 0x55ba528f69c0 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 20 zone default found 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 4 Realm: () 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.790+0000 7f3ef4719800 20 zonegroup default 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba528ffa90 con 0x7f3eec031040 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba52901470 con 0x55ba528fcc10 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.791+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba52901900 con 0x55ba528fcc10 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.792+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.792+0000 7f3ef4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.792+0000 7f3ef4719800 20 started sync module instance, tier type = 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.792+0000 7f3ef4719800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:04.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.792+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52900910 con 0x7f3edc074060 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.793+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.793+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94258737450288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52900570 con 0x7f3edc074060 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.793+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52902830 con 0x55ba528f69c0 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.794+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94258737450288] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.794+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.794+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94258737454432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52902830 con 0x55ba528f69c0 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.794+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52903250 con 0x55ba528fcc10 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.795+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.795+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94258737458496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52903af0 con 0x55ba528fcc10 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.795+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52904570 con 0x7f3edc074060 2024-04-24T01:43:04.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.795+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94258737454432] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.796+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94258737458496] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.796+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.796+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94258737460800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52902380 con 0x7f3edc074060 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.796+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52904e40 con 0x55ba528f69c0 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.797+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94258737460800] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.797+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.797+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94258737463392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52904e40 con 0x55ba528f69c0 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.797+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba529058c0 con 0x7f3eec031040 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.798+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.798+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94258737468368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba529057f0 con 0x7f3eec031040 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.798+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba529067a0 con 0x7f3eec031040 2024-04-24T01:43:04.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.798+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94258737463392] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.799+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.799+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94258737472208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba529067a0 con 0x7f3eec031040 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.799+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba529071c0 con 0x7f3eec031040 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.799+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94258737468368] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94258737472208] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94258737465744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52905c60 con 0x7f3eec031040 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 20 add_watcher() i=0 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 20 add_watcher() i=1 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 20 add_watcher() i=2 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 20 add_watcher() i=3 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 20 add_watcher() i=4 2024-04-24T01:43:04.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 20 add_watcher() i=5 2024-04-24T01:43:04.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.800+0000 7f3ef4719800 20 add_watcher() i=6 2024-04-24T01:43:04.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.801+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94258737465744] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.801+0000 7f3ef4719800 20 add_watcher() i=7 2024-04-24T01:43:04.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.801+0000 7f3ef4719800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:04.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.801+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5290a1b0 con 0x55ba528f69c0 2024-04-24T01:43:04.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.802+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.802+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94258737474736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52907630 con 0x55ba528f69c0 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94258737474736] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3da8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 5 note: GC not initialized 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3d237fe640 20 reqs_thread_entry: start 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 20 Filter name: none 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3d217fa640 20 reqs_thread_entry: start 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:04.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.803+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5293d3e0 con 0x55ba528f69c0 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5293f4c0 con 0x7f3edc074060 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:04.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.804+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba52940dd0 con 0x7f3eec031040 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(64 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T01:43:04.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.805+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52945580 con 0x7f3eec031040 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.806+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.806+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5294b440 con 0x7f3eec031040 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.807+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(66 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.807+0000 7f3ef4719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.807+0000 7f3ef4719800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.807+0000 7f3ef4719800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.807+0000 7f3ef4719800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.807+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94258737714320 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba529459b0 con 0x7f3eec031040 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== watch-notify(notify (1) cookie 94258737468368 notify 137438953479 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55ba529411c0 con 0x7f3eec031040 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94258737468368 notifier 4520 bl.length()=752 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:04.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(67 notify.5 [notify cookie 94258737714320 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3dd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3dd5ffb640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3db8003ea0 con 0x7f3eec031040 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== watch-notify(notify_complete (2) cookie 94258737714320 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba529402f0 con 0x7f3eec031040 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef4719800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_sources= new_sources= 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef4719800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential sources added=[] removed=[] 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef4719800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_dests= new_dests= 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef4719800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential dests added=[] removed=[] 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.808+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52949ca0 con 0x7f3edc074060 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.809+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.809+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52941470 con 0x7f3edc074060 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.810+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.810+0000 7f3ef4719800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.810+0000 7f3ef4719800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.810+0000 7f3ef4719800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.810+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94258737714288 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5294a150 con 0x7f3eec031040 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== watch-notify(notify (1) cookie 94258737472208 notify 137438953480 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55ba528c1370 con 0x7f3eec031040 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94258737472208 notifier 4520 bl.length()=314 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(71 notify.6 [notify cookie 94258737714288 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3dd5ffb640 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3db8003ea0 con 0x7f3eec031040 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.811+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== watch-notify(notify_complete (2) cookie 94258737714288 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba528be6c0 con 0x7f3eec031040 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.812+0000 7f3da8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.812+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94258737474736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52942020 con 0x55ba528f69c0 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.813+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94258737474736] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.813+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94258737450288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52906cb0 con 0x7f3edc074060 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.814+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94258737450288] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.814+0000 7f3ef4719800 20 remove_watcher() i=0 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.814+0000 7f3ef4719800 2 removed watcher, disabling cache 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.814+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94258737454432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52906cb0 con 0x55ba528f69c0 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.815+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94258737454432] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.815+0000 7f3ef4719800 20 remove_watcher() i=1 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.815+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94258737458496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52906cb0 con 0x55ba528fcc10 2024-04-24T01:43:04.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.816+0000 7f3ee9a1e640 1 -- 172.21.15.131:0/786334675 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94258737458496] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc071030 con 0x55ba528fcc10 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.816+0000 7f3ef4719800 20 remove_watcher() i=2 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.816+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94258737460800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52902d40 con 0x7f3edc074060 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.817+0000 7f3ef2a20640 1 -- 172.21.15.131:0/786334675 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94258737460800] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eec040040 con 0x7f3edc074060 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.817+0000 7f3ef4719800 20 remove_watcher() i=3 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.817+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94258737463392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52903640 con 0x55ba528f69c0 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.818+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94258737463392] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x55ba528f69c0 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.818+0000 7f3ef4719800 20 remove_watcher() i=4 2024-04-24T01:43:04.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.818+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94258737468368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52902d40 con 0x7f3eec031040 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.819+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94258737468368] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.819+0000 7f3ef4719800 20 remove_watcher() i=5 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.819+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94258737472208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52903640 con 0x7f3eec031040 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.820+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94258737472208] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.820+0000 7f3ef4719800 20 remove_watcher() i=6 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.820+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94258737465744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba52902d40 con 0x7f3eec031040 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94258737465744] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee4029030 con 0x7f3eec031040 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 20 remove_watcher() i=7 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3eec031040 msgr2=0x7f3eec032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3eec031040 0x7f3eec032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528f69c0 msgr2=0x55ba528f8e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528f69c0 0x55ba528f8e80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3edc074060 msgr2=0x7f3edc098820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3edc074060 0x7f3edc098820 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ba528fcc10 msgr2=0x55ba528ff000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ba528fcc10 0x55ba528ff000 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dbc036950 msgr2=0x7f3dbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dbc036950 0x7f3dbc038e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55ba528c2650 tx=0x7f3eec01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 msgr2=0x55ba528eaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528eaec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3edc08cc80 tx=0x7f3edc08dca0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef221f640 1 -- 172.21.15.131:0/786334675 reap_dead start 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 shutdown_connections 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 --2- 172.21.15.131:0/786334675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528e38c0 0x55ba528eaec0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.821+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 >> 172.21.15.131:0/786334675 conn(0x55ba528dfc20 msgr2=0x55ba528dd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 shutdown_connections 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/786334675 wait complete. 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dcc036950 msgr2=0x7f3dcc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dcc036950 0x7f3dcc038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ba528c66f0 tx=0x7f3eec005840 comp rx=0 tx=0).stop 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528d6660 msgr2=0x55ba528d6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528d6660 0x55ba528d6a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3edc01ced0 tx=0x7f3edc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 shutdown_connections 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dcc036950 0x7f3dcc038e10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1893869910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba528d6660 0x55ba528d6a80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 >> 172.21.15.131:0/1893869910 conn(0x55ba528ca700 msgr2=0x55ba528cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 shutdown_connections 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.822+0000 7f3ef4719800 1 -- 172.21.15.131:0/1893869910 wait complete. 2024-04-24T01:43:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528c3120 msgr2=0x55ba528c5510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528c3120 0x55ba528c5510 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dd8036900 msgr2=0x7f3dd8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dd8036900 0x7f3dd8038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3edc054000 tx=0x7f3edc04e000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 msgr2=0x55ba528bdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba528bdef0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55ba528b6f00 tx=0x7f3ee4000bc0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 shutdown_connections 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ba528c3120 0x55ba528c5510 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3dd8036900 0x7f3dd8038dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 --2- 172.21.15.131:0/1762200876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba527c9420 0x55ba528bdef0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 >> 172.21.15.131:0/1762200876 conn(0x55ba527bf340 msgr2=0x55ba528b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 shutdown_connections 2024-04-24T01:43:04.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.823+0000 7f3ef4719800 1 -- 172.21.15.131:0/1762200876 wait complete. 2024-04-24T01:43:04.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T01:43:04.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T01:43:04.836 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T01:43:04.878 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:04.879 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c519a2800 1 Processor -- start 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c519a2800 1 -- start start 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c519a2800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5594d47b12a0 0x5594d47b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c519a2800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594d466fd40 con 0x5594d47af760 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c519a2800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5594d46424d0 con 0x5594d47b12a0 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c4eca7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5594d47b12a0 0x5594d47b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c4eca7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5594d47b12a0 0x5594d47b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42658/0 (socket says 172.21.15.131:42658) 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2869040868 learned_addr learned my addr 172.21.15.131:0/2869040868 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2869040868 >> v1:172.21.15.107:6789/0 conn(0x5594d47af760 legacy=0x5594d47afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.878+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2869040868 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d466e590 con 0x5594d47b12a0 2024-04-24T01:43:04.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.880+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/2869040868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47b12a0 0x5594d47b9da0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400a520 tx=0x7f3c4401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05e6c242ca46018 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.880+0000 7f3c4e4a6640 1 -- 172.21.15.131:0/2869040868 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44057070 con 0x5594d47b12a0 2024-04-24T01:43:04.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.880+0000 7f3c4e4a6640 1 -- 172.21.15.131:0/2869040868 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c44052440 con 0x5594d47b12a0 2024-04-24T01:43:04.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.880+0000 7f3c4e4a6640 1 -- 172.21.15.131:0/2869040868 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4404ae60 con 0x5594d47b12a0 2024-04-24T01:43:04.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.881+0000 7f3c519a2800 1 -- 172.21.15.131:0/2869040868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47b12a0 msgr2=0x5594d47b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.881+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2869040868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47b12a0 0x5594d47b9da0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400a520 tx=0x7f3c4401d010 comp rx=0 tx=0).stop 2024-04-24T01:43:04.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.881+0000 7f3c519a2800 1 -- 172.21.15.131:0/2869040868 shutdown_connections 2024-04-24T01:43:04.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.881+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2869040868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47b12a0 0x5594d47b9da0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.881+0000 7f3c519a2800 1 -- 172.21.15.131:0/2869040868 >> 172.21.15.131:0/2869040868 conn(0x5594d47ab380 msgr2=0x5594d47ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.881+0000 7f3c519a2800 1 -- 172.21.15.131:0/2869040868 shutdown_connections 2024-04-24T01:43:04.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.881+0000 7f3c519a2800 1 -- 172.21.15.131:0/2869040868 wait complete. 2024-04-24T01:43:04.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.892+0000 7f3c519a2800 1 Processor -- start 2024-04-24T01:43:04.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.892+0000 7f3c519a2800 1 -- start start 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.893+0000 7f3c519a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48a4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.893+0000 7f3c519a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5594d46fc3c0 con 0x5594d47af760 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.893+0000 7f3c4f4a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.893+0000 7f3c4f4a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48a4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42668/0 (socket says 172.21.15.131:42668) 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.893+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/4031649918 learned_addr learned my addr 172.21.15.131:0/4031649918 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.893+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/4031649918 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d48a4a50 con 0x5594d47af760 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.893+0000 7f3c4f4a8640 1 --2- 172.21.15.131:0/4031649918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48a4480 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3c40001cd0 tx=0x7f3c4000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b3c9bd32349f24 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3b3d60a640 1 -- 172.21.15.131:0/4031649918 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4000be10 con 0x5594d47af760 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3b3d60a640 1 -- 172.21.15.131:0/4031649918 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4000f400 con 0x5594d47af760 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3b3d60a640 1 -- 172.21.15.131:0/4031649918 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4000f720 con 0x5594d47af760 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3c519a2800 1 -- 172.21.15.131:0/4031649918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 msgr2=0x5594d48a4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4031649918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48a4480 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3c40001cd0 tx=0x7f3c4000b5b0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3c519a2800 1 -- 172.21.15.131:0/4031649918 shutdown_connections 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4031649918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48a4480 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3c519a2800 1 -- 172.21.15.131:0/4031649918 >> 172.21.15.131:0/4031649918 conn(0x5594d47ab380 msgr2=0x5594d489fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3c519a2800 1 -- 172.21.15.131:0/4031649918 shutdown_connections 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.894+0000 7f3c519a2800 1 -- 172.21.15.131:0/4031649918 wait complete. 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c519a2800 1 Processor -- start 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c519a2800 1 -- start start 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c519a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c519a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5594d47bc5c0 con 0x5594d47af760 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c4f4a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c4f4a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42684/0 (socket says 172.21.15.131:42684) 2024-04-24T01:43:04.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/4152995997 learned_addr learned my addr 172.21.15.131:0/4152995997 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.895+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d48ac570 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.896+0000 7f3c4f4a8640 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48ac030 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b5f0 tx=0x7f3c40000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.896+0000 7f3b3be07640 1 -- 172.21.15.131:0/4152995997 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4001a7c0 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.896+0000 7f3b3be07640 1 -- 172.21.15.131:0/4152995997 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4001a960 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.896+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594d48ac800 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.896+0000 7f3b3be07640 1 -- 172.21.15.131:0/4152995997 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4001ac60 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.896+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d48af4b0 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.896+0000 7f3b3be07640 1 -- 172.21.15.131:0/4152995997 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3c40017070 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3b3be07640 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b34036900 0x7f3b34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3b3be07640 1 -- 172.21.15.131:0/4152995997 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3c40015020 con 0x5594d47af760 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b34036900 0x7f3b34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d47b12a0 0x5594d48b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48b3840 con 0x5594d47b12a0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d47b12a0 0x5594d48b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b34036900 0x7f3b34038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c44054000 tx=0x7f3c4404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.897+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d47b12a0 0x5594d48b3270 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.898+0000 7f3c4fca9640 1 -- 172.21.15.131:0/4152995997 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c4800a4a0 con 0x5594d47b12a0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.898+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48b0840 con 0x5594d47b12a0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.898+0000 7f3c4fca9640 1 -- 172.21.15.131:0/4152995997 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c4800a4a0 con 0x5594d47b12a0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.898+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48b5660 con 0x5594d47b12a0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.898+0000 7f3c4fca9640 1 -- 172.21.15.131:0/4152995997 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c4800a4a0 con 0x5594d47b12a0 2024-04-24T01:43:04.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.898+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48b49a0 con 0x5594d47b12a0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.899+0000 7f3c4fca9640 1 -- 172.21.15.131:0/4152995997 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c4800a4a0 con 0x5594d47b12a0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.899+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48b4df0 con 0x5594d47b12a0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.899+0000 7f3c4fca9640 1 -- 172.21.15.131:0/4152995997 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c4800a4a0 con 0x5594d47b12a0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.899+0000 7f3c519a2800 1 Processor -- start 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.899+0000 7f3c519a2800 1 -- start start 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.899+0000 7f3c519a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48c43d0 0x5594d48c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.899+0000 7f3c519a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5594d46a26b0 con 0x5594d48c43d0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3c4eca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48c43d0 0x5594d48c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3c4eca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48c43d0 0x5594d48c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42694/0 (socket says 172.21.15.131:42694) 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2694290509 learned_addr learned my addr 172.21.15.131:0/2694290509 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2694290509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d48c4d30 con 0x5594d48c43d0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48c43d0 0x5594d48c47f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3c44055040 tx=0x7f3c44002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3b39602640 1 -- 172.21.15.131:0/2694290509 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44057040 con 0x5594d48c43d0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3b39602640 1 -- 172.21.15.131:0/2694290509 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4405d630 con 0x5594d48c43d0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594d48c57a0 con 0x5594d48c43d0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3b39602640 1 -- 172.21.15.131:0/2694290509 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4405d910 con 0x5594d48c43d0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.900+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d48c5c40 con 0x5594d48c43d0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.901+0000 7f3b39602640 1 -- 172.21.15.131:0/2694290509 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3c44067070 con 0x5594d48c43d0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.901+0000 7f3b39602640 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b28036950 0x7f3b28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.901+0000 7f3b39602640 1 -- 172.21.15.131:0/2694290509 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3c4408f4a0 con 0x5594d48c43d0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.901+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b28036950 0x7f3b28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.901+0000 7f3c519a2800 1 Processor -- start 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.901+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b28036950 0x7f3b28038e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5594d48b44c0 tx=0x7f3c48005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.901+0000 7f3c519a2800 1 -- start start 2024-04-24T01:43:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3c519a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3c519a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5594d48a4dd0 con 0x5594d48d1650 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3c4eca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3c4eca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42710/0 (socket says 172.21.15.131:42710) 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2255458958 learned_addr learned my addr 172.21.15.131:0/2255458958 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2255458958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d48d2040 con 0x5594d48d1650 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/2255458958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d1a70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3c4408d830 tx=0x7f3c44000f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1579c59b0551c77c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3b32ffd640 1 -- 172.21.15.131:0/2255458958 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44082070 con 0x5594d48d1650 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3b32ffd640 1 -- 172.21.15.131:0/2255458958 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c44071400 con 0x5594d48d1650 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.902+0000 7f3b32ffd640 1 -- 172.21.15.131:0/2255458958 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4408b070 con 0x5594d48d1650 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 -- 172.21.15.131:0/2255458958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 msgr2=0x5594d48d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2255458958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d1a70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3c4408d830 tx=0x7f3c44000f90 comp rx=0 tx=0).stop 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 -- 172.21.15.131:0/2255458958 shutdown_connections 2024-04-24T01:43:04.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2255458958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d1a70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 -- 172.21.15.131:0/2255458958 >> 172.21.15.131:0/2255458958 conn(0x5594d48cd9b0 msgr2=0x5594d48cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 -- 172.21.15.131:0/2255458958 shutdown_connections 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 -- 172.21.15.131:0/2255458958 wait complete. 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 Processor -- start 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 -- start start 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c519a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5594d48d27b0 con 0x5594d48d1650 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c4eca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c4eca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42726/0 (socket says 172.21.15.131:42726) 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.903+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 learned_addr learned my addr 172.21.15.131:0/2316682619 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.904+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d48d9270 con 0x5594d48d1650 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.904+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d8d30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000fd0 tx=0x7f3c4408d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.904+0000 7f3b317fa640 1 -- 172.21.15.131:0/2316682619 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44093020 con 0x5594d48d1650 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.904+0000 7f3b317fa640 1 -- 172.21.15.131:0/2316682619 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c44067840 con 0x5594d48d1650 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.904+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594d48d9500 con 0x5594d48d1650 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.904+0000 7f3b317fa640 1 -- 172.21.15.131:0/2316682619 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4408b030 con 0x5594d48d1650 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.904+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d48dc1b0 con 0x5594d48d1650 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3b317fa640 1 -- 172.21.15.131:0/2316682619 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3c44096020 con 0x5594d48d1650 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3b317fa640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b18036950 0x7f3b18038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3b317fa640 1 -- 172.21.15.131:0/2316682619 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3c44099c40 con 0x5594d48d1650 2024-04-24T01:43:04.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b18036950 0x7f3b18038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b18036950 0x7f3b18038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5594d48b0790 tx=0x7f3c4801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d48e4880 0x5594d48e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.905+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e7490 con 0x5594d48e4880 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c4f4a8640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d48e4880 0x5594d48e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c4f4a8640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d48e4880 0x5594d48e6d40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 20 realm 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e78a0 con 0x5594d48e4880 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e8170 con 0x5594d48e4880 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.906+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e8510 con 0x5594d48e4880 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c519a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e8d60 con 0x5594d48e4880 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c519a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c519a2800 20 searching for the correct realm 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5594d48eaad0 0x5594d48ecec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5594d48eaad0 0x5594d48ecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.907+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5594d48eaad0 0x5594d48ecec0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4eca7640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3c440a3040 0x7f3c4405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c440a3040 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3c440a3040 0x7f3c4405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3c440a3040 0x7f3c4405c610 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4801f070 con 0x7f3c440a3040 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4fca9640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3c48031040 0x7f3c48032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.908+0000 7f3c4f4a8640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3c48031040 0x7f3c48032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.909+0000 7f3c4f4a8640 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3c48031040 0x7f3c48032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.909+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.909+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c440a3040 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4801f070 con 0x7f3c440a3040 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.910+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.911+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c440a3040 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c4801f070 con 0x7f3c440a3040 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.912+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.913+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c440a3040 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4801f070 con 0x7f3c440a3040 2024-04-24T01:43:04.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x5594d48e4880 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.914+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4002e070 con 0x7f3c48031040 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c440a3040 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4801f070 con 0x7f3c440a3040 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48eaad0 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.915+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c48031040 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.916+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.916+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x5594d48e4880 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.916+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.916+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed4d0 con 0x7f3c440a3040 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4801f070 con 0x7f3c440a3040 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:04.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e96e0 con 0x5594d48e4880 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e9f80 con 0x5594d48e4880 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48e9f80 con 0x5594d48e4880 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:04.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 zone default found 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 4 Realm: () 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 zonegroup default 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.917+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ed950 con 0x7f3c48031040 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ef330 con 0x5594d48eaad0 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ef800 con 0x5594d48eaad0 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 20 started sync module instance, tier type = 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.918+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48ee7d0 con 0x7f3c440a3040 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.919+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.919+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94097709657024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f0110 con 0x7f3c440a3040 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.919+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f0960 con 0x5594d48e4880 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.920+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94097709657024] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.921+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.921+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94097709661280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f05b0 con 0x5594d48e4880 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.921+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f10a0 con 0x5594d48eaad0 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.922+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94097709661280] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.922+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.922+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94097709665136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f1490 con 0x5594d48eaad0 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.922+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f1e90 con 0x7f3c440a3040 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.923+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94097709665136] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.923+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.923+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94097709662336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f2280 con 0x7f3c440a3040 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.923+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f2cc0 con 0x5594d48e4880 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.924+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94097709662336] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.924+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.924+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94097709672336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f2c80 con 0x5594d48e4880 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.924+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f36f0 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.925+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94097709672336] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.925+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.925+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94097709675040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f36f0 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.925+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f4130 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.926+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.926+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94097709677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f4590 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.926+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f5080 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.926+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94097709675040] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94097709677696] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94097709681488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f40a0 con 0x7f3c48031040 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 20 add_watcher() i=0 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 20 add_watcher() i=1 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 20 add_watcher() i=2 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 20 add_watcher() i=3 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 20 add_watcher() i=4 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 20 add_watcher() i=5 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.927+0000 7f3c519a2800 20 add_watcher() i=6 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.928+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94097709681488] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.928+0000 7f3c519a2800 20 add_watcher() i=7 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.928+0000 7f3c519a2800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.928+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f8070 con 0x5594d48e4880 2024-04-24T01:43:04.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.928+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.928+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94097709668768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f54f0 con 0x5594d48e4880 2024-04-24T01:43:04.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.929+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94097709668768] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.930+0000 7f3b05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.930+0000 7f3c519a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:04.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.930+0000 7f3c519a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:04.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.930+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d49008f0 con 0x5594d48e4880 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.931+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'47 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.931+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4900fc0 con 0x7f3c48031040 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.932+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.932+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4900fc0 con 0x5594d48eaad0 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.933+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.933+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4901810 con 0x5594d48e4880 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.934+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'128 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.934+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d49000d0 con 0x7f3c440a3040 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.935+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.935+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d49000d0 con 0x5594d48eaad0 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.936+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.936+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4901e90 con 0x5594d48e4880 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.937+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.937+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4901e90 con 0x7f3c48031040 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.938+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.938+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4901e90 con 0x7f3c440a3040 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.939+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.940+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902400 con 0x5594d48eaad0 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.940+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.940+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d49027e0 con 0x7f3c440a3040 2024-04-24T01:43:04.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.941+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.941+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902bd0 con 0x7f3c48031040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.942+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.942+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902bd0 con 0x7f3c440a3040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.943+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.943+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902bd0 con 0x7f3c48031040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.944+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'41 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.944+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902ca0 con 0x5594d48e4880 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.945+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'129 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.945+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902c60 con 0x5594d48eaad0 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.946+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.946+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902cf0 con 0x7f3c440a3040 2024-04-24T01:43:04.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.947+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.947+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902cf0 con 0x5594d48eaad0 2024-04-24T01:43:04.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.948+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.949+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902cf0 con 0x5594d48e4880 2024-04-24T01:43:04.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.949+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.949+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902cf0 con 0x5594d48e4880 2024-04-24T01:43:04.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.951+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'130 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.951+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902cf0 con 0x5594d48eaad0 2024-04-24T01:43:04.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.952+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.952+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902d30 con 0x7f3c440a3040 2024-04-24T01:43:04.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.953+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.953+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902cf0 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.954+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.954+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902cf0 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.954+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.954+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.955+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.955+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.956+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.956+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x7f3c48031040 2024-04-24T01:43:04.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.957+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.957+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x5594d48eaad0 2024-04-24T01:43:04.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.958+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.958+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x7f3c48031040 2024-04-24T01:43:04.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.959+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.959+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x5594d48eaad0 2024-04-24T01:43:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.960+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.960+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x7f3c48031040 2024-04-24T01:43:04.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.962+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'42 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.962+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4902720 con 0x7f3c440a3040 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.963+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.963+0000 7f3b04fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.963+0000 7f3c519a2800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.963+0000 7f3c519a2800 20 Filter name: none 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3a7e7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d492dd80 con 0x7f3c48031040 2024-04-24T01:43:04.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d4930750 con 0x7f3c48031040 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T01:43:04.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.964+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d492e730 con 0x7f3c48031040 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.965+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.965+0000 7f3c519a2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.965+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94097709920912 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d4930d50 con 0x5594d48eaad0 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== watch-notify(notify (1) cookie 94097709665136 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5594d49032c0 con 0x5594d48eaad0 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3b32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94097709665136 notifier 4527 bl.length()=170 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3b32ffd640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3b14003d60 con 0x5594d48eaad0 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(97 notify.2 [notify cookie 94097709920912 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== watch-notify(notify_complete (2) cookie 94097709920912 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594d48d9270 con 0x5594d48eaad0 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3c519a2800 10 removing email index: 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3c519a2800 10 removing user buckets index 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.966+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4930cb0 con 0x7f3c48031040 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.967+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.967+0000 7f3c519a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.967+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94097709927600 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d49302a0 con 0x7f3c48031040 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.967+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== watch-notify(notify (1) cookie 94097709677696 notify 137438953481 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5594d49019e0 con 0x7f3c48031040 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.967+0000 7f3b327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94097709677696 notifier 4527 bl.length()=160 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.967+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(100 notify.6 [notify cookie 94097709927600 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.967+0000 7f3b327fc640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3a840032c0 con 0x7f3c48031040 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.968+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.968+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== watch-notify(notify_complete (2) cookie 94097709927600 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c40039020 con 0x7f3c48031040 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.968+0000 7f3c519a2800 10 removing user index: fud 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.968+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4930cb0 con 0x7f3c48031040 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c519a2800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c519a2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94097709927600 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594d492f290 con 0x7f3c48031040 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== watch-notify(notify (1) cookie 94097709675040 notify 137438953482 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f3c40039020 con 0x7f3c48031040 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3b32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94097709675040 notifier 4527 bl.length()=152 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3b32ffd640 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3b14003d60 con 0x7f3c48031040 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(103 notify.5 [notify cookie 94097709927600 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.969+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== watch-notify(notify_complete (2) cookie 94097709927600 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594d48af4b0 con 0x7f3c48031040 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.970+0000 7f3b05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.970+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94097709668768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4930cb0 con 0x5594d48e4880 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.971+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94097709668768] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.971+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94097709657024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4930cb0 con 0x7f3c440a3040 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.972+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94097709657024] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.972+0000 7f3c519a2800 20 remove_watcher() i=0 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.972+0000 7f3c519a2800 2 removed watcher, disabling cache 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.972+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94097709661280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d4930cb0 con 0x5594d48e4880 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.973+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94097709661280] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.974+0000 7f3c519a2800 20 remove_watcher() i=1 2024-04-24T01:43:04.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.974+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94097709665136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48efc60 con 0x5594d48eaad0 2024-04-24T01:43:04.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.975+0000 7f3c4eca7640 1 -- 172.21.15.131:0/2316682619 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94097709665136] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44085040 con 0x5594d48eaad0 2024-04-24T01:43:04.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.975+0000 7f3c519a2800 20 remove_watcher() i=2 2024-04-24T01:43:04.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.975+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94097709662336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f0b70 con 0x7f3c440a3040 2024-04-24T01:43:04.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.976+0000 7f3c4fca9640 1 -- 172.21.15.131:0/2316682619 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94097709662336] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c48040040 con 0x7f3c440a3040 2024-04-24T01:43:04.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.976+0000 7f3c519a2800 20 remove_watcher() i=3 2024-04-24T01:43:04.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.976+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94097709672336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48eebc0 con 0x5594d48e4880 2024-04-24T01:43:04.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.977+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94097709672336] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x5594d48e4880 2024-04-24T01:43:04.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.977+0000 7f3c519a2800 20 remove_watcher() i=4 2024-04-24T01:43:04.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.977+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94097709675040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48eebc0 con 0x7f3c48031040 2024-04-24T01:43:04.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.977+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94097709675040] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.977+0000 7f3c519a2800 20 remove_watcher() i=5 2024-04-24T01:43:04.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.977+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94097709677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48f3220 con 0x7f3c48031040 2024-04-24T01:43:04.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.978+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94097709677696] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.978+0000 7f3c519a2800 20 remove_watcher() i=6 2024-04-24T01:43:04.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.978+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94097709681488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594d48eebc0 con 0x7f3c48031040 2024-04-24T01:43:04.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94097709681488] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c40058040 con 0x7f3c48031040 2024-04-24T01:43:04.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 20 remove_watcher() i=7 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3c48031040 msgr2=0x7f3c48032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3c48031040 0x7f3c48032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d48e4880 msgr2=0x5594d48e6d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d48e4880 0x5594d48e6d40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3c440a3040 msgr2=0x7f3c4405c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3c440a3040 0x7f3c4405c610 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5594d48eaad0 msgr2=0x5594d48ecec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.979+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5594d48eaad0 0x5594d48ecec0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b18036950 msgr2=0x7f3b18038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b18036950 0x7f3b18038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5594d48b0790 tx=0x7f3c4801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 msgr2=0x5594d48d8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2316682619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48d1650 0x5594d48d8d30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000fd0 tx=0x7f3c4408d7c0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 reap_dead start 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c4f4a8640 1 -- 172.21.15.131:0/2316682619 reap_dead start 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 shutdown_connections 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 >> 172.21.15.131:0/2316682619 conn(0x5594d48cd9b0 msgr2=0x5594d48cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 shutdown_connections 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2316682619 wait complete. 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b28036950 msgr2=0x7f3b28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b28036950 0x7f3b28038e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5594d48b44c0 tx=0x7f3c48005840 comp rx=0 tx=0).stop 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48c43d0 msgr2=0x5594d48c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48c43d0 0x5594d48c47f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3c44055040 tx=0x7f3c44002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 shutdown_connections 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b28036950 0x7f3b28038e10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 --2- 172.21.15.131:0/2694290509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d48c43d0 0x5594d48c47f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 >> 172.21.15.131:0/2694290509 conn(0x5594d48b8470 msgr2=0x5594d48b8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 shutdown_connections 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/2694290509 wait complete. 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d47b12a0 msgr2=0x5594d48b3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.980+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d47b12a0 0x5594d48b3270 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b34036900 msgr2=0x7f3b34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b34036900 0x7f3b34038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c44054000 tx=0x7f3c4404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 msgr2=0x5594d48ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48ac030 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b5f0 tx=0x7f3c40000bc0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 shutdown_connections 2024-04-24T01:43:04.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5594d47b12a0 0x5594d48b3270 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3b34036900 0x7f3b34038dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 --2- 172.21.15.131:0/4152995997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5594d47af760 0x5594d48ac030 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:04.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 >> 172.21.15.131:0/4152995997 conn(0x5594d47ab380 msgr2=0x5594d489e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:04.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 shutdown_connections 2024-04-24T01:43:04.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:04.981+0000 7f3c519a2800 1 -- 172.21.15.131:0/4152995997 wait complete. 2024-04-24T01:43:04.990 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:43:04.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:43:04.991 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-24T01:43:05.082 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:05.082 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:05.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb5b1f800 1 Processor -- start 2024-04-24T01:43:05.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb5b1f800 1 -- start start 2024-04-24T01:43:05.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb5b1f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559f22f53420 0x559f22f55810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb5b1f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f22e0dd40 con 0x559f22f4f910 2024-04-24T01:43:05.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb5b1f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x559f22de04d0 con 0x559f22f53420 2024-04-24T01:43:05.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb0fe6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559f22f53420 0x559f22f55810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb17e7640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x559f22f4f910 0x559f22f51d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56710/0 (socket says 172.21.15.131:56710) 2024-04-24T01:43:05.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb0fe6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559f22f53420 0x559f22f55810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42740/0 (socket says 172.21.15.131:42740) 2024-04-24T01:43:05.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.082+0000 7fcfb17e7640 1 -- 172.21.15.131:0/1406978419 learned_addr learned my addr 172.21.15.131:0/1406978419 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:05.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.083+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/1406978419 >> v1:172.21.15.107:6789/0 conn(0x559f22f4f910 legacy=0x559f22f51d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.083+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/1406978419 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f22e0c590 con 0x559f22f53420 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.084+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/1406978419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f53420 0x559f22f55810 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800a470 tx=0x7fcfa801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdb366e6238a9c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.084+0000 7fcfa3fff640 1 -- 172.21.15.131:0/1406978419 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8057070 con 0x559f22f53420 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfa3fff640 1 -- 172.21.15.131:0/1406978419 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa8052570 con 0x559f22f53420 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfa3fff640 1 -- 172.21.15.131:0/1406978419 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8052870 con 0x559f22f53420 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1406978419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f53420 msgr2=0x559f22f55810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/1406978419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f53420 0x559f22f55810 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800a470 tx=0x7fcfa801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1406978419 shutdown_connections 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/1406978419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f53420 0x559f22f55810 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1406978419 >> 172.21.15.131:0/1406978419 conn(0x559f22f492c0 msgr2=0x559f22f4b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1406978419 shutdown_connections 2024-04-24T01:43:05.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.085+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1406978419 wait complete. 2024-04-24T01:43:05.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb5b1f800 1 Processor -- start 2024-04-24T01:43:05.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb5b1f800 1 -- start start 2024-04-24T01:43:05.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb5b1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f230402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb5b1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559f22e9a360 con 0x559f22f4f910 2024-04-24T01:43:05.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb17e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f230402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb17e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f230402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42754/0 (socket says 172.21.15.131:42754) 2024-04-24T01:43:05.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb17e7640 1 -- 172.21.15.131:0/853974663 learned_addr learned my addr 172.21.15.131:0/853974663 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.097+0000 7fcfb17e7640 1 -- 172.21.15.131:0/853974663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f230408a0 con 0x559f22f4f910 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fcfb17e7640 1 --2- 172.21.15.131:0/853974663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f230402d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4001dd0 tx=0x7fcfa400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd2e637bec5a6e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fce9f606640 1 -- 172.21.15.131:0/853974663 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa4012020 con 0x559f22f4f910 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fce9f606640 1 -- 172.21.15.131:0/853974663 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa400e5a0 con 0x559f22f4f910 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fce9f606640 1 -- 172.21.15.131:0/853974663 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa400e900 con 0x559f22f4f910 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/853974663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 msgr2=0x559f230402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/853974663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f230402d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4001dd0 tx=0x7fcfa400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/853974663 shutdown_connections 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/853974663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f230402d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/853974663 >> 172.21.15.131:0/853974663 conn(0x559f22f492c0 msgr2=0x559f2303bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.098+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/853974663 shutdown_connections 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/853974663 wait complete. 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb5b1f800 1 Processor -- start 2024-04-24T01:43:05.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb5b1f800 1 -- start start 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb5b1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f22f4f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb5b1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559f22f58060 con 0x559f22f4f910 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb17e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f22f4f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb17e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f22f4f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42762/0 (socket says 172.21.15.131:42762) 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb17e7640 1 -- 172.21.15.131:0/4018584597 learned_addr learned my addr 172.21.15.131:0/4018584597 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.099+0000 7fcfb17e7640 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f22f4d940 con 0x559f22f4f910 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.100+0000 7fcfb17e7640 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f22f4f250 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4001dd0 tx=0x7fcfa4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.100+0000 7fce9de03640 1 -- 172.21.15.131:0/4018584597 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa4012030 con 0x559f22f4f910 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.100+0000 7fce9de03640 1 -- 172.21.15.131:0/4018584597 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa401a720 con 0x559f22f4f910 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.100+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f22f4dbd0 con 0x559f22f4f910 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.100+0000 7fce9de03640 1 -- 172.21.15.131:0/4018584597 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa401aa40 con 0x559f22f4f910 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.100+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f22f4e0f0 con 0x559f22f4f910 2024-04-24T01:43:05.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fce9de03640 1 -- 172.21.15.131:0/4018584597 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfa4015020 con 0x559f22f4f910 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fce9de03640 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce98036900 0x7fce98038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fce9de03640 1 -- 172.21.15.131:0/4018584597 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fcfa4020030 con 0x559f22f4f910 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce98036900 0x7fce98038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f2304f220 0x559f23051610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23051b90 con 0x559f2304f220 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f2304f220 0x559f23051610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce98036900 0x7fce98038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8054000 tx=0x7fcfa804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.101+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f2304f220 0x559f23051610 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.102+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/4018584597 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfac00a4a0 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.102+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23052450 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.102+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/4018584597 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfac00a4a0 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.102+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23053840 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.102+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/4018584597 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfac00a4a0 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.102+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23052ca0 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.102+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/4018584597 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfac00a4a0 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.103+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23053080 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.103+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/4018584597 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcfac00a4a0 con 0x559f2304f220 2024-04-24T01:43:05.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.103+0000 7fcfb5b1f800 1 Processor -- start 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.103+0000 7fcfb5b1f800 1 -- start start 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.103+0000 7fcfb5b1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f23062970 0x559f23062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.103+0000 7fcfb5b1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559f22f4f790 con 0x559f23062970 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fcfb0fe6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f23062970 0x559f23062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fcfb0fe6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f23062970 0x559f23062d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42778/0 (socket says 172.21.15.131:42778) 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/1970030187 learned_addr learned my addr 172.21.15.131:0/1970030187 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/1970030187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f230632d0 con 0x559f23062970 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f23062970 0x559f23062d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcfa801ced0 tx=0x7fcfa8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fce96ffd640 1 -- 172.21.15.131:0/1970030187 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa806f070 con 0x559f23062970 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fce96ffd640 1 -- 172.21.15.131:0/1970030187 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa8058040 con 0x559f23062970 2024-04-24T01:43:05.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f23063d40 con 0x559f23062970 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fce96ffd640 1 -- 172.21.15.131:0/1970030187 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8057050 con 0x559f23062970 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.104+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f230641e0 con 0x559f23062970 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.105+0000 7fce96ffd640 1 -- 172.21.15.131:0/1970030187 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfa8072070 con 0x559f23062970 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.105+0000 7fce96ffd640 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce88036950 0x7fce88038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.105+0000 7fce96ffd640 1 -- 172.21.15.131:0/1970030187 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fcfa808f8c0 con 0x559f23062970 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.105+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce88036950 0x7fce88038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb5b1f800 1 Processor -- start 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce88036950 0x7fce88038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x559f22f4e730 tx=0x7fcfac005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb5b1f800 1 -- start start 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb5b1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f2306ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb5b1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559f22e406b0 con 0x559f2306fbb0 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb0fe6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f2306ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb0fe6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f2306ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42788/0 (socket says 172.21.15.131:42788) 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/4064841459 learned_addr learned my addr 172.21.15.131:0/4064841459 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/4064841459 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f230705a0 con 0x559f2306fbb0 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.106+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/4064841459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f2306ffd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8052f70 tx=0x7fcfa808de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05e6e872dddb9b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fce94ff9640 1 -- 172.21.15.131:0/4064841459 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa808b070 con 0x559f2306fbb0 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fce94ff9640 1 -- 172.21.15.131:0/4064841459 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa8069aa0 con 0x559f2306fbb0 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fce94ff9640 1 -- 172.21.15.131:0/4064841459 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8069ca0 con 0x559f2306fbb0 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4064841459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 msgr2=0x559f2306ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4064841459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f2306ffd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8052f70 tx=0x7fcfa808de10 comp rx=0 tx=0).stop 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4064841459 shutdown_connections 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4064841459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f2306ffd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4064841459 >> 172.21.15.131:0/4064841459 conn(0x559f2306bf10 msgr2=0x559f23069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4064841459 shutdown_connections 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4064841459 wait complete. 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 Processor -- start 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 -- start start 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.107+0000 7fcfb5b1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f23077070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb5b1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559f23070b90 con 0x559f2306fbb0 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb0fe6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f23077070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb0fe6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f23077070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42802/0 (socket says 172.21.15.131:42802) 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 learned_addr learned my addr 172.21.15.131:0/546709330 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f230775b0 con 0x559f2306fbb0 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f23077070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcfa808cb80 tx=0x7fcfa808dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fce86ffd640 1 -- 172.21.15.131:0/546709330 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8093070 con 0x559f2306fbb0 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fce86ffd640 1 -- 172.21.15.131:0/546709330 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa808fd20 con 0x559f2306fbb0 2024-04-24T01:43:05.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f23077840 con 0x559f2306fbb0 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fce86ffd640 1 -- 172.21.15.131:0/546709330 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8073a60 con 0x559f2306fbb0 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.108+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f2307a4f0 con 0x559f2306fbb0 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.109+0000 7fce86ffd640 1 -- 172.21.15.131:0/546709330 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfa8096070 con 0x559f2306fbb0 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.109+0000 7fce86ffd640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce7c036950 0x7fce7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.109+0000 7fce86ffd640 1 -- 172.21.15.131:0/546709330 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fcfa8099c90 con 0x559f2306fbb0 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.109+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce7c036950 0x7fce7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce7c036950 0x7fce7c038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x559f22f4e700 tx=0x7fcfac01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f23082b70 0x559f23085030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23085780 con 0x559f23082b70 2024-04-24T01:43:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb17e7640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f23082b70 0x559f23085030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb17e7640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f23082b70 0x559f23085030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa4018950 con 0x559f23082b70 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb5b1f800 20 realm 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.110+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23085b90 con 0x559f23082b70 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa4018950 con 0x559f23082b70 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23086460 con 0x559f23082b70 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa4018950 con 0x559f23082b70 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23086800 con 0x559f23082b70 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23087050 con 0x559f23082b70 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 20 searching for the correct realm 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559f23088dc0 0x559f2308b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.111+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559f23088dc0 0x559f2308b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.112+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559f23088dc0 0x559f2308b1b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.112+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.112+0000 7fcfb0fe6640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcfa8098070 0x7fcfa8055880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.112+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfa8098070 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.112+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcfa8098070 0x7fcfa8055880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.112+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcfa8098070 0x7fcfa8055880 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.113+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac01f070 con 0x7fcfa8098070 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.113+0000 7fcfb1fe8640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcfac031040 0x7fcfac032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.113+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.113+0000 7fcfb17e7640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcfac031040 0x7fcfac032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.113+0000 7fcfb17e7640 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcfac031040 0x7fcfac032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.114+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfa8098070 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac01f070 con 0x7fcfa8098070 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.115+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfa8098070 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcfac01f070 con 0x7fcfa8098070 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.116+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.117+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.118+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.118+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.118+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.118+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.118+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfa8098070 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.118+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac01f070 con 0x7fcfa8098070 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.119+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.119+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.119+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.119+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.119+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.119+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.119+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfa8098070 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac01f070 con 0x7fcfa8098070 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23088dc0 2024-04-24T01:43:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfac031040 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.120+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x559f23082b70 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f2308b740 con 0x7fcfa8098070 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac01f070 con 0x7fcfa8098070 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23087a00 con 0x559f23082b70 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f230882a0 con 0x559f23082b70 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.121+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f230882a0 con 0x559f23082b70 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 zone default found 2024-04-24T01:43:05.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 4 Realm: () 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 zonegroup default 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f2308bba0 con 0x7fcfac031040 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f2308d610 con 0x559f23088dc0 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.122+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f2308db00 con 0x559f23088dc0 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.123+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.123+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.123+0000 7fcfb5b1f800 20 started sync module instance, tier type = 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.123+0000 7fcfb5b1f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.123+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308ca20 con 0x7fcfa8098070 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.124+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.124+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94141975940624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308d230 con 0x7fcfa8098070 2024-04-24T01:43:05.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.124+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308e920 con 0x559f23082b70 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.125+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94141975940624] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.125+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.125+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94141975945056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308ed10 con 0x559f23082b70 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.125+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308f750 con 0x559f23088dc0 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.126+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.126+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94141975949856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308fff0 con 0x559f23088dc0 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.126+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23090a90 con 0x7fcfa8098070 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.126+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94141975945056] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.127+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.127+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94141975954784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23090e80 con 0x7fcfa8098070 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.127+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94141975949856] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.127+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f230918e0 con 0x559f23082b70 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.128+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.128+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94141975952272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f230918e0 con 0x559f23082b70 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.128+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23092330 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.128+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94141975954784] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.129+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.129+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94141975961120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f230922f0 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.129+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94141975952272] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.129+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23092d60 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.130+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.130+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94141975958544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23092d60 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.130+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23093760 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.130+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94141975961120] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94141975958544] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94141975963792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23093270 con 0x7fcfac031040 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 20 add_watcher() i=0 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 20 add_watcher() i=1 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 20 add_watcher() i=2 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 20 add_watcher() i=3 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 20 add_watcher() i=4 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 20 add_watcher() i=5 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.131+0000 7fcfb5b1f800 20 add_watcher() i=6 2024-04-24T01:43:05.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.132+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94141975963792] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.132+0000 7fcfb5b1f800 20 add_watcher() i=7 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.132+0000 7fcfb5b1f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.132+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f23093270 con 0x559f23082b70 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.132+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.132+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94141975946112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23093e10 con 0x559f23082b70 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.133+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94141975946112] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.133+0000 7fce677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.133+0000 7fcfb5b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.133+0000 7fcfb5b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fcfb5b1f800 5 note: GC not initialized 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fce667e4640 20 reqs_thread_entry: start 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fcfb5b1f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:05.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fcfb5b1f800 20 Filter name: none 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fcdd7fff640 20 reqs_thread_entry: start 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fcfb5b1f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.134+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f230c9b00 con 0x7fcfac031040 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f230c81f0 con 0x7fcfac031040 2024-04-24T01:43:05.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.135+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f230cc810 con 0x7fcfac031040 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.136+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.136+0000 7fcfb5b1f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.136+0000 7fcfb5b1f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.136+0000 7fcfb5b1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.136+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94141976199632 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f230cd360 con 0x7fcfa8098070 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== watch-notify(notify (1) cookie 94141975954784 notify 137438953490 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fcfac024680 con 0x7fcfa8098070 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fce94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94141975954784 notifier 4534 bl.length()=610 2024-04-24T01:43:05.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fce94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fce94ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fce94ff9640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fce74003ea0 con 0x7fcfa8098070 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(65 notify.3 [notify cookie 94141976199632 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== watch-notify(notify_complete (2) cookie 94141976199632 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcfac024850 con 0x7fcfa8098070 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.137+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f230cc210 con 0x7fcfac031040 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fcfb5b1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fcfb5b1f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fcfb5b1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94141976191008 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f230cc210 con 0x559f23088dc0 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== watch-notify(notify (1) cookie 94141975949856 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x559f23077840 con 0x559f23088dc0 2024-04-24T01:43:05.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fce87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94141975949856 notifier 4534 bl.length()=192 2024-04-24T01:43:05.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fce87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:43:05.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fce87fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:43:05.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 notify.2 [notify cookie 94141976191008 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.138+0000 7fce87fff640 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcde4003400 con 0x559f23088dc0 2024-04-24T01:43:05.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.139+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== watch-notify(notify_complete (2) cookie 94141976191008 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f230775b0 con 0x559f23088dc0 2024-04-24T01:43:05.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.139+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.158 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:43:05.137248Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:43:05.137229Z","tags":[],"group_ids":[]} 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.139+0000 7fce677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.139+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94141975946112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f230c8d70 con 0x559f23082b70 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.140+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94141975946112] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.140+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94141975940624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308e380 con 0x7fcfa8098070 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.141+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94141975940624] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.141+0000 7fcfb5b1f800 20 remove_watcher() i=0 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.141+0000 7fcfb5b1f800 2 removed watcher, disabling cache 2024-04-24T01:43:05.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.141+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94141975945056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308e380 con 0x559f23082b70 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.142+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94141975945056] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.142+0000 7fcfb5b1f800 20 remove_watcher() i=1 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.142+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94141975949856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308ce10 con 0x559f23088dc0 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.143+0000 7fcfb0fe6640 1 -- 172.21.15.131:0/546709330 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94141975949856] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa809f070 con 0x559f23088dc0 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.143+0000 7fcfb5b1f800 20 remove_watcher() i=2 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.143+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94141975954784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308f220 con 0x7fcfa8098070 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.144+0000 7fcfb1fe8640 1 -- 172.21.15.131:0/546709330 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94141975954784] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac040040 con 0x7fcfa8098070 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.144+0000 7fcfb5b1f800 20 remove_watcher() i=3 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.144+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94141975952272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308f220 con 0x559f23082b70 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.145+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94141975952272] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x559f23082b70 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.145+0000 7fcfb5b1f800 20 remove_watcher() i=4 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.145+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94141975961120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308f220 con 0x7fcfac031040 2024-04-24T01:43:05.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.146+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94141975961120] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.146+0000 7fcfb5b1f800 20 remove_watcher() i=5 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.147+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94141975958544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f23091e20 con 0x7fcfac031040 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.147+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94141975958544] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.147+0000 7fcfb5b1f800 20 remove_watcher() i=6 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.147+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94141975963792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f2308f220 con 0x7fcfac031040 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94141975963792] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4043040 con 0x7fcfac031040 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 20 remove_watcher() i=7 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcfac031040 msgr2=0x7fcfac032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcfac031040 0x7fcfac032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f23082b70 msgr2=0x559f23085030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f23082b70 0x559f23085030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcfa8098070 msgr2=0x7fcfa8055880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcfa8098070 0x7fcfa8055880 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559f23088dc0 msgr2=0x559f2308b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.148+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559f23088dc0 0x559f2308b1b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce7c036950 msgr2=0x7fce7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce7c036950 0x7fce7c038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x559f22f4e700 tx=0x7fcfac01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 msgr2=0x559f23077070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f23077070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcfa808cb80 tx=0x7fcfa808dba0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb17e7640 1 -- 172.21.15.131:0/546709330 reap_dead start 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 shutdown_connections 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/546709330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f2306fbb0 0x559f23077070 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 >> 172.21.15.131:0/546709330 conn(0x559f2306bf10 msgr2=0x559f23069570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 shutdown_connections 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/546709330 wait complete. 2024-04-24T01:43:05.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce88036950 msgr2=0x7fce88038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce88036950 0x7fce88038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x559f22f4e730 tx=0x7fcfac005840 comp rx=0 tx=0).stop 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f23062970 msgr2=0x559f23062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f23062970 0x559f23062d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcfa801ced0 tx=0x7fcfa8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 shutdown_connections 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce88036950 0x7fce88038e10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/1970030187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f23062970 0x559f23062d90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 >> 172.21.15.131:0/1970030187 conn(0x559f23056a10 msgr2=0x559f23056e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 shutdown_connections 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/1970030187 wait complete. 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f2304f220 msgr2=0x559f23051610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f2304f220 0x559f23051610 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce98036900 msgr2=0x7fce98038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce98036900 0x7fce98038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8054000 tx=0x7fcfa804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 msgr2=0x559f22f4f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f22f4f250 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4001dd0 tx=0x7fcfa4000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 shutdown_connections 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559f2304f220 0x559f23051610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fce98036900 0x7fce98038dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 --2- 172.21.15.131:0/4018584597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559f22f4f910 0x559f22f4f250 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.149+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 >> 172.21.15.131:0/4018584597 conn(0x559f22f492c0 msgr2=0x559f2303a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.150+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 shutdown_connections 2024-04-24T01:43:05.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.150+0000 7fcfb5b1f800 1 -- 172.21.15.131:0/4018584597 wait complete. 2024-04-24T01:43:05.169 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:43:05.137248Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:43:05.137229Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:05.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:43:05.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:43:05.170 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-24T01:43:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:05.217 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:05.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.216+0000 7f7395f2f800 1 Processor -- start 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.216+0000 7f7395f2f800 1 -- start start 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.216+0000 7f7395f2f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5558023183e0 0x55580231a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.216+0000 7f7395f2f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558021d2d40 con 0x5558023148d0 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.216+0000 7f7395f2f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5558021a54d0 con 0x5558023183e0 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.217+0000 7f73913ad640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5558023183e0 0x55580231a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.217+0000 7f73913ad640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5558023183e0 0x55580231a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42816/0 (socket says 172.21.15.131:42816) 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.217+0000 7f7391bae640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5558023148d0 0x555802316cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56726/0 (socket says 172.21.15.131:56726) 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.217+0000 7f73913ad640 1 -- 172.21.15.131:0/3093338980 learned_addr learned my addr 172.21.15.131:0/3093338980 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.217+0000 7f73913ad640 1 -- 172.21.15.131:0/3093338980 >> v1:172.21.15.107:6789/0 conn(0x5558023148d0 legacy=0x555802316cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.217+0000 7f73913ad640 1 -- 172.21.15.131:0/3093338980 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558021d1590 con 0x5558023183e0 2024-04-24T01:43:05.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f73913ad640 1 --2- 172.21.15.131:0/3093338980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023183e0 0x55580231a7d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f738800a520 tx=0x7f738801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30988b141b45aee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f7390bac640 1 -- 172.21.15.131:0/3093338980 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7388057070 con 0x5558023183e0 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f7390bac640 1 -- 172.21.15.131:0/3093338980 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7388052570 con 0x5558023183e0 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f7390bac640 1 -- 172.21.15.131:0/3093338980 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f738804ae60 con 0x5558023183e0 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f7395f2f800 1 -- 172.21.15.131:0/3093338980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023183e0 msgr2=0x55580231a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3093338980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023183e0 0x55580231a7d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f738800a520 tx=0x7f738801d010 comp rx=0 tx=0).stop 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f7395f2f800 1 -- 172.21.15.131:0/3093338980 shutdown_connections 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.219+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3093338980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023183e0 0x55580231a7d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.220+0000 7f7395f2f800 1 -- 172.21.15.131:0/3093338980 >> 172.21.15.131:0/3093338980 conn(0x55580230e3a0 msgr2=0x5558023107c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.220+0000 7f7395f2f800 1 -- 172.21.15.131:0/3093338980 shutdown_connections 2024-04-24T01:43:05.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.220+0000 7f7395f2f800 1 -- 172.21.15.131:0/3093338980 wait complete. 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.231+0000 7f7395f2f800 1 Processor -- start 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.231+0000 7f7395f2f800 1 -- start start 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.231+0000 7f7395f2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x555802314210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.231+0000 7f7395f2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55580225f3e0 con 0x5558023148d0 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f7391bae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x555802314210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f7391bae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x555802314210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42824/0 (socket says 172.21.15.131:42824) 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f7391bae640 1 -- 172.21.15.131:0/3332186574 learned_addr learned my addr 172.21.15.131:0/3332186574 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f7391bae640 1 -- 172.21.15.131:0/3332186574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558023127d0 con 0x5558023148d0 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f7391bae640 1 --2- 172.21.15.131:0/3332186574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x555802314210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7384001e90 tx=0x7f738400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2fc783c4ec0aec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f727fe07640 1 -- 172.21.15.131:0/3332186574 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f738400e5c0 con 0x5558023148d0 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f727fe07640 1 -- 172.21.15.131:0/3332186574 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7384006070 con 0x5558023148d0 2024-04-24T01:43:05.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.232+0000 7f727fe07640 1 -- 172.21.15.131:0/3332186574 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f738400e890 con 0x5558023148d0 2024-04-24T01:43:05.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 -- 172.21.15.131:0/3332186574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 msgr2=0x555802314210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3332186574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x555802314210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7384001e90 tx=0x7f738400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 -- 172.21.15.131:0/3332186574 shutdown_connections 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3332186574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x555802314210 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 -- 172.21.15.131:0/3332186574 >> 172.21.15.131:0/3332186574 conn(0x55580230e3a0 msgr2=0x555802400a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 -- 172.21.15.131:0/3332186574 shutdown_connections 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 -- 172.21.15.131:0/3332186574 wait complete. 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 Processor -- start 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.233+0000 7f7395f2f800 1 -- start start 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7395f2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x55580240ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7395f2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55580231b010 con 0x5558023148d0 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7391bae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x55580240ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7391bae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x55580240ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42838/0 (socket says 172.21.15.131:42838) 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7391bae640 1 -- 172.21.15.131:0/3423986516 learned_addr learned my addr 172.21.15.131:0/3423986516 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7391bae640 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55580240f390 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7391bae640 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x55580240ee50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f738400c010 tx=0x7f7384000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f727e604640 1 -- 172.21.15.131:0/3423986516 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f738400f8d0 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f727e604640 1 -- 172.21.15.131:0/3423986516 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738400fa90 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55580240f620 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f727e604640 1 -- 172.21.15.131:0/3423986516 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f738400fdb0 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.234+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558024122d0 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.235+0000 7f727e604640 1 -- 172.21.15.131:0/3423986516 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7384017070 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.235+0000 7f727e604640 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7278036900 0x7f7278038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.235+0000 7f727e604640 1 -- 172.21.15.131:0/3423986516 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7384015020 con 0x5558023148d0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.235+0000 7f73913ad640 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7278036900 0x7f7278038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.236+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5558023183e0 0x555802416090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.236+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802416620 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.236+0000 7f73923af640 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5558023183e0 0x555802416090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.236+0000 7f73913ad640 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7278036900 0x7f7278038dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7388054000 tx=0x7f738804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.236+0000 7f73923af640 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5558023183e0 0x555802416090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.236+0000 7f73923af640 1 -- 172.21.15.131:0/3423986516 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f738c00a4a0 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.236+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802413660 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.237+0000 7f73923af640 1 -- 172.21.15.131:0/3423986516 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f738c00a4a0 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.237+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802418460 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.237+0000 7f73923af640 1 -- 172.21.15.131:0/3423986516 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f738c00a4a0 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.237+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558024177a0 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.237+0000 7f73923af640 1 -- 172.21.15.131:0/3423986516 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f738c00a4a0 con 0x5558023183e0 2024-04-24T01:43:05.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.237+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802417bf0 con 0x5558023183e0 2024-04-24T01:43:05.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.237+0000 7f73923af640 1 -- 172.21.15.131:0/3423986516 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f738c00a4a0 con 0x5558023183e0 2024-04-24T01:43:05.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f7395f2f800 1 Processor -- start 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f7395f2f800 1 -- start start 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f7395f2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802427250 0x555802427670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f7395f2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5558022056b0 con 0x555802427250 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f73913ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802427250 0x555802427670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f73913ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802427250 0x555802427670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42844/0 (socket says 172.21.15.131:42844) 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f73913ad640 1 -- 172.21.15.131:0/2747811551 learned_addr learned my addr 172.21.15.131:0/2747811551 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.238+0000 7f73913ad640 1 -- 172.21.15.131:0/2747811551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555802427bb0 con 0x555802427250 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.239+0000 7f73913ad640 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802427250 0x555802427670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7388005930 tx=0x7f7388002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.239+0000 7f72777fe640 1 -- 172.21.15.131:0/2747811551 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7388057040 con 0x555802427250 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.239+0000 7f72777fe640 1 -- 172.21.15.131:0/2747811551 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738805d650 con 0x555802427250 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.239+0000 7f72777fe640 1 -- 172.21.15.131:0/2747811551 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f738805d950 con 0x555802427250 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.239+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555802428620 con 0x555802427250 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.239+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555802428ac0 con 0x555802427250 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f72777fe640 1 -- 172.21.15.131:0/2747811551 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7388067070 con 0x555802427250 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f72777fe640 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f726c036900 0x7f726c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f72777fe640 1 -- 172.21.15.131:0/2747811551 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f738808f6b0 con 0x555802427250 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f73923af640 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f726c036900 0x7f726c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f7395f2f800 1 Processor -- start 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f73923af640 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f726c036900 0x7f726c038dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5558024172c0 tx=0x7f738c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f7395f2f800 1 -- start start 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f7395f2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x5558024348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f7395f2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555802312b50 con 0x555802434490 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.240+0000 7f73913ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x5558024348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f73913ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x5558024348b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42856/0 (socket says 172.21.15.131:42856) 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f73913ad640 1 -- 172.21.15.131:0/2700085123 learned_addr learned my addr 172.21.15.131:0/2700085123 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f73913ad640 1 -- 172.21.15.131:0/2700085123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555802434e80 con 0x555802434490 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f73913ad640 1 --2- 172.21.15.131:0/2700085123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x5558024348b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f738808da40 tx=0x7f738805df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f240a03118b2185 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f72757fa640 1 -- 172.21.15.131:0/2700085123 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7388082070 con 0x555802434490 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f72757fa640 1 -- 172.21.15.131:0/2700085123 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7388071400 con 0x555802434490 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f72757fa640 1 -- 172.21.15.131:0/2700085123 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f738808b070 con 0x555802434490 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f7395f2f800 1 -- 172.21.15.131:0/2700085123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 msgr2=0x5558024348b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f7395f2f800 1 --2- 172.21.15.131:0/2700085123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x5558024348b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f738808da40 tx=0x7f738805df50 comp rx=0 tx=0).stop 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f7395f2f800 1 -- 172.21.15.131:0/2700085123 shutdown_connections 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f7395f2f800 1 --2- 172.21.15.131:0/2700085123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x5558024348b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f7395f2f800 1 -- 172.21.15.131:0/2700085123 >> 172.21.15.131:0/2700085123 conn(0x5558024307f0 msgr2=0x55580242e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f7395f2f800 1 -- 172.21.15.131:0/2700085123 shutdown_connections 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.241+0000 7f7395f2f800 1 -- 172.21.15.131:0/2700085123 wait complete. 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f7395f2f800 1 Processor -- start 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f7395f2f800 1 -- start start 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f7395f2f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x55580243bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f7395f2f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5558024355f0 con 0x555802434490 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f73913ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x55580243bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f73913ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x55580243bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42860/0 (socket says 172.21.15.131:42860) 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 learned_addr learned my addr 172.21.15.131:0/3072479502 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.242+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55580243c080 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.243+0000 7f73913ad640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x55580243bb40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7388080040 tx=0x7f738808d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.243+0000 7f72637fe640 1 -- 172.21.15.131:0/3072479502 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7388093070 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.243+0000 7f72637fe640 1 -- 172.21.15.131:0/3072479502 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7388083040 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.243+0000 7f72637fe640 1 -- 172.21.15.131:0/3072479502 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7388082070 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.243+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55580243c310 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.243+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55580243efc0 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.243+0000 7f72637fe640 1 -- 172.21.15.131:0/3072479502 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7388096070 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f72637fe640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f725c036900 0x7f725c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f72637fe640 1 -- 172.21.15.131:0/3072479502 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7388099c90 con 0x555802434490 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f73923af640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f725c036900 0x7f725c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f73923af640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f725c036900 0x7f725c038dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5558024135b0 tx=0x7f738c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555802447680 0x555802449b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580244a290 con 0x555802447680 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.244+0000 7f7391bae640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555802447680 0x555802449b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7391bae640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555802447680 0x555802449b40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 realm 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580244a6a0 con 0x555802447680 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580244af70 con 0x555802447680 2024-04-24T01:43:05.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580244b310 con 0x555802447680 2024-04-24T01:43:05.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.245+0000 7f7395f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580244bb60 con 0x555802447680 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f7395f2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f7395f2f800 20 searching for the correct realm 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55580244d8d0 0x55580244fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x55580244d8d0 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f73913ad640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55580244d8d0 0x55580244fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f73913ad640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55580244d8d0 0x55580244fcc0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f73913ad640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7388098070 0x7f73880065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.246+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x7f7388098070 2024-04-24T01:43:05.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.247+0000 7f73923af640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7388098070 0x7f73880065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.247+0000 7f73923af640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7388098070 0x7f73880065b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.247+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738c01f070 con 0x7f7388098070 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.247+0000 7f73923af640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f738c031040 0x7f738c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.247+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x7f738c031040 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.247+0000 7f7391bae640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f738c031040 0x7f738c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f738c031040 0x7f738c032940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x7f738c031040 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x555802447680 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x555802447680 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x7f738c031040 2024-04-24T01:43:05.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x7f738c031040 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.248+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x7f738c031040 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x7f738c031040 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x7f7388098070 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738c01f070 con 0x7f7388098070 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x55580244d8d0 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x555802447680 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.249+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x7f738c031040 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x7f738c031040 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x555802447680 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x7f7388098070 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f738c01f070 con 0x7f7388098070 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x55580244d8d0 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.250+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558024502d0 con 0x55580244d8d0 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f738c031040 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x7f738c031040 2024-04-24T01:43:05.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x55580244d8d0 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x55580244d8d0 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.251+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x555802447680 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.252+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.252+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x555802447680 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.252+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.252+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f738c031040 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.252+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x7f738c031040 2024-04-24T01:43:05.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.252+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x55580244d8d0 2024-04-24T01:43:05.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f7388098070 2024-04-24T01:43:05.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738c01f070 con 0x7f7388098070 2024-04-24T01:43:05.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x555802447680 2024-04-24T01:43:05.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738402e070 con 0x555802447680 2024-04-24T01:43:05.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f738c031040 2024-04-24T01:43:05.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x55580244d8d0 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.253+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.254+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f738c031040 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.254+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.254+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f7388098070 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.254+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738c01f070 con 0x7f7388098070 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.254+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x55580244d8d0 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.254+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.254+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f738c031040 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x555802447680 2024-04-24T01:43:05.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f73880af040 con 0x7f7388098070 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f738c01f070 con 0x7f7388098070 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580244c4e0 con 0x555802447680 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.255+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580244cd80 con 0x555802447680 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802450750 con 0x555802447680 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 zone default found 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 4 Realm: () 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:05.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 zonegroup default 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802450770 con 0x7f738c031040 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802452590 con 0x55580244d8d0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.256+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802452960 con 0x55580244d8d0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.257+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.257+0000 7f7395f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.257+0000 7f7395f2f800 20 started sync module instance, tier type = 2024-04-24T01:43:05.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.257+0000 7f7395f2f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:05.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.257+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802451a30 con 0x7f7388098070 2024-04-24T01:43:05.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.258+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.258+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93836483567136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802453270 con 0x7f7388098070 2024-04-24T01:43:05.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.258+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802453ac0 con 0x555802447680 2024-04-24T01:43:05.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.259+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93836483567136] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.259+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.259+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93836483571136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802453790 con 0x555802447680 2024-04-24T01:43:05.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.259+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802454290 con 0x55580244d8d0 2024-04-24T01:43:05.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.260+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.260+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93836483571136] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.260+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93836483575168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802453220 con 0x55580244d8d0 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.260+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802455100 con 0x7f7388098070 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.261+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.261+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93836483579472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558024559a0 con 0x7f7388098070 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.261+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802456470 con 0x555802447680 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.261+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93836483575168] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.262+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.262+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93836483579472] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.262+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93836483583840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802456430 con 0x555802447680 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.262+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802456a00 con 0x7f738c031040 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.263+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.263+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93836483581168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802456a00 con 0x7f738c031040 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.263+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802457900 con 0x7f738c031040 2024-04-24T01:43:05.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.263+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93836483583840] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.264+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93836483581168] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.265+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.265+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93836483587568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802457410 con 0x7f738c031040 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.265+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802457dd0 con 0x7f738c031040 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93836483587568] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93836483577392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802457dd0 con 0x7f738c031040 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 20 add_watcher() i=0 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 20 add_watcher() i=1 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 20 add_watcher() i=2 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 20 add_watcher() i=3 2024-04-24T01:43:05.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 20 add_watcher() i=4 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 20 add_watcher() i=5 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.266+0000 7f7395f2f800 20 add_watcher() i=6 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.267+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93836483577392] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.267+0000 7f7395f2f800 20 add_watcher() i=7 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.267+0000 7f7395f2f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.267+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580245b120 con 0x555802447680 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.268+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.268+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93836483603248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802457f40 con 0x555802447680 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93836483603248] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f72437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:05.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 5 note: GC not initialized 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f72427fc640 20 reqs_thread_entry: start 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 20 Filter name: none 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f71b3fff640 20 reqs_thread_entry: start 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.269+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580248e650 con 0x7f738c031040 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7395f2f800 20 rados_obj.operate() r=0 bl.length=419 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7395f2f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7395f2f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7395f2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7395f2f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.271+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580248e0a0 con 0x7f7388098070 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.272+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.272+0000 7f7395f2f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.272+0000 7f7395f2f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.272+0000 7f7395f2f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.272+0000 7f7395f2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.272+0000 7f7395f2f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.272+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802491e80 con 0x7f738c031040 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(64 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.273+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802496410 con 0x7f7388098070 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.274+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.274+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 8.4 8:266a66a6:root::.bucket.meta.testx%3amyfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802499d20 con 0x7f7388098070 2024-04-24T01:43:05.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [create,call,writefull 0~412,setxattr (203)] v32'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7395f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x7 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7395f2f800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7395f2f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7395f2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93836483853136 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558024997b0 con 0x555802447680 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 93836483583840 notify 137438953483 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5558024913f0 con 0x555802447680 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f72757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93836483583840 notifier 4541 bl.length()=847 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f72757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x7 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f72757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f72757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(67 notify.4 [notify cookie 93836483853136 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f72757fa640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7254003ea0 con 0x555802447680 2024-04-24T01:43:05.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.275+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.276+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 93836483853136 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7384037080 con 0x555802447680 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.276+0000 7f7395f2f800 20 handle_bi_update(): bucket=testx:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_sources= new_sources= 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.276+0000 7f7395f2f800 20 handle_bi_update(): bucket=testx:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential sources added=[] removed=[] 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.276+0000 7f7395f2f800 20 handle_bi_update(): bucket=testx:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_dests= new_dests= 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.276+0000 7f7395f2f800 20 handle_bi_update(): bucket=testx:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential dests added=[] removed=[] 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.276+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802499870 con 0x555802447680 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.277+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.277+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802499870 con 0x555802447680 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7395f2f800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7395f2f800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7395f2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-24T01:43:05.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93836483859392 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55580249a3b0 con 0x555802447680 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== watch-notify(notify (1) cookie 93836483583840 notify 137438953484 ret 0) ==== 390+0+0 (crc 0 0 0) 0x555802498b60 con 0x555802447680 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7274ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93836483583840 notifier 4541 bl.length()=348 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7274ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7274ff9640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(71 notify.4 [notify cookie 93836483859392 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.278+0000 7f7274ff9640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f71bc003400 con 0x555802447680 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.279+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== watch-notify(notify_complete (2) cookie 93836483859392 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7384037080 con 0x555802447680 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.279+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.279+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802499870 con 0x7f7388098070 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7395f2f800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7395f2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93836483859392 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802496b40 con 0x7f738c031040 2024-04-24T01:43:05.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== watch-notify(notify (1) cookie 93836483587568 notify 137438953483 ret 0) ==== 191+0+0 (crc 0 0 0) 0x7f7384037080 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f72757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93836483587568 notifier 4541 bl.length()=149 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f72757fa640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7254003ea0 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(74 notify.6 [notify cookie 93836483859392 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== watch-notify(notify_complete (2) cookie 93836483859392 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558024122d0 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.280+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802499870 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.281+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(76 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.281+0000 7f7395f2f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 from cache 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.281+0000 7f7395f2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.281+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 93836483827536 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555802499870 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.281+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== watch-notify(notify (1) cookie 93836483581168 notify 137438953484 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5558024122d0 con 0x7f738c031040 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.281+0000 7f7274ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93836483581168 notifier 4541 bl.length()=206 2024-04-24T01:43:05.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.282+0000 7f7274ff9640 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f71bc0033e0 con 0x7f738c031040 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.282+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(77 notify.5 [notify cookie 93836483827536 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.282+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.282+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== watch-notify(notify_complete (2) cookie 93836483827536 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55580240f620 con 0x7f738c031040 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.283+0000 7f72437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.283+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93836483603248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802476fd0 con 0x555802447680 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.284+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93836483603248] v32'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.284+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93836483567136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802476fd0 con 0x7f7388098070 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.285+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93836483567136] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.285+0000 7f7395f2f800 20 remove_watcher() i=0 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.285+0000 7f7395f2f800 2 removed watcher, disabling cache 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.285+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93836483571136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802476fd0 con 0x555802447680 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.286+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93836483571136] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.286+0000 7f7395f2f800 20 remove_watcher() i=1 2024-04-24T01:43:05.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.286+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93836483575168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802476fd0 con 0x55580244d8d0 2024-04-24T01:43:05.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.287+0000 7f73913ad640 1 -- 172.21.15.131:0/3072479502 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93836483575168] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738809f070 con 0x55580244d8d0 2024-04-24T01:43:05.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.287+0000 7f7395f2f800 20 remove_watcher() i=2 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.287+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93836483579472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802451e20 con 0x7f7388098070 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.288+0000 7f73923af640 1 -- 172.21.15.131:0/3072479502 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93836483579472] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738c040040 con 0x7f7388098070 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.288+0000 7f7395f2f800 20 remove_watcher() i=3 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.288+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93836483583840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802451e20 con 0x555802447680 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.289+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93836483583840] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x555802447680 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.289+0000 7f7395f2f800 20 remove_watcher() i=4 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.289+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93836483581168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802455f60 con 0x7f738c031040 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.290+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93836483581168] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.290+0000 7f7395f2f800 20 remove_watcher() i=5 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.290+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93836483587568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802451e20 con 0x7f738c031040 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.291+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93836483587568] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.291+0000 7f7395f2f800 20 remove_watcher() i=6 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.291+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93836483577392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555802451e20 con 0x7f738c031040 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93836483577392] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f738405b040 con 0x7f738c031040 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 20 remove_watcher() i=7 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f738c031040 msgr2=0x7f738c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f738c031040 0x7f738c032940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555802447680 msgr2=0x555802449b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555802447680 0x555802449b40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7388098070 msgr2=0x7f73880065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7388098070 0x7f73880065b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55580244d8d0 msgr2=0x55580244fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55580244d8d0 0x55580244fcc0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f725c036900 msgr2=0x7f725c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f725c036900 0x7f725c038dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5558024135b0 tx=0x7f738c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 msgr2=0x55580243bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x55580243bb40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7388080040 tx=0x7f738808d9d0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7391bae640 1 -- 172.21.15.131:0/3072479502 reap_dead start 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 shutdown_connections 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3072479502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802434490 0x55580243bb40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 >> 172.21.15.131:0/3072479502 conn(0x5558024307f0 msgr2=0x55580242de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 shutdown_connections 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.292+0000 7f7395f2f800 1 -- 172.21.15.131:0/3072479502 wait complete. 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f726c036900 msgr2=0x7f726c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f726c036900 0x7f726c038dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5558024172c0 tx=0x7f738c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802427250 msgr2=0x555802427670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802427250 0x555802427670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7388005930 tx=0x7f7388002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 shutdown_connections 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f726c036900 0x7f726c038dc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/2747811551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555802427250 0x555802427670 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 >> 172.21.15.131:0/2747811551 conn(0x55580241b2f0 msgr2=0x55580241b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 shutdown_connections 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/2747811551 wait complete. 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5558023183e0 msgr2=0x555802416090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5558023183e0 0x555802416090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7278036900 msgr2=0x7f7278038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7278036900 0x7f7278038dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7388054000 tx=0x7f738804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 msgr2=0x55580240ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x55580240ee50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f738400c010 tx=0x7f7384000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 shutdown_connections 2024-04-24T01:43:05.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5558023183e0 0x555802416090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7278036900 0x7f7278038dc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 --2- 172.21.15.131:0/3423986516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5558023148d0 0x55580240ee50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 >> 172.21.15.131:0/3423986516 conn(0x55580230e3a0 msgr2=0x5558023130b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 shutdown_connections 2024-04-24T01:43:05.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.293+0000 7f7395f2f800 1 -- 172.21.15.131:0/3423986516 wait complete. 2024-04-24T01:43:05.309 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-24T01:43:05.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-24T01:43:05.309 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-24T01:43:05.351 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:05.351 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:05.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.350+0000 7fa43412f800 1 Processor -- start 2024-04-24T01:43:05.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.350+0000 7fa43412f800 1 -- start start 2024-04-24T01:43:05.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.350+0000 7fa43412f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d4c8c56780 0x55d4c8c56ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.350+0000 7fa43412f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d4c8b16d40 con 0x55d4c8c570e0 2024-04-24T01:43:05.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.350+0000 7fa43412f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55d4c8ae94d0 con 0x55d4c8c56780 2024-04-24T01:43:05.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.351+0000 7fa42fec5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d4c8c56780 0x55d4c8c56ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.351+0000 7fa4276c4640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55d4c8c570e0 0x55d4c8c57590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56740/0 (socket says 172.21.15.131:56740) 2024-04-24T01:43:05.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.351+0000 7fa4276c4640 1 -- 172.21.15.131:0/3255651225 learned_addr learned my addr 172.21.15.131:0/3255651225 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:05.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.351+0000 7fa42fec5640 1 -- 172.21.15.131:0/3255651225 >> v1:172.21.15.107:6789/0 conn(0x55d4c8c570e0 legacy=0x55d4c8c57590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.351+0000 7fa42fec5640 1 -- 172.21.15.131:0/3255651225 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c8b15590 con 0x55d4c8c56780 2024-04-24T01:43:05.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa42fec5640 1 --2- 172.21.15.131:0/3255651225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8c56ba0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa42000a470 tx=0x7fa42001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d783ed20ce8403b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa42f6c4640 1 -- 172.21.15.131:0/3255651225 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa420057070 con 0x55d4c8c56780 2024-04-24T01:43:05.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa42f6c4640 1 -- 172.21.15.131:0/3255651225 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42004adc0 con 0x55d4c8c56780 2024-04-24T01:43:05.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa42f6c4640 1 -- 172.21.15.131:0/3255651225 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa420052590 con 0x55d4c8c56780 2024-04-24T01:43:05.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa43412f800 1 -- 172.21.15.131:0/3255651225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 msgr2=0x55d4c8c56ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa43412f800 1 --2- 172.21.15.131:0/3255651225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8c56ba0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa42000a470 tx=0x7fa42001ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:05.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa43412f800 1 -- 172.21.15.131:0/3255651225 shutdown_connections 2024-04-24T01:43:05.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa43412f800 1 --2- 172.21.15.131:0/3255651225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8c56ba0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa43412f800 1 -- 172.21.15.131:0/3255651225 >> 172.21.15.131:0/3255651225 conn(0x55d4c8c52320 msgr2=0x55d4c8c54740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa43412f800 1 -- 172.21.15.131:0/3255651225 shutdown_connections 2024-04-24T01:43:05.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.353+0000 7fa43412f800 1 -- 172.21.15.131:0/3255651225 wait complete. 2024-04-24T01:43:05.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.365+0000 7fa43412f800 1 Processor -- start 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.365+0000 7fa43412f800 1 -- start start 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.365+0000 7fa43412f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d4b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.365+0000 7fa43412f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d4c8ba33c0 con 0x55d4c8c56780 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa42fec5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d4b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa42fec5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d4b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42878/0 (socket says 172.21.15.131:42878) 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa42fec5640 1 -- 172.21.15.131:0/520346251 learned_addr learned my addr 172.21.15.131:0/520346251 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa42fec5640 1 -- 172.21.15.131:0/520346251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c8d4b9e0 con 0x55d4c8c56780 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa42fec5640 1 --2- 172.21.15.131:0/520346251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d4b410 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa420055040 tx=0x7fa42004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afeec94c0c0ad59f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa31de0b640 1 -- 172.21.15.131:0/520346251 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa420057040 con 0x55d4c8c56780 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa31de0b640 1 -- 172.21.15.131:0/520346251 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa420062070 con 0x55d4c8c56780 2024-04-24T01:43:05.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.366+0000 7fa31de0b640 1 -- 172.21.15.131:0/520346251 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42005d470 con 0x55d4c8c56780 2024-04-24T01:43:05.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 -- 172.21.15.131:0/520346251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 msgr2=0x55d4c8d4b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 --2- 172.21.15.131:0/520346251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d4b410 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa420055040 tx=0x7fa42004c000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 -- 172.21.15.131:0/520346251 shutdown_connections 2024-04-24T01:43:05.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 --2- 172.21.15.131:0/520346251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d4b410 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 -- 172.21.15.131:0/520346251 >> 172.21.15.131:0/520346251 conn(0x55d4c8c52320 msgr2=0x55d4c8d46d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 -- 172.21.15.131:0/520346251 shutdown_connections 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 -- 172.21.15.131:0/520346251 wait complete. 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 Processor -- start 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 -- start start 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d52f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.367+0000 7fa43412f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d4c8c57f40 con 0x55d4c8c56780 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa42fec5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d52f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa42fec5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d52f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42884/0 (socket says 172.21.15.131:42884) 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa42fec5640 1 -- 172.21.15.131:0/2423697265 learned_addr learned my addr 172.21.15.131:0/2423697265 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa42fec5640 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c8d53490 con 0x55d4c8c56780 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa42fec5640 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d52f50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa420005870 tx=0x7fa420002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa317fff640 1 -- 172.21.15.131:0/2423697265 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42006b070 con 0x55d4c8c56780 2024-04-24T01:43:05.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa317fff640 1 -- 172.21.15.131:0/2423697265 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42005d940 con 0x55d4c8c56780 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4c8d53720 con 0x55d4c8c56780 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa317fff640 1 -- 172.21.15.131:0/2423697265 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa420057070 con 0x55d4c8c56780 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.368+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c8d56330 con 0x55d4c8c56780 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.369+0000 7fa317fff640 1 -- 172.21.15.131:0/2423697265 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa42005dc20 con 0x55d4c8c56780 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.369+0000 7fa317fff640 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa318036900 0x7fa318038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.369+0000 7fa317fff640 1 -- 172.21.15.131:0/2423697265 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa42008e1d0 con 0x55d4c8c56780 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.369+0000 7fa4276c4640 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa318036900 0x7fa318038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.369+0000 7fa43412f800 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8c570e0 0x55d4c8d5a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.369+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d5a670 con 0x55d4c8c570e0 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.370+0000 7fa4306c6640 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8c570e0 0x55d4c8d5a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.370+0000 7fa4276c4640 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa318036900 0x7fa318038dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa418000f60 tx=0x7fa4180012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.370+0000 7fa4306c6640 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8c570e0 0x55d4c8d5a0f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.370+0000 7fa4306c6640 1 -- 172.21.15.131:0/2423697265 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42800a4a0 con 0x55d4c8c570e0 2024-04-24T01:43:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.370+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d576c0 con 0x55d4c8c570e0 2024-04-24T01:43:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.370+0000 7fa4306c6640 1 -- 172.21.15.131:0/2423697265 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa42800a4a0 con 0x55d4c8c570e0 2024-04-24T01:43:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.370+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d5c4c0 con 0x55d4c8c570e0 2024-04-24T01:43:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.371+0000 7fa4306c6640 1 -- 172.21.15.131:0/2423697265 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa42800a4a0 con 0x55d4c8c570e0 2024-04-24T01:43:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.371+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d5b800 con 0x55d4c8c570e0 2024-04-24T01:43:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.371+0000 7fa4306c6640 1 -- 172.21.15.131:0/2423697265 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa42800a4a0 con 0x55d4c8c570e0 2024-04-24T01:43:05.375 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.371+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d5bc50 con 0x55d4c8c570e0 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.371+0000 7fa4306c6640 1 -- 172.21.15.131:0/2423697265 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa42800a4a0 con 0x55d4c8c570e0 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa43412f800 1 Processor -- start 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa43412f800 1 -- start start 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa43412f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d6b290 0x55d4c8d6b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa43412f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d4c8b496b0 con 0x55d4c8d6b290 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa4276c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d6b290 0x55d4c8d6b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa4276c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d6b290 0x55d4c8d6b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42888/0 (socket says 172.21.15.131:42888) 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa4276c4640 1 -- 172.21.15.131:0/2770069004 learned_addr learned my addr 172.21.15.131:0/2770069004 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.372+0000 7fa4276c4640 1 -- 172.21.15.131:0/2770069004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c8d6bbf0 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.373+0000 7fa4276c4640 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d6b290 0x55d4c8d6b6b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa418001ed0 tx=0x7fa41800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.373+0000 7fa3157fa640 1 -- 172.21.15.131:0/2770069004 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41801b550 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.373+0000 7fa3157fa640 1 -- 172.21.15.131:0/2770069004 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41801b6f0 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.373+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4c8d6c660 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.373+0000 7fa3157fa640 1 -- 172.21.15.131:0/2770069004 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41801b9d0 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.373+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c8d6cb60 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.373+0000 7fa3157fa640 1 -- 172.21.15.131:0/2770069004 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa418023020 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa3157fa640 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa308036900 0x7fa308038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa3157fa640 1 -- 172.21.15.131:0/2770069004 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa418021020 con 0x55d4c8d6b290 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa4306c6640 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa308036900 0x7fa308038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa43412f800 1 Processor -- start 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa4306c6640 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa308036900 0x7fa308038dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55d4c8d5b320 tx=0x7fa428005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa43412f800 1 -- start start 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa43412f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa43412f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d4c8d4bca0 con 0x55d4c8d785d0 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa4276c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa4276c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42894/0 (socket says 172.21.15.131:42894) 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.374+0000 7fa4276c4640 1 -- 172.21.15.131:0/3728596092 learned_addr learned my addr 172.21.15.131:0/3728596092 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa4276c4640 1 -- 172.21.15.131:0/3728596092 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c8d78fc0 con 0x55d4c8d785d0 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa4276c4640 1 --2- 172.21.15.131:0/3728596092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d789f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa41804cec0 tx=0x7fa4180468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd26cd7b8865ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa30effd640 1 -- 172.21.15.131:0/3728596092 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41801be20 con 0x55d4c8d785d0 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa30effd640 1 -- 172.21.15.131:0/3728596092 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41800c360 con 0x55d4c8d785d0 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa30effd640 1 -- 172.21.15.131:0/3728596092 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa418041130 con 0x55d4c8d785d0 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa43412f800 1 -- 172.21.15.131:0/3728596092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 msgr2=0x55d4c8d789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa43412f800 1 --2- 172.21.15.131:0/3728596092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d789f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa41804cec0 tx=0x7fa4180468f0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa43412f800 1 -- 172.21.15.131:0/3728596092 shutdown_connections 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa43412f800 1 --2- 172.21.15.131:0/3728596092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d789f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa43412f800 1 -- 172.21.15.131:0/3728596092 >> 172.21.15.131:0/3728596092 conn(0x55d4c8d74930 msgr2=0x55d4c8d72990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa43412f800 1 -- 172.21.15.131:0/3728596092 shutdown_connections 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.375+0000 7fa43412f800 1 -- 172.21.15.131:0/3728596092 wait complete. 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa43412f800 1 Processor -- start 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa43412f800 1 -- start start 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa43412f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d7fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa43412f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d4c8d79730 con 0x55d4c8d785d0 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa4276c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d7fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa4276c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d7fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42900/0 (socket says 172.21.15.131:42900) 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 learned_addr learned my addr 172.21.15.131:0/4025991818 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c8d80170 con 0x55d4c8d785d0 2024-04-24T01:43:05.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa4276c4640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d7fc30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa41804cf20 tx=0x7fa41804ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.376+0000 7fa30d7fa640 1 -- 172.21.15.131:0/4025991818 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa418034020 con 0x55d4c8d785d0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa30d7fa640 1 -- 172.21.15.131:0/4025991818 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4180460d0 con 0x55d4c8d785d0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4c8d80400 con 0x55d4c8d785d0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa30d7fa640 1 -- 172.21.15.131:0/4025991818 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4180462e0 con 0x55d4c8d785d0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c8d80400 con 0x55d4c8d785d0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa30d7fa640 1 -- 172.21.15.131:0/4025991818 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa418037020 con 0x55d4c8d785d0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa30d7fa640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa2f8036900 0x7fa2f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa30d7fa640 1 -- 172.21.15.131:0/4025991818 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa41803ac40 con 0x55d4c8d785d0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.377+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa4306c6640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa2f8036900 0x7fa2f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8d8b500 0x55d4c8d8d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d8e0f0 con 0x55d4c8d8b500 2024-04-24T01:43:05.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa42fec5640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8d8b500 0x55d4c8d8d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa4306c6640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa2f8036900 0x7fa2f8038dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55d4c8d540d0 tx=0x7fa42801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa42fec5640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8d8b500 0x55d4c8d8d9a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa43412f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa43412f800 20 realm 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.378+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d8e500 con 0x55d4c8d8b500 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d8edd0 con 0x55d4c8d8b500 2024-04-24T01:43:05.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d8f170 con 0x55d4c8d8b500 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d8f5d0 con 0x55d4c8d8b500 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 20 searching for the correct realm 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d4c8d91620 0x55d4c8d93a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.379+0000 7fa4276c4640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d4c8d91620 0x55d4c8d93a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.380+0000 7fa4276c4640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d4c8d91620 0x55d4c8d93a10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.380+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.380+0000 7fa4276c4640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa418039020 0x7fa4180308d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.380+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa418039020 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.380+0000 7fa4306c6640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa418039020 0x7fa4180308d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.380+0000 7fa4306c6640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa418039020 0x7fa4180308d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.381+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42801f070 con 0x7fa418039020 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.381+0000 7fa4306c6640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa428031040 0x7fa428032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.381+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.381+0000 7fa42fec5640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa428031040 0x7fa428032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.381+0000 7fa42fec5640 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa428031040 0x7fa428032430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.382+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa418039020 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42801f070 con 0x7fa418039020 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.383+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa418039020 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa42801f070 con 0x7fa418039020 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.384+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.385+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa418039020 2024-04-24T01:43:05.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42801f070 con 0x7fa418039020 2024-04-24T01:43:05.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.386+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.387+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.387+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.387+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.387+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.387+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.387+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa418039020 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42801f070 con 0x7fa418039020 2024-04-24T01:43:05.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d91620 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa428031040 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x55d4c8d8b500 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d940c0 con 0x7fa418039020 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42801f070 con 0x7fa418039020 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa43412f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa43412f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa43412f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa43412f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa43412f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:05.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.388+0000 7fa43412f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d90070 con 0x55d4c8d8b500 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d90910 con 0x55d4c8d8b500 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d8fcb0 con 0x55d4c8d8b500 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 zone default found 2024-04-24T01:43:05.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 4 Realm: () 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 zonegroup default 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.389+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d90910 con 0x7fa428031040 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d95f00 con 0x55d4c8d91620 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d962a0 con 0x55d4c8d91620 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 20 started sync module instance, tier type = 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.390+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d953a0 con 0x7fa418039020 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.391+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa428040040 con 0x7fa418039020 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.391+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94372391114640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d96b40 con 0x7fa418039020 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.391+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d97390 con 0x55d4c8d8b500 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.392+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94372391114640] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa428040040 con 0x7fa418039020 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.393+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.393+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94372391118480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d97080 con 0x55d4c8d8b500 2024-04-24T01:43:05.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.393+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d97ba0 con 0x55d4c8d91620 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.394+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94372391118480] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.394+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.394+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94372391122544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d97f90 con 0x55d4c8d91620 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.394+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d98950 con 0x7fa418039020 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.395+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94372391122544] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.395+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa428040040 con 0x7fa418039020 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.395+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94372391126176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d988c0 con 0x7fa418039020 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.395+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d99810 con 0x55d4c8d8b500 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.396+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.396+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94372391129952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d99c30 con 0x55d4c8d8b500 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.396+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9a6f0 con 0x7fa428031040 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.396+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94372391126176] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa428040040 con 0x7fa418039020 2024-04-24T01:43:05.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.397+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.397+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94372391133728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9a6f0 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.397+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9b130 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.397+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94372391129952] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.398+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94372391133728] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.398+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.398+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94372391128384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9ac80 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.398+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9b9d0 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94372391128384] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94372391131008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9ac80 con 0x7fa428031040 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 20 add_watcher() i=0 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 20 add_watcher() i=1 2024-04-24T01:43:05.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 20 add_watcher() i=2 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 20 add_watcher() i=3 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 20 add_watcher() i=4 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 20 add_watcher() i=5 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.399+0000 7fa43412f800 20 add_watcher() i=6 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.400+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94372391131008] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.400+0000 7fa43412f800 20 add_watcher() i=7 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.400+0000 7fa43412f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.400+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9e960 con 0x55d4c8d8b500 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.401+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.401+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94372391138432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9be70 con 0x55d4c8d8b500 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94372391138432] v32'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa2e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa43412f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa43412f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa43412f800 5 note: GC not initialized 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa2e4fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa43412f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa43412f800 20 Filter name: none 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa25e7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa43412f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.402+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8dd1730 con 0x55d4c8d8b500 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.403+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.403+0000 7fa43412f800 20 rados_obj.operate() r=0 bl.length=193 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.403+0000 7fa2e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.403+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94372391138432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9e2b0 con 0x55d4c8d8b500 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.404+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94372391138432] v32'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.404+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94372391114640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9b480 con 0x7fa418039020 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.405+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94372391114640] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa428040040 con 0x7fa418039020 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.405+0000 7fa43412f800 20 remove_watcher() i=0 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.405+0000 7fa43412f800 2 removed watcher, disabling cache 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.405+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94372391118480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d95790 con 0x55d4c8d8b500 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.406+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94372391118480] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.406+0000 7fa43412f800 20 remove_watcher() i=1 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.406+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94372391122544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d95790 con 0x55d4c8d91620 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.407+0000 7fa4276c4640 1 -- 172.21.15.131:0/4025991818 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94372391122544] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa418009050 con 0x55d4c8d91620 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.407+0000 7fa43412f800 20 remove_watcher() i=2 2024-04-24T01:43:05.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.407+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94372391126176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d97670 con 0x7fa418039020 2024-04-24T01:43:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.408+0000 7fa4306c6640 1 -- 172.21.15.131:0/4025991818 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94372391126176] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa428040040 con 0x7fa418039020 2024-04-24T01:43:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.409+0000 7fa43412f800 20 remove_watcher() i=3 2024-04-24T01:43:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.409+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94372391129952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d984a0 con 0x55d4c8d8b500 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.409+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94372391129952] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x55d4c8d8b500 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.409+0000 7fa43412f800 20 remove_watcher() i=4 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.409+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94372391133728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d984a0 con 0x7fa428031040 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.410+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94372391133728] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.410+0000 7fa43412f800 20 remove_watcher() i=5 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.410+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94372391128384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d9a220 con 0x7fa428031040 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.412+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94372391128384] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.412+0000 7fa43412f800 20 remove_watcher() i=6 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.412+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94372391131008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d4c8d984a0 con 0x7fa428031040 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94372391131008] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42005a040 con 0x7fa428031040 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 20 remove_watcher() i=7 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa428031040 msgr2=0x7fa428032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa428031040 0x7fa428032430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8d8b500 msgr2=0x55d4c8d8d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8d8b500 0x55d4c8d8d9a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa418039020 msgr2=0x7fa4180308d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa418039020 0x7fa4180308d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d4c8d91620 msgr2=0x55d4c8d93a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d4c8d91620 0x55d4c8d93a10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa2f8036900 msgr2=0x7fa2f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa2f8036900 0x7fa2f8038dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55d4c8d540d0 tx=0x7fa42801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 msgr2=0x55d4c8d7fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa42fec5640 1 -- 172.21.15.131:0/4025991818 reap_dead start 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d7fc30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa41804cf20 tx=0x7fa41804ce20 comp rx=0 tx=0).stop 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 shutdown_connections 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/4025991818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d785d0 0x55d4c8d7fc30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 >> 172.21.15.131:0/4025991818 conn(0x55d4c8d74930 msgr2=0x55d4c8d71f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 shutdown_connections 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/4025991818 wait complete. 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa308036900 msgr2=0x7fa308038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa308036900 0x7fa308038dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55d4c8d5b320 tx=0x7fa428005840 comp rx=0 tx=0).stop 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d6b290 msgr2=0x55d4c8d6b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d6b290 0x55d4c8d6b6b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa418001ed0 tx=0x7fa41800d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 shutdown_connections 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa308036900 0x7fa308038dc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 --2- 172.21.15.131:0/2770069004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8d6b290 0x55d4c8d6b6b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 >> 172.21.15.131:0/2770069004 conn(0x55d4c8d5f330 msgr2=0x55d4c8d5f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 shutdown_connections 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.413+0000 7fa43412f800 1 -- 172.21.15.131:0/2770069004 wait complete. 2024-04-24T01:43:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8c570e0 msgr2=0x55d4c8d5a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8c570e0 0x55d4c8d5a0f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa318036900 msgr2=0x7fa318038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa318036900 0x7fa318038dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa418000f60 tx=0x7fa4180012b0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 msgr2=0x55d4c8d52f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d52f50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa420005870 tx=0x7fa420002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 shutdown_connections 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d4c8c570e0 0x55d4c8d5a0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa318036900 0x7fa318038dc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 --2- 172.21.15.131:0/2423697265 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4c8c56780 0x55d4c8d52f50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 >> 172.21.15.131:0/2423697265 conn(0x55d4c8c52320 msgr2=0x55d4c8d45530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 shutdown_connections 2024-04-24T01:43:05.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.414+0000 7fa43412f800 1 -- 172.21.15.131:0/2423697265 wait complete. 2024-04-24T01:43:05.427 INFO:teuthology.orchestra.run.smithi131.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"/J96bOaSz78VmCFioR/HO1kQ","ver":2},"mtime":"2024-04-24T01:43:05.279147Z","data":{"bucket":{"name":"myfoo","marker":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","bucket_id":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-04-24T01:43:02.579344Z","linked":true,"has_bucket_info":false}} 2024-04-24T01:43:05.427 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '/J96bOaSz78VmCFioR/HO1kQ', 'ver': 2}, 'mtime': '2024-04-24T01:43:05.279147Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'bucket_id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-24T01:43:02.579344Z', 'linked': True, 'has_bucket_info': False}} 2024-04-24T01:43:05.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-24T01:43:05.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-24T01:43:05.428 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-24T01:43:05.512 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:05.512 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:05.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.511+0000 7f1728410800 1 Processor -- start 2024-04-24T01:43:05.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.511+0000 7f1728410800 1 -- start start 2024-04-24T01:43:05.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.511+0000 7f1728410800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5628f832f9b0 0x5628f8331da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.511+0000 7f1728410800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628f81edd40 con 0x5628f83322e0 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.511+0000 7f1728410800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5628f81c04d0 con 0x5628f832f9b0 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.512+0000 7f1723bb9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5628f832f9b0 0x5628f8331da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.512+0000 7f1723bb9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5628f832f9b0 0x5628f8331da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42908/0 (socket says 172.21.15.131:42908) 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.512+0000 7f1723bb9640 1 -- 172.21.15.131:0/1874069577 learned_addr learned my addr 172.21.15.131:0/1874069577 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.512+0000 7f171b3b8640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5628f83322e0 0x5628f83346d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56742/0 (socket says 172.21.15.131:56742) 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.512+0000 7f1723bb9640 1 -- 172.21.15.131:0/1874069577 >> v1:172.21.15.107:6789/0 conn(0x5628f83322e0 legacy=0x5628f83346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.512+0000 7f1723bb9640 1 -- 172.21.15.131:0/1874069577 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f81ec590 con 0x5628f832f9b0 2024-04-24T01:43:05.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1723bb9640 1 --2- 172.21.15.131:0/1874069577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8331da0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f171400a520 tx=0x7f171401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a4cb11ff8d9424 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f17233b8640 1 -- 172.21.15.131:0/1874069577 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1714057070 con 0x5628f832f9b0 2024-04-24T01:43:05.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f17233b8640 1 -- 172.21.15.131:0/1874069577 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1714052570 con 0x5628f832f9b0 2024-04-24T01:43:05.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f17233b8640 1 -- 172.21.15.131:0/1874069577 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f171404ae60 con 0x5628f832f9b0 2024-04-24T01:43:05.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1728410800 1 -- 172.21.15.131:0/1874069577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 msgr2=0x5628f8331da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1728410800 1 --2- 172.21.15.131:0/1874069577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8331da0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f171400a520 tx=0x7f171401d010 comp rx=0 tx=0).stop 2024-04-24T01:43:05.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1728410800 1 -- 172.21.15.131:0/1874069577 shutdown_connections 2024-04-24T01:43:05.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1728410800 1 --2- 172.21.15.131:0/1874069577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8331da0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1728410800 1 -- 172.21.15.131:0/1874069577 >> 172.21.15.131:0/1874069577 conn(0x5628f8329340 msgr2=0x5628f832b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1728410800 1 -- 172.21.15.131:0/1874069577 shutdown_connections 2024-04-24T01:43:05.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.514+0000 7f1728410800 1 -- 172.21.15.131:0/1874069577 wait complete. 2024-04-24T01:43:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.526+0000 7f1728410800 1 Processor -- start 2024-04-24T01:43:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.526+0000 7f1728410800 1 -- start start 2024-04-24T01:43:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.526+0000 7f1728410800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f832f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.526+0000 7f1728410800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5628f827a3b0 con 0x5628f832f9b0 2024-04-24T01:43:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.526+0000 7f1723bb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f832f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.526+0000 7f1723bb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f832f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42922/0 (socket says 172.21.15.131:42922) 2024-04-24T01:43:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.526+0000 7f1723bb9640 1 -- 172.21.15.131:0/4223069809 learned_addr learned my addr 172.21.15.131:0/4223069809 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.527+0000 7f1723bb9640 1 -- 172.21.15.131:0/4223069809 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f832d8b0 con 0x5628f832f9b0 2024-04-24T01:43:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.527+0000 7f1723bb9640 1 --2- 172.21.15.131:0/4223069809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f832f2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1714055040 tx=0x7f171404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e494f303cb6cc61d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.527+0000 7f1611e0b640 1 -- 172.21.15.131:0/4223069809 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1714057040 con 0x5628f832f9b0 2024-04-24T01:43:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.527+0000 7f1611e0b640 1 -- 172.21.15.131:0/4223069809 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1714052720 con 0x5628f832f9b0 2024-04-24T01:43:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.527+0000 7f1611e0b640 1 -- 172.21.15.131:0/4223069809 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1714052a40 con 0x5628f832f9b0 2024-04-24T01:43:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 -- 172.21.15.131:0/4223069809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 msgr2=0x5628f832f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 --2- 172.21.15.131:0/4223069809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f832f2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1714055040 tx=0x7f171404c000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 -- 172.21.15.131:0/4223069809 shutdown_connections 2024-04-24T01:43:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 --2- 172.21.15.131:0/4223069809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f832f2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 -- 172.21.15.131:0/4223069809 >> 172.21.15.131:0/4223069809 conn(0x5628f8329340 msgr2=0x5628f841ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 -- 172.21.15.131:0/4223069809 shutdown_connections 2024-04-24T01:43:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 -- 172.21.15.131:0/4223069809 wait complete. 2024-04-24T01:43:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 Processor -- start 2024-04-24T01:43:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 -- start start 2024-04-24T01:43:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8429d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1728410800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5628f8338100 con 0x5628f832f9b0 2024-04-24T01:43:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1723bb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8429d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1723bb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8429d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42932/0 (socket says 172.21.15.131:42932) 2024-04-24T01:43:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.528+0000 7f1723bb9640 1 -- 172.21.15.131:0/3514829133 learned_addr learned my addr 172.21.15.131:0/3514829133 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.529+0000 7f1723bb9640 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f842a2b0 con 0x5628f832f9b0 2024-04-24T01:43:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.529+0000 7f1723bb9640 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8429d70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f17140524f0 tx=0x7f1714003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.529+0000 7f160bfff640 1 -- 172.21.15.131:0/3514829133 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1714073070 con 0x5628f832f9b0 2024-04-24T01:43:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.529+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628f842a540 con 0x5628f832f9b0 2024-04-24T01:43:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.529+0000 7f160bfff640 1 -- 172.21.15.131:0/3514829133 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171405d440 con 0x5628f832f9b0 2024-04-24T01:43:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.529+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f842d1f0 con 0x5628f832f9b0 2024-04-24T01:43:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.529+0000 7f160bfff640 1 -- 172.21.15.131:0/3514829133 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1714057070 con 0x5628f832f9b0 2024-04-24T01:43:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.530+0000 7f160bfff640 1 -- 172.21.15.131:0/3514829133 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1714076070 con 0x5628f832f9b0 2024-04-24T01:43:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.530+0000 7f160bfff640 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f160c036900 0x7f160c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.530+0000 7f160bfff640 1 -- 172.21.15.131:0/3514829133 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f171408dbe0 con 0x5628f832f9b0 2024-04-24T01:43:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.530+0000 7f171b3b8640 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f160c036900 0x7f160c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.530+0000 7f1728410800 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f83322e0 0x5628f8430fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.530+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84314f0 con 0x5628f83322e0 2024-04-24T01:43:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.530+0000 7f17243ba640 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f83322e0 0x5628f8430fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.531+0000 7f171b3b8640 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f160c036900 0x7f160c038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f170c000f60 tx=0x7f170c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.531+0000 7f17243ba640 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f83322e0 0x5628f8430fb0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.531+0000 7f17243ba640 1 -- 172.21.15.131:0/3514829133 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f171c00a4a0 con 0x5628f83322e0 2024-04-24T01:43:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.531+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f842e580 con 0x5628f83322e0 2024-04-24T01:43:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.531+0000 7f17243ba640 1 -- 172.21.15.131:0/3514829133 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f171c00a4a0 con 0x5628f83322e0 2024-04-24T01:43:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.531+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f8433310 con 0x5628f83322e0 2024-04-24T01:43:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.531+0000 7f17243ba640 1 -- 172.21.15.131:0/3514829133 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f171c00a4a0 con 0x5628f83322e0 2024-04-24T01:43:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f8432650 con 0x5628f83322e0 2024-04-24T01:43:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f17243ba640 1 -- 172.21.15.131:0/3514829133 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f171c00a4a0 con 0x5628f83322e0 2024-04-24T01:43:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84329f0 con 0x5628f83322e0 2024-04-24T01:43:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f17243ba640 1 -- 172.21.15.131:0/3514829133 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f171c00a4a0 con 0x5628f83322e0 2024-04-24T01:43:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f1728410800 1 Processor -- start 2024-04-24T01:43:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f1728410800 1 -- start start 2024-04-24T01:43:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f1728410800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f8442180 0x5628f84425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.532+0000 7f1728410800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5628f82206b0 con 0x5628f8442180 2024-04-24T01:43:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.533+0000 7f171b3b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f8442180 0x5628f84425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.533+0000 7f171b3b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f8442180 0x5628f84425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42948/0 (socket says 172.21.15.131:42948) 2024-04-24T01:43:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.533+0000 7f171b3b8640 1 -- 172.21.15.131:0/3078826753 learned_addr learned my addr 172.21.15.131:0/3078826753 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.533+0000 7f171b3b8640 1 -- 172.21.15.131:0/3078826753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f8442ae0 con 0x5628f8442180 2024-04-24T01:43:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.534+0000 7f171b3b8640 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f8442180 0x5628f84425a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f170c001ed0 tx=0x7f170c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.534+0000 7f16097fa640 1 -- 172.21.15.131:0/3078826753 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c022070 con 0x5628f8442180 2024-04-24T01:43:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.534+0000 7f16097fa640 1 -- 172.21.15.131:0/3078826753 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c00d520 con 0x5628f8442180 2024-04-24T01:43:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.534+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628f8443550 con 0x5628f8442180 2024-04-24T01:43:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.534+0000 7f16097fa640 1 -- 172.21.15.131:0/3078826753 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c00d800 con 0x5628f8442180 2024-04-24T01:43:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.534+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f8443a50 con 0x5628f8442180 2024-04-24T01:43:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f16097fa640 1 -- 172.21.15.131:0/3078826753 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f170c025070 con 0x5628f8442180 2024-04-24T01:43:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f16097fa640 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15fc036950 0x7f15fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f16097fa640 1 -- 172.21.15.131:0/3078826753 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f170c04dd30 con 0x5628f8442180 2024-04-24T01:43:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f17243ba640 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15fc036950 0x7f15fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f1728410800 1 Processor -- start 2024-04-24T01:43:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f17243ba640 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15fc036950 0x7f15fc038e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5628f8431d50 tx=0x7f171c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f1728410800 1 -- start start 2024-04-24T01:43:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f1728410800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f844f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.535+0000 7f1728410800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5628f832db70 con 0x5628f844f480 2024-04-24T01:43:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f171b3b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f844f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f171b3b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f844f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42952/0 (socket says 172.21.15.131:42952) 2024-04-24T01:43:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f171b3b8640 1 -- 172.21.15.131:0/894291685 learned_addr learned my addr 172.21.15.131:0/894291685 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f171b3b8640 1 -- 172.21.15.131:0/894291685 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f844fe70 con 0x5628f844f480 2024-04-24T01:43:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f171b3b8640 1 --2- 172.21.15.131:0/894291685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f844f8a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f170c00eee0 tx=0x7f170c024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfb7958efcaf44a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f1602ffd640 1 -- 172.21.15.131:0/894291685 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c04a030 con 0x5628f844f480 2024-04-24T01:43:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f1602ffd640 1 -- 172.21.15.131:0/894291685 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c026730 con 0x5628f844f480 2024-04-24T01:43:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.536+0000 7f1602ffd640 1 -- 172.21.15.131:0/894291685 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c025c50 con 0x5628f844f480 2024-04-24T01:43:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 -- 172.21.15.131:0/894291685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 msgr2=0x5628f844f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 --2- 172.21.15.131:0/894291685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f844f8a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f170c00eee0 tx=0x7f170c024740 comp rx=0 tx=0).stop 2024-04-24T01:43:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 -- 172.21.15.131:0/894291685 shutdown_connections 2024-04-24T01:43:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 --2- 172.21.15.131:0/894291685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f844f8a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 -- 172.21.15.131:0/894291685 >> 172.21.15.131:0/894291685 conn(0x5628f844b7e0 msgr2=0x5628f8449840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 -- 172.21.15.131:0/894291685 shutdown_connections 2024-04-24T01:43:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 -- 172.21.15.131:0/894291685 wait complete. 2024-04-24T01:43:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 Processor -- start 2024-04-24T01:43:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 -- start start 2024-04-24T01:43:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f8456ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f1728410800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5628f84505e0 con 0x5628f844f480 2024-04-24T01:43:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f171b3b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f8456ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f171b3b8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f8456ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42958/0 (socket says 172.21.15.131:42958) 2024-04-24T01:43:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.537+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 learned_addr learned my addr 172.21.15.131:0/54028209 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.538+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f8457000 con 0x5628f844f480 2024-04-24T01:43:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.538+0000 7f171b3b8640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f8456ac0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f170c04b030 tx=0x7f170c04c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.538+0000 7f16017fa640 1 -- 172.21.15.131:0/54028209 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c00dbb0 con 0x5628f844f480 2024-04-24T01:43:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.538+0000 7f16017fa640 1 -- 172.21.15.131:0/54028209 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c00dd50 con 0x5628f844f480 2024-04-24T01:43:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.538+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628f8457000 con 0x5628f844f480 2024-04-24T01:43:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.538+0000 7f16017fa640 1 -- 172.21.15.131:0/54028209 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c01a320 con 0x5628f844f480 2024-04-24T01:43:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.538+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f8457000 con 0x5628f844f480 2024-04-24T01:43:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f16017fa640 1 -- 172.21.15.131:0/54028209 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f170c01a4c0 con 0x5628f844f480 2024-04-24T01:43:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f16017fa640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15ec036950 0x7f15ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f16017fa640 1 -- 172.21.15.131:0/54028209 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f170c045070 con 0x5628f844f480 2024-04-24T01:43:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f17243ba640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15ec036950 0x7f15ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f17243ba640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15ec036950 0x7f15ec038e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5628f8431d20 tx=0x7f171c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f84621b0 0x5628f8464670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f8464dc0 con 0x5628f84621b0 2024-04-24T01:43:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.539+0000 7f1723bb9640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f84621b0 0x5628f8464670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1723bb9640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f84621b0 0x5628f8464670 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 20 realm 2024-04-24T01:43:05.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84651d0 con 0x5628f84621b0 2024-04-24T01:43:05.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:05.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f8465aa0 con 0x5628f84621b0 2024-04-24T01:43:05.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.540+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f8465e40 con 0x5628f84621b0 2024-04-24T01:43:05.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1728410800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f8466690 con 0x5628f84621b0 2024-04-24T01:43:05.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1728410800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:05.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1728410800 20 searching for the correct realm 2024-04-24T01:43:05.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5628f8468400 0x5628f846a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f171b3b8640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5628f8468400 0x5628f846a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f171b3b8640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5628f8468400 0x5628f846a7f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f171b3b8640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f170c01ac20 0x7f170c045270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.541+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f170c01ac20 2024-04-24T01:43:05.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.542+0000 7f17243ba640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f170c01ac20 0x7f170c045270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.542+0000 7f17243ba640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f170c01ac20 0x7f170c045270 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.542+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c01f070 con 0x7f170c01ac20 2024-04-24T01:43:05.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.542+0000 7f17243ba640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f171c031040 0x7f171c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.542+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.542+0000 7f1723bb9640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f171c031040 0x7f171c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.543+0000 7f1723bb9640 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f171c031040 0x7f171c032940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.543+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.543+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f84621b0 2024-04-24T01:43:05.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.543+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.543+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f84621b0 2024-04-24T01:43:05.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.543+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.543+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f170c01ac20 2024-04-24T01:43:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c01f070 con 0x7f170c01ac20 2024-04-24T01:43:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.544+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f84621b0 2024-04-24T01:43:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f84621b0 2024-04-24T01:43:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f170c01ac20 2024-04-24T01:43:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f171c01f070 con 0x7f170c01ac20 2024-04-24T01:43:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.545+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.546+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f84621b0 2024-04-24T01:43:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.547+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.547+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f84621b0 2024-04-24T01:43:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.547+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.547+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.547+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.547+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f170c01ac20 2024-04-24T01:43:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c01f070 con 0x7f170c01ac20 2024-04-24T01:43:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f84621b0 2024-04-24T01:43:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.548+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.549+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.549+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f170c01ac20 2024-04-24T01:43:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.549+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c01f070 con 0x7f170c01ac20 2024-04-24T01:43:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.549+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x5628f8468400 2024-04-24T01:43:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f846ae20 con 0x7f171c031040 2024-04-24T01:43:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f171409f040 con 0x5628f84621b0 2024-04-24T01:43:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f171409f040 con 0x7f170c01ac20 2024-04-24T01:43:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f171c01f070 con 0x7f170c01ac20 2024-04-24T01:43:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.550+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f8467010 con 0x5628f84621b0 2024-04-24T01:43:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84678b0 con 0x5628f84621b0 2024-04-24T01:43:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84678b0 con 0x5628f84621b0 2024-04-24T01:43:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 zone default found 2024-04-24T01:43:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 4 Realm: () 2024-04-24T01:43:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 zonegroup default 2024-04-24T01:43:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.551+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f846b2a0 con 0x7f171c031040 2024-04-24T01:43:05.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f846cc80 con 0x5628f8468400 2024-04-24T01:43:05.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f846d190 con 0x5628f8468400 2024-04-24T01:43:05.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 20 started sync module instance, tier type = 2024-04-24T01:43:05.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:05.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.552+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846c120 con 0x7f170c01ac20 2024-04-24T01:43:05.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.553+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.553+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94733964068112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846bd80 con 0x7f170c01ac20 2024-04-24T01:43:05.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.553+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846e0c0 con 0x5628f84621b0 2024-04-24T01:43:05.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.554+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94733964068112] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.555+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.555+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94733964072432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846e0c0 con 0x5628f84621b0 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.555+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846eac0 con 0x5628f8468400 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.556+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.556+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94733964072432] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.556+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94733964076496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846f360 con 0x5628f8468400 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.556+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846dc30 con 0x7f170c01ac20 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.557+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94733964076496] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.557+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.557+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94733964078768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846fd50 con 0x7f170c01ac20 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.557+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8470710 con 0x5628f84621b0 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.558+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.558+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94733964083808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8470b30 con 0x5628f84621b0 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.558+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84715d0 con 0x7f171c031040 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.558+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94733964078768] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.559+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.559+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94733964083808] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.559+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94733964087488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8471590 con 0x7f171c031040 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.559+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8470680 con 0x7f171c031040 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.560+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94733964087488] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.560+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.560+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94733964084864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8471b60 con 0x7f171c031040 2024-04-24T01:43:05.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.560+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8472430 con 0x7f171c031040 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94733964084864] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94733964081312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8472610 con 0x7f171c031040 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 20 add_watcher() i=0 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 20 add_watcher() i=1 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 20 add_watcher() i=2 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 20 add_watcher() i=3 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 20 add_watcher() i=4 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 20 add_watcher() i=5 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.561+0000 7f1728410800 20 add_watcher() i=6 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.562+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94733964081312] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.562+0000 7f1728410800 20 add_watcher() i=7 2024-04-24T01:43:05.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.562+0000 7f1728410800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.562+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84759e0 con 0x5628f84621b0 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.562+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.562+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94733964092672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8472dd0 con 0x5628f84621b0 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.563+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94733964092672] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.563+0000 7f15d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.563+0000 7f1728410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.563+0000 7f1728410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.563+0000 7f1728410800 5 note: GC not initialized 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f15d8fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 20 Filter name: none 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f15527fc640 20 reqs_thread_entry: start 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:05.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84a8b80 con 0x5628f84621b0 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.564+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84aac60 con 0x5628f84621b0 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 20 rados_obj.operate() r=0 bl.length=193 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T01:43:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.4 8:266a66a6:root::.bucket.meta.testx%3amyfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84ac4b0 con 0x7f170c01ac20 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 20 rados_obj.operate() r=0 bl.length=412 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.565+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b0bb0 con 0x5628f84621b0 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.566+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.566+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b44c0 con 0x7f171c031040 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(66 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [create,call,writefull 0~379,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1728410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x7 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1728410800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1728410800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1728410800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94733964354048 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b3e80 con 0x7f171c031040 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== watch-notify(notify (1) cookie 94733964087488 notify 137438953485 ret 0) ==== 770+0+0 (crc 0 0 0) 0x5628f84b4860 con 0x7f171c031040 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1602ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94733964087488 notifier 4555 bl.length()=728 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1602ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x7 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1602ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1602ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(67 notify.5 [notify cookie 94733964354048 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.568+0000 7f1602ffd640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f15e8003ea0 con 0x7f171c031040 2024-04-24T01:43:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.569+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.569+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== watch-notify(notify_complete (2) cookie 94733964354048 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5628f84b05e0 con 0x7f171c031040 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.569+0000 7f1728410800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_sources= new_sources= 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.569+0000 7f1728410800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential sources added=[] removed=[] 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.569+0000 7f1728410800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_dests= new_dests= 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.569+0000 7f1728410800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential dests added=[] removed=[] 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.569+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b3f20 con 0x7f170c01ac20 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.570+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.570+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b3410 con 0x7f170c01ac20 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f1728410800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f1728410800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f1728410800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94733964360304 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b4ac0 con 0x7f171c031040 2024-04-24T01:43:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== watch-notify(notify (1) cookie 94733964084864 notify 137438953486 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5628f842d1f0 con 0x7f171c031040 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f16027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94733964084864 notifier 4555 bl.length()=314 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f16027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f16027fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(71 notify.6 [notify cookie 94733964360304 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f16027fc640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1558003400 con 0x7f171c031040 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.571+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.572+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== watch-notify(notify_complete (2) cookie 94733964360304 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5628f842a540 con 0x7f171c031040 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.572+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b3a70 con 0x5628f84621b0 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1728410800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1728410800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94733964360304 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b11f0 con 0x5628f84621b0 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== watch-notify(notify (1) cookie 94733964083808 notify 137438953485 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5628f842a540 con 0x5628f84621b0 2024-04-24T01:43:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1602ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94733964083808 notifier 4555 bl.length()=155 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1602ffd640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f15e8003ea0 con 0x5628f84621b0 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(74 notify.4 [notify cookie 94733964360304 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== watch-notify(notify_complete (2) cookie 94733964360304 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5628f842a2b0 con 0x5628f84621b0 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.573+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:76 8.4 8:266a66a6:root::.bucket.meta.testx%3amyfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b4170 con 0x7f170c01ac20 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call,delete] v32'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f1728410800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 from cache 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f1728410800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94733964360304 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f84b4170 con 0x5628f84621b0 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== watch-notify(notify (1) cookie 94733964083808 notify 137438953486 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5628f842a2b0 con 0x5628f84621b0 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f16027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94733964083808 notifier 4555 bl.length()=212 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f16027fc640 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1558003470 con 0x5628f84621b0 2024-04-24T01:43:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.574+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(77 notify.4 [notify cookie 94733964360304 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.575+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== watch-notify(notify_complete (2) cookie 94733964360304 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5628f832d8b0 con 0x5628f84621b0 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.575+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.576+0000 7f15d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.576+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94733964092672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84acb50 con 0x5628f84621b0 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.577+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94733964092672] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.577+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94733964068112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f84abe50 con 0x7f170c01ac20 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.578+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94733964068112] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.578+0000 7f1728410800 20 remove_watcher() i=0 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.578+0000 7f1728410800 2 removed watcher, disabling cache 2024-04-24T01:43:05.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.578+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94733964072432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846c510 con 0x5628f84621b0 2024-04-24T01:43:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.579+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94733964072432] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.579+0000 7f1728410800 20 remove_watcher() i=1 2024-04-24T01:43:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.579+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94733964076496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846d5f0 con 0x5628f8468400 2024-04-24T01:43:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.580+0000 7f171b3b8640 1 -- 172.21.15.131:0/54028209 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94733964076496] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c024030 con 0x5628f8468400 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.580+0000 7f1728410800 20 remove_watcher() i=2 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.580+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94733964078768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846c510 con 0x7f170c01ac20 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.581+0000 7f17243ba640 1 -- 172.21.15.131:0/54028209 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94733964078768] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f171c040040 con 0x7f170c01ac20 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.581+0000 7f1728410800 20 remove_watcher() i=3 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.581+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94733964083808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846eeb0 con 0x5628f84621b0 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.582+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94733964083808] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x5628f84621b0 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.582+0000 7f1728410800 20 remove_watcher() i=4 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.582+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94733964087488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846c510 con 0x7f171c031040 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.583+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94733964087488] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.583+0000 7f1728410800 20 remove_watcher() i=5 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.583+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94733964084864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f8470260 con 0x7f171c031040 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.584+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94733964084864] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.584+0000 7f1728410800 20 remove_watcher() i=6 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.584+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94733964081312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f846c510 con 0x7f171c031040 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94733964081312] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1714075030 con 0x7f171c031040 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 20 remove_watcher() i=7 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f171c031040 msgr2=0x7f171c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f171c031040 0x7f171c032940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f84621b0 msgr2=0x5628f8464670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f84621b0 0x5628f8464670 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f170c01ac20 msgr2=0x7f170c045270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f170c01ac20 0x7f170c045270 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5628f8468400 msgr2=0x5628f846a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5628f8468400 0x5628f846a7f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15ec036950 msgr2=0x7f15ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15ec036950 0x7f15ec038e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5628f8431d20 tx=0x7f171c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1723bb9640 1 -- 172.21.15.131:0/54028209 reap_dead start 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 msgr2=0x5628f8456ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f8456ac0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f170c04b030 tx=0x7f170c04c050 comp rx=0 tx=0).stop 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 shutdown_connections 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 --2- 172.21.15.131:0/54028209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f844f480 0x5628f8456ac0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 >> 172.21.15.131:0/54028209 conn(0x5628f844b7e0 msgr2=0x5628f8448e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 shutdown_connections 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.585+0000 7f1728410800 1 -- 172.21.15.131:0/54028209 wait complete. 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15fc036950 msgr2=0x7f15fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15fc036950 0x7f15fc038e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5628f8431d50 tx=0x7f171c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f8442180 msgr2=0x5628f84425a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f8442180 0x5628f84425a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f170c001ed0 tx=0x7f170c00ea00 comp rx=0 tx=0).stop 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 shutdown_connections 2024-04-24T01:43:05.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f15fc036950 0x7f15fc038e10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3078826753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f8442180 0x5628f84425a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 >> 172.21.15.131:0/3078826753 conn(0x5628f8436220 msgr2=0x5628f8436620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 shutdown_connections 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3078826753 wait complete. 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f83322e0 msgr2=0x5628f8430fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f83322e0 0x5628f8430fb0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f160c036900 msgr2=0x7f160c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f160c036900 0x7f160c038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f170c000f60 tx=0x7f170c001370 comp rx=0 tx=0).stop 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 msgr2=0x5628f8429d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8429d70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f17140524f0 tx=0x7f1714003020 comp rx=0 tx=0).stop 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 shutdown_connections 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5628f83322e0 0x5628f8430fb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f160c036900 0x7f160c038dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 --2- 172.21.15.131:0/3514829133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5628f832f9b0 0x5628f8429d70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 >> 172.21.15.131:0/3514829133 conn(0x5628f8329340 msgr2=0x5628f832e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 shutdown_connections 2024-04-24T01:43:05.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.586+0000 7f1728410800 1 -- 172.21.15.131:0/3514829133 wait complete. 2024-04-24T01:43:05.641 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:43:05.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:43:05.641 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-24T01:43:05.686 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:05.686 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:05.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.685+0000 7f523b087800 1 Processor -- start 2024-04-24T01:43:05.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.685+0000 7f523b087800 1 -- start start 2024-04-24T01:43:05.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.685+0000 7f523b087800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a4caaccd40 0x55a4caacd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.685+0000 7f523b087800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4ca98cd40 con 0x55a4caacdfa0 2024-04-24T01:43:05.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.685+0000 7f523b087800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55a4ca95f4d0 con 0x55a4caaccd40 2024-04-24T01:43:05.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.686+0000 7f5238b86640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a4caaccd40 0x55a4caacd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.686+0000 7f5233fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55a4caacdfa0 0x55a4caace420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56746/0 (socket says 172.21.15.131:56746) 2024-04-24T01:43:05.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.686+0000 7f5233fff640 1 -- 172.21.15.131:0/950362258 learned_addr learned my addr 172.21.15.131:0/950362258 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:05.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.686+0000 7f5238b86640 1 -- 172.21.15.131:0/950362258 >> v1:172.21.15.107:6789/0 conn(0x55a4caacdfa0 legacy=0x55a4caace420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.686+0000 7f5238b86640 1 -- 172.21.15.131:0/950362258 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ca98b590 con 0x55a4caaccd40 2024-04-24T01:43:05.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f5238b86640 1 --2- 172.21.15.131:0/950362258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caacd160 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f522c00a470 tx=0x7f522c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6206a873c18751 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f52337fe640 1 -- 172.21.15.131:0/950362258 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c057070 con 0x55a4caaccd40 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f52337fe640 1 -- 172.21.15.131:0/950362258 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c052570 con 0x55a4caaccd40 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f52337fe640 1 -- 172.21.15.131:0/950362258 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c052870 con 0x55a4caaccd40 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f523b087800 1 -- 172.21.15.131:0/950362258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 msgr2=0x55a4caacd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f523b087800 1 --2- 172.21.15.131:0/950362258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caacd160 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f522c00a470 tx=0x7f522c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f523b087800 1 -- 172.21.15.131:0/950362258 shutdown_connections 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f523b087800 1 --2- 172.21.15.131:0/950362258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caacd160 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f523b087800 1 -- 172.21.15.131:0/950362258 >> 172.21.15.131:0/950362258 conn(0x55a4caac83a0 msgr2=0x55a4caaca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.688+0000 7f523b087800 1 -- 172.21.15.131:0/950362258 shutdown_connections 2024-04-24T01:43:05.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.689+0000 7f523b087800 1 -- 172.21.15.131:0/950362258 wait complete. 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.700+0000 7f523b087800 1 Processor -- start 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.700+0000 7f523b087800 1 -- start start 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.700+0000 7f523b087800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caa41010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.700+0000 7f523b087800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a4caa193b0 con 0x55a4caaccd40 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5238b86640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caa41010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5238b86640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caa41010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42980/0 (socket says 172.21.15.131:42980) 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5238b86640 1 -- 172.21.15.131:0/3885822551 learned_addr learned my addr 172.21.15.131:0/3885822551 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5238b86640 1 -- 172.21.15.131:0/3885822551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cabc2040 con 0x55a4caaccd40 2024-04-24T01:43:05.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5238b86640 1 --2- 172.21.15.131:0/3885822551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caa41010 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f522c000c00 tx=0x7f522c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05676cf17ccf67e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5126e05640 1 -- 172.21.15.131:0/3885822551 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c057070 con 0x55a4caaccd40 2024-04-24T01:43:05.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5126e05640 1 -- 172.21.15.131:0/3885822551 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c063070 con 0x55a4caaccd40 2024-04-24T01:43:05.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.701+0000 7f5126e05640 1 -- 172.21.15.131:0/3885822551 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c052720 con 0x55a4caaccd40 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 -- 172.21.15.131:0/3885822551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 msgr2=0x55a4caa41010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 --2- 172.21.15.131:0/3885822551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caa41010 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f522c000c00 tx=0x7f522c04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 -- 172.21.15.131:0/3885822551 shutdown_connections 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 --2- 172.21.15.131:0/3885822551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4caa41010 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 -- 172.21.15.131:0/3885822551 >> 172.21.15.131:0/3885822551 conn(0x55a4caac83a0 msgr2=0x55a4cabb9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 -- 172.21.15.131:0/3885822551 shutdown_connections 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 -- 172.21.15.131:0/3885822551 wait complete. 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 Processor -- start 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.702+0000 7f523b087800 1 -- start start 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f523b087800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4cabc6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f523b087800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a4caad6410 con 0x55a4caaccd40 2024-04-24T01:43:05.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5238b86640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4cabc6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5238b86640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4cabc6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42992/0 (socket says 172.21.15.131:42992) 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5238b86640 1 -- 172.21.15.131:0/2951211552 learned_addr learned my addr 172.21.15.131:0/2951211552 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5238b86640 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cabc7290 con 0x55a4caaccd40 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5238b86640 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4cabc6d50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f522c060040 tx=0x7f522c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5125602640 1 -- 172.21.15.131:0/2951211552 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c052e30 con 0x55a4caaccd40 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5125602640 1 -- 172.21.15.131:0/2951211552 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c06c070 con 0x55a4caaccd40 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f5125602640 1 -- 172.21.15.131:0/2951211552 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c05e5f0 con 0x55a4caaccd40 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.703+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4cabc7520 con 0x55a4caaccd40 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.704+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4cabca1d0 con 0x55a4caaccd40 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f5125602640 1 -- 172.21.15.131:0/2951211552 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f522c06e030 con 0x55a4caaccd40 2024-04-24T01:43:05.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f5125602640 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5120036900 0x7f5120038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f5125602640 1 -- 172.21.15.131:0/2951211552 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f522c08e4e0 con 0x55a4caaccd40 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f5233fff640 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5120036900 0x7f5120038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f523b087800 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4caacdfa0 0x55a4cabcdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cabce560 con 0x55a4caacdfa0 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f5239387640 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4caacdfa0 0x55a4cabcdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f5233fff640 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5120036900 0x7f5120038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5224001d90 tx=0x7f52240012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.705+0000 7f5239387640 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4caacdfa0 0x55a4cabcdf90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f5239387640 1 -- 172.21.15.131:0/2951211552 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f523400a4a0 con 0x55a4caacdfa0 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cabcb540 con 0x55a4caacdfa0 2024-04-24T01:43:05.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f5239387640 1 -- 172.21.15.131:0/2951211552 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f523400a4a0 con 0x55a4caacdfa0 2024-04-24T01:43:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cabd0360 con 0x55a4caacdfa0 2024-04-24T01:43:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f5239387640 1 -- 172.21.15.131:0/2951211552 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f523400a4a0 con 0x55a4caacdfa0 2024-04-24T01:43:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cabcf6a0 con 0x55a4caacdfa0 2024-04-24T01:43:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f5239387640 1 -- 172.21.15.131:0/2951211552 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f523400a4a0 con 0x55a4caacdfa0 2024-04-24T01:43:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.706+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cabcfac0 con 0x55a4caacdfa0 2024-04-24T01:43:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f5239387640 1 -- 172.21.15.131:0/2951211552 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f523400a4a0 con 0x55a4caacdfa0 2024-04-24T01:43:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f523b087800 1 Processor -- start 2024-04-24T01:43:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f523b087800 1 -- start start 2024-04-24T01:43:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f523b087800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabdf170 0x55a4cabdf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f523b087800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a4ca9bf6b0 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f5233fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabdf170 0x55a4cabdf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f5233fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabdf170 0x55a4cabdf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43000/0 (socket says 172.21.15.131:43000) 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.707+0000 7f5233fff640 1 -- 172.21.15.131:0/2846332394 learned_addr learned my addr 172.21.15.131:0/2846332394 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.708+0000 7f5233fff640 1 -- 172.21.15.131:0/2846332394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cabdfad0 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.708+0000 7f5233fff640 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabdf170 0x55a4cabdf590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f522400efd0 tx=0x7f522400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.708+0000 7f511e7fc640 1 -- 172.21.15.131:0/2846332394 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522401b550 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.708+0000 7f511e7fc640 1 -- 172.21.15.131:0/2846332394 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522401b6f0 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.708+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4cabe0540 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.708+0000 7f511e7fc640 1 -- 172.21.15.131:0/2846332394 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522401b9f0 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.708+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4cabe0a40 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f511e7fc640 1 -- 172.21.15.131:0/2846332394 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5224023020 con 0x55a4cabdf170 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f511e7fc640 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5110036950 0x7f5110038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f511e7fc640 1 -- 172.21.15.131:0/2846332394 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5224021020 con 0x55a4cabdf170 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f5239387640 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5110036950 0x7f5110038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f523b087800 1 Processor -- start 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f5239387640 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5110036950 0x7f5110038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a4cabcfa40 tx=0x7f5234005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f523b087800 1 -- start start 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f523b087800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabec930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.709+0000 7f523b087800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a4cabc22d0 con 0x55a4cabec510 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f5233fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f5233fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabec930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43008/0 (socket says 172.21.15.131:43008) 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f5233fff640 1 -- 172.21.15.131:0/1138282555 learned_addr learned my addr 172.21.15.131:0/1138282555 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f5233fff640 1 -- 172.21.15.131:0/1138282555 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cabecf00 con 0x55a4cabec510 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f5233fff640 1 --2- 172.21.15.131:0/1138282555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabec930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5224024b00 tx=0x7f5224024c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a217fff522ed0f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f510ffff640 1 -- 172.21.15.131:0/1138282555 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5224025410 con 0x55a4cabec510 2024-04-24T01:43:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f510ffff640 1 -- 172.21.15.131:0/1138282555 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224019320 con 0x55a4cabec510 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f510ffff640 1 -- 172.21.15.131:0/1138282555 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52240255b0 con 0x55a4cabec510 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f523b087800 1 -- 172.21.15.131:0/1138282555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 msgr2=0x55a4cabec930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.710+0000 7f523b087800 1 --2- 172.21.15.131:0/1138282555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabec930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5224024b00 tx=0x7f5224024c20 comp rx=0 tx=0).stop 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 -- 172.21.15.131:0/1138282555 shutdown_connections 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 --2- 172.21.15.131:0/1138282555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabec930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 -- 172.21.15.131:0/1138282555 >> 172.21.15.131:0/1138282555 conn(0x55a4cabe8870 msgr2=0x55a4cabe68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 -- 172.21.15.131:0/1138282555 shutdown_connections 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 -- 172.21.15.131:0/1138282555 wait complete. 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 Processor -- start 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 -- start start 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabf3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f523b087800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a4cabed670 con 0x55a4cabec510 2024-04-24T01:43:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f5233fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabf3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f5233fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabf3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43024/0 (socket says 172.21.15.131:43024) 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 learned_addr learned my addr 172.21.15.131:0/2022358420 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.711+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cabf40c0 con 0x55a4cabec510 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.712+0000 7f5233fff640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabf3b80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f522401afd0 tx=0x7f522404cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.712+0000 7f510e7fc640 1 -- 172.21.15.131:0/2022358420 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5224034020 con 0x55a4cabec510 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.712+0000 7f510e7fc640 1 -- 172.21.15.131:0/2022358420 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52240198b0 con 0x55a4cabec510 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.712+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4cabf4350 con 0x55a4cabec510 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.712+0000 7f510e7fc640 1 -- 172.21.15.131:0/2022358420 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5224024370 con 0x55a4cabec510 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.712+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4cabf4350 con 0x55a4cabec510 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.712+0000 7f510e7fc640 1 -- 172.21.15.131:0/2022358420 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5224037020 con 0x55a4cabec510 2024-04-24T01:43:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f510e7fc640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5104036950 0x7f5104038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f510e7fc640 1 -- 172.21.15.131:0/2022358420 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f522403ac40 con 0x55a4cabec510 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f5239387640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5104036950 0x7f5104038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f5239387640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5104036950 0x7f5104038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55a4cabcf1c0 tx=0x7f523401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4cabff4a0 0x55a4cac01960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac020b0 con 0x55a4cabff4a0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.713+0000 7f5238b86640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4cabff4a0 0x55a4cac01960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f5238b86640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4cabff4a0 0x55a4cac01960 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 20 realm 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac024c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac02d90 con 0x55a4cabff4a0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.714+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac03130 con 0x55a4cabff4a0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f523b087800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac03980 con 0x55a4cabff4a0 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f523b087800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f523b087800 20 searching for the correct realm 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a4cac056f0 0x55a4cac07ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f5233fff640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a4cac056f0 0x55a4cac07ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f5233fff640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a4cac056f0 0x55a4cac07ae0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.715+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5233fff640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5224039020 0x7f5224023950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5224039020 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5239387640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5224039020 0x7f5224023950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5239387640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5224039020 0x7f5224023950 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5224039020 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5239387640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5234031040 0x7f5234032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.716+0000 7f5238b86640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5234031040 0x7f5234032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.717+0000 7f5238b86640 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5234031040 0x7f5234032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.717+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.717+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.717+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.717+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.717+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.717+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5224039020 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5224039020 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.718+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5224039020 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f523401f070 con 0x7f5224039020 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.719+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.720+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.721+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.721+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.721+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.721+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.721+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.721+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5224039020 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5224039020 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.722+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5224039020 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5224039020 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cac056f0 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.723+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5234031040 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac080c0 con 0x7f5224039020 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5224039020 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac04300 con 0x55a4cabff4a0 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.724+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac04ba0 con 0x55a4cabff4a0 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac08540 con 0x55a4cabff4a0 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 zone default found 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 4 Realm: () 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:05.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 zonegroup default 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac04800 con 0x7f5234031040 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.725+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0a420 con 0x55a4cac056f0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f523b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0a7c0 con 0x55a4cac056f0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f523b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f523b087800 20 started sync module instance, tier type = 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f523b087800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.726+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac098c0 con 0x7f5224039020 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.727+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.727+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94166264618208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0b0a0 con 0x7f5224039020 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.727+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0b8f0 con 0x55a4cabff4a0 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.728+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94166264618208] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.728+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.728+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94166264622064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0b5c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.728+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0c0e0 con 0x55a4cac056f0 2024-04-24T01:43:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.729+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94166264622064] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.730+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.730+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94166264626096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0c4d0 con 0x55a4cac056f0 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.730+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0cef0 con 0x7f5224039020 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.731+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.731+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94166264629728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0d790 con 0x7f5224039020 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.731+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0e270 con 0x55a4cabff4a0 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.731+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94166264626096] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.732+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94166264629728] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.732+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.732+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94166264634752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0d2e0 con 0x55a4cabff4a0 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.732+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0eb10 con 0x7f5234031040 2024-04-24T01:43:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.733+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94166264634752] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.733+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.733+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94166264623120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0d2e0 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.733+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0f150 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.734+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94166264623120] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.734+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.734+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94166264638496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0f110 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.734+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0fb10 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94166264638496] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94166264636624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0fad0 con 0x7f5234031040 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 20 add_watcher() i=0 2024-04-24T01:43:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 20 add_watcher() i=1 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 20 add_watcher() i=2 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 20 add_watcher() i=3 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 20 add_watcher() i=4 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 20 add_watcher() i=5 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.735+0000 7f523b087800 20 add_watcher() i=6 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.736+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94166264636624] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.736+0000 7f523b087800 20 add_watcher() i=7 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.736+0000 7f523b087800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.736+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac12f00 con 0x55a4cabff4a0 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.736+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.736+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94166264641520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac10420 con 0x55a4cabff4a0 2024-04-24T01:43:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.737+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94166264641520] v32'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.737+0000 7f50eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.738+0000 7f523b087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.738+0000 7f523b087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.738+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac12bf0 con 0x55a4cabff4a0 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.739+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'48 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.739+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1bf70 con 0x7f5234031040 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.740+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.740+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1bf70 con 0x55a4cac056f0 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.741+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.741+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1c370 con 0x55a4cabff4a0 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.742+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'141 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.742+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1c7c0 con 0x7f5224039020 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.743+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.743+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1b5e0 con 0x55a4cac056f0 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.744+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.744+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d320 con 0x55a4cabff4a0 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.745+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.746+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d320 con 0x7f5234031040 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.746+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.747+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d320 con 0x7f5224039020 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.747+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.747+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d7d0 con 0x55a4cac056f0 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.748+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.748+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d7d0 con 0x7f5224039020 2024-04-24T01:43:05.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.749+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.749+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x7f5234031040 2024-04-24T01:43:05.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.750+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.750+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x7f5224039020 2024-04-24T01:43:05.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.751+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.751+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1dc00 con 0x7f5234031040 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.752+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.752+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1dc00 con 0x55a4cabff4a0 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.753+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.753+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1dc00 con 0x55a4cac056f0 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.754+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.754+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1dc00 con 0x7f5224039020 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.755+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'46 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.755+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1dc00 con 0x55a4cac056f0 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.756+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.756+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1ddd0 con 0x55a4cabff4a0 2024-04-24T01:43:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.757+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.757+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d7d0 con 0x55a4cabff4a0 2024-04-24T01:43:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.758+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'143 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.758+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x55a4cac056f0 2024-04-24T01:43:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.759+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.759+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x7f5224039020 2024-04-24T01:43:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.760+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.760+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x55a4cac056f0 2024-04-24T01:43:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.761+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.761+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x55a4cac056f0 2024-04-24T01:43:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.762+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'36 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.762+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x55a4cac056f0 2024-04-24T01:43:05.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.763+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.763+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x55a4cac056f0 2024-04-24T01:43:05.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.764+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.764+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x7f5234031040 2024-04-24T01:43:05.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.764+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.765+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x55a4cac056f0 2024-04-24T01:43:05.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.765+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.765+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x7f5234031040 2024-04-24T01:43:05.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.767+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.767+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x55a4cac056f0 2024-04-24T01:43:05.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.768+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.768+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x7f5234031040 2024-04-24T01:43:05.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.769+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.769+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac1d9a0 con 0x7f5224039020 2024-04-24T01:43:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.770+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.770+0000 7f50edfe3640 20 reqs_thread_entry: start 2024-04-24T01:43:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.770+0000 7f523b087800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.770+0000 7f523b087800 20 Filter name: none 2024-04-24T01:43:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f505f7fe640 20 reqs_thread_entry: start 2024-04-24T01:43:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T01:43:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac48d70 con 0x7f5234031040 2024-04-24T01:43:05.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 20 rados_obj.operate() r=0 bl.length=419 2024-04-24T01:43:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-24T01:43:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:43:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac487f0 con 0x55a4cabff4a0 2024-04-24T01:43:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.771+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.772+0000 7f523b087800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T01:43:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.772+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac487f0 con 0x7f5234031040 2024-04-24T01:43:05.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f523b087800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:43:05.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94166264881872 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4bbb0 con 0x55a4cac056f0 2024-04-24T01:43:05.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== watch-notify(notify (1) cookie 94166264626096 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a4cac1b130 con 0x55a4cac056f0 2024-04-24T01:43:05.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f510ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94166264626096 notifier 4562 bl.length()=170 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(97 notify.2 [notify cookie 94166264881872 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f510ffff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50fc003d60 con 0x55a4cac056f0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== watch-notify(notify_complete (2) cookie 94166264881872 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a4cabecf00 con 0x55a4cac056f0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f523b087800 10 removing email index: 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f523b087800 10 removing user buckets index 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.773+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac49770 con 0x55a4cabff4a0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.774+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.774+0000 7f523b087800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.774+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94166264881872 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4bbb0 con 0x55a4cabff4a0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.774+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== watch-notify(notify (1) cookie 94166264634752 notify 137438953487 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55a4cac1dda0 con 0x55a4cabff4a0 2024-04-24T01:43:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.774+0000 7f510f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94166264634752 notifier 4562 bl.length()=175 2024-04-24T01:43:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.774+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(100 notify.4 [notify cookie 94166264881872 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.774+0000 7f510f7fe640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f506c0032c0 con 0x55a4cabff4a0 2024-04-24T01:43:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.775+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== watch-notify(notify_complete (2) cookie 94166264881872 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a4cac123d0 con 0x55a4cabff4a0 2024-04-24T01:43:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.775+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.775+0000 7f523b087800 10 removing user index: testx$tenanteduser 2024-04-24T01:43:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.775+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x7f5234031040 2024-04-24T01:43:05.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f523b087800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-24T01:43:05.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f523b087800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-24T01:43:05.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94166264894560 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d880 con 0x7f5224039020 2024-04-24T01:43:05.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== watch-notify(notify (1) cookie 94166264629728 notify 137438953491 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55a4cac1d320 con 0x7f5224039020 2024-04-24T01:43:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f510ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94166264629728 notifier 4562 bl.length()=167 2024-04-24T01:43:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(103 notify.3 [notify cookie 94166264894560 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.776+0000 7f510ffff640 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50fc003d60 con 0x7f5224039020 2024-04-24T01:43:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.777+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== watch-notify(notify_complete (2) cookie 94166264894560 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a4cac1b300 con 0x7f5224039020 2024-04-24T01:43:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.777+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.777+0000 7f50eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.778+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94166264641520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x55a4cabff4a0 2024-04-24T01:43:05.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.779+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94166264641520] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.779+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94166264618208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x7f5224039020 2024-04-24T01:43:05.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.780+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94166264618208] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.780+0000 7f523b087800 20 remove_watcher() i=0 2024-04-24T01:43:05.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.780+0000 7f523b087800 2 removed watcher, disabling cache 2024-04-24T01:43:05.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.780+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94166264622064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x55a4cabff4a0 2024-04-24T01:43:05.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.781+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94166264622064] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.781+0000 7f523b087800 20 remove_watcher() i=1 2024-04-24T01:43:05.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.781+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94166264626096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x55a4cac056f0 2024-04-24T01:43:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.782+0000 7f5233fff640 1 -- 172.21.15.131:0/2022358420 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94166264626096] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5224009050 con 0x55a4cac056f0 2024-04-24T01:43:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.782+0000 7f523b087800 20 remove_watcher() i=2 2024-04-24T01:43:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.782+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94166264629728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x7f5224039020 2024-04-24T01:43:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.783+0000 7f5239387640 1 -- 172.21.15.131:0/2022358420 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94166264629728] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5224039020 2024-04-24T01:43:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.783+0000 7f523b087800 20 remove_watcher() i=3 2024-04-24T01:43:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.783+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94166264634752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x55a4cabff4a0 2024-04-24T01:43:05.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.784+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94166264634752] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x55a4cabff4a0 2024-04-24T01:43:05.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.784+0000 7f523b087800 20 remove_watcher() i=4 2024-04-24T01:43:05.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.784+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94166264623120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x7f5234031040 2024-04-24T01:43:05.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.785+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94166264623120] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.785+0000 7f523b087800 20 remove_watcher() i=5 2024-04-24T01:43:05.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.785+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94166264638496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac0bbb0 con 0x7f5234031040 2024-04-24T01:43:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.786+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94166264638496] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.786+0000 7f523b087800 20 remove_watcher() i=6 2024-04-24T01:43:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.786+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94166264636624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4cac4d910 con 0x7f5234031040 2024-04-24T01:43:05.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.786+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94166264636624] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c070410 con 0x7f5234031040 2024-04-24T01:43:05.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.786+0000 7f523b087800 20 remove_watcher() i=7 2024-04-24T01:43:05.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5234031040 msgr2=0x7f5234032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5234031040 0x7f5234032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4cabff4a0 msgr2=0x55a4cac01960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4cabff4a0 0x55a4cac01960 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5224039020 msgr2=0x7f5224023950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5224039020 0x7f5224023950 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a4cac056f0 msgr2=0x55a4cac07ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a4cac056f0 0x55a4cac07ae0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5104036950 msgr2=0x7f5104038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5104036950 0x7f5104038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55a4cabcf1c0 tx=0x7f523401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 msgr2=0x55a4cabf3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2022358420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabec510 0x55a4cabf3b80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f522401afd0 tx=0x7f522404cd40 comp rx=0 tx=0).stop 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 reap_dead start 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f5238b86640 1 -- 172.21.15.131:0/2022358420 reap_dead start 2024-04-24T01:43:05.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 shutdown_connections 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 >> 172.21.15.131:0/2022358420 conn(0x55a4cabe8870 msgr2=0x55a4cabe5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 shutdown_connections 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2022358420 wait complete. 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5110036950 msgr2=0x7f5110038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5110036950 0x7f5110038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a4cabcfa40 tx=0x7f5234005840 comp rx=0 tx=0).stop 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabdf170 msgr2=0x55a4cabdf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabdf170 0x55a4cabdf590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f522400efd0 tx=0x7f522400d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 shutdown_connections 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5110036950 0x7f5110038e10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 --2- 172.21.15.131:0/2846332394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4cabdf170 0x55a4cabdf590 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 >> 172.21.15.131:0/2846332394 conn(0x55a4cabd3210 msgr2=0x55a4cabd3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 shutdown_connections 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.787+0000 7f523b087800 1 -- 172.21.15.131:0/2846332394 wait complete. 2024-04-24T01:43:05.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4caacdfa0 msgr2=0x55a4cabcdf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4caacdfa0 0x55a4cabcdf90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5120036900 msgr2=0x7f5120038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5120036900 0x7f5120038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5224001d90 tx=0x7f52240012f0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 msgr2=0x55a4cabc6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4cabc6d50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f522c060040 tx=0x7f522c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 shutdown_connections 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a4caacdfa0 0x55a4cabcdf90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5120036900 0x7f5120038dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 --2- 172.21.15.131:0/2951211552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a4caaccd40 0x55a4cabc6d50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 >> 172.21.15.131:0/2951211552 conn(0x55a4caac83a0 msgr2=0x55a4cabb83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 shutdown_connections 2024-04-24T01:43:05.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.788+0000 7f523b087800 1 -- 172.21.15.131:0/2951211552 wait complete. 2024-04-24T01:43:05.805 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-24T01:43:05.809 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-24T01:43:05.859 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:05.859 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-24T01:43:05.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-24T01:43:05.859 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-24T01:43:05.905 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:05.905 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe949b2b800 1 Processor -- start 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe949b2b800 1 -- start start 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe949b2b800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a9eaff2ac0 0x55a9eaff1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe949b2b800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a9eaf3bd40 con 0x55a9eaff15b0 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe949b2b800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55a9eaf0e4d0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe945775640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a9eaff2ac0 0x55a9eaff1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe945775640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a9eaff2ac0 0x55a9eaff1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43038/0 (socket says 172.21.15.131:43038) 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe945775640 1 -- 172.21.15.131:0/1822918768 learned_addr learned my addr 172.21.15.131:0/1822918768 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe945775640 1 -- 172.21.15.131:0/1822918768 >> v1:172.21.15.107:6789/0 conn(0x55a9eaff15b0 legacy=0x55a9eb084e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.905+0000 7fe945775640 1 -- 172.21.15.131:0/1822918768 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9eaf3a590 con 0x55a9eaff2ac0 2024-04-24T01:43:05.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.907+0000 7fe945775640 1 --2- 172.21.15.131:0/1822918768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff2ac0 0x55a9eaff1070 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe94000a520 tx=0x7fe94001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128edb297771eb2f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.907+0000 7fe93ffff640 1 -- 172.21.15.131:0/1822918768 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940057070 con 0x55a9eaff2ac0 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.907+0000 7fe93ffff640 1 -- 172.21.15.131:0/1822918768 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe940052570 con 0x55a9eaff2ac0 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.907+0000 7fe93ffff640 1 -- 172.21.15.131:0/1822918768 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe94004ae60 con 0x55a9eaff2ac0 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.908+0000 7fe949b2b800 1 -- 172.21.15.131:0/1822918768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff2ac0 msgr2=0x55a9eaff1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.908+0000 7fe949b2b800 1 --2- 172.21.15.131:0/1822918768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff2ac0 0x55a9eaff1070 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe94000a520 tx=0x7fe94001d010 comp rx=0 tx=0).stop 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.908+0000 7fe949b2b800 1 -- 172.21.15.131:0/1822918768 shutdown_connections 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.908+0000 7fe949b2b800 1 --2- 172.21.15.131:0/1822918768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff2ac0 0x55a9eaff1070 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.908+0000 7fe949b2b800 1 -- 172.21.15.131:0/1822918768 >> 172.21.15.131:0/1822918768 conn(0x55a9eb078550 msgr2=0x55a9eb07a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.908+0000 7fe949b2b800 1 -- 172.21.15.131:0/1822918768 shutdown_connections 2024-04-24T01:43:05.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.908+0000 7fe949b2b800 1 -- 172.21.15.131:0/1822918768 wait complete. 2024-04-24T01:43:05.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.919+0000 7fe949b2b800 1 Processor -- start 2024-04-24T01:43:05.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.919+0000 7fe949b2b800 1 -- start start 2024-04-24T01:43:05.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe949b2b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb170840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe949b2b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a9eafc83b0 con 0x55a9eaff15b0 2024-04-24T01:43:05.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe945775640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb170840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe945775640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb170840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43046/0 (socket says 172.21.15.131:43046) 2024-04-24T01:43:05.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe945775640 1 -- 172.21.15.131:0/1638953212 learned_addr learned my addr 172.21.15.131:0/1638953212 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe945775640 1 -- 172.21.15.131:0/1638953212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9eb170e10 con 0x55a9eaff15b0 2024-04-24T01:43:05.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe945775640 1 --2- 172.21.15.131:0/1638953212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb170840 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe940000c00 tx=0x7fe94004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5493b24c0728360 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.920+0000 7fe833606640 1 -- 172.21.15.131:0/1638953212 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940057040 con 0x55a9eaff15b0 2024-04-24T01:43:05.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe833606640 1 -- 172.21.15.131:0/1638953212 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe940052720 con 0x55a9eaff15b0 2024-04-24T01:43:05.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe833606640 1 -- 172.21.15.131:0/1638953212 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940052a40 con 0x55a9eaff15b0 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe949b2b800 1 -- 172.21.15.131:0/1638953212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 msgr2=0x55a9eb170840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe949b2b800 1 --2- 172.21.15.131:0/1638953212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb170840 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe940000c00 tx=0x7fe94004c000 comp rx=0 tx=0).stop 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe949b2b800 1 -- 172.21.15.131:0/1638953212 shutdown_connections 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe949b2b800 1 --2- 172.21.15.131:0/1638953212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb170840 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe949b2b800 1 -- 172.21.15.131:0/1638953212 >> 172.21.15.131:0/1638953212 conn(0x55a9eb078550 msgr2=0x55a9eb16c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe949b2b800 1 -- 172.21.15.131:0/1638953212 shutdown_connections 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.921+0000 7fe949b2b800 1 -- 172.21.15.131:0/1638953212 wait complete. 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe949b2b800 1 Processor -- start 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe949b2b800 1 -- start start 2024-04-24T01:43:05.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe949b2b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb178320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe949b2b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a9eb088830 con 0x55a9eaff15b0 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe945775640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb178320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe945775640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb178320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43060/0 (socket says 172.21.15.131:43060) 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe945775640 1 -- 172.21.15.131:0/3278364315 learned_addr learned my addr 172.21.15.131:0/3278364315 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe945775640 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9eb178860 con 0x55a9eaff15b0 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe945775640 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb178320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe940052540 tx=0x7fe940003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.922+0000 7fe831e03640 1 -- 172.21.15.131:0/3278364315 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940073070 con 0x55a9eaff15b0 2024-04-24T01:43:05.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.923+0000 7fe831e03640 1 -- 172.21.15.131:0/3278364315 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe940052c80 con 0x55a9eaff15b0 2024-04-24T01:43:05.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.923+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9eb178af0 con 0x55a9eaff15b0 2024-04-24T01:43:05.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.923+0000 7fe831e03640 1 -- 172.21.15.131:0/3278364315 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940057070 con 0x55a9eaff15b0 2024-04-24T01:43:05.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.923+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9eb17b7a0 con 0x55a9eaff15b0 2024-04-24T01:43:05.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.923+0000 7fe831e03640 1 -- 172.21.15.131:0/3278364315 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe940076070 con 0x55a9eaff15b0 2024-04-24T01:43:05.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.923+0000 7fe831e03640 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe82c036950 0x7fe82c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe831e03640 1 -- 172.21.15.131:0/3278364315 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe94008da30 con 0x55a9eaff15b0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe944f74640 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe82c036950 0x7fe82c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eaff2ac0 0x55a9eb17f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb17faa0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe945f76640 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eaff2ac0 0x55a9eb17f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe944f74640 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe82c036950 0x7fe82c038e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe930001e10 tx=0x7fe930001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe945f76640 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eaff2ac0 0x55a9eb17f560 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe945f76640 1 -- 172.21.15.131:0/3278364315 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.924+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb180380 con 0x55a9eaff2ac0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.925+0000 7fe945f76640 1 -- 172.21.15.131:0/3278364315 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe93800a4a0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.925+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb181730 con 0x55a9eaff2ac0 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.925+0000 7fe945f76640 1 -- 172.21.15.131:0/3278364315 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe93800a4a0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.925+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb180bd0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.925+0000 7fe945f76640 1 -- 172.21.15.131:0/3278364315 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe93800a4a0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.925+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb180fb0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe945f76640 1 -- 172.21.15.131:0/3278364315 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe93800a4a0 con 0x55a9eaff2ac0 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe949b2b800 1 Processor -- start 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe949b2b800 1 -- start start 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe949b2b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb190740 0x55a9eb190b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe949b2b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a9eaf6e6b0 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe944f74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb190740 0x55a9eb190b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe944f74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb190740 0x55a9eb190b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43066/0 (socket says 172.21.15.131:43066) 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.926+0000 7fe944f74640 1 -- 172.21.15.131:0/3162704200 learned_addr learned my addr 172.21.15.131:0/3162704200 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.927+0000 7fe944f74640 1 -- 172.21.15.131:0/3162704200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9eb1910a0 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.927+0000 7fe944f74640 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb190740 0x55a9eb190b60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe930001770 tx=0x7fe93000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.927+0000 7fe82affd640 1 -- 172.21.15.131:0/3162704200 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe93001c410 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.927+0000 7fe82affd640 1 -- 172.21.15.131:0/3162704200 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe930017050 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.927+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9eb191b10 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.927+0000 7fe82affd640 1 -- 172.21.15.131:0/3162704200 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe93001c6e0 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.927+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9eb192010 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe82affd640 1 -- 172.21.15.131:0/3162704200 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe93000e070 con 0x55a9eb190740 2024-04-24T01:43:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe82affd640 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe81c036950 0x7fe81c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe82affd640 1 -- 172.21.15.131:0/3162704200 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe93004dfe0 con 0x55a9eb190740 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe945f76640 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe81c036950 0x7fe81c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe949b2b800 1 Processor -- start 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe945f76640 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe81c036950 0x7fe81c038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a9eb17cc90 tx=0x7fe938005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe949b2b800 1 -- start start 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe949b2b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb19df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.928+0000 7fe949b2b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a9eb1710d0 con 0x55a9eb19dae0 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe944f74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb19df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe944f74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb19df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43070/0 (socket says 172.21.15.131:43070) 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe944f74640 1 -- 172.21.15.131:0/547169766 learned_addr learned my addr 172.21.15.131:0/547169766 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe944f74640 1 -- 172.21.15.131:0/547169766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9eb19e4d0 con 0x55a9eb19dae0 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe944f74640 1 --2- 172.21.15.131:0/547169766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb19df00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe93004c350 tx=0x7fe93001ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea3e87d3b5bdb0c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe828ff9640 1 -- 172.21.15.131:0/547169766 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9300249c0 con 0x55a9eb19dae0 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe828ff9640 1 -- 172.21.15.131:0/547169766 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe93003b240 con 0x55a9eb19dae0 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.929+0000 7fe828ff9640 1 -- 172.21.15.131:0/547169766 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe930025780 con 0x55a9eb19dae0 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 -- 172.21.15.131:0/547169766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 msgr2=0x55a9eb19df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 --2- 172.21.15.131:0/547169766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb19df00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe93004c350 tx=0x7fe93001ab30 comp rx=0 tx=0).stop 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 -- 172.21.15.131:0/547169766 shutdown_connections 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 --2- 172.21.15.131:0/547169766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb19df00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 -- 172.21.15.131:0/547169766 >> 172.21.15.131:0/547169766 conn(0x55a9eb199e40 msgr2=0x55a9eb197ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 -- 172.21.15.131:0/547169766 shutdown_connections 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 -- 172.21.15.131:0/547169766 wait complete. 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 Processor -- start 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 -- start start 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb1a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe949b2b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a9eb19ec40 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe944f74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb1a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe944f74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb1a51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43086/0 (socket says 172.21.15.131:43086) 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.930+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 learned_addr learned my addr 172.21.15.131:0/3341021409 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9eb1a5700 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe944f74640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb1a51c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe93001ab70 tx=0x7fe93004c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe81affd640 1 -- 172.21.15.131:0/3341021409 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe93001ba30 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe81affd640 1 -- 172.21.15.131:0/3341021409 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe930033070 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9eb1a5700 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe81affd640 1 -- 172.21.15.131:0/3341021409 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe93001bd60 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9eb1a5700 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.931+0000 7fe81affd640 1 -- 172.21.15.131:0/3341021409 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe930050030 con 0x55a9eb19dae0 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe81affd640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe810036950 0x7fe810038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe81affd640 1 -- 172.21.15.131:0/3341021409 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe9300270b0 con 0x55a9eb19dae0 2024-04-24T01:43:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe945f76640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe810036950 0x7fe810038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe945f76640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe810036950 0x7fe810038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a9eb17cc60 tx=0x7fe93801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eb1b0910 0x55a9eb1b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b3520 con 0x55a9eb1b0910 2024-04-24T01:43:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.932+0000 7fe945775640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eb1b0910 0x55a9eb1b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe945775640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eb1b0910 0x55a9eb1b2dd0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 20 realm 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b3930 con 0x55a9eb1b0910 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b4200 con 0x55a9eb1b0910 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.933+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b45a0 con 0x55a9eb1b0910 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe949b2b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b4df0 con 0x55a9eb1b0910 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe949b2b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe949b2b800 20 searching for the correct realm 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a9eb1b6b60 0x55a9eb1b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe944f74640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a9eb1b6b60 0x55a9eb1b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.934+0000 7fe944f74640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a9eb1b6b60 0x55a9eb1b8f50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe944f74640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe930024360 0x7fe93004c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe930024360 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe945f76640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe930024360 0x7fe93004c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe945f76640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe930024360 0x7fe93004c710 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93801f070 con 0x7fe930024360 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe945f76640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe938031040 0x7fe938032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.935+0000 7fe945775640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe938031040 0x7fe938032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.936+0000 7fe945775640 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe938031040 0x7fe938032940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.936+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.936+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b0910 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.936+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.936+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b0910 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.936+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.936+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe930024360 2024-04-24T01:43:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93801f070 con 0x7fe930024360 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.937+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b0910 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b0910 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe930024360 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe93801f070 con 0x7fe930024360 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.938+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.939+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b0910 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b0910 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.940+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe930024360 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.941+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93801f070 con 0x7fe930024360 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.941+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b0910 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.941+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.941+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.941+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.941+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x55a9eb1b6b60 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b9530 con 0x7fe938031040 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe9400a2040 con 0x7fe930024360 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93801f070 con 0x7fe930024360 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe9400a2040 con 0x55a9eb1b6b60 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.942+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe9400a2040 con 0x7fe938031040 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.943+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.943+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe9400a2040 con 0x55a9eb1b0910 2024-04-24T01:43:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.943+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.943+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe9400a2040 con 0x7fe930024360 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe93801f070 con 0x7fe930024360 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b5740 con 0x55a9eb1b0910 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b5fe0 con 0x55a9eb1b0910 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b5fe0 con 0x55a9eb1b0910 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 zone default found 2024-04-24T01:43:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 4 Realm: () 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 zonegroup default 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.944+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1b99b0 con 0x7fe938031040 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bb390 con 0x55a9eb1b6b60 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bb850 con 0x55a9eb1b6b60 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 20 started sync module instance, tier type = 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.945+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ba830 con 0x7fe930024360 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.946+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.946+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94188282293280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ba490 con 0x7fe930024360 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.946+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bc780 con 0x55a9eb1b0910 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.947+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94188282293280] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.947+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.947+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94188282297520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bc780 con 0x55a9eb1b0910 2024-04-24T01:43:05.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.947+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bd180 con 0x55a9eb1b6b60 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.948+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94188282297520] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.949+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.949+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94188282299088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bc6f0 con 0x55a9eb1b6b60 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.949+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bdf40 con 0x7fe930024360 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.949+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94188282299088] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.950+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.950+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94188282303856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1be330 con 0x7fe930024360 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.950+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bed50 con 0x55a9eb1b0910 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.951+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.951+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94188282308672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bed10 con 0x55a9eb1b0910 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.951+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bfd10 con 0x7fe938031040 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.951+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94188282303856] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.952+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.952+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94188282308672] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.952+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94188282312768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1bfd10 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.952+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1c0270 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.953+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.953+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94188282310832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1c0720 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.953+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1c1120 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.953+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94188282312768] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.953+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94188282310832] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.953+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94188282304912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1c0270 con 0x7fe938031040 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 20 add_watcher() i=0 2024-04-24T01:43:05.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 20 add_watcher() i=1 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 20 add_watcher() i=2 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 20 add_watcher() i=3 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 20 add_watcher() i=4 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 20 add_watcher() i=5 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.954+0000 7fe949b2b800 20 add_watcher() i=6 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.955+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94188282304912] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.955+0000 7fe949b2b800 20 add_watcher() i=7 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.955+0000 7fe949b2b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.955+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1c4220 con 0x55a9eb1b0910 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.955+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.955+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94188282317872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1c16a0 con 0x55a9eb1b0910 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.956+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94188282317872] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.956+0000 7fe7fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.956+0000 7fe949b2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.956+0000 7fe949b2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.956+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cc8d0 con 0x55a9eb1b0910 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.957+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'49 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.957+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ccfa0 con 0x7fe938031040 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.958+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.958+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ccfa0 con 0x55a9eb1b6b60 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.959+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.959+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cd7f0 con 0x55a9eb1b0910 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.960+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'146 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.960+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cd7f0 con 0x7fe930024360 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.961+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.961+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cdd60 con 0x55a9eb1b6b60 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.962+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.962+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ce190 con 0x55a9eb1b0910 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.964+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.964+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ce190 con 0x7fe938031040 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.965+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.965+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cd510 con 0x7fe930024360 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.966+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.966+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ce7c0 con 0x55a9eb1b6b60 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.967+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.967+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ce7c0 con 0x7fe930024360 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.968+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.968+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ced30 con 0x7fe938031040 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.969+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.969+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1ced30 con 0x7fe930024360 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.970+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.970+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x7fe938031040 2024-04-24T01:43:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.971+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.971+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b0910 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.972+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'147 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.972+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.973+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.973+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x7fe930024360 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.974+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'49 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.974+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.975+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.975+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b0910 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.976+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.977+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b0910 2024-04-24T01:43:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.977+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'148 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.977+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.978+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.979+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x7fe930024360 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.979+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.979+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.980+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.980+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.981+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.981+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.982+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.982+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.983+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.983+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x7fe938031040 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.984+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.984+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.985+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.985+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x7fe938031040 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.986+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.986+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x55a9eb1b6b60 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.987+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.987+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x7fe938031040 2024-04-24T01:43:05.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.988+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.988+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1cf150 con 0x7fe930024360 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.989+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe7fa7e4640 20 reqs_thread_entry: start 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 20 Filter name: none 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe76bfff640 20 reqs_thread_entry: start 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1f9e80 con 0x7fe930024360 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.990+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:95 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1fb920 con 0x7fe938031040 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(95 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:05.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 20 get_obj_state: octx=0x7fe94000a4d0 obj=myfoo:four state=0x55a9eb1fcc08 s->prefetch_data=0 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:96 3.as0 3:52740903:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb1fda30 con 0x55a9eb1b6b60 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(96 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 10 manifest: total_size = 4 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.6981663333025042459 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 20 get_obj_state: octx=0x7fe94000a4d0 obj=myfoo:four state=0x55a9eb1fcc08 s->prefetch_data=0 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 20 prepare_atomic_modification: state is not atomic. state=0x55a9eb1fcc08 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 2024-04-24T01:43:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.991+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:97 4.11 4:8b3156cf:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202410 con 0x7fe938031040 2024-04-24T01:43:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.992+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(97 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.992+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 3.as0 3:52740903:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202410 con 0x55a9eb1b6b60 2024-04-24T01:43:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.993+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(98 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.994+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:99 4.11 4:8b3156cf:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x7fe938031040 2024-04-24T01:43:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.994+0000 7fe7fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.995+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94188282317872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x55a9eb1b0910 2024-04-24T01:43:05.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.995+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(99 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:05.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.995+0000 7fe828ff9640 20 handle_completion(): completion ok for obj=four 2024-04-24T01:43:05.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.996+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94188282317872] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:05.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.996+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94188282293280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x7fe930024360 2024-04-24T01:43:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.997+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94188282293280] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.997+0000 7fe949b2b800 20 remove_watcher() i=0 2024-04-24T01:43:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.997+0000 7fe949b2b800 2 removed watcher, disabling cache 2024-04-24T01:43:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.997+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94188282297520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x55a9eb1b0910 2024-04-24T01:43:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.998+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94188282297520] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.998+0000 7fe949b2b800 20 remove_watcher() i=1 2024-04-24T01:43:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.998+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94188282299088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x55a9eb1b6b60 2024-04-24T01:43:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.999+0000 7fe944f74640 1 -- 172.21.15.131:0/3341021409 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94188282299088] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93004cd50 con 0x55a9eb1b6b60 2024-04-24T01:43:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.999+0000 7fe949b2b800 20 remove_watcher() i=2 2024-04-24T01:43:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:05.999+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94188282303856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x7fe930024360 2024-04-24T01:43:06.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.000+0000 7fe945f76640 1 -- 172.21.15.131:0/3341021409 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94188282303856] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe938040040 con 0x7fe930024360 2024-04-24T01:43:06.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.000+0000 7fe949b2b800 20 remove_watcher() i=3 2024-04-24T01:43:06.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.000+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94188282308672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x55a9eb1b0910 2024-04-24T01:43:06.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.001+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94188282308672] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x55a9eb1b0910 2024-04-24T01:43:06.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.001+0000 7fe949b2b800 20 remove_watcher() i=4 2024-04-24T01:43:06.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.001+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94188282312768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x7fe938031040 2024-04-24T01:43:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.001+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94188282312768] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.002+0000 7fe949b2b800 20 remove_watcher() i=5 2024-04-24T01:43:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.002+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94188282310832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x7fe938031040 2024-04-24T01:43:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.003+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94188282310832] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.003+0000 7fe949b2b800 20 remove_watcher() i=6 2024-04-24T01:43:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.003+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94188282304912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9eb202ea0 con 0x7fe938031040 2024-04-24T01:43:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94188282304912] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe940075030 con 0x7fe938031040 2024-04-24T01:43:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 20 remove_watcher() i=7 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe938031040 msgr2=0x7fe938032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe938031040 0x7fe938032940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eb1b0910 msgr2=0x55a9eb1b2dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eb1b0910 0x55a9eb1b2dd0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe930024360 msgr2=0x7fe93004c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe930024360 0x7fe93004c710 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a9eb1b6b60 msgr2=0x55a9eb1b8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a9eb1b6b60 0x55a9eb1b8f50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe810036950 msgr2=0x7fe810038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe810036950 0x7fe810038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a9eb17cc60 tx=0x7fe93801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe945775640 1 -- 172.21.15.131:0/3341021409 reap_dead start 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 msgr2=0x55a9eb1a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb1a51c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe93001ab70 tx=0x7fe93004c2e0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 shutdown_connections 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3341021409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb19dae0 0x55a9eb1a51c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 >> 172.21.15.131:0/3341021409 conn(0x55a9eb199e40 msgr2=0x55a9eb1974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 shutdown_connections 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3341021409 wait complete. 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe81c036950 msgr2=0x7fe81c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe81c036950 0x7fe81c038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a9eb17cc90 tx=0x7fe938005840 comp rx=0 tx=0).stop 2024-04-24T01:43:06.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb190740 msgr2=0x55a9eb190b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb190740 0x55a9eb190b60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe930001770 tx=0x7fe93000f790 comp rx=0 tx=0).stop 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 shutdown_connections 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe81c036950 0x7fe81c038e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3162704200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eb190740 0x55a9eb190b60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 >> 172.21.15.131:0/3162704200 conn(0x55a9eb1847e0 msgr2=0x55a9eb184be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 shutdown_connections 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.004+0000 7fe949b2b800 1 -- 172.21.15.131:0/3162704200 wait complete. 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eaff2ac0 msgr2=0x55a9eb17f560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eaff2ac0 0x55a9eb17f560 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe82c036950 msgr2=0x7fe82c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe82c036950 0x7fe82c038e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe930001e10 tx=0x7fe930001390 comp rx=0 tx=0).stop 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 msgr2=0x55a9eb178320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb178320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe940052540 tx=0x7fe940003020 comp rx=0 tx=0).stop 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 shutdown_connections 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a9eaff2ac0 0x55a9eb17f560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe82c036950 0x7fe82c038e10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 --2- 172.21.15.131:0/3278364315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a9eaff15b0 0x55a9eb178320 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 >> 172.21.15.131:0/3278364315 conn(0x55a9eb078550 msgr2=0x55a9eb16a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 shutdown_connections 2024-04-24T01:43:06.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.005+0000 7fe949b2b800 1 -- 172.21.15.131:0/3278364315 wait complete. 2024-04-24T01:43:06.015 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:43:06.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:43:06.015 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T01:43:06.057 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:06.057 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.056+0000 7f3e3352d800 1 Processor -- start 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.056+0000 7f3e3352d800 1 -- start start 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e3352d800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558b3d01d8f0 0x558b3d01fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e3352d800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b3cedbd40 con 0x558b3d020220 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e3352d800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x558b3ceae4d0 con 0x558b3d01d8f0 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e2f1ae640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558b3d01d8f0 0x558b3d01fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e2e9ad640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x558b3d020220 0x558b3d022610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56768/0 (socket says 172.21.15.131:56768) 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e2f1ae640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558b3d01d8f0 0x558b3d01fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43088/0 (socket says 172.21.15.131:43088) 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/2340809233 learned_addr learned my addr 172.21.15.131:0/2340809233 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/2340809233 >> v1:172.21.15.107:6789/0 conn(0x558b3d020220 legacy=0x558b3d022610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.057+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/2340809233 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3ceda590 con 0x558b3d01d8f0 2024-04-24T01:43:06.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.059+0000 7f3e2f1ae640 1 --2- 172.21.15.131:0/2340809233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01fce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000a470 tx=0x7f3e2001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0394a5e21a04ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.059+0000 7f3e2e1ac640 1 -- 172.21.15.131:0/2340809233 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e20057070 con 0x558b3d01d8f0 2024-04-24T01:43:06.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.059+0000 7f3e2e1ac640 1 -- 172.21.15.131:0/2340809233 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e20052570 con 0x558b3d01d8f0 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.059+0000 7f3e2e1ac640 1 -- 172.21.15.131:0/2340809233 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e20052870 con 0x558b3d01d8f0 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.060+0000 7f3e3352d800 1 -- 172.21.15.131:0/2340809233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 msgr2=0x558b3d01fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.060+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2340809233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01fce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000a470 tx=0x7f3e2001ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.060+0000 7f3e3352d800 1 -- 172.21.15.131:0/2340809233 shutdown_connections 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.060+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2340809233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01fce0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.060+0000 7f3e3352d800 1 -- 172.21.15.131:0/2340809233 >> 172.21.15.131:0/2340809233 conn(0x558b3d017300 msgr2=0x558b3d019720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.060+0000 7f3e3352d800 1 -- 172.21.15.131:0/2340809233 shutdown_connections 2024-04-24T01:43:06.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.060+0000 7f3e3352d800 1 -- 172.21.15.131:0/2340809233 wait complete. 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.071+0000 7f3e3352d800 1 Processor -- start 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.071+0000 7f3e3352d800 1 -- start start 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3e3352d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d10e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3e3352d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558b3cf683c0 con 0x558b3d01d8f0 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3e2f1ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d10e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3e2f1ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d10e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43104/0 (socket says 172.21.15.131:43104) 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/2247634483 learned_addr learned my addr 172.21.15.131:0/2247634483 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/2247634483 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d10e6c0 con 0x558b3d01d8f0 2024-04-24T01:43:06.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3e2f1ae640 1 --2- 172.21.15.131:0/2247634483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d10e0f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3e20055040 tx=0x7f3e2004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ef7964905b3d6a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3d1d60a640 1 -- 172.21.15.131:0/2247634483 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e20057070 con 0x558b3d01d8f0 2024-04-24T01:43:06.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3d1d60a640 1 -- 172.21.15.131:0/2247634483 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e20063070 con 0x558b3d01d8f0 2024-04-24T01:43:06.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.072+0000 7f3d1d60a640 1 -- 172.21.15.131:0/2247634483 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e20052720 con 0x558b3d01d8f0 2024-04-24T01:43:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 -- 172.21.15.131:0/2247634483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 msgr2=0x558b3d10e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2247634483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d10e0f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3e20055040 tx=0x7f3e2004c000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 -- 172.21.15.131:0/2247634483 shutdown_connections 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2247634483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d10e0f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 -- 172.21.15.131:0/2247634483 >> 172.21.15.131:0/2247634483 conn(0x558b3d017300 msgr2=0x558b3d109a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 -- 172.21.15.131:0/2247634483 shutdown_connections 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 -- 172.21.15.131:0/2247634483 wait complete. 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 Processor -- start 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.073+0000 7f3e3352d800 1 -- start start 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e3352d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e3352d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558b3d023fd0 con 0x558b3d01d8f0 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e2f1ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e2f1ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43108/0 (socket says 172.21.15.131:43108) 2024-04-24T01:43:06.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1054132221 learned_addr learned my addr 172.21.15.131:0/1054132221 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d01b900 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e2f1ae640 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01d210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e20060040 tx=0x7f3e20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3d1be07640 1 -- 172.21.15.131:0/1054132221 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e20052e30 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3d1be07640 1 -- 172.21.15.131:0/1054132221 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2006c070 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b3d01bb90 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3d1be07640 1 -- 172.21.15.131:0/1054132221 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e2005e5f0 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.074+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b3d01c110 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.075+0000 7f3d1be07640 1 -- 172.21.15.131:0/1054132221 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3e2005e790 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.075+0000 7f3d1be07640 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d14036900 0x7f3d14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.075+0000 7f3d1be07640 1 -- 172.21.15.131:0/1054132221 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3e2008e8d0 con 0x558b3d01d8f0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.075+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d14036900 0x7f3d14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d020220 0x558b3d11f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d11f660 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d020220 0x558b3d11f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d020220 0x558b3d11f120 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d14036900 0x7f3d14038dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000f60 tx=0x7f3e240012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1054132221 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e2800a4a0 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d11fab0 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.076+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1054132221 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e2800a4a0 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.077+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1213b0 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.077+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1054132221 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e2800a4a0 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.077+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1206f0 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.077+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1054132221 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e2800a4a0 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.077+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d120b40 con 0x558b3d020220 2024-04-24T01:43:06.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.077+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1054132221 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e2800a4a0 con 0x558b3d020220 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e3352d800 1 Processor -- start 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e3352d800 1 -- start start 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e3352d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d130180 0x558b3d1305a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e3352d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558b3cf0e6b0 con 0x558b3d130180 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e2e9ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d130180 0x558b3d1305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e2e9ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d130180 0x558b3d1305a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43122/0 (socket says 172.21.15.131:43122) 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/2519454504 learned_addr learned my addr 172.21.15.131:0/2519454504 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.078+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/2519454504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d130ae0 con 0x558b3d130180 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.079+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d130180 0x558b3d1305a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e24001ed0 tx=0x7f3e2400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.079+0000 7f3d19602640 1 -- 172.21.15.131:0/2519454504 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e2401b550 con 0x558b3d130180 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.079+0000 7f3d19602640 1 -- 172.21.15.131:0/2519454504 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2401b6f0 con 0x558b3d130180 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.079+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b3d131550 con 0x558b3d130180 2024-04-24T01:43:06.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.079+0000 7f3d19602640 1 -- 172.21.15.131:0/2519454504 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e2401b9d0 con 0x558b3d130180 2024-04-24T01:43:06.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.079+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b3d131a50 con 0x558b3d130180 2024-04-24T01:43:06.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.079+0000 7f3d19602640 1 -- 172.21.15.131:0/2519454504 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3e24023020 con 0x558b3d130180 2024-04-24T01:43:06.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3d19602640 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d08036950 0x7f3d08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3d19602640 1 -- 172.21.15.131:0/2519454504 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3e24021020 con 0x558b3d130180 2024-04-24T01:43:06.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d08036950 0x7f3d08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e3352d800 1 Processor -- start 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e3352d800 1 -- start start 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d08036950 0x7f3d08038e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x558b3d120210 tx=0x7f3e28005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e3352d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d13d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e3352d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558b3d10e980 con 0x558b3d13d4c0 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e2e9ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d13d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e2e9ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d13d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43132/0 (socket says 172.21.15.131:43132) 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.080+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/2112762416 learned_addr learned my addr 172.21.15.131:0/2112762416 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/2112762416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d13deb0 con 0x558b3d13d4c0 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/2112762416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d13d8e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3e2404ce60 tx=0x7f3e2404d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b40a473f4ff02b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3d12ffd640 1 -- 172.21.15.131:0/2112762416 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e24024c20 con 0x558b3d13d4c0 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3d12ffd640 1 -- 172.21.15.131:0/2112762416 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2404a070 con 0x558b3d13d4c0 2024-04-24T01:43:06.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3d12ffd640 1 -- 172.21.15.131:0/2112762416 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e24025410 con 0x558b3d13d4c0 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3e3352d800 1 -- 172.21.15.131:0/2112762416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 msgr2=0x558b3d13d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2112762416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d13d8e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3e2404ce60 tx=0x7f3e2404d020 comp rx=0 tx=0).stop 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3e3352d800 1 -- 172.21.15.131:0/2112762416 shutdown_connections 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2112762416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d13d8e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.081+0000 7f3e3352d800 1 -- 172.21.15.131:0/2112762416 >> 172.21.15.131:0/2112762416 conn(0x558b3d139820 msgr2=0x558b3d137880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e3352d800 1 -- 172.21.15.131:0/2112762416 shutdown_connections 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e3352d800 1 -- 172.21.15.131:0/2112762416 wait complete. 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e3352d800 1 Processor -- start 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e3352d800 1 -- start start 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e3352d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e3352d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558b3d13e620 con 0x558b3d13d4c0 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e2e9ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e2e9ad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d144b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43142/0 (socket says 172.21.15.131:43142) 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 learned_addr learned my addr 172.21.15.131:0/1137317852 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.082+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d145060 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.083+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d144b20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3e2404bd50 tx=0x7f3e2404cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.083+0000 7f3d117fa640 1 -- 172.21.15.131:0/1137317852 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e24034070 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.083+0000 7f3d117fa640 1 -- 172.21.15.131:0/1137317852 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e24025550 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.083+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b3d1452f0 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.083+0000 7f3d117fa640 1 -- 172.21.15.131:0/1137317852 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e24024370 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.083+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b3d1452f0 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.083+0000 7f3d117fa640 1 -- 172.21.15.131:0/1137317852 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3e24037070 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3d117fa640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3cf8036900 0x7f3cf8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3d117fa640 1 -- 172.21.15.131:0/1137317852 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3e2403ac90 con 0x558b3d13d4c0 2024-04-24T01:43:06.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3cf8036900 0x7f3cf8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d150440 0x558b3d1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d153020 con 0x558b3d150440 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3e2f1ae640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d150440 0x558b3d1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.084+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3cf8036900 0x7f3cf8038dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x558b3d11fa00 tx=0x7f3e2801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e2f1ae640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d150440 0x558b3d1528d0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 realm 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d153430 con 0x558b3d150440 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d153d00 con 0x558b3d150440 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1540a0 con 0x558b3d150440 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.085+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d154500 con 0x558b3d150440 2024-04-24T01:43:06.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e3352d800 20 searching for the correct realm 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558b3d156550 0x558b3d158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558b3d156550 0x558b3d158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558b3d156550 0x558b3d158940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e2e9ad640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e24039070 0x7f3e24043870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e24039070 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.086+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e24039070 0x7f3e24043870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.087+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e24039070 0x7f3e24043870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.087+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2801f070 con 0x7f3e24039070 2024-04-24T01:43:06.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.087+0000 7f3e2f9af640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e28031040 0x7f3e28032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.087+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.087+0000 7f3e2f1ae640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e28031040 0x7f3e28032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.087+0000 7f3e2f1ae640 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e28031040 0x7f3e28032940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.088+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.088+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.088+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.088+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.088+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.088+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.088+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e24039070 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2801f070 con 0x7f3e24039070 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.089+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e24039070 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e2801f070 con 0x7f3e24039070 2024-04-24T01:43:06.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.090+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.091+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.092+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.092+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.092+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.092+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.092+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.092+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e24039070 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2801f070 con 0x7f3e24039070 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.093+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e24039070 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2801f070 con 0x7f3e24039070 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d156550 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.094+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x7f3e28031040 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d158ff0 con 0x558b3d150440 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3e200a9040 con 0x7f3e24039070 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2801f070 con 0x7f3e24039070 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d154e70 con 0x558b3d150440 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.095+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d155260 con 0x558b3d150440 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d155260 con 0x558b3d150440 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 zone default found 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 4 Realm: () 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:06.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 zonegroup default 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d155680 con 0x7f3e28031040 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d155680 con 0x558b3d156550 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.096+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15ae30 con 0x558b3d156550 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.097+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.097+0000 7f3e3352d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.097+0000 7f3e3352d800 20 started sync module instance, tier type = 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.097+0000 7f3e3352d800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.097+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15a2d0 con 0x7f3e24039070 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.098+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.098+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94056513644224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15b6f0 con 0x7f3e24039070 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.098+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15bf40 con 0x558b3d150440 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.099+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94056513644224] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.099+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.099+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94056513647168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15bbd0 con 0x558b3d150440 2024-04-24T01:43:06.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.099+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15c6f0 con 0x558b3d156550 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.100+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.100+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94056513651136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15cf90 con 0x558b3d156550 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.100+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15da40 con 0x7f3e24039070 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.100+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94056513647168] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.101+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94056513651136] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.101+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.101+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94056513653472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15d520 con 0x7f3e24039070 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.101+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15e310 con 0x558b3d150440 2024-04-24T01:43:06.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.102+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94056513653472] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.102+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.102+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94056513648224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15e310 con 0x558b3d150440 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.102+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15ed60 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.103+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.103+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94056513661040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15ec90 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.103+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94056513648224] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.103+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15fc80 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.104+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94056513661040] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.104+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.104+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94056513663312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15fc40 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.105+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d160120 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.105+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94056513663312] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.105+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94056513658464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1600e0 con 0x7f3e28031040 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=0 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=1 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=2 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=3 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=4 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=5 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=6 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94056513658464] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 20 add_watcher() i=7 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.106+0000 7f3e3352d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.107+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d163540 con 0x558b3d150440 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.107+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.107+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94056513664880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1609f0 con 0x558b3d150440 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94056513664880] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3e3352d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3e3352d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3e3352d800 5 note: GC not initialized 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3ce4fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3e3352d800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3e3352d800 20 Filter name: none 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3c5e7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.108+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d196950 con 0x7f3e24039070 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1971e0 con 0x7f3e28031040 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(63 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.109+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d195cf0 con 0x7f3e24039070 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d195d40 con 0x7f3e28031040 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(65 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:06.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 4.f 4:f304a00f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d199d50 con 0x558b3d150440 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 4.d 4:b205e15f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d19c830 con 0x558b3d156550 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 4.2a 4:57091848:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d19f1f0 con 0x558b3d150440 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 4.25 4:a7334b03:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1a1cb0 con 0x558b3d156550 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 4.1e 4:797afb18:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1a4650 con 0x7f3e28031040 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 4.1e 4:785e71a1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1a74b0 con 0x7f3e28031040 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 4.11 4:8b3156cf:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1aa370 con 0x7f3e28031040 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 4.25 4:a4be0969:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1ad1a0 con 0x558b3d156550 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:74 4.2e 4:7455b879:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1b0010 con 0x558b3d156550 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 4.8 4:1174bd7f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1b2ed0 con 0x558b3d156550 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.110+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:76 4.3e 4:7d91042a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1b5d40 con 0x7f3e24039070 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(68 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(66 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(76 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(69 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(70 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(72 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(73 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(71 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.5 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(74 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.111+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(75 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.112+0000 7f3ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.112+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94056513664880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d1ad1a0 con 0x558b3d150440 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.113+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94056513664880] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.113+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94056513644224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d17f080 con 0x7f3e24039070 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.114+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94056513644224] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.114+0000 7f3e3352d800 20 remove_watcher() i=0 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.114+0000 7f3e3352d800 2 removed watcher, disabling cache 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.114+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94056513647168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d17f080 con 0x558b3d150440 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.115+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94056513647168] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.115+0000 7f3e3352d800 20 remove_watcher() i=1 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.115+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94056513651136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15b240 con 0x558b3d156550 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.116+0000 7f3e2e9ad640 1 -- 172.21.15.131:0/1137317852 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94056513651136] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24036030 con 0x558b3d156550 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.116+0000 7f3e3352d800 20 remove_watcher() i=2 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.116+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94056513653472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d17f080 con 0x7f3e24039070 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.117+0000 7f3e2f9af640 1 -- 172.21.15.131:0/1137317852 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94056513653472] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e28040040 con 0x7f3e24039070 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.117+0000 7f3e3352d800 20 remove_watcher() i=3 2024-04-24T01:43:06.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.117+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94056513648224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15b240 con 0x558b3d150440 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.118+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94056513648224] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x558b3d150440 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.118+0000 7f3e3352d800 20 remove_watcher() i=4 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.118+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94056513661040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d17f080 con 0x7f3e28031040 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.119+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94056513661040] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.119+0000 7f3e3352d800 20 remove_watcher() i=5 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.119+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94056513663312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d15e870 con 0x7f3e28031040 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.120+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94056513663312] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.120+0000 7f3e3352d800 20 remove_watcher() i=6 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.120+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94056513658464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d17f080 con 0x7f3e28031040 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94056513658464] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20071990 con 0x7f3e28031040 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 20 remove_watcher() i=7 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e28031040 msgr2=0x7f3e28032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e28031040 0x7f3e28032940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d150440 msgr2=0x558b3d1528d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d150440 0x558b3d1528d0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e24039070 msgr2=0x7f3e24043870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e24039070 0x7f3e24043870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558b3d156550 msgr2=0x558b3d158940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558b3d156550 0x558b3d158940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3cf8036900 msgr2=0x7f3cf8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3cf8036900 0x7f3cf8038dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x558b3d11fa00 tx=0x7f3e2801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 msgr2=0x558b3d144b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1137317852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d13d4c0 0x558b3d144b20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3e2404bd50 tx=0x7f3e2404cdc0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 reap_dead start 2024-04-24T01:43:06.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e2f1ae640 1 -- 172.21.15.131:0/1137317852 reap_dead start 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 shutdown_connections 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 >> 172.21.15.131:0/1137317852 conn(0x558b3d139820 msgr2=0x558b3d136e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 shutdown_connections 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.121+0000 7f3e3352d800 1 -- 172.21.15.131:0/1137317852 wait complete. 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d08036950 msgr2=0x7f3d08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d08036950 0x7f3d08038e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x558b3d120210 tx=0x7f3e28005840 comp rx=0 tx=0).stop 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d130180 msgr2=0x558b3d1305a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d130180 0x558b3d1305a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e24001ed0 tx=0x7f3e2400d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 shutdown_connections 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d08036950 0x7f3d08038e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/2519454504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d130180 0x558b3d1305a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 >> 172.21.15.131:0/2519454504 conn(0x558b3d124220 msgr2=0x558b3d124620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 shutdown_connections 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/2519454504 wait complete. 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d020220 msgr2=0x558b3d11f120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d020220 0x558b3d11f120 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d14036900 msgr2=0x7f3d14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d14036900 0x7f3d14038dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000f60 tx=0x7f3e240012b0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 msgr2=0x558b3d01d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01d210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e20060040 tx=0x7f3e20002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 shutdown_connections 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558b3d020220 0x558b3d11f120 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d14036900 0x7f3d14038dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 --2- 172.21.15.131:0/1054132221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558b3d01d8f0 0x558b3d01d210 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 >> 172.21.15.131:0/1054132221 conn(0x558b3d017300 msgr2=0x558b3d108210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 shutdown_connections 2024-04-24T01:43:06.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.122+0000 7f3e3352d800 1 -- 172.21.15.131:0/1054132221 wait complete. 2024-04-24T01:43:06.142 INFO:teuthology.orchestra.run.smithi131.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"e8007cb0-7095-49ae-9c09-cc804d4cc0c2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","marker":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:43:05.568785Z","creation_time":"2024-04-24T01:43:02.579344Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T01:43:06.142 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:43:05.568785Z', 'creation_time': '2024-04-24T01:43:02.579344Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:43:06.142 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-24T01:43:06.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-24T01:43:06.142 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-24T01:43:06.223 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:06.223 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:06.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.222+0000 7f8995a0e800 1 Processor -- start 2024-04-24T01:43:06.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.222+0000 7f8995a0e800 1 -- start start 2024-04-24T01:43:06.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.222+0000 7f8995a0e800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55995ae70d10 0x55995ae71130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.222+0000 7f8995a0e800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55995ad30d40 con 0x55995ae71f70 2024-04-24T01:43:06.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.222+0000 7f8995a0e800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55995ad034d0 con 0x55995ae70d10 2024-04-24T01:43:06.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.223+0000 7f899350d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55995ae70d10 0x55995ae71130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.223+0000 7f898bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55995ae71f70 0x55995ae723f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56770/0 (socket says 172.21.15.131:56770) 2024-04-24T01:43:06.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.223+0000 7f898bfff640 1 -- 172.21.15.131:0/406697971 learned_addr learned my addr 172.21.15.131:0/406697971 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:06.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.223+0000 7f899350d640 1 -- 172.21.15.131:0/406697971 >> v1:172.21.15.107:6789/0 conn(0x55995ae71f70 legacy=0x55995ae723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.223+0000 7f899350d640 1 -- 172.21.15.131:0/406697971 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55995ad2f590 con 0x55995ae70d10 2024-04-24T01:43:06.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f899350d640 1 --2- 172.21.15.131:0/406697971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995ae71130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f898400a470 tx=0x7f898401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dede32e520499bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8992d0c640 1 -- 172.21.15.131:0/406697971 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8984057070 con 0x55995ae70d10 2024-04-24T01:43:06.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8992d0c640 1 -- 172.21.15.131:0/406697971 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8984052570 con 0x55995ae70d10 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8992d0c640 1 -- 172.21.15.131:0/406697971 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8984052870 con 0x55995ae70d10 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8995a0e800 1 -- 172.21.15.131:0/406697971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 msgr2=0x55995ae71130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8995a0e800 1 --2- 172.21.15.131:0/406697971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995ae71130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f898400a470 tx=0x7f898401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8995a0e800 1 -- 172.21.15.131:0/406697971 shutdown_connections 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8995a0e800 1 --2- 172.21.15.131:0/406697971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995ae71130 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.225+0000 7f8995a0e800 1 -- 172.21.15.131:0/406697971 >> 172.21.15.131:0/406697971 conn(0x55995ae6c370 msgr2=0x55995ae6e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.226+0000 7f8995a0e800 1 -- 172.21.15.131:0/406697971 shutdown_connections 2024-04-24T01:43:06.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.226+0000 7f8995a0e800 1 -- 172.21.15.131:0/406697971 wait complete. 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.237+0000 7f8995a0e800 1 Processor -- start 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.237+0000 7f8995a0e800 1 -- start start 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.237+0000 7f8995a0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af62430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.237+0000 7f8995a0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55995adbd3b0 con 0x55995ae70d10 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f899350d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af62430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f899350d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af62430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43170/0 (socket says 172.21.15.131:43170) 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f899350d640 1 -- 172.21.15.131:0/1889547989 learned_addr learned my addr 172.21.15.131:0/1889547989 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f899350d640 1 -- 172.21.15.131:0/1889547989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55995af62a00 con 0x55995ae70d10 2024-04-24T01:43:06.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f899350d640 1 --2- 172.21.15.131:0/1889547989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af62430 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8984055040 tx=0x7f898404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a51584bbbb3cd36 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f888160a640 1 -- 172.21.15.131:0/1889547989 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8984057070 con 0x55995ae70d10 2024-04-24T01:43:06.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f888160a640 1 -- 172.21.15.131:0/1889547989 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8984063070 con 0x55995ae70d10 2024-04-24T01:43:06.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.238+0000 7f888160a640 1 -- 172.21.15.131:0/1889547989 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8984052720 con 0x55995ae70d10 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.239+0000 7f8995a0e800 1 -- 172.21.15.131:0/1889547989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 msgr2=0x55995af62430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.239+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1889547989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af62430 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8984055040 tx=0x7f898404c000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.239+0000 7f8995a0e800 1 -- 172.21.15.131:0/1889547989 shutdown_connections 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.239+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1889547989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af62430 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.239+0000 7f8995a0e800 1 -- 172.21.15.131:0/1889547989 >> 172.21.15.131:0/1889547989 conn(0x55995ae6c370 msgr2=0x55995af5dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.239+0000 7f8995a0e800 1 -- 172.21.15.131:0/1889547989 shutdown_connections 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.239+0000 7f8995a0e800 1 -- 172.21.15.131:0/1889547989 wait complete. 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f8995a0e800 1 Processor -- start 2024-04-24T01:43:06.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f8995a0e800 1 -- start start 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f8995a0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af69f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f8995a0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55995ae7a3e0 con 0x55995ae70d10 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f899350d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af69f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f899350d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af69f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43182/0 (socket says 172.21.15.131:43182) 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f899350d640 1 -- 172.21.15.131:0/3216265145 learned_addr learned my addr 172.21.15.131:0/3216265145 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f899350d640 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55995af6a480 con 0x55995ae70d10 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.240+0000 7f899350d640 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af69f40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8984060040 tx=0x7f8984002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.241+0000 7f887fe07640 1 -- 172.21.15.131:0/3216265145 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8984052c70 con 0x55995ae70d10 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.241+0000 7f887fe07640 1 -- 172.21.15.131:0/3216265145 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898406c070 con 0x55995ae70d10 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.241+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55995af6a710 con 0x55995ae70d10 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.241+0000 7f887fe07640 1 -- 172.21.15.131:0/3216265145 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f898405e480 con 0x55995ae70d10 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.241+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55995af6d3c0 con 0x55995ae70d10 2024-04-24T01:43:06.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.241+0000 7f887fe07640 1 -- 172.21.15.131:0/3216265145 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f898405e620 con 0x55995ae70d10 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.241+0000 7f887fe07640 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8878036950 0x7f8878038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f887fe07640 1 -- 172.21.15.131:0/3216265145 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f898408e700 con 0x55995ae70d10 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f898bfff640 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8878036950 0x7f8878038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995ae71f70 0x55995af71180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995af71710 con 0x55995ae71f70 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f8993d0e640 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995ae71f70 0x55995af71180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f898bfff640 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8878036950 0x7f8878038e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f897c000f60 tx=0x7f897c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f8993d0e640 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995ae71f70 0x55995af71180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f8993d0e640 1 -- 172.21.15.131:0/3216265145 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f898c00a4a0 con 0x55995ae71f70 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.242+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995af6e730 con 0x55995ae71f70 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.243+0000 7f8993d0e640 1 -- 172.21.15.131:0/3216265145 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f898c00a4a0 con 0x55995ae71f70 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.243+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995af73530 con 0x55995ae71f70 2024-04-24T01:43:06.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.243+0000 7f8993d0e640 1 -- 172.21.15.131:0/3216265145 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f898c00a4a0 con 0x55995ae71f70 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.243+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995af72870 con 0x55995ae71f70 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.243+0000 7f8993d0e640 1 -- 172.21.15.131:0/3216265145 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f898c00a4a0 con 0x55995ae71f70 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.243+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995af72cc0 con 0x55995ae71f70 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.243+0000 7f8993d0e640 1 -- 172.21.15.131:0/3216265145 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f898c00a4a0 con 0x55995ae71f70 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f8995a0e800 1 Processor -- start 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f8995a0e800 1 -- start start 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f8995a0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af822a0 0x55995af826c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f8995a0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55995ad636b0 con 0x55995af822a0 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f898bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af822a0 0x55995af826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f898bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af822a0 0x55995af826c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43196/0 (socket says 172.21.15.131:43196) 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f898bfff640 1 -- 172.21.15.131:0/2683108433 learned_addr learned my addr 172.21.15.131:0/2683108433 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.244+0000 7f898bfff640 1 -- 172.21.15.131:0/2683108433 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55995af82c00 con 0x55995af822a0 2024-04-24T01:43:06.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.245+0000 7f898bfff640 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af822a0 0x55995af826c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f897c001ed0 tx=0x7f897c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.245+0000 7f887d602640 1 -- 172.21.15.131:0/2683108433 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c01b550 con 0x55995af822a0 2024-04-24T01:43:06.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.245+0000 7f887d602640 1 -- 172.21.15.131:0/2683108433 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c01b6f0 con 0x55995af822a0 2024-04-24T01:43:06.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.245+0000 7f887d602640 1 -- 172.21.15.131:0/2683108433 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c01b9d0 con 0x55995af822a0 2024-04-24T01:43:06.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.245+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55995af83670 con 0x55995af822a0 2024-04-24T01:43:06.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.245+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55995af83b70 con 0x55995af822a0 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f887d602640 1 -- 172.21.15.131:0/2683108433 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f897c023020 con 0x55995af822a0 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f887d602640 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f886c036950 0x7f886c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f887d602640 1 -- 172.21.15.131:0/2683108433 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f897c021020 con 0x55995af822a0 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f8993d0e640 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f886c036950 0x7f886c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f8995a0e800 1 Processor -- start 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f8995a0e800 1 -- start start 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f8993d0e640 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f886c036950 0x7f886c038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55995af72390 tx=0x7f898c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f8995a0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995af8fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f8995a0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55995af62cc0 con 0x55995af8f5e0 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f898bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995af8fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f898bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995af8fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43210/0 (socket says 172.21.15.131:43210) 2024-04-24T01:43:06.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.246+0000 7f898bfff640 1 -- 172.21.15.131:0/3628210515 learned_addr learned my addr 172.21.15.131:0/3628210515 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f898bfff640 1 -- 172.21.15.131:0/3628210515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55995af8ffd0 con 0x55995af8f5e0 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f898bfff640 1 --2- 172.21.15.131:0/3628210515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995af8fa00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f897c04ce10 tx=0x7f897c019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6131386448743c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8876ffd640 1 -- 172.21.15.131:0/3628210515 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c041070 con 0x55995af8f5e0 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8876ffd640 1 -- 172.21.15.131:0/3628210515 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c01bd50 con 0x55995af8f5e0 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8876ffd640 1 -- 172.21.15.131:0/3628210515 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c025a30 con 0x55995af8f5e0 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8995a0e800 1 -- 172.21.15.131:0/3628210515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 msgr2=0x55995af8fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3628210515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995af8fa00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f897c04ce10 tx=0x7f897c019ce0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8995a0e800 1 -- 172.21.15.131:0/3628210515 shutdown_connections 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3628210515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995af8fa00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8995a0e800 1 -- 172.21.15.131:0/3628210515 >> 172.21.15.131:0/3628210515 conn(0x55995af8b940 msgr2=0x55995af899a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.247+0000 7f8995a0e800 1 -- 172.21.15.131:0/3628210515 shutdown_connections 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f8995a0e800 1 -- 172.21.15.131:0/3628210515 wait complete. 2024-04-24T01:43:06.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f8995a0e800 1 Processor -- start 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f8995a0e800 1 -- start start 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f8995a0e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995ade5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f8995a0e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55995af90740 con 0x55995af8f5e0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f898bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995ade5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f898bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995ade5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43212/0 (socket says 172.21.15.131:43212) 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 learned_addr learned my addr 172.21.15.131:0/1956715102 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.248+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55995af9a9a0 con 0x55995af8f5e0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.249+0000 7f898bfff640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995ade5020 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f897c019f50 tx=0x7f897c04cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.249+0000 7f88757fa640 1 -- 172.21.15.131:0/1956715102 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c041070 con 0x55995af8f5e0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.249+0000 7f88757fa640 1 -- 172.21.15.131:0/1956715102 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c0258e0 con 0x55995af8f5e0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.249+0000 7f88757fa640 1 -- 172.21.15.131:0/1956715102 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c00cc60 con 0x55995af8f5e0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.249+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55995af9ab70 con 0x55995af8f5e0 2024-04-24T01:43:06.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.249+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55995af9ab70 con 0x55995af8f5e0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.249+0000 7f88757fa640 1 -- 172.21.15.131:0/1956715102 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f897c04eb20 con 0x55995af8f5e0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f88757fa640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f885c036900 0x7f885c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f88757fa640 1 -- 172.21.15.131:0/1956715102 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f897c039c40 con 0x55995af8f5e0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f8993d0e640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f885c036900 0x7f885c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995afa3630 0x55995afa5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa6220 con 0x55995afa3630 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f899350d640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995afa3630 0x55995afa5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f8993d0e640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f885c036900 0x7f885c038dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55995af6e6a0 tx=0x7f898c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f899350d640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995afa3630 0x55995afa5ad0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.250+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 realm 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa6630 con 0x55995afa3630 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa6ed0 con 0x55995afa3630 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa7270 con 0x55995afa3630 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa7ac0 con 0x55995afa3630 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 20 searching for the correct realm 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.251+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55995afa9830 0x55995afabc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.252+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.252+0000 7f898bfff640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55995afa9830 0x55995afabc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.252+0000 7f898bfff640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55995afa9830 0x55995afabc20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.252+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.252+0000 7f898bfff640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f897c0448c0 0x7f897c0152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.252+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f897c0448c0 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.252+0000 7f8993d0e640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f897c0448c0 0x7f897c0152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.253+0000 7f8993d0e640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f897c0448c0 0x7f897c0152e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.253+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898c01f070 con 0x7f897c0448c0 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.253+0000 7f8993d0e640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f898c031040 0x7f898c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.253+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.253+0000 7f899350d640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f898c031040 0x7f898c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.253+0000 7f899350d640 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f898c031040 0x7f898c032940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.254+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f897c0448c0 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898c01f070 con 0x7f897c0448c0 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.255+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f897c0448c0 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f898c01f070 con 0x7f897c0448c0 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.256+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.257+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.258+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.258+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.258+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.258+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f897c0448c0 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.258+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898c01f070 con 0x7f897c0448c0 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.258+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.259+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f897c0448c0 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898c01f070 con 0x7f897c0448c0 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa9830 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f898c031040 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x55995afa3630 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.260+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afac230 con 0x7f897c0448c0 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f898c01f070 con 0x7f897c0448c0 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x55995afa3630 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8d10 con 0x55995afa3630 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa80b0 con 0x55995afa3630 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 zone default found 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 4 Realm: () 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:06.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 zonegroup default 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.261+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8d10 con 0x7f898c031040 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afae070 con 0x55995afa9830 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afae410 con 0x55995afa9830 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 20 started sync module instance, tier type = 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.262+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x7f897c0448c0 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.263+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.263+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117144746288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afaecb0 con 0x7f897c0448c0 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.263+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afaf500 con 0x55995afa3630 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.264+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117144746288] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.265+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.265+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117144750080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afaf210 con 0x55995afa3630 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.265+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afafd00 con 0x55995afa9830 2024-04-24T01:43:06.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.266+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117144750080] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.266+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.266+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117144754128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb00f0 con 0x55995afa9830 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.266+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb0b30 con 0x7f897c0448c0 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.267+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117144754128] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.267+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.267+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117144757760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb0f20 con 0x7f897c0448c0 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.267+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb1980 con 0x55995afa3630 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.268+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.268+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117144761440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb1980 con 0x55995afa3630 2024-04-24T01:43:06.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.268+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb2920 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.268+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117144757760] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.269+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.269+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117144765424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb28e0 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.269+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb3330 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.269+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117144761440] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.270+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117144765424] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.270+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.270+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117144751200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb2e80 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.270+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb3840 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.271+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117144751200] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117144763664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb3840 con 0x7f898c031040 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=0 2024-04-24T01:43:06.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=1 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=2 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=3 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=4 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=5 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=6 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117144763664] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 20 add_watcher() i=7 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.272+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55995afb6b30 con 0x55995afa3630 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.273+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.273+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117144769792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afb3dd0 con 0x55995afa3630 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117144769792] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f8849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f8995a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f8995a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f8995a0e800 5 note: GC not initialized 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f8848fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f8995a0e800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.274+0000 7f8995a0e800 20 Filter name: none 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.275+0000 7f87c27fc640 20 reqs_thread_entry: start 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.275+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afe9530 con 0x7f898c031040 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.275+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'46 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.275+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x7f898c031040 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.275+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.275+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x55995afa9830 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.276+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'37 uv29 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.276+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x7f898c031040 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.276+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.276+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x55995afa3630 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.276+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.276+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x7f897c0448c0 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'22 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x55995afa9830 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x55995afa9830 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x55995afa9830 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'17 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.277+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x7f897c0448c0 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x7f897c0448c0 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.278+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa3630 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa3630 2024-04-24T01:43:06.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'21 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.279+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa9830 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.280+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'26 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.280+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa9830 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.280+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.280+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa3630 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.280+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'49 uv41 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.280+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x7f897c0448c0 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.281+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.281+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x7f897c0448c0 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.281+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.281+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa3630 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.281+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.281+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x7f898c031040 2024-04-24T01:43:06.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.282+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.282+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x7f897c0448c0 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.282+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.282+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x7f898c031040 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa9830 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'24 uv16 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa9830 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa9830 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.283+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x55995afa3630 2024-04-24T01:43:06.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.284+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.284+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x7f897c0448c0 2024-04-24T01:43:06.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.284+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.284+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f897c075040 con 0x7f898c031040 2024-04-24T01:43:06.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.284+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.303 INFO:teuthology.orchestra.run.smithi131.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-24T01:43:06.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.286+0000 7f8849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.286+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117144769792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x55995afa3630 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.287+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94117144769792] v32'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.287+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117144746288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afe7a40 con 0x7f897c0448c0 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.288+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94117144746288] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.288+0000 7f8995a0e800 20 remove_watcher() i=0 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.288+0000 7f8995a0e800 2 removed watcher, disabling cache 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.288+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117144750080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x55995afa3630 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.289+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94117144750080] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.289+0000 7f8995a0e800 20 remove_watcher() i=1 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.289+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117144754128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afa8470 con 0x55995afa9830 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.290+0000 7f898bfff640 1 -- 172.21.15.131:0/1956715102 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94117144754128] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f897c009050 con 0x55995afa9830 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.290+0000 7f8995a0e800 20 remove_watcher() i=2 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.290+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117144757760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x7f897c0448c0 2024-04-24T01:43:06.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.291+0000 7f8993d0e640 1 -- 172.21.15.131:0/1956715102 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94117144757760] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f898c040040 con 0x7f897c0448c0 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.291+0000 7f8995a0e800 20 remove_watcher() i=3 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.291+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117144761440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x55995afa3630 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.292+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94117144761440] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x55995afa3630 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.292+0000 7f8995a0e800 20 remove_watcher() i=4 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.292+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117144765424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x7f898c031040 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.293+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94117144765424] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.293+0000 7f8995a0e800 20 remove_watcher() i=5 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.293+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117144751200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x7f898c031040 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.294+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94117144751200] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.294+0000 7f8995a0e800 20 remove_watcher() i=6 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.294+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117144763664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55995afad510 con 0x7f898c031040 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94117144763664] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8984009d10 con 0x7f898c031040 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 20 remove_watcher() i=7 2024-04-24T01:43:06.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f898c031040 msgr2=0x7f898c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f898c031040 0x7f898c032940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995afa3630 msgr2=0x55995afa5ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995afa3630 0x55995afa5ad0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f897c0448c0 msgr2=0x7f897c0152e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f897c0448c0 0x7f897c0152e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55995afa9830 msgr2=0x55995afabc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55995afa9830 0x55995afabc20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f885c036900 msgr2=0x7f885c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f885c036900 0x7f885c038dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55995af6e6a0 tx=0x7f898c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 msgr2=0x55995ade5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995ade5020 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f897c019f50 tx=0x7f897c04cda0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f899350d640 1 -- 172.21.15.131:0/1956715102 reap_dead start 2024-04-24T01:43:06.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 shutdown_connections 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 --2- 172.21.15.131:0/1956715102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af8f5e0 0x55995ade5020 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.295+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 >> 172.21.15.131:0/1956715102 conn(0x55995af8b940 msgr2=0x55995af88fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 shutdown_connections 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/1956715102 wait complete. 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f886c036950 msgr2=0x7f886c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f886c036950 0x7f886c038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55995af72390 tx=0x7f898c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af822a0 msgr2=0x55995af826c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af822a0 0x55995af826c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f897c001ed0 tx=0x7f897c00d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 shutdown_connections 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f886c036950 0x7f886c038e10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/2683108433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995af822a0 0x55995af826c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 >> 172.21.15.131:0/2683108433 conn(0x55995af76340 msgr2=0x55995af76740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 shutdown_connections 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/2683108433 wait complete. 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995ae71f70 msgr2=0x55995af71180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995ae71f70 0x55995af71180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8878036950 msgr2=0x7f8878038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8878036950 0x7f8878038e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f897c000f60 tx=0x7f897c0012b0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 msgr2=0x55995af69f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af69f40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8984060040 tx=0x7f8984002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 shutdown_connections 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55995ae71f70 0x55995af71180 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8878036950 0x7f8878038e10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 --2- 172.21.15.131:0/3216265145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55995ae70d10 0x55995af69f40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 >> 172.21.15.131:0/3216265145 conn(0x55995ae6c370 msgr2=0x55995af5c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 shutdown_connections 2024-04-24T01:43:06.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.296+0000 7f8995a0e800 1 -- 172.21.15.131:0/3216265145 wait complete. 2024-04-24T01:43:06.315 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-24T01:43:06.315 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-24T01:43:06.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-24T01:43:06.316 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-24T01:43:06.392 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:06.393 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:06.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.391+0000 7f6274146800 1 Processor -- start 2024-04-24T01:43:06.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.391+0000 7f6274146800 1 -- start start 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f6274146800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559e3a96d460 0x559e3a96f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f6274146800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e3a827d40 con 0x559e3a969950 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f6274146800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x559e3a7fa4d0 con 0x559e3a96d460 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f6271c4c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x559e3a969950 0x559e3a96bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56772/0 (socket says 172.21.15.131:56772) 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f6271c4c640 1 -- 172.21.15.131:0/1302488227 learned_addr learned my addr 172.21.15.131:0/1302488227 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f627144b640 1 --2- 172.21.15.131:0/1302488227 >> v2:172.21.15.107:3300/0 conn(0x559e3a96d460 0x559e3a96f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f6270c4a640 1 -- 172.21.15.131:0/1302488227 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812952133 0 0) 0x559e3a827d40 con 0x559e3a969950 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f6270c4a640 1 -- 172.21.15.131:0/1302488227 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6260001e10 con 0x559e3a969950 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f627144b640 1 -- 172.21.15.131:0/1302488227 >> v1:172.21.15.107:6789/0 conn(0x559e3a969950 legacy=0x559e3a96bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.392+0000 7f627144b640 1 -- 172.21.15.131:0/1302488227 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3a826590 con 0x559e3a96d460 2024-04-24T01:43:06.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f627144b640 1 --2- 172.21.15.131:0/1302488227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a96d460 0x559e3a96f850 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f625c00a470 tx=0x7f625c01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b42d9ef7704733 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6270c4a640 1 -- 172.21.15.131:0/1302488227 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c057070 con 0x559e3a96d460 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6270c4a640 1 -- 172.21.15.131:0/1302488227 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625c052570 con 0x559e3a96d460 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6270c4a640 1 -- 172.21.15.131:0/1302488227 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c052870 con 0x559e3a96d460 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6274146800 1 -- 172.21.15.131:0/1302488227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a96d460 msgr2=0x559e3a96f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6274146800 1 --2- 172.21.15.131:0/1302488227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a96d460 0x559e3a96f850 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f625c00a470 tx=0x7f625c01cdb0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6274146800 1 -- 172.21.15.131:0/1302488227 shutdown_connections 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6274146800 1 --2- 172.21.15.131:0/1302488227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a96d460 0x559e3a96f850 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.394+0000 7f6274146800 1 -- 172.21.15.131:0/1302488227 >> 172.21.15.131:0/1302488227 conn(0x559e3a963380 msgr2=0x559e3a9657a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.395+0000 7f6274146800 1 -- 172.21.15.131:0/1302488227 shutdown_connections 2024-04-24T01:43:06.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.395+0000 7f6274146800 1 -- 172.21.15.131:0/1302488227 wait complete. 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.406+0000 7f6274146800 1 Processor -- start 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.406+0000 7f6274146800 1 -- start start 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.406+0000 7f6274146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa59ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.406+0000 7f6274146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e3a8b43c0 con 0x559e3a969950 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f6271c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa59ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f6271c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa59ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43226/0 (socket says 172.21.15.131:43226) 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f6271c4c640 1 -- 172.21.15.131:0/1801949384 learned_addr learned my addr 172.21.15.131:0/1801949384 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f6271c4c640 1 -- 172.21.15.131:0/1801949384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3aa5a4b0 con 0x559e3a969950 2024-04-24T01:43:06.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f6271c4c640 1 --2- 172.21.15.131:0/1801949384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa59ee0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f626c001de0 tx=0x7f626c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902e9e0488585a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f615fe07640 1 -- 172.21.15.131:0/1801949384 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626c012020 con 0x559e3a969950 2024-04-24T01:43:06.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f615fe07640 1 -- 172.21.15.131:0/1801949384 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626c00e5a0 con 0x559e3a969950 2024-04-24T01:43:06.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.407+0000 7f615fe07640 1 -- 172.21.15.131:0/1801949384 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626c00e900 con 0x559e3a969950 2024-04-24T01:43:06.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 -- 172.21.15.131:0/1801949384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 msgr2=0x559e3aa59ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 --2- 172.21.15.131:0/1801949384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa59ee0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f626c001de0 tx=0x7f626c00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 -- 172.21.15.131:0/1801949384 shutdown_connections 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 --2- 172.21.15.131:0/1801949384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa59ee0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 -- 172.21.15.131:0/1801949384 >> 172.21.15.131:0/1801949384 conn(0x559e3a963380 msgr2=0x559e3aa55800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 -- 172.21.15.131:0/1801949384 shutdown_connections 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 -- 172.21.15.131:0/1801949384 wait complete. 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 Processor -- start 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.408+0000 7f6274146800 1 -- start start 2024-04-24T01:43:06.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6274146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa63c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6274146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e3a9720a0 con 0x559e3a969950 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6271c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa63c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6271c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa63c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43230/0 (socket says 172.21.15.131:43230) 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6271c4c640 1 -- 172.21.15.131:0/2835555517 learned_addr learned my addr 172.21.15.131:0/2835555517 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6271c4c640 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3aa64140 con 0x559e3a969950 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6271c4c640 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa63c00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c010 tx=0x7f626c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f615e604640 1 -- 172.21.15.131:0/2835555517 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626c012030 con 0x559e3a969950 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f615e604640 1 -- 172.21.15.131:0/2835555517 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626c01a7a0 con 0x559e3a969950 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.409+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e3aa643d0 con 0x559e3a969950 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.410+0000 7f615e604640 1 -- 172.21.15.131:0/2835555517 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626c01a950 con 0x559e3a969950 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.410+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e3aa67080 con 0x559e3a969950 2024-04-24T01:43:06.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.410+0000 7f615e604640 1 -- 172.21.15.131:0/2835555517 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f626c015020 con 0x559e3a969950 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.410+0000 7f615e604640 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6158036950 0x7f6158038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.410+0000 7f615e604640 1 -- 172.21.15.131:0/2835555517 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f626c020030 con 0x559e3a969950 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f627144b640 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6158036950 0x7f6158038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f6274146800 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3a96d460 0x559e3aa6ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa6b3c0 con 0x559e3a96d460 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f627244d640 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3a96d460 0x559e3aa6ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f627144b640 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6158036950 0x7f6158038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f625c054000 tx=0x7f625c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f627244d640 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3a96d460 0x559e3aa6ae40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f627244d640 1 -- 172.21.15.131:0/2835555517 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f626400a4a0 con 0x559e3a96d460 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.411+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa68410 con 0x559e3a96d460 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.412+0000 7f627244d640 1 -- 172.21.15.131:0/2835555517 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f626400a4a0 con 0x559e3a96d460 2024-04-24T01:43:06.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.412+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa6d1c0 con 0x559e3a96d460 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.412+0000 7f627244d640 1 -- 172.21.15.131:0/2835555517 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f626400a4a0 con 0x559e3a96d460 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.412+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa6c500 con 0x559e3a96d460 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.412+0000 7f627244d640 1 -- 172.21.15.131:0/2835555517 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f626400a4a0 con 0x559e3a96d460 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.412+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa6c950 con 0x559e3a96d460 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.412+0000 7f627244d640 1 -- 172.21.15.131:0/2835555517 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f626400a4a0 con 0x559e3a96d460 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f6274146800 1 Processor -- start 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f6274146800 1 -- start start 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f6274146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa7bf90 0x559e3aa7c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f6274146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e3a85a6b0 con 0x559e3aa7bf90 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f627144b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa7bf90 0x559e3aa7c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f627144b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa7bf90 0x559e3aa7c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43242/0 (socket says 172.21.15.131:43242) 2024-04-24T01:43:06.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f627144b640 1 -- 172.21.15.131:0/3726854294 learned_addr learned my addr 172.21.15.131:0/3726854294 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.413+0000 7f627144b640 1 -- 172.21.15.131:0/3726854294 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3aa7c8f0 con 0x559e3aa7bf90 2024-04-24T01:43:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.414+0000 7f627144b640 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa7bf90 0x559e3aa7c3b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f625c01cdf0 tx=0x7f625c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.414+0000 7f61577fe640 1 -- 172.21.15.131:0/3726854294 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c06f070 con 0x559e3aa7bf90 2024-04-24T01:43:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.414+0000 7f61577fe640 1 -- 172.21.15.131:0/3726854294 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625c058040 con 0x559e3aa7bf90 2024-04-24T01:43:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.414+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e3aa7d360 con 0x559e3aa7bf90 2024-04-24T01:43:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.414+0000 7f61577fe640 1 -- 172.21.15.131:0/3726854294 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c057050 con 0x559e3aa7bf90 2024-04-24T01:43:06.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.414+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e3aa7d800 con 0x559e3aa7bf90 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f61577fe640 1 -- 172.21.15.131:0/3726854294 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f625c072070 con 0x559e3aa7bf90 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f61577fe640 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f614c036950 0x7f614c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f61577fe640 1 -- 172.21.15.131:0/3726854294 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f625c08f9a0 con 0x559e3aa7bf90 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f627244d640 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f614c036950 0x7f614c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f6274146800 1 Processor -- start 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f6274146800 1 -- start start 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f627244d640 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f614c036950 0x7f614c038e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x559e3aa6c020 tx=0x7f6264005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f6274146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa89590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f6274146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e3aa5a830 con 0x559e3aa89170 2024-04-24T01:43:06.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f627144b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa89590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f627144b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa89590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43248/0 (socket says 172.21.15.131:43248) 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.415+0000 7f627144b640 1 -- 172.21.15.131:0/553477961 learned_addr learned my addr 172.21.15.131:0/553477961 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f627144b640 1 -- 172.21.15.131:0/553477961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3aa89b60 con 0x559e3aa89170 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f627144b640 1 --2- 172.21.15.131:0/553477961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa89590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f625c08ddb0 tx=0x7f625c073d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c8a250d7117822 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f61557fa640 1 -- 172.21.15.131:0/553477961 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c07c030 con 0x559e3aa89170 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f61557fa640 1 -- 172.21.15.131:0/553477961 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625c05eb30 con 0x559e3aa89170 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f61557fa640 1 -- 172.21.15.131:0/553477961 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c07f040 con 0x559e3aa89170 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f6274146800 1 -- 172.21.15.131:0/553477961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 msgr2=0x559e3aa89590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f6274146800 1 --2- 172.21.15.131:0/553477961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa89590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f625c08ddb0 tx=0x7f625c073d50 comp rx=0 tx=0).stop 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f6274146800 1 -- 172.21.15.131:0/553477961 shutdown_connections 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f6274146800 1 --2- 172.21.15.131:0/553477961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa89590 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f6274146800 1 -- 172.21.15.131:0/553477961 >> 172.21.15.131:0/553477961 conn(0x559e3aa854d0 msgr2=0x559e3aa83530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f6274146800 1 -- 172.21.15.131:0/553477961 shutdown_connections 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.416+0000 7f6274146800 1 -- 172.21.15.131:0/553477961 wait complete. 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f6274146800 1 Processor -- start 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f6274146800 1 -- start start 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f6274146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa907a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f6274146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e3aa8a2d0 con 0x559e3aa89170 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f627144b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa907a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f627144b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa907a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43256/0 (socket says 172.21.15.131:43256) 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 learned_addr learned my addr 172.21.15.131:0/4129220147 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.417+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3aa90ce0 con 0x559e3aa89170 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.418+0000 7f627144b640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa907a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f625c072800 tx=0x7f625c08dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.418+0000 7f61437fe640 1 -- 172.21.15.131:0/4129220147 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c05fb60 con 0x559e3aa89170 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.418+0000 7f61437fe640 1 -- 172.21.15.131:0/4129220147 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625c05fd00 con 0x559e3aa89170 2024-04-24T01:43:06.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.418+0000 7f61437fe640 1 -- 172.21.15.131:0/4129220147 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f625c0733b0 con 0x559e3aa89170 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.418+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e3aa90f70 con 0x559e3aa89170 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.418+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e3aa93c20 con 0x559e3aa89170 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.418+0000 7f61437fe640 1 -- 172.21.15.131:0/4129220147 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f625c073550 con 0x559e3aa89170 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f61437fe640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f613c036950 0x7f613c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f61437fe640 1 -- 172.21.15.131:0/4129220147 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f625c098c40 con 0x559e3aa89170 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f627244d640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f613c036950 0x7f613c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f627244d640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f613c036950 0x7f613c038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x559e3aa68360 tx=0x7f626401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3aa9c270 0x559e3aa9e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa9ee80 con 0x559e3aa9c270 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.419+0000 7f6271c4c640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3aa9c270 0x559e3aa9e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6271c4c640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3aa9c270 0x559e3aa9e730 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 realm 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa9f290 con 0x559e3aa9c270 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa9fb60 con 0x559e3aa9c270 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aa9ff00 con 0x559e3aa9c270 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.420+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa0750 con 0x559e3aa9c270 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f6274146800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f6274146800 20 searching for the correct realm 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559e3aaa24c0 0x559e3aaa48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f627144b640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559e3aaa24c0 0x559e3aaa48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f627144b640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559e3aaa24c0 0x559e3aaa48b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f627144b640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f625c074060 0x7f625c083400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.421+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f625c074060 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.422+0000 7f627244d640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f625c074060 0x7f625c083400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.422+0000 7f627244d640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f625c074060 0x7f625c083400 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.422+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626401f070 con 0x7f625c074060 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.422+0000 7f627244d640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6264031040 0x7f6264032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.422+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.422+0000 7f6271c4c640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6264031040 0x7f6264032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.423+0000 7f6271c4c640 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6264031040 0x7f6264032940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.423+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.423+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.423+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.423+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.423+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.423+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f625c074060 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626401f070 con 0x7f625c074060 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.424+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.425+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.425+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.425+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.425+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f625c074060 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.425+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f626401f070 con 0x7f625c074060 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.425+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.426+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.427+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f625c074060 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626401f070 con 0x7f625c074060 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.428+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f625c074060 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626401f070 con 0x7f625c074060 2024-04-24T01:43:06.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aaa24c0 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.429+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f6264031040 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x559e3aa9c270 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa4e90 con 0x7f625c074060 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626401f070 con 0x7f625c074060 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:06.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa1100 con 0x559e3aa9c270 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.430+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa19a0 con 0x559e3aa9c270 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa19a0 con 0x559e3aa9c270 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 zone default found 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 4 Realm: () 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:06.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 zonegroup default 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa5310 con 0x7f6264031040 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.431+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa6d80 con 0x559e3aaa24c0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f6274146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa72c0 con 0x559e3aaa24c0 2024-04-24T01:43:06.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f6274146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f6274146800 20 started sync module instance, tier type = 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f6274146800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.432+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa6190 con 0x7f625c074060 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.433+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.433+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94138077439360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa7bd0 con 0x7f625c074060 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.433+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa8420 con 0x559e3aa9c270 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.434+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94138077439360] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.434+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.434+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94138077443872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa8070 con 0x559e3aa9c270 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.434+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa8b90 con 0x559e3aaa24c0 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.435+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94138077443872] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.436+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.436+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94138077447776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa8f80 con 0x559e3aaa24c0 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.436+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa9980 con 0x7f625c074060 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.437+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.437+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94138077451408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaaa220 con 0x7f625c074060 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.437+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaaad20 con 0x559e3aa9c270 2024-04-24T01:43:06.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.437+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94138077447776] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.438+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.438+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94138077456400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaaace0 con 0x559e3aa9c270 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.438+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94138077451408] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.438+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaab780 con 0x7f6264031040 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.439+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.439+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94138077456400] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.439+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94138077459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaab780 con 0x7f6264031040 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.439+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaabbf0 con 0x7f6264031040 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.440+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94138077459120] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.440+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.440+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94138077453680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaabbb0 con 0x7f6264031040 2024-04-24T01:43:06.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.440+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaac5b0 con 0x7f6264031040 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94138077453680] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94138077444928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaac570 con 0x7f6264031040 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 20 add_watcher() i=0 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 20 add_watcher() i=1 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 20 add_watcher() i=2 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 20 add_watcher() i=3 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 20 add_watcher() i=4 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 20 add_watcher() i=5 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.441+0000 7f6274146800 20 add_watcher() i=6 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.443+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94138077444928] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.443+0000 7f6274146800 20 add_watcher() i=7 2024-04-24T01:43:06.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.443+0000 7f6274146800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.443+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaaf9d0 con 0x559e3aa9c270 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.443+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.444+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94138077463184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaacef0 con 0x559e3aa9c270 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94138077463184] v32'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f61237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 5 note: GC not initialized 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f61227fc640 20 reqs_thread_entry: start 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 20 Filter name: none 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6093fff640 20 reqs_thread_entry: start 2024-04-24T01:43:06.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.445+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae2d00 con 0x559e3aa9c270 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae5790 con 0x7f625c074060 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 20 disabling bucket name=myfoo 2024-04-24T01:43:06.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae3770 con 0x7f625c074060 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.446+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae60c0 con 0x7f6264031040 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(65 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6274146800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6274146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:06.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6274146800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6274146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6274146800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6274146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.447+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaedac0 con 0x7f6264031040 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(66 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6274146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6274146800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6274146800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6274146800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94138077698368 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae9170 con 0x7f6264031040 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== watch-notify(notify (1) cookie 94138077459120 notify 137438953487 ret 0) ==== 794+0+0 (crc 0 0 0) 0x559e3aae5600 con 0x7f6264031040 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f61557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94138077459120 notifier 4590 bl.length()=752 2024-04-24T01:43:06.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f61557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f61557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f61557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f61557fa640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6134003ea0 con 0x7f6264031040 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.448+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(67 notify.5 [notify cookie 94138077698368 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.449+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== watch-notify(notify_complete (2) cookie 94138077698368 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f626c033040 con 0x7f6264031040 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.449+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.449+0000 7f6274146800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_sources= new_sources= 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.449+0000 7f6274146800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential sources added=[] removed=[] 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.449+0000 7f6274146800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_dests= new_dests= 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.449+0000 7f6274146800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential dests added=[] removed=[] 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.449+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae8c80 con 0x559e3aa9c270 2024-04-24T01:43:06.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6274146800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6274146800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6274146800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94138077680736 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae8c80 con 0x559e3aa9c270 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94138077456400 notify 137438953488 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f626c033040 con 0x559e3aa9c270 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6154ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94138077456400 notifier 4590 bl.length()=567 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6154ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6154ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(70 notify.4 [notify cookie 94138077680736 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6154ff9640 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f609c003430 con 0x559e3aa9c270 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.450+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 94138077680736 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559e3aa67080 con 0x559e3aa9c270 2024-04-24T01:43:06.471 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:06.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.451+0000 7f61237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.451+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94138077463184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aae6cd0 con 0x559e3aa9c270 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.452+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94138077463184] v32'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.452+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94138077439360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaac260 con 0x7f625c074060 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.453+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94138077439360] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.453+0000 7f6274146800 20 remove_watcher() i=0 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.453+0000 7f6274146800 2 removed watcher, disabling cache 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.453+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94138077443872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa6580 con 0x559e3aa9c270 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.455+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94138077443872] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.455+0000 7f6274146800 20 remove_watcher() i=1 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.455+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94138077447776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa7720 con 0x559e3aaa24c0 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.456+0000 7f627144b640 1 -- 172.21.15.131:0/4129220147 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94138077447776] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f625c071030 con 0x559e3aaa24c0 2024-04-24T01:43:06.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.456+0000 7f6274146800 20 remove_watcher() i=2 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.456+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94138077451408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa8660 con 0x7f625c074060 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.457+0000 7f627244d640 1 -- 172.21.15.131:0/4129220147 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94138077451408] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264040040 con 0x7f625c074060 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.457+0000 7f6274146800 20 remove_watcher() i=3 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.457+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94138077456400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaa8660 con 0x559e3aa9c270 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.458+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94138077456400] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x559e3aa9c270 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.458+0000 7f6274146800 20 remove_watcher() i=4 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.458+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94138077459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaaa810 con 0x7f6264031040 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.459+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94138077459120] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.459+0000 7f6274146800 20 remove_watcher() i=5 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.459+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94138077453680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaaa810 con 0x7f6264031040 2024-04-24T01:43:06.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.460+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94138077453680] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.460+0000 7f6274146800 20 remove_watcher() i=6 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.460+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94138077444928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e3aaaa810 con 0x7f6264031040 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94138077444928] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c00dcd0 con 0x7f6264031040 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 20 remove_watcher() i=7 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6264031040 msgr2=0x7f6264032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6264031040 0x7f6264032940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3aa9c270 msgr2=0x559e3aa9e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3aa9c270 0x559e3aa9e730 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f625c074060 msgr2=0x7f625c083400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f625c074060 0x7f625c083400 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559e3aaa24c0 msgr2=0x559e3aaa48b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x559e3aaa24c0 0x559e3aaa48b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f613c036950 msgr2=0x7f613c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f613c036950 0x7f613c038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x559e3aa68360 tx=0x7f626401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 msgr2=0x559e3aa907a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa907a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f625c072800 tx=0x7f625c08dd40 comp rx=0 tx=0).stop 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6271c4c640 1 -- 172.21.15.131:0/4129220147 reap_dead start 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 shutdown_connections 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/4129220147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa89170 0x559e3aa907a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 >> 172.21.15.131:0/4129220147 conn(0x559e3aa854d0 msgr2=0x559e3aa82b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 shutdown_connections 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/4129220147 wait complete. 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f614c036950 msgr2=0x7f614c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f614c036950 0x7f614c038e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x559e3aa6c020 tx=0x7f6264005840 comp rx=0 tx=0).stop 2024-04-24T01:43:06.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa7bf90 msgr2=0x559e3aa7c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa7bf90 0x559e3aa7c3b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f625c01cdf0 tx=0x7f625c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 shutdown_connections 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f614c036950 0x7f614c038e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 --2- 172.21.15.131:0/3726854294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3aa7bf90 0x559e3aa7c3b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 >> 172.21.15.131:0/3726854294 conn(0x559e3aa70030 msgr2=0x559e3aa70430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 shutdown_connections 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.461+0000 7f6274146800 1 -- 172.21.15.131:0/3726854294 wait complete. 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3a96d460 msgr2=0x559e3aa6ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3a96d460 0x559e3aa6ae40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6158036950 msgr2=0x7f6158038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6158036950 0x7f6158038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f625c054000 tx=0x7f625c04e000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 msgr2=0x559e3aa63c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa63c00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c010 tx=0x7f626c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 shutdown_connections 2024-04-24T01:43:06.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x559e3a96d460 0x559e3aa6ae40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6158036950 0x7f6158038e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 --2- 172.21.15.131:0/2835555517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e3a969950 0x559e3aa63c00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 >> 172.21.15.131:0/2835555517 conn(0x559e3a963380 msgr2=0x559e3aa540c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 shutdown_connections 2024-04-24T01:43:06.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.462+0000 7f6274146800 1 -- 172.21.15.131:0/2835555517 wait complete. 2024-04-24T01:43:06.482 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:06.485 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-24T01:43:06.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-24T01:43:06.485 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-24T01:43:06.561 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:06.561 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:06.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.560+0000 7f48dd419800 1 Processor -- start 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.560+0000 7f48dd419800 1 -- start start 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.560+0000 7f48dd419800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561256703970 0x561256705d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48dd419800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612565c1d40 con 0x5612567062a0 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48dd419800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5612565944d0 con 0x561256703970 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48daf18640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561256703970 0x561256705d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48da717640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5612567062a0 0x561256708690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56780/0 (socket says 172.21.15.131:56780) 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48daf18640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561256703970 0x561256705d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43264/0 (socket says 172.21.15.131:43264) 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48da717640 1 -- 172.21.15.131:0/2020321860 learned_addr learned my addr 172.21.15.131:0/2020321860 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48daf18640 1 -- 172.21.15.131:0/2020321860 >> v1:172.21.15.107:6789/0 conn(0x5612567062a0 legacy=0x561256708690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.561+0000 7f48daf18640 1 -- 172.21.15.131:0/2020321860 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612565c0590 con 0x561256703970 2024-04-24T01:43:06.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.563+0000 7f48daf18640 1 --2- 172.21.15.131:0/2020321860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x561256705d60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00a470 tx=0x7f48cc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdbc13d4b68b388 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.563+0000 7f48d9f16640 1 -- 172.21.15.131:0/2020321860 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc057070 con 0x561256703970 2024-04-24T01:43:06.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.563+0000 7f48d9f16640 1 -- 172.21.15.131:0/2020321860 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc052570 con 0x561256703970 2024-04-24T01:43:06.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.563+0000 7f48d9f16640 1 -- 172.21.15.131:0/2020321860 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc052870 con 0x561256703970 2024-04-24T01:43:06.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.563+0000 7f48dd419800 1 -- 172.21.15.131:0/2020321860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 msgr2=0x561256705d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.563+0000 7f48dd419800 1 --2- 172.21.15.131:0/2020321860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x561256705d60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00a470 tx=0x7f48cc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:06.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.564+0000 7f48dd419800 1 -- 172.21.15.131:0/2020321860 shutdown_connections 2024-04-24T01:43:06.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.564+0000 7f48dd419800 1 --2- 172.21.15.131:0/2020321860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x561256705d60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.564+0000 7f48dd419800 1 -- 172.21.15.131:0/2020321860 >> 172.21.15.131:0/2020321860 conn(0x5612566fd320 msgr2=0x5612566ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.564+0000 7f48dd419800 1 -- 172.21.15.131:0/2020321860 shutdown_connections 2024-04-24T01:43:06.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.564+0000 7f48dd419800 1 -- 172.21.15.131:0/2020321860 wait complete. 2024-04-24T01:43:06.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.575+0000 7f48dd419800 1 Processor -- start 2024-04-24T01:43:06.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.575+0000 7f48dd419800 1 -- start start 2024-04-24T01:43:06.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f48dd419800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567032b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f48dd419800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56125664e3c0 con 0x561256703970 2024-04-24T01:43:06.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f48daf18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f48daf18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567032b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43278/0 (socket says 172.21.15.131:43278) 2024-04-24T01:43:06.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f48daf18640 1 -- 172.21.15.131:0/3069477576 learned_addr learned my addr 172.21.15.131:0/3069477576 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f48daf18640 1 -- 172.21.15.131:0/3069477576 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561256701870 con 0x561256703970 2024-04-24T01:43:06.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f48daf18640 1 --2- 172.21.15.131:0/3069477576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567032b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f48cc055040 tx=0x7f48cc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4036255e44c72fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f47c8e09640 1 -- 172.21.15.131:0/3069477576 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc057070 con 0x561256703970 2024-04-24T01:43:06.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f47c8e09640 1 -- 172.21.15.131:0/3069477576 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc063070 con 0x561256703970 2024-04-24T01:43:06.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.576+0000 7f47c8e09640 1 -- 172.21.15.131:0/3069477576 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc052720 con 0x561256703970 2024-04-24T01:43:06.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 -- 172.21.15.131:0/3069477576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 msgr2=0x5612567032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 --2- 172.21.15.131:0/3069477576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567032b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f48cc055040 tx=0x7f48cc04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 -- 172.21.15.131:0/3069477576 shutdown_connections 2024-04-24T01:43:06.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 --2- 172.21.15.131:0/3069477576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567032b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 -- 172.21.15.131:0/3069477576 >> 172.21.15.131:0/3069477576 conn(0x5612566fd320 msgr2=0x5612567efa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 -- 172.21.15.131:0/3069477576 shutdown_connections 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 -- 172.21.15.131:0/3069477576 wait complete. 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 Processor -- start 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.577+0000 7f48dd419800 1 -- start start 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48dd419800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48dd419800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56125670c0c0 con 0x561256703970 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48daf18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48daf18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567fdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43282/0 (socket says 172.21.15.131:43282) 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48daf18640 1 -- 172.21.15.131:0/2733100179 learned_addr learned my addr 172.21.15.131:0/2733100179 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48daf18640 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612567fe2b0 con 0x561256703970 2024-04-24T01:43:06.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48daf18640 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567fdd70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f48cc060040 tx=0x7f48cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f47c7606640 1 -- 172.21.15.131:0/2733100179 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc052e30 con 0x561256703970 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f47c7606640 1 -- 172.21.15.131:0/2733100179 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc06c070 con 0x561256703970 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f47c7606640 1 -- 172.21.15.131:0/2733100179 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc05e5d0 con 0x561256703970 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612567fe540 con 0x561256703970 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.578+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612568011f0 con 0x561256703970 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.579+0000 7f47c7606640 1 -- 172.21.15.131:0/2733100179 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f48cc05e770 con 0x561256703970 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.579+0000 7f47c7606640 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47c0036950 0x7f47c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.579+0000 7f47c7606640 1 -- 172.21.15.131:0/2733100179 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f48cc08e870 con 0x561256703970 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.579+0000 7f48da717640 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47c0036950 0x7f47c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.579+0000 7f48dd419800 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612567062a0 0x561256804fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.579+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256805530 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.580+0000 7f48db719640 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612567062a0 0x561256804fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.580+0000 7f48da717640 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47c0036950 0x7f47c0038e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f48d0000f60 tx=0x7f48d00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.580+0000 7f48db719640 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612567062a0 0x561256804fb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.580+0000 7f48db719640 1 -- 172.21.15.131:0/2733100179 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48d400a4a0 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.580+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256802580 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.580+0000 7f48db719640 1 -- 172.21.15.131:0/2733100179 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48d400a4a0 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.580+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612568073a0 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.581+0000 7f48db719640 1 -- 172.21.15.131:0/2733100179 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48d400a4a0 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.581+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612568066e0 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.581+0000 7f48db719640 1 -- 172.21.15.131:0/2733100179 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48d400a4a0 con 0x5612567062a0 2024-04-24T01:43:06.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.581+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256806b30 con 0x5612567062a0 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.581+0000 7f48db719640 1 -- 172.21.15.131:0/2733100179 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48d400a4a0 con 0x5612567062a0 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48dd419800 1 Processor -- start 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48dd419800 1 -- start start 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48dd419800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256816190 0x5612568165b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48dd419800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5612565f46b0 con 0x561256816190 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48da717640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256816190 0x5612568165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48da717640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256816190 0x5612568165b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43296/0 (socket says 172.21.15.131:43296) 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48da717640 1 -- 172.21.15.131:0/2266369917 learned_addr learned my addr 172.21.15.131:0/2266369917 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48da717640 1 -- 172.21.15.131:0/2266369917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561256816af0 con 0x561256816190 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.582+0000 7f48da717640 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256816190 0x5612568165b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f48d0001ed0 tx=0x7f48d000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.583+0000 7f47c4e01640 1 -- 172.21.15.131:0/2266369917 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d001b550 con 0x561256816190 2024-04-24T01:43:06.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.583+0000 7f47c4e01640 1 -- 172.21.15.131:0/2266369917 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d001b6f0 con 0x561256816190 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.583+0000 7f47c4e01640 1 -- 172.21.15.131:0/2266369917 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d001b9d0 con 0x561256816190 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.583+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561256817560 con 0x561256816190 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.583+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561256817a60 con 0x561256816190 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.583+0000 7f47c4e01640 1 -- 172.21.15.131:0/2266369917 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f48d0023020 con 0x561256816190 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f47c4e01640 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47b4036900 0x7f47b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f47c4e01640 1 -- 172.21.15.131:0/2266369917 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f48d0021020 con 0x561256816190 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48db719640 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47b4036900 0x7f47b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48dd419800 1 Processor -- start 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48dd419800 1 -- start start 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48db719640 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47b4036900 0x7f47b4038dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x561256806200 tx=0x7f48d4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48dd419800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x5612568238f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48dd419800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561256701b30 con 0x5612568234d0 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48da717640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x5612568238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48da717640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x5612568238f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43298/0 (socket says 172.21.15.131:43298) 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.584+0000 7f48da717640 1 -- 172.21.15.131:0/1748661116 learned_addr learned my addr 172.21.15.131:0/1748661116 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48da717640 1 -- 172.21.15.131:0/1748661116 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561256823ec0 con 0x5612568234d0 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48da717640 1 --2- 172.21.15.131:0/1748661116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x5612568238f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f48d004ce90 tx=0x7f48d00468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e15f8de50b52283 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f47be7fc640 1 -- 172.21.15.131:0/1748661116 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d001be20 con 0x5612568234d0 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f47be7fc640 1 -- 172.21.15.131:0/1748661116 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d004a070 con 0x5612568234d0 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f47be7fc640 1 -- 172.21.15.131:0/1748661116 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d0024e10 con 0x5612568234d0 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48dd419800 1 -- 172.21.15.131:0/1748661116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 msgr2=0x5612568238f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48dd419800 1 --2- 172.21.15.131:0/1748661116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x5612568238f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f48d004ce90 tx=0x7f48d00468f0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48dd419800 1 -- 172.21.15.131:0/1748661116 shutdown_connections 2024-04-24T01:43:06.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48dd419800 1 --2- 172.21.15.131:0/1748661116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x5612568238f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48dd419800 1 -- 172.21.15.131:0/1748661116 >> 172.21.15.131:0/1748661116 conn(0x56125681f830 msgr2=0x56125681d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48dd419800 1 -- 172.21.15.131:0/1748661116 shutdown_connections 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.585+0000 7f48dd419800 1 -- 172.21.15.131:0/1748661116 wait complete. 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48dd419800 1 Processor -- start 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48dd419800 1 -- start start 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48dd419800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x56125682ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48dd419800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561256824630 con 0x5612568234d0 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48da717640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x56125682ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48da717640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x56125682ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:43312/0 (socket says 172.21.15.131:43312) 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 learned_addr learned my addr 172.21.15.131:0/3502602833 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.586+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125682b0d0 con 0x5612568234d0 2024-04-24T01:43:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.587+0000 7f48da717640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x56125682ab90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f48d00234d0 tx=0x7f48d004ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.587+0000 7f47bcff9640 1 -- 172.21.15.131:0/3502602833 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d0034070 con 0x5612568234d0 2024-04-24T01:43:06.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.587+0000 7f47bcff9640 1 -- 172.21.15.131:0/3502602833 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d0024e10 con 0x5612568234d0 2024-04-24T01:43:06.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.587+0000 7f47bcff9640 1 -- 172.21.15.131:0/3502602833 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d0025ad0 con 0x5612568234d0 2024-04-24T01:43:06.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.587+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56125682b360 con 0x5612568234d0 2024-04-24T01:43:06.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.587+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125682b360 con 0x5612568234d0 2024-04-24T01:43:06.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.587+0000 7f47bcff9640 1 -- 172.21.15.131:0/3502602833 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f48d0037070 con 0x5612568234d0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f47bcff9640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47a4036860 0x7f47a4038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f47bcff9640 1 -- 172.21.15.131:0/3502602833 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f48d003ac90 con 0x5612568234d0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f48db719640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47a4036860 0x7f47a4038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f48db719640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47a4036860 0x7f47a4038d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x5612568024d0 tx=0x7f48d401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612568364b0 0x561256838970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612568390c0 con 0x5612568364b0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.588+0000 7f48daf18640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612568364b0 0x561256838970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48daf18640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612568364b0 0x561256838970 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 realm 2024-04-24T01:43:06.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612568394d0 con 0x5612568364b0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256839da0 con 0x5612568364b0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125683a140 con 0x5612568364b0 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.589+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48dd419800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48dd419800 20 searching for the correct realm 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56125683c700 0x56125683eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683f120 con 0x56125683c700 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48da717640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56125683c700 0x56125683eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.590+0000 7f48da717640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56125683c700 0x56125683eaf0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48da717640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f48d0039070 0x7f48d004b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683f120 con 0x7f48d0039070 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48db719640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f48d0039070 0x7f48d004b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48db719640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f48d0039070 0x7f48d004b4f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48d0039070 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48db719640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f48d4031040 0x7f48d4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683f120 con 0x7f48d4031040 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.591+0000 7f48daf18640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f48d4031040 0x7f48d4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.592+0000 7f48daf18640 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f48d4031040 0x7f48d4032430 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.592+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.592+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.592+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.592+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.592+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.592+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d0039070 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48d0039070 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.593+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d0039070 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48d401f070 con 0x7f48d0039070 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.594+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.595+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.596+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d0039070 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48d0039070 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.597+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.598+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.598+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d0039070 2024-04-24T01:43:06.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.598+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48d0039070 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.598+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x56125683c700 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.598+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.598+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d4031040 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x5612568364b0 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56125683a990 con 0x7f48d0039070 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48d0039070 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:06.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.599+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125683b1e0 con 0x5612568364b0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125683b5d0 con 0x5612568364b0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125683b5d0 con 0x5612568364b0 2024-04-24T01:43:06.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 zone default found 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 4 Realm: () 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 zonegroup default 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125683f5a0 con 0x7f48d4031040 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.600+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256840f80 con 0x56125683c700 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48dd419800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256841320 con 0x56125683c700 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48dd419800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48dd419800 20 started sync module instance, tier type = 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48dd419800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.601+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256840420 con 0x7f48d0039070 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.602+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.602+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94636760891248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612568416c0 con 0x7f48d0039070 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.602+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256841f10 con 0x5612568364b0 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.603+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94636760891248] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.604+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.604+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94636760897216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256842330 con 0x5612568364b0 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.604+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256842b80 con 0x56125683c700 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.605+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94636760897216] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.605+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.605+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94636760900400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256842750 con 0x56125683c700 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.605+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256843880 con 0x7f48d0039070 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.606+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94636760900400] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.606+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.606+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94636760903936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256843b30 con 0x7f48d0039070 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.606+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256844630 con 0x5612568364b0 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.607+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.607+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94636760908064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612568445f0 con 0x5612568364b0 2024-04-24T01:43:06.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.607+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612568455e0 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.607+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94636760903936] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.608+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94636760908064] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.608+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.608+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94636760912080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612568455a0 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.608+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256844b70 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.609+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.609+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94636760914384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256844b70 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.609+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612568469a0 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.609+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94636760912080] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94636760914384] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94636760915440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256843580 con 0x7f48d4031040 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 20 add_watcher() i=0 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 20 add_watcher() i=1 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 20 add_watcher() i=2 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 20 add_watcher() i=3 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 20 add_watcher() i=4 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 20 add_watcher() i=5 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.610+0000 7f48dd419800 20 add_watcher() i=6 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.611+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94636760915440] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.611+0000 7f48dd419800 20 add_watcher() i=7 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.611+0000 7f48dd419800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:06.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.611+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256849990 con 0x5612568364b0 2024-04-24T01:43:06.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.611+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.612+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94636760917136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256846e10 con 0x5612568364b0 2024-04-24T01:43:06.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.612+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94636760917136] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f47917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 5 note: GC not initialized 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f470bfff640 20 reqs_thread_entry: start 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 20 Filter name: none 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f4709ffb640 20 reqs_thread_entry: start 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.613+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125687cb40 con 0x5612568364b0 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:06.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125687f5d0 con 0x7f48d0039070 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 20 enabling bucket name=myfoo 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125687d5b0 con 0x7f48d0039070 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 : miss 2024-04-24T01:43:06.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 20 rados->read ofs=0 len=0 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.614+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56125687ff00 con 0x7f48d4031040 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(65 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48dd419800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48dd419800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48dd419800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48dd419800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48dd419800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48dd419800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.615+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 8.6 8:61912ff9:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256887a40 con 0x7f48d4031040 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.616+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(66 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.616+0000 7f48dd419800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.616+0000 7f48dd419800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:06.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.616+0000 7f48dd419800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.616+0000 7f48dd419800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1, ofs0, ns] 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.616+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94636761154944 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256882030 con 0x7f48d4031040 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== watch-notify(notify (1) cookie 94636760912080 notify 137438953488 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5612568802f0 con 0x7f48d4031040 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f47be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94636760912080 notifier 4597 bl.length()=752 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f47be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 info.flags=0x17 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f47be7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1 to cache LRU end 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(67 notify.5 [notify cookie 94636761154944 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f47be7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f47be7fc640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f47a0003ea0 con 0x7f48d4031040 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== watch-notify(notify_complete (2) cookie 94636761154944 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56125687f440 con 0x7f48d4031040 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48dd419800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_sources= new_sources= 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48dd419800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential sources added=[] removed=[] 2024-04-24T01:43:06.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48dd419800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): orig_dests= new_dests= 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48dd419800 20 handle_bi_update(): bucket=:myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1]): potential dests added=[] removed=[] 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.617+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256882c00 con 0x5612568364b0 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.618+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.618+0000 7f48dd419800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.618+0000 7f48dd419800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.618+0000 7f48dd419800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.618+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94636761173616 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561256882c00 con 0x5612568364b0 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.618+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94636760908064 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56125687f440 con 0x5612568364b0 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.619+0000 7f47be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94636760908064 notifier 4597 bl.length()=567 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.619+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(70 notify.4 [notify cookie 94636761173616 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.619+0000 7f47be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:06.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.619+0000 7f47be7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:06.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.619+0000 7f47be7fc640 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f47a0003ea0 con 0x5612568364b0 2024-04-24T01:43:06.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.619+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== watch-notify(notify_complete (2) cookie 94636761173616 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5612568011f0 con 0x5612568364b0 2024-04-24T01:43:06.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.619+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.639 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.620+0000 7f47917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.620+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94636760917136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256885730 con 0x5612568364b0 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.621+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94636760917136] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.621+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94636760891248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256846490 con 0x7f48d0039070 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.622+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94636760891248] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.622+0000 7f48dd419800 20 remove_watcher() i=0 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.622+0000 7f48dd419800 2 removed watcher, disabling cache 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.622+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94636760897216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56125683ff70 con 0x5612568364b0 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.623+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94636760897216] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.623+0000 7f48dd419800 20 remove_watcher() i=1 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.623+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94636760900400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56125683ff70 con 0x56125683c700 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.624+0000 7f48da717640 1 -- 172.21.15.131:0/3502602833 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94636760900400] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d0036030 con 0x56125683c700 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.624+0000 7f48dd419800 20 remove_watcher() i=2 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.624+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94636760903936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256842330 con 0x7f48d0039070 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.625+0000 7f48db719640 1 -- 172.21.15.131:0/3502602833 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94636760903936] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48d0039070 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.625+0000 7f48dd419800 20 remove_watcher() i=3 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.625+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94636760908064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256843100 con 0x5612568364b0 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.626+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94636760908064] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x5612568364b0 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.626+0000 7f48dd419800 20 remove_watcher() i=4 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.626+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94636760912080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256844120 con 0x7f48d4031040 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.627+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94636760912080] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.627+0000 7f48dd419800 20 remove_watcher() i=5 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.627+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94636760914384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256843100 con 0x7f48d4031040 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.628+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94636760914384] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.628+0000 7f48dd419800 20 remove_watcher() i=6 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.628+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94636760915440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561256844120 con 0x7f48d4031040 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94636760915440] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc009d10 con 0x7f48d4031040 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 20 remove_watcher() i=7 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f48d4031040 msgr2=0x7f48d4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f48d4031040 0x7f48d4032430 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612568364b0 msgr2=0x561256838970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612568364b0 0x561256838970 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f48d0039070 msgr2=0x7f48d004b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f48d0039070 0x7f48d004b4f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56125683c700 msgr2=0x56125683eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.629+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56125683c700 0x56125683eaf0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47a4036860 msgr2=0x7f47a4038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47a4036860 0x7f47a4038d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x5612568024d0 tx=0x7f48d401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 msgr2=0x56125682ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 --2- 172.21.15.131:0/3502602833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5612568234d0 0x56125682ab90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f48d00234d0 tx=0x7f48d004ce20 comp rx=0 tx=0).stop 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 reap_dead start 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48daf18640 1 -- 172.21.15.131:0/3502602833 reap_dead start 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 shutdown_connections 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 >> 172.21.15.131:0/3502602833 conn(0x56125681f830 msgr2=0x56125681ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 shutdown_connections 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/3502602833 wait complete. 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47b4036900 msgr2=0x7f47b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47b4036900 0x7f47b4038dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x561256806200 tx=0x7f48d4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256816190 msgr2=0x5612568165b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256816190 0x5612568165b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f48d0001ed0 tx=0x7f48d000d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 shutdown_connections 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47b4036900 0x7f47b4038dc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 --2- 172.21.15.131:0/2266369917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256816190 0x5612568165b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 >> 172.21.15.131:0/2266369917 conn(0x56125680a230 msgr2=0x56125680a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 shutdown_connections 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/2266369917 wait complete. 2024-04-24T01:43:06.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612567062a0 msgr2=0x561256804fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.630+0000 7f48dd419800 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612567062a0 0x561256804fb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47c0036950 msgr2=0x7f47c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47c0036950 0x7f47c0038e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f48d0000f60 tx=0x7f48d00012b0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 msgr2=0x5612567fdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567fdd70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f48cc060040 tx=0x7f48cc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 shutdown_connections 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5612567062a0 0x561256804fb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f47c0036950 0x7f47c0038e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 --2- 172.21.15.131:0/2733100179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561256703970 0x5612567fdd70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 >> 172.21.15.131:0/2733100179 conn(0x5612566fd320 msgr2=0x5612567ef600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 shutdown_connections 2024-04-24T01:43:06.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:06.631+0000 7f48dd419800 1 -- 172.21.15.131:0/2733100179 wait complete. 2024-04-24T01:43:06.651 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:06.658 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:43:06.915 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-24T01:43:06.921 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:21.921 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-24T01:43:21.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-24T01:43:21.922 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-24T01:43:21.969 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:21.969 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.969+0000 7f1a8a32f800 1 Processor -- start 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.969+0000 7f1a8a32f800 1 -- start start 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a8a32f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556827d56100 0x556827d56520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a8a32f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556827c16d40 con 0x556827d56ed0 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a8a32f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x556827be94d0 con 0x556827d56100 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a860c5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556827d56100 0x556827d56520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a858c4640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x556827d56ed0 0x556827d57380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56908/0 (socket says 172.21.15.131:56908) 2024-04-24T01:43:21.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a858c4640 1 -- 172.21.15.131:0/3528692978 learned_addr learned my addr 172.21.15.131:0/3528692978 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:21.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a860c5640 1 -- 172.21.15.131:0/3528692978 >> v1:172.21.15.107:6789/0 conn(0x556827d56ed0 legacy=0x556827d57380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:21.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.970+0000 7f1a860c5640 1 -- 172.21.15.131:0/3528692978 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556827c15590 con 0x556827d56100 2024-04-24T01:43:21.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.972+0000 7f1a860c5640 1 --2- 172.21.15.131:0/3528692978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827d56520 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800a470 tx=0x7f1a7801ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7de5d052fe6f43 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:21.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.972+0000 7f1a850c3640 1 -- 172.21.15.131:0/3528692978 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78057070 con 0x556827d56100 2024-04-24T01:43:21.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a850c3640 1 -- 172.21.15.131:0/3528692978 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7804ad80 con 0x556827d56100 2024-04-24T01:43:21.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a850c3640 1 -- 172.21.15.131:0/3528692978 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78052590 con 0x556827d56100 2024-04-24T01:43:21.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3528692978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 msgr2=0x556827d56520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:21.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3528692978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827d56520 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800a470 tx=0x7f1a7801ce50 comp rx=0 tx=0).stop 2024-04-24T01:43:21.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3528692978 shutdown_connections 2024-04-24T01:43:21.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3528692978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827d56520 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:21.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3528692978 >> 172.21.15.131:0/3528692978 conn(0x556827d51b00 msgr2=0x556827d53f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:21.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3528692978 shutdown_connections 2024-04-24T01:43:21.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.973+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3528692978 wait complete. 2024-04-24T01:43:21.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.986+0000 7f1a8a32f800 1 Processor -- start 2024-04-24T01:43:21.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.986+0000 7f1a8a32f800 1 -- start start 2024-04-24T01:43:21.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.987+0000 7f1a8a32f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e4b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:21.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.987+0000 7f1a8a32f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556827ca33c0 con 0x556827d56100 2024-04-24T01:43:21.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.987+0000 7f1a860c5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e4b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:21.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.987+0000 7f1a860c5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e4b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53794/0 (socket says 172.21.15.131:53794) 2024-04-24T01:43:21.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.987+0000 7f1a860c5640 1 -- 172.21.15.131:0/552725260 learned_addr learned my addr 172.21.15.131:0/552725260 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:21.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.987+0000 7f1a860c5640 1 -- 172.21.15.131:0/552725260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556827e4bdd0 con 0x556827d56100 2024-04-24T01:43:22.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.987+0000 7f1a860c5640 1 --2- 172.21.15.131:0/552725260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e4b800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1a78055040 tx=0x7f1a7804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e9c87faf2f8428 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1974608640 1 -- 172.21.15.131:0/552725260 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78057040 con 0x556827d56100 2024-04-24T01:43:22.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1974608640 1 -- 172.21.15.131:0/552725260 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a78062070 con 0x556827d56100 2024-04-24T01:43:22.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1974608640 1 -- 172.21.15.131:0/552725260 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7805d470 con 0x556827d56100 2024-04-24T01:43:22.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1a8a32f800 1 -- 172.21.15.131:0/552725260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 msgr2=0x556827e4b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/552725260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e4b800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1a78055040 tx=0x7f1a7804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1a8a32f800 1 -- 172.21.15.131:0/552725260 shutdown_connections 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/552725260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e4b800 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1a8a32f800 1 -- 172.21.15.131:0/552725260 >> 172.21.15.131:0/552725260 conn(0x556827d51b00 msgr2=0x556827e47120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1a8a32f800 1 -- 172.21.15.131:0/552725260 shutdown_connections 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.988+0000 7f1a8a32f800 1 -- 172.21.15.131:0/552725260 wait complete. 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a8a32f800 1 Processor -- start 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a8a32f800 1 -- start start 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a8a32f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a8a32f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556827d63820 con 0x556827d56100 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a860c5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a860c5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53798/0 (socket says 172.21.15.131:53798) 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a860c5640 1 -- 172.21.15.131:0/1838192247 learned_addr learned my addr 172.21.15.131:0/1838192247 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.989+0000 7f1a860c5640 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556827e53830 con 0x556827d56100 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.990+0000 7f1a860c5640 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e532f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1a7801ce20 tx=0x7f1a78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.990+0000 7f1972e05640 1 -- 172.21.15.131:0/1838192247 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7806b070 con 0x556827d56100 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.990+0000 7f1972e05640 1 -- 172.21.15.131:0/1838192247 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7805d8f0 con 0x556827d56100 2024-04-24T01:43:22.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.990+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556827e53ac0 con 0x556827d56100 2024-04-24T01:43:22.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.990+0000 7f1972e05640 1 -- 172.21.15.131:0/1838192247 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78057070 con 0x556827d56100 2024-04-24T01:43:22.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.990+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556827e566d0 con 0x556827d56100 2024-04-24T01:43:22.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1972e05640 1 -- 172.21.15.131:0/1838192247 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a7805dbd0 con 0x556827d56100 2024-04-24T01:43:22.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1972e05640 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f196c036900 0x7f196c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1972e05640 1 -- 172.21.15.131:0/1838192247 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1a7808e1c0 con 0x556827d56100 2024-04-24T01:43:22.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1a858c4640 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f196c036900 0x7f196c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827d56ed0 0x556827e5a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e5a9d0 con 0x556827d56ed0 2024-04-24T01:43:22.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1a868c6640 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827d56ed0 0x556827e5a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.991+0000 7f1a858c4640 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f196c036900 0x7f196c038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c001d90 tx=0x7f1a7c0012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.992+0000 7f1a868c6640 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827d56ed0 0x556827e5a490 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.992+0000 7f1a868c6640 1 -- 172.21.15.131:0/1838192247 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a8000a4a0 con 0x556827d56ed0 2024-04-24T01:43:22.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.992+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e5b2b0 con 0x556827d56ed0 2024-04-24T01:43:22.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.992+0000 7f1a868c6640 1 -- 172.21.15.131:0/1838192247 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a8000a4a0 con 0x556827d56ed0 2024-04-24T01:43:22.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.992+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e5c660 con 0x556827d56ed0 2024-04-24T01:43:22.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.993+0000 7f1a868c6640 1 -- 172.21.15.131:0/1838192247 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a8000a4a0 con 0x556827d56ed0 2024-04-24T01:43:22.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.993+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e5bb00 con 0x556827d56ed0 2024-04-24T01:43:22.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.993+0000 7f1a868c6640 1 -- 172.21.15.131:0/1838192247 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a8000a4a0 con 0x556827d56ed0 2024-04-24T01:43:22.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.993+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e5bf20 con 0x556827d56ed0 2024-04-24T01:43:22.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.993+0000 7f1a868c6640 1 -- 172.21.15.131:0/1838192247 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a8000a4a0 con 0x556827d56ed0 2024-04-24T01:43:22.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.993+0000 7f1a8a32f800 1 Processor -- start 2024-04-24T01:43:22.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.993+0000 7f1a8a32f800 1 -- start start 2024-04-24T01:43:22.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.994+0000 7f1a8a32f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e6b680 0x556827e6baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.994+0000 7f1a8a32f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556827c496b0 con 0x556827e6b680 2024-04-24T01:43:22.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.994+0000 7f1a858c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e6b680 0x556827e6baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.994+0000 7f1a858c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e6b680 0x556827e6baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53810/0 (socket says 172.21.15.131:53810) 2024-04-24T01:43:22.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.994+0000 7f1a858c4640 1 -- 172.21.15.131:0/1683694040 learned_addr learned my addr 172.21.15.131:0/1683694040 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.994+0000 7f1a858c4640 1 -- 172.21.15.131:0/1683694040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556827e6bfe0 con 0x556827e6b680 2024-04-24T01:43:22.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.994+0000 7f1a858c4640 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e6b680 0x556827e6baa0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00efd0 tx=0x7f1a7c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.995+0000 7f196bfff640 1 -- 172.21.15.131:0/1683694040 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7c01b550 con 0x556827e6b680 2024-04-24T01:43:22.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.995+0000 7f196bfff640 1 -- 172.21.15.131:0/1683694040 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c01b6f0 con 0x556827e6b680 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.995+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556827e6ca50 con 0x556827e6b680 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.995+0000 7f196bfff640 1 -- 172.21.15.131:0/1683694040 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7c01b9f0 con 0x556827e6b680 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.995+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556827e6cf50 con 0x556827e6b680 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f196bfff640 1 -- 172.21.15.131:0/1683694040 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a7c023020 con 0x556827e6b680 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f196bfff640 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1960036900 0x7f1960038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f196bfff640 1 -- 172.21.15.131:0/1683694040 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1a7c021020 con 0x556827e6b680 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f1a868c6640 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1960036900 0x7f1960038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f1a8a32f800 1 Processor -- start 2024-04-24T01:43:22.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f1a8a32f800 1 -- start start 2024-04-24T01:43:22.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f1a868c6640 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1960036900 0x7f1960038dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x556827e5bea0 tx=0x7f1a80005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f1a8a32f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e78de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.996+0000 7f1a8a32f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556827e4c090 con 0x556827e789c0 2024-04-24T01:43:22.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1a858c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e78de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1a858c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e78de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53816/0 (socket says 172.21.15.131:53816) 2024-04-24T01:43:22.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1a858c4640 1 -- 172.21.15.131:0/2278150552 learned_addr learned my addr 172.21.15.131:0/2278150552 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1a858c4640 1 -- 172.21.15.131:0/2278150552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556827e793b0 con 0x556827e789c0 2024-04-24T01:43:22.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1a858c4640 1 --2- 172.21.15.131:0/2278150552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e78de0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c01bbb0 tx=0x7f1a7c04cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cedd137aece91ed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1969ffb640 1 -- 172.21.15.131:0/2278150552 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7c024bf0 con 0x556827e789c0 2024-04-24T01:43:22.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1969ffb640 1 -- 172.21.15.131:0/2278150552 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c04a070 con 0x556827e789c0 2024-04-24T01:43:22.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.997+0000 7f1969ffb640 1 -- 172.21.15.131:0/2278150552 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7c025a60 con 0x556827e789c0 2024-04-24T01:43:22.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 -- 172.21.15.131:0/2278150552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 msgr2=0x556827e78de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/2278150552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e78de0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c01bbb0 tx=0x7f1a7c04cf40 comp rx=0 tx=0).stop 2024-04-24T01:43:22.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 -- 172.21.15.131:0/2278150552 shutdown_connections 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/2278150552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e78de0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 -- 172.21.15.131:0/2278150552 >> 172.21.15.131:0/2278150552 conn(0x556827e74d20 msgr2=0x556827e72d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 -- 172.21.15.131:0/2278150552 shutdown_connections 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 -- 172.21.15.131:0/2278150552 wait complete. 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 Processor -- start 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 -- start start 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e800f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.998+0000 7f1a8a32f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556827e79b20 con 0x556827e789c0 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1a858c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e800f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1a858c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e800f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53830/0 (socket says 172.21.15.131:53830) 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 learned_addr learned my addr 172.21.15.131:0/3405773418 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556827e80630 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1a858c4640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e800f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c024ba0 tx=0x7f1a7c04cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1957fff640 1 -- 172.21.15.131:0/3405773418 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7c034070 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1957fff640 1 -- 172.21.15.131:0/3405773418 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c019320 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1957fff640 1 -- 172.21.15.131:0/3405773418 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7c025930 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556827e808c0 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:21.999+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556827e808c0 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.000+0000 7f1957fff640 1 -- 172.21.15.131:0/3405773418 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a7c037070 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.000+0000 7f1957fff640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1950036950 0x7f1950038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.000+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.000+0000 7f1957fff640 1 -- 172.21.15.131:0/3405773418 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1a7c04e040 con 0x556827e789c0 2024-04-24T01:43:22.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.000+0000 7f1a868c6640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1950036950 0x7f1950038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827e8b9f0 0x556827e8de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e8e5e0 con 0x556827e8b9f0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a860c5640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827e8b9f0 0x556827e8de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a868c6640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1950036950 0x7f1950038e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x556827e5b240 tx=0x7f1a8001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a860c5640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827e8b9f0 0x556827e8de90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a8a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a8a32f800 20 realm 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.001+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e8e9f0 con 0x556827e8b9f0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e8f2c0 con 0x556827e8b9f0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e8f660 con 0x556827e8b9f0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e8fac0 con 0x556827e8b9f0 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 20 searching for the correct realm 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556827e91b10 0x556827e93f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.002+0000 7f1a858c4640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556827e91b10 0x556827e93f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.003+0000 7f1a858c4640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556827e91b10 0x556827e93f00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.003+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.003+0000 7f1a858c4640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1a7c039070 0x7f1a7c03e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.003+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a7c039070 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.003+0000 7f1a868c6640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1a7c039070 0x7f1a7c03e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.004+0000 7f1a868c6640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1a7c039070 0x7f1a7c03e0b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.004+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8001f070 con 0x7f1a7c039070 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.004+0000 7f1a868c6640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1a80031040 0x7f1a80032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.004+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.004+0000 7f1a860c5640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1a80031040 0x7f1a80032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.005+0000 7f1a860c5640 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1a80031040 0x7f1a80032940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.005+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.005+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.005+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.005+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.005+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.005+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.006+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.006+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.006+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.006+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a7c039070 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.006+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8001f070 con 0x7f1a7c039070 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.006+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.007+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.007+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.007+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.007+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.007+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.007+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a7c039070 2024-04-24T01:43:22.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a8001f070 con 0x7f1a7c039070 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.008+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.009+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.010+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.010+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.010+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.010+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a7c039070 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.010+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8001f070 con 0x7f1a7c039070 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.010+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a7c039070 2024-04-24T01:43:22.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8001f070 con 0x7f1a7c039070 2024-04-24T01:43:22.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.011+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a7c039070 2024-04-24T01:43:22.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.012+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a8001f070 con 0x7f1a7c039070 2024-04-24T01:43:22.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.012+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e91b10 2024-04-24T01:43:22.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.012+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.012+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a80031040 2024-04-24T01:43:22.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.012+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.012+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x556827e8b9f0 2024-04-24T01:43:22.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556827e945d0 con 0x7f1a7c039070 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e90530 con 0x556827e8b9f0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e90dd0 con 0x556827e8b9f0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.013+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e90170 con 0x556827e8b9f0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 zone default found 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 4 Realm: () 2024-04-24T01:43:22.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 zonegroup default 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e90dd0 con 0x7f1a7c039070 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e968e0 con 0x556827e91b10 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e96c80 con 0x556827e91b10 2024-04-24T01:43:22.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.014+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.015+0000 7f1a8a32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.015+0000 7f1a8a32f800 20 started sync module instance, tier type = 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.015+0000 7f1a8a32f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.015+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e95d20 con 0x7f1a7c039070 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.016+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.016+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93905834566176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e95d20 con 0x7f1a7c039070 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.016+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e97640 con 0x556827e8b9f0 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.017+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93905834566176] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.017+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.017+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93905834564208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e97640 con 0x556827e8b9f0 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.017+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e98040 con 0x556827e91b10 2024-04-24T01:43:22.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.018+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.018+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93905834572624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e988d0 con 0x556827e91b10 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.018+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e99390 con 0x7f1a7c039070 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.019+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93905834564208] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.020+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93905834572624] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.020+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.020+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93905834577504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e983e0 con 0x7f1a7c039070 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.020+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e99ca0 con 0x556827e8b9f0 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.021+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93905834577504] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.021+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.021+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93905834570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e99c60 con 0x556827e8b9f0 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.021+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9a6b0 con 0x7f1a80031040 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.022+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.022+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93905834582528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9a620 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.022+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9b640 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.023+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93905834570128] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.023+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93905834582528] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.023+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.024+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93905834584736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9b140 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.024+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9baf0 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.024+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93905834584736] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93905834579888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9baf0 con 0x7f1a80031040 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 20 add_watcher() i=0 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 20 add_watcher() i=1 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 20 add_watcher() i=2 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 20 add_watcher() i=3 2024-04-24T01:43:22.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 20 add_watcher() i=4 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 20 add_watcher() i=5 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.025+0000 7f1a8a32f800 20 add_watcher() i=6 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.026+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93905834579888] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.026+0000 7f1a8a32f800 20 add_watcher() i=7 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.026+0000 7f1a8a32f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.026+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827e9ef20 con 0x556827e8b9f0 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.026+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.026+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93905834588176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9c440 con 0x556827e8b9f0 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.027+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93905834588176] v34'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.027+0000 7f193cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.027+0000 7f1a8a32f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.027+0000 7f1a8a32f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.027+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea7570 con 0x556827e8b9f0 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.029+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'50 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.029+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea7740 con 0x7f1a80031040 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.030+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.030+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea7910 con 0x556827e91b10 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.031+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.031+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea8260 con 0x556827e8b9f0 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.032+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'159 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.032+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea6ef0 con 0x7f1a7c039070 2024-04-24T01:43:22.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.033+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.033+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea6ef0 con 0x556827e91b10 2024-04-24T01:43:22.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.034+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.034+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea83f0 con 0x556827e8b9f0 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.035+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.035+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea89a0 con 0x7f1a80031040 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.036+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.036+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea89a0 con 0x7f1a7c039070 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.037+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.037+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea8f10 con 0x556827e91b10 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.038+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.038+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea8fa0 con 0x7f1a7c039070 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.039+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'51 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.039+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9450 con 0x7f1a80031040 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.040+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.040+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9450 con 0x7f1a7c039070 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.041+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.041+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea94e0 con 0x7f1a80031040 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.042+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'48 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.042+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9990 con 0x556827e8b9f0 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.043+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.043+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9990 con 0x556827e91b10 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.045+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.045+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9990 con 0x7f1a7c039070 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.046+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'52 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.046+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9990 con 0x556827e91b10 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.046+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.047+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9990 con 0x556827e8b9f0 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.048+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.048+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9890 con 0x556827e8b9f0 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.049+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'161 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.049+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9890 con 0x556827e91b10 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.050+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.050+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9890 con 0x7f1a7c039070 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.051+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.051+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x556827e91b10 2024-04-24T01:43:22.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.052+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.052+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.053+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'38 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.053+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.054+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.054+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.055+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.055+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x7f1a80031040 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.056+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.056+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.057+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.057+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x7f1a80031040 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.058+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.058+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x556827e91b10 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.059+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'46 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.059+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x7f1a80031040 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.060+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'49 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.060+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ea9800 con 0x7f1a7c039070 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f18b77fe640 20 reqs_thread_entry: start 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f1a8a32f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f1a8a32f800 20 Filter name: none 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f18b57fa640 20 reqs_thread_entry: start 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed4d40 con 0x556827e8b9f0 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.062+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed4d40 con 0x556827e8b9f0 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.063+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.063+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2c60 con 0x556827e8b9f0 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.063+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.063+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed27b0 con 0x7f1a80031040 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.063+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.063+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.064+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.064+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.064+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.064+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.065+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.066+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.067+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.068+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.068+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.068+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.068+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.068+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.068+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.069+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.069+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.069+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.069+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.069+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.069+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.070+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.071+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.072+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.072+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.072+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.072+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.072+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.072+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.073+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.074+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.074+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.074+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.074+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.074+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.074+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.075+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.076+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.077+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.078+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e8b9f0 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.079+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a7c039070 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.080+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.081+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.082+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.083+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.084+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.084+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.084+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.084+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.084+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.084+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.085+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.085+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.085+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.085+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.085+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.085+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.086+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.086+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.086+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.086+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.086+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.086+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.087+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.087+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x556827e91b10 2024-04-24T01:43:22.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.087+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.087+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.087+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.087+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed2760 con 0x7f1a80031040 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== osd_op_reply(186 gc.30 [call out=1701b] v0'0 uv47 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed48f0 con 0x7f1a7c039070 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed48f0 con 0x7f1a7c039070 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.088+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556827ed48f0 con 0x7f1a7c039070 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.089+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.089+0000 7f193cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.089+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93905834588176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ed4ce0 con 0x556827e8b9f0 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.090+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93905834588176] v34'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.090+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93905834566176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827ed4ce0 con 0x7f1a7c039070 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.092+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93905834566176] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.092+0000 7f1a8a32f800 20 remove_watcher() i=0 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.092+0000 7f1a8a32f800 2 removed watcher, disabling cache 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.092+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93905834564208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e96220 con 0x556827e8b9f0 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.093+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93905834564208] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.093+0000 7f1a8a32f800 20 remove_watcher() i=1 2024-04-24T01:43:22.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.093+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93905834572624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e95a70 con 0x556827e91b10 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.094+0000 7f1a858c4640 1 -- 172.21.15.131:0/3405773418 <== osd.3 v2:172.21.15.131:6800/3849831825 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93905834572624] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7c036030 con 0x556827e91b10 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.094+0000 7f1a8a32f800 20 remove_watcher() i=2 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.094+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93905834577504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e95a70 con 0x7f1a7c039070 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.095+0000 7f1a868c6640 1 -- 172.21.15.131:0/3405773418 <== osd.2 v2:172.21.15.131:6809/3673094383 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93905834577504] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a80040040 con 0x7f1a7c039070 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.095+0000 7f1a8a32f800 20 remove_watcher() i=3 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.095+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93905834570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e98e60 con 0x556827e8b9f0 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.096+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.1 v2:172.21.15.131:6808/2417718615 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93905834570128] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x556827e8b9f0 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.096+0000 7f1a8a32f800 20 remove_watcher() i=4 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.096+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93905834582528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e98e60 con 0x7f1a80031040 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.097+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93905834582528] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.097+0000 7f1a8a32f800 20 remove_watcher() i=5 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.097+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93905834584736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9a200 con 0x7f1a80031040 2024-04-24T01:43:22.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.098+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93905834584736] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.098+0000 7f1a8a32f800 20 remove_watcher() i=6 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.098+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93905834579888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556827e9a200 con 0x7f1a80031040 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93905834579888] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a7805a040 con 0x7f1a80031040 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 20 remove_watcher() i=7 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1a80031040 msgr2=0x7f1a80032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1a80031040 0x7f1a80032940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827e8b9f0 msgr2=0x556827e8de90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827e8b9f0 0x556827e8de90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1a7c039070 msgr2=0x7f1a7c03e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1a7c039070 0x7f1a7c03e0b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556827e91b10 msgr2=0x556827e93f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556827e91b10 0x556827e93f00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1950036950 msgr2=0x7f1950038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1950036950 0x7f1950038e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x556827e5b240 tx=0x7f1a8001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 msgr2=0x556827e800f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/3405773418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e789c0 0x556827e800f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c024ba0 tx=0x7f1a7c04cd90 comp rx=0 tx=0).stop 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 reap_dead start 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a860c5640 1 -- 172.21.15.131:0/3405773418 reap_dead start 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 shutdown_connections 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 >> 172.21.15.131:0/3405773418 conn(0x556827e74d20 msgr2=0x556827e72380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 shutdown_connections 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.099+0000 7f1a8a32f800 1 -- 172.21.15.131:0/3405773418 wait complete. 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1960036900 msgr2=0x7f1960038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1960036900 0x7f1960038dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x556827e5bea0 tx=0x7f1a80005840 comp rx=0 tx=0).stop 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e6b680 msgr2=0x556827e6baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e6b680 0x556827e6baa0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00efd0 tx=0x7f1a7c00d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 shutdown_connections 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1960036900 0x7f1960038dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1683694040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827e6b680 0x556827e6baa0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 >> 172.21.15.131:0/1683694040 conn(0x556827e5f720 msgr2=0x556827e5fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 shutdown_connections 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1683694040 wait complete. 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827d56ed0 msgr2=0x556827e5a490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827d56ed0 0x556827e5a490 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f196c036900 msgr2=0x7f196c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f196c036900 0x7f196c038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c001d90 tx=0x7f1a7c0012f0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 msgr2=0x556827e532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e532f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1a7801ce20 tx=0x7f1a78002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 shutdown_connections 2024-04-24T01:43:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556827d56ed0 0x556827e5a490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f196c036900 0x7f196c038dc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 --2- 172.21.15.131:0/1838192247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556827d56100 0x556827e532f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 >> 172.21.15.131:0/1838192247 conn(0x556827d51b00 msgr2=0x556827e45960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 shutdown_connections 2024-04-24T01:43:22.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.100+0000 7f1a8a32f800 1 -- 172.21.15.131:0/1838192247 wait complete. 2024-04-24T01:43:22.121 INFO:teuthology.orchestra.run.smithi131.stdout:[{"tag":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7163641608735712312\u0000","time":"2024-04-24T01:43:21.920765+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_7","key":"","instance":""}]}] 2024-04-24T01:43:22.121 DEBUG:tasks.util.rgw: json result: [{'tag': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7163641608735712312\x00', 'time': '2024-04-24T01:43:21.920765+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_7', 'key': '', 'instance': ''}]}] 2024-04-24T01:43:22.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-24T01:43:22.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-24T01:43:22.122 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-24T01:43:22.162 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:22.162 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:22.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.162+0000 7f00a762f800 1 Processor -- start 2024-04-24T01:43:22.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.162+0000 7f00a762f800 1 -- start start 2024-04-24T01:43:22.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.162+0000 7f00a762f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55867f64c2d0 0x55867f654dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.162+0000 7f00a762f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55867f50ad40 con 0x55867f64a790 2024-04-24T01:43:22.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.162+0000 7f00a762f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55867f4dd4d0 con 0x55867f64c2d0 2024-04-24T01:43:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.162+0000 7f00a21bf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55867f64c2d0 0x55867f654dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.163+0000 7f00a29c0640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55867f64a790 0x55867f64abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56910/0 (socket says 172.21.15.131:56910) 2024-04-24T01:43:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.163+0000 7f00a21bf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55867f64c2d0 0x55867f654dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53832/0 (socket says 172.21.15.131:53832) 2024-04-24T01:43:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.163+0000 7f00a29c0640 1 -- 172.21.15.131:0/2532389845 learned_addr learned my addr 172.21.15.131:0/2532389845 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.163+0000 7f00a21bf640 1 -- 172.21.15.131:0/2532389845 >> v1:172.21.15.107:6789/0 conn(0x55867f64a790 legacy=0x55867f64abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.163+0000 7f00a21bf640 1 -- 172.21.15.131:0/2532389845 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867f509590 con 0x55867f64c2d0 2024-04-24T01:43:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a21bf640 1 --2- 172.21.15.131:0/2532389845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64c2d0 0x55867f654dd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f009800a470 tx=0x7f009801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48be27d6555b5712 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a19be640 1 -- 172.21.15.131:0/2532389845 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098057070 con 0x55867f64c2d0 2024-04-24T01:43:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a19be640 1 -- 172.21.15.131:0/2532389845 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0098052440 con 0x55867f64c2d0 2024-04-24T01:43:22.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a19be640 1 -- 172.21.15.131:0/2532389845 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098052740 con 0x55867f64c2d0 2024-04-24T01:43:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a762f800 1 -- 172.21.15.131:0/2532389845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64c2d0 msgr2=0x55867f654dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a762f800 1 --2- 172.21.15.131:0/2532389845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64c2d0 0x55867f654dd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f009800a470 tx=0x7f009801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a762f800 1 -- 172.21.15.131:0/2532389845 shutdown_connections 2024-04-24T01:43:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a762f800 1 --2- 172.21.15.131:0/2532389845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64c2d0 0x55867f654dd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a762f800 1 -- 172.21.15.131:0/2532389845 >> 172.21.15.131:0/2532389845 conn(0x55867f646310 msgr2=0x55867f648730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a762f800 1 -- 172.21.15.131:0/2532389845 shutdown_connections 2024-04-24T01:43:22.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.165+0000 7f00a762f800 1 -- 172.21.15.131:0/2532389845 wait complete. 2024-04-24T01:43:22.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.177+0000 7f00a762f800 1 Processor -- start 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.177+0000 7f00a762f800 1 -- start start 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.177+0000 7f00a762f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f73f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.177+0000 7f00a762f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55867f5973b0 con 0x55867f64a790 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.177+0000 7f00a29c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f73f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.177+0000 7f00a29c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f73f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53840/0 (socket says 172.21.15.131:53840) 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.177+0000 7f00a29c0640 1 -- 172.21.15.131:0/903178840 learned_addr learned my addr 172.21.15.131:0/903178840 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.178+0000 7f00a29c0640 1 -- 172.21.15.131:0/903178840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867f73fac0 con 0x55867f64a790 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.178+0000 7f00a29c0640 1 --2- 172.21.15.131:0/903178840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f73f4f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0094001de0 tx=0x7f009400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c6cc4bd2040309 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.178+0000 7eff90e09640 1 -- 172.21.15.131:0/903178840 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0094012020 con 0x55867f64a790 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.178+0000 7eff90e09640 1 -- 172.21.15.131:0/903178840 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009400e5a0 con 0x55867f64a790 2024-04-24T01:43:22.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.178+0000 7eff90e09640 1 -- 172.21.15.131:0/903178840 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009400e8c0 con 0x55867f64a790 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 -- 172.21.15.131:0/903178840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 msgr2=0x55867f73f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 --2- 172.21.15.131:0/903178840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f73f4f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0094001de0 tx=0x7f009400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 -- 172.21.15.131:0/903178840 shutdown_connections 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 --2- 172.21.15.131:0/903178840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f73f4f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 -- 172.21.15.131:0/903178840 >> 172.21.15.131:0/903178840 conn(0x55867f646310 msgr2=0x55867f73ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 -- 172.21.15.131:0/903178840 shutdown_connections 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 -- 172.21.15.131:0/903178840 wait complete. 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 Processor -- start 2024-04-24T01:43:22.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 -- start start 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f7470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a762f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55867f6575f0 con 0x55867f64a790 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.179+0000 7f00a29c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f7470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7f00a29c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f7470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53846/0 (socket says 172.21.15.131:53846) 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7f00a29c0640 1 -- 172.21.15.131:0/3526879057 learned_addr learned my addr 172.21.15.131:0/3526879057 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7f00a29c0640 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867f7475f0 con 0x55867f64a790 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7f00a29c0640 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f7470b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f009400c010 tx=0x7f0094000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7eff8f606640 1 -- 172.21.15.131:0/3526879057 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0094012070 con 0x55867f64a790 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7eff8f606640 1 -- 172.21.15.131:0/3526879057 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009401a7a0 con 0x55867f64a790 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7eff8f606640 1 -- 172.21.15.131:0/3526879057 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009401aa80 con 0x55867f64a790 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55867f747880 con 0x55867f64a790 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.180+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55867f74a490 con 0x55867f64a790 2024-04-24T01:43:22.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.181+0000 7eff8f606640 1 -- 172.21.15.131:0/3526879057 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0094015020 con 0x55867f64a790 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.181+0000 7eff8f606640 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff88036900 0x7eff88038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.181+0000 7eff8f606640 1 -- 172.21.15.131:0/3526879057 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0094020070 con 0x55867f64a790 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.181+0000 7f00a21bf640 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff88036900 0x7eff88038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a762f800 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f64c2d0 0x55867f74e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f74e790 con 0x55867f64c2d0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a31c1640 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f64c2d0 0x55867f74e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a21bf640 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff88036900 0x7eff88038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0098054000 tx=0x7f009804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a31c1640 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f64c2d0 0x55867f74e250 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a31c1640 1 -- 172.21.15.131:0/3526879057 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f009c00a4a0 con 0x55867f64c2d0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f74b820 con 0x55867f64c2d0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a31c1640 1 -- 172.21.15.131:0/3526879057 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f009c00a4a0 con 0x55867f64c2d0 2024-04-24T01:43:22.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.182+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7505d0 con 0x55867f64c2d0 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.183+0000 7f00a31c1640 1 -- 172.21.15.131:0/3526879057 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f009c00a4a0 con 0x55867f64c2d0 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.183+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f74f910 con 0x55867f64c2d0 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.183+0000 7f00a31c1640 1 -- 172.21.15.131:0/3526879057 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f009c00a4a0 con 0x55867f64c2d0 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.183+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f74fcb0 con 0x55867f64c2d0 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.183+0000 7f00a31c1640 1 -- 172.21.15.131:0/3526879057 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f009c00a4a0 con 0x55867f64c2d0 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a762f800 1 Processor -- start 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a762f800 1 -- start start 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a762f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f75f3f0 0x55867f75f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a762f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55867f53d6b0 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a21bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f75f3f0 0x55867f75f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a21bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f75f3f0 0x55867f75f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53852/0 (socket says 172.21.15.131:53852) 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a21bf640 1 -- 172.21.15.131:0/3906685139 learned_addr learned my addr 172.21.15.131:0/3906685139 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.184+0000 7f00a21bf640 1 -- 172.21.15.131:0/3906685139 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867f75fd50 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.185+0000 7f00a21bf640 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f75f3f0 0x55867f75f810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0098044840 tx=0x7f0098002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.185+0000 7eff8ce01640 1 -- 172.21.15.131:0/3906685139 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009806f070 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.185+0000 7eff8ce01640 1 -- 172.21.15.131:0/3906685139 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0098058040 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.185+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55867f7607c0 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.185+0000 7eff8ce01640 1 -- 172.21.15.131:0/3906685139 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098057050 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.185+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55867f760c60 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7eff8ce01640 1 -- 172.21.15.131:0/3906685139 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0098072070 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7eff8ce01640 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff7c036900 0x7eff7c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7eff8ce01640 1 -- 172.21.15.131:0/3906685139 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f009808f890 con 0x55867f75f3f0 2024-04-24T01:43:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7f00a31c1640 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff7c036900 0x7eff7c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7f00a762f800 1 Processor -- start 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7f00a762f800 1 -- start start 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7f00a31c1640 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff7c036900 0x7eff7c038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55867f74f430 tx=0x7f009c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7f00a762f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f76ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7f00a762f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55867f73fe40 con 0x55867f76c630 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.186+0000 7f00a21bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f76ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.187+0000 7f00a21bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f76ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53864/0 (socket says 172.21.15.131:53864) 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.187+0000 7f00a21bf640 1 -- 172.21.15.131:0/217710403 learned_addr learned my addr 172.21.15.131:0/217710403 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.187+0000 7f00a21bf640 1 -- 172.21.15.131:0/217710403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867f76d020 con 0x55867f76c630 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.187+0000 7f00a21bf640 1 --2- 172.21.15.131:0/217710403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f76ca50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f009808dbf0 tx=0x7f0098069cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6870c287e42858e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.187+0000 7eff867fc640 1 -- 172.21.15.131:0/217710403 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009805f8f0 con 0x55867f76c630 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.187+0000 7eff867fc640 1 -- 172.21.15.131:0/217710403 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009805faf0 con 0x55867f76c630 2024-04-24T01:43:22.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.187+0000 7eff867fc640 1 -- 172.21.15.131:0/217710403 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00980693a0 con 0x55867f76c630 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 -- 172.21.15.131:0/217710403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 msgr2=0x55867f76ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 --2- 172.21.15.131:0/217710403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f76ca50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f009808dbf0 tx=0x7f0098069cc0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 -- 172.21.15.131:0/217710403 shutdown_connections 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 --2- 172.21.15.131:0/217710403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f76ca50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 -- 172.21.15.131:0/217710403 >> 172.21.15.131:0/217710403 conn(0x55867f768990 msgr2=0x55867f7669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 -- 172.21.15.131:0/217710403 shutdown_connections 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 -- 172.21.15.131:0/217710403 wait complete. 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 Processor -- start 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 -- start start 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f773c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a762f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55867f76d790 con 0x55867f76c630 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a21bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f773c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a21bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f773c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53874/0 (socket says 172.21.15.131:53874) 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.188+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 learned_addr learned my addr 172.21.15.131:0/1391509947 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.189+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867f7741a0 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.189+0000 7f00a21bf640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f773c60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0098052ce0 tx=0x7f009808db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.189+0000 7eff84ff9640 1 -- 172.21.15.131:0/1391509947 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098093020 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.189+0000 7eff84ff9640 1 -- 172.21.15.131:0/1391509947 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009805f8f0 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.189+0000 7eff84ff9640 1 -- 172.21.15.131:0/1391509947 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009808fbe0 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.189+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55867f774430 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.189+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55867f7770e0 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7eff84ff9640 1 -- 172.21.15.131:0/1391509947 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0098096020 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7eff84ff9640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff6c036900 0x7eff6c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7eff84ff9640 1 -- 172.21.15.131:0/1391509947 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0098099cf0 con 0x55867f76c630 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7f00a31c1640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff6c036900 0x7eff6c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7f00a31c1640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff6c036900 0x7eff6c038dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55867f74b770 tx=0x7f009c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f77f720 0x55867f781be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.190+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f782330 con 0x55867f77f720 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a29c0640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f77f720 0x55867f781be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a29c0640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f77f720 0x55867f781be0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 20 realm 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f782740 con 0x55867f77f720 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:22.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f783010 con 0x55867f77f720 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.191+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7833b0 con 0x55867f77f720 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f783c00 con 0x55867f77f720 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 20 searching for the correct realm 2024-04-24T01:43:22.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55867f785970 0x55867f787d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a21bf640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55867f785970 0x55867f787d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.192+0000 7f00a21bf640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55867f785970 0x55867f787d60 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a21bf640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f00980a3040 0x7f0098073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f00980a3040 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a31c1640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f00980a3040 0x7f0098073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a31c1640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f00980a3040 0x7f0098073a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c01f070 con 0x7f00980a3040 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a31c1640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f009c031040 0x7f009c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.193+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.194+0000 7f00a29c0640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f009c031040 0x7f009c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.194+0000 7f00a29c0640 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f009c031040 0x7f009c032940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.194+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.194+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.195+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f00980a3040 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c01f070 con 0x7f00980a3040 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.196+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f00980a3040 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f009c01f070 con 0x7f00980a3040 2024-04-24T01:43:22.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.197+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.198+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f00980a3040 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c01f070 con 0x7f00980a3040 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.199+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f00980a3040 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c01f070 con 0x7f00980a3040 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.200+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f00980a3040 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c01f070 con 0x7f00980a3040 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f785970 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f009c031040 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x55867f77f720 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.201+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55867f788340 con 0x7f00980a3040 2024-04-24T01:43:22.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f784580 con 0x55867f77f720 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f784e20 con 0x55867f77f720 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f784e20 con 0x55867f77f720 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.202+0000 7f00a762f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 zone default found 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 4 Realm: () 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 zonegroup default 2024-04-24T01:43:22.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7887c0 con 0x7f00980a3040 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f78a5c0 con 0x55867f785970 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f78ab30 con 0x55867f785970 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 started sync module instance, tier type = 2024-04-24T01:43:22.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.203+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7899e0 con 0x7f00980a3040 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.204+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.204+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94036152590080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7899e0 con 0x7f00980a3040 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.204+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78b5b0 con 0x55867f77f720 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.205+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94036152590080] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.206+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.206+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94036152595168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7899e0 con 0x55867f77f720 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.206+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78bff0 con 0x55867f785970 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.207+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94036152595168] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.207+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.207+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94036152597312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78c390 con 0x55867f785970 2024-04-24T01:43:22.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.207+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78ce30 con 0x7f00980a3040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.208+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.208+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94036152600864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78d700 con 0x7f00980a3040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.208+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78e1b0 con 0x55867f77f720 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.209+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94036152597312] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.209+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.209+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94036152587568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78e1b0 con 0x55867f77f720 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.209+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78ec00 con 0x7f009c031040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.209+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94036152600864] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.210+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.210+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94036152587568] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.210+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94036152603216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78ebc0 con 0x7f009c031040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.210+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78f160 con 0x7f009c031040 2024-04-24T01:43:22.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.211+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94036152603216] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.211+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.211+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94036152605840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78ebc0 con 0x7f009c031040 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.211+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78fa80 con 0x7f009c031040 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94036152605840] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94036152612240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f78fc60 con 0x7f009c031040 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 20 add_watcher() i=0 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 20 add_watcher() i=1 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 20 add_watcher() i=2 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 20 add_watcher() i=3 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 20 add_watcher() i=4 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 20 add_watcher() i=5 2024-04-24T01:43:22.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.212+0000 7f00a762f800 20 add_watcher() i=6 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.213+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94036152612240] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.213+0000 7f00a762f800 20 add_watcher() i=7 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.213+0000 7f00a762f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.213+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f793030 con 0x55867f77f720 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.214+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.214+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94036152613712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f790420 con 0x55867f77f720 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.215+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94036152613712] v34'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.215+0000 7eff597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.215+0000 7f00a762f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.215+0000 7f00a762f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.215+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79b860 con 0x55867f77f720 2024-04-24T01:43:22.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.216+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'51 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.216+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79beb0 con 0x7f009c031040 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.218+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.218+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79beb0 con 0x55867f785970 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.219+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.219+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79c2d0 con 0x55867f77f720 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.220+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'164 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.220+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79c2e0 con 0x7f00980a3040 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.221+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.221+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79c930 con 0x55867f785970 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.222+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.222+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79cd30 con 0x55867f77f720 2024-04-24T01:43:22.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.223+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.223+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79cd30 con 0x7f009c031040 2024-04-24T01:43:22.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.224+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.224+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79cd30 con 0x7f00980a3040 2024-04-24T01:43:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.225+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.225+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79d300 con 0x55867f785970 2024-04-24T01:43:22.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.226+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.226+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79d6a0 con 0x7f00980a3040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.227+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'54 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.227+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79dc10 con 0x7f009c031040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.228+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.228+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79dc10 con 0x7f00980a3040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.229+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.229+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x7f009c031040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.230+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'50 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.230+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f77f720 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.231+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'165 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.231+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.232+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.232+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x7f00980a3040 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.233+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'55 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.233+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.234+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.234+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f77f720 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.235+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.235+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f77f720 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.236+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'166 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.236+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.238+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.238+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x7f00980a3040 2024-04-24T01:43:22.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.238+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.239+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.239+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.239+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.240+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'39 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.240+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.241+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.241+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.242+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.242+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x7f009c031040 2024-04-24T01:43:22.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.243+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.243+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.244+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.244+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x7f009c031040 2024-04-24T01:43:22.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.245+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.245+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x55867f785970 2024-04-24T01:43:22.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.246+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'49 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.246+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x7f009c031040 2024-04-24T01:43:22.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.247+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.247+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f79e0c0 con 0x7f00980a3040 2024-04-24T01:43:22.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.248+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.249+0000 7efed3fff640 20 reqs_thread_entry: start 2024-04-24T01:43:22.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.249+0000 7f00a762f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:22.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.249+0000 7f00a762f800 20 Filter name: none 2024-04-24T01:43:22.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.249+0000 7efed1ffb640 20 reqs_thread_entry: start 2024-04-24T01:43:22.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.249+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-24T01:43:22.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.249+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.250+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 gc.3 [call] v34'167 uv167 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.250+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.250+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(95 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.250+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.250+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(96 gc.3 [call out=24b] v0'0 uv167 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(97 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(98 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.251+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.252+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(99 gc.3 [call] v34'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.252+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.252+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:100 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.253+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(100 gc.4 [call] v34'56 uv56 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.253+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:101 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.253+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(101 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.253+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.253+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:102 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(102 gc.4 [call out=24b] v0'0 uv56 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:103 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(103 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(104 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.254+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:105 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.255+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(105 gc.4 [call] v34'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.255+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.255+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:106 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.256+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(106 gc.5 [call] v34'45 uv45 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.256+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:107 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.256+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(107 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.256+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.256+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:108 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.256+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(108 gc.5 [call out=24b] v0'0 uv45 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.256+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.257+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.257+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.257+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.257+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(110 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.257+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.257+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.258+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(111 gc.5 [call] v34'46 uv46 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.258+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.258+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.259+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(112 gc.6 [call] v34'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.259+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.259+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(113 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.259+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.259+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f77f720 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.259+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(114 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.259+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:115 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.260+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(115 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.260+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.260+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:116 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.260+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(116 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.260+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.260+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:117 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.261+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(117 gc.6 [call] v34'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.261+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.261+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:118 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.262+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(118 gc.7 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.262+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:119 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.262+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(119 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.262+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.262+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:120 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(120 gc.7 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:121 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(121 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:122 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(122 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.263+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:123 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.264+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(123 gc.7 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.264+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.264+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:124 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.265+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(124 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.265+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:125 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.265+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(125 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.265+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.265+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:126 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.265+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(126 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.265+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:127 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.266+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(127 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.266+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.266+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:128 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.266+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(128 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.266+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.266+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:129 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.267+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== osd_op_reply(129 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.267+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.267+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:130 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.268+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(130 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.268+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:131 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.268+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(131 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.268+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.268+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:132 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== osd_op_reply(132 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:133 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(133 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:134 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 36 ==== osd_op_reply(134 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.269+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:135 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.270+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 37 ==== osd_op_reply(135 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.270+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.270+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:136 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.271+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(136 gc.10 [call] v34'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.271+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:137 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.271+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== osd_op_reply(137 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.271+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.271+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:138 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(138 gc.10 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:139 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== osd_op_reply(139 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:140 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 36 ==== osd_op_reply(140 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.272+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:141 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.273+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 37 ==== osd_op_reply(141 gc.10 [call] v34'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.273+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.273+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:142 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.274+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(142 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.274+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:143 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.274+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(143 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.274+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.274+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:144 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f009c031040 2024-04-24T01:43:22.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(144 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:145 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(145 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:146 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(146 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.275+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:147 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.276+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(147 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.276+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.276+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:148 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.277+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 38 ==== osd_op_reply(148 gc.12 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.277+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:149 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 39 ==== osd_op_reply(149 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:150 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f00980a3040 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 40 ==== osd_op_reply(150 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:151 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 41 ==== osd_op_reply(151 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:152 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 42 ==== osd_op_reply(152 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.278+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:153 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.279+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 43 ==== osd_op_reply(153 gc.12 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.279+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-24T01:43:22.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.279+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:154 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(154 gc.13 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:155 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(155 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:156 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== osd_op_reply(156 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:157 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(157 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.281+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:158 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.282+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(158 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.282+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.282+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:159 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.283+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== osd_op_reply(159 gc.13 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.283+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-24T01:43:22.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.283+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:160 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(160 gc.14 [call] v34'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:161 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(161 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:162 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(162 gc.14 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:163 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(163 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.284+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:164 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.285+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(164 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.285+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.285+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:165 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.285+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(165 gc.14 [call] v34'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.285+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.286+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:166 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 38 ==== osd_op_reply(166 gc.15 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:167 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 39 ==== osd_op_reply(167 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:168 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 40 ==== osd_op_reply(168 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:169 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 41 ==== osd_op_reply(169 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.287+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:170 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.288+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 42 ==== osd_op_reply(170 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.288+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.288+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:171 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.289+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 43 ==== osd_op_reply(171 gc.15 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.289+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.289+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:172 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.289+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 44 ==== osd_op_reply(172 gc.16 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.289+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:173 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 45 ==== osd_op_reply(173 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:174 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f00980a3040 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 46 ==== osd_op_reply(174 gc.16 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:175 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 47 ==== osd_op_reply(175 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:176 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 48 ==== osd_op_reply(176 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.290+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:177 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.291+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 49 ==== osd_op_reply(177 gc.16 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.291+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-24T01:43:22.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.291+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:178 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.292+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 44 ==== osd_op_reply(178 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.292+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:179 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 45 ==== osd_op_reply(179 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:180 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 46 ==== osd_op_reply(180 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:181 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 47 ==== osd_op_reply(181 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:182 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 48 ==== osd_op_reply(182 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.293+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:183 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.294+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 49 ==== osd_op_reply(183 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.294+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-24T01:43:22.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.294+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.295+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 47 ==== osd_op_reply(184 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 48 ==== osd_op_reply(185 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:186 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 49 ==== osd_op_reply(186 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:187 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 50 ==== osd_op_reply(187 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:188 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 51 ==== osd_op_reply(188 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.296+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:189 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.297+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 52 ==== osd_op_reply(189 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.297+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-24T01:43:22.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.297+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.298+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 53 ==== osd_op_reply(190 gc.19 [call] v34'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.298+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 54 ==== osd_op_reply(191 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:192 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f77f720 2024-04-24T01:43:22.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 55 ==== osd_op_reply(192 gc.19 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:193 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 56 ==== osd_op_reply(193 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:194 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 57 ==== osd_op_reply(194 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.299+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:195 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f77f720 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.300+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 58 ==== osd_op_reply(195 gc.19 [call] v34'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.300+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-24T01:43:22.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.300+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.301+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 50 ==== osd_op_reply(196 gc.20 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.301+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.301+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 51 ==== osd_op_reply(197 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.301+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.301+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:198 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 52 ==== osd_op_reply(198 gc.20 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:199 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 53 ==== osd_op_reply(199 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:200 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 54 ==== osd_op_reply(200 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.302+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:201 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.303+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 55 ==== osd_op_reply(201 gc.20 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.303+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-24T01:43:22.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.303+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.304+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 50 ==== osd_op_reply(202 gc.21 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.304+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.304+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 51 ==== osd_op_reply(203 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.304+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.304+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:204 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 52 ==== osd_op_reply(204 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:205 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 53 ==== osd_op_reply(205 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:206 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 54 ==== osd_op_reply(206 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.305+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:207 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f00980a3040 2024-04-24T01:43:22.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.306+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 55 ==== osd_op_reply(207 gc.21 [call] v34'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.306+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-24T01:43:22.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.306+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:208 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.307+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 56 ==== osd_op_reply(208 gc.22 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.307+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:209 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.307+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 57 ==== osd_op_reply(209 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.307+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.307+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:210 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.307+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 58 ==== osd_op_reply(210 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.307+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:211 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.308+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 59 ==== osd_op_reply(211 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.308+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.308+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:212 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.308+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 60 ==== osd_op_reply(212 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.308+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.308+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:213 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.309+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 61 ==== osd_op_reply(213 gc.22 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.309+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-24T01:43:22.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.309+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:214 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 62 ==== osd_op_reply(214 gc.23 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:215 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 63 ==== osd_op_reply(215 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:216 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 64 ==== osd_op_reply(216 gc.23 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:217 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 65 ==== osd_op_reply(217 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.310+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:218 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.311+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 66 ==== osd_op_reply(218 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.311+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.311+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:219 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.312+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 67 ==== osd_op_reply(219 gc.23 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.312+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.312+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:220 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.312+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 68 ==== osd_op_reply(220 gc.24 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.312+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:221 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 69 ==== osd_op_reply(221 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:222 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 70 ==== osd_op_reply(222 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:223 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 71 ==== osd_op_reply(223 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:224 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 72 ==== osd_op_reply(224 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.313+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:225 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.314+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 73 ==== osd_op_reply(225 gc.24 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.314+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.314+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:226 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.315+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 74 ==== osd_op_reply(226 gc.25 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.315+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:227 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.315+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 75 ==== osd_op_reply(227 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.315+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.315+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:228 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 76 ==== osd_op_reply(228 gc.25 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:229 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 77 ==== osd_op_reply(229 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:230 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 78 ==== osd_op_reply(230 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.316+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:231 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.317+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 79 ==== osd_op_reply(231 gc.25 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.317+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.317+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:232 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.318+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(232 gc.26 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.318+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:233 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.318+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== osd_op_reply(233 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.318+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.318+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:234 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f009c031040 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== osd_op_reply(234 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:235 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== osd_op_reply(235 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:236 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== osd_op_reply(236 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.319+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:237 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.320+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(237 gc.26 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.320+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-24T01:43:22.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.320+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:238 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.321+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 80 ==== osd_op_reply(238 gc.27 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.321+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:239 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.321+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 81 ==== osd_op_reply(239 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.321+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.321+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:240 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.321+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 82 ==== osd_op_reply(240 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.321+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:241 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.322+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 83 ==== osd_op_reply(241 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.322+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.322+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:242 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.322+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 84 ==== osd_op_reply(242 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.322+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.322+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:243 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.323+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 85 ==== osd_op_reply(243 gc.27 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.323+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.323+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:244 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.324+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 46 ==== osd_op_reply(244 gc.28 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.324+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:245 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.324+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 47 ==== osd_op_reply(245 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.324+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.324+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:246 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.324+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 48 ==== osd_op_reply(246 gc.28 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.324+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:247 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.325+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 49 ==== osd_op_reply(247 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.325+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.325+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:248 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.325+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 50 ==== osd_op_reply(248 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.325+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.328 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.325+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:249 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.326+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 51 ==== osd_op_reply(249 gc.28 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.326+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.326+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:250 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 86 ==== osd_op_reply(250 gc.29 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:251 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 87 ==== osd_op_reply(251 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:252 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 88 ==== osd_op_reply(252 gc.29 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:253 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 89 ==== osd_op_reply(253 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.327+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:254 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.328+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 90 ==== osd_op_reply(254 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.328+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.328+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:255 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x55867f785970 2024-04-24T01:43:22.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.329+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 91 ==== osd_op_reply(255 gc.29 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.329+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-24T01:43:22.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.329+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:256 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 52 ==== osd_op_reply(256 gc.30 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:257 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 53 ==== osd_op_reply(257 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:258 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c8f50 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 54 ==== osd_op_reply(258 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:259 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 55 ==== osd_op_reply(259 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.330+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:260 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7c9f60 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 56 ==== osd_op_reply(260 gc.30 [call out=1701b] v0'0 uv54 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 20 garbage collection: RGWGC::process iterating over entry tag='57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7163641608735712312', time=2024-04-24T01:43:21.920765+0000, chain.objs.size()=7 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_1 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:261 3.18s0 3:1b4b8337:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7ca640 con 0x55867f785970 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_2 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:262 3.29s0 3:9689beb0:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_3 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:263 3.0s0 3:030f2e61:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cfea0 con 0x7f009c031040 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_4 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:264 3.0s0 3:018bcfa1:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_5 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:265 3.24s0 3:241b25e5:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7d4de0 con 0x7f009c031040 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_6 2024-04-24T01:43:22.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:266 3.fs0 3:f2676e82:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_7 2024-04-24T01:43:22.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.331+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:267 3.0s0 3:02382fe1:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7d9bf0 con 0x7f009c031040 2024-04-24T01:43:22.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.333+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 92 ==== osd_op_reply(261 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.333+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 57 ==== osd_op_reply(265 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.333+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 56 ==== osd_op_reply(266 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.333+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 58 ==== osd_op_reply(263 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_3 [call] v34'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.333+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 59 ==== osd_op_reply(262 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.335+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 60 ==== osd_op_reply(264 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_4 [call] v34'5 uv5 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.335+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 61 ==== osd_op_reply(267 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1__shadow_.v1uBr_Wb535uOZoam5lUZDJULHFhL1Z_7 [call] v34'6 uv6 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.335+0000 7f00a762f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-24T01:43:22.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.335+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:268 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.336+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 62 ==== osd_op_reply(268 gc.30 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.336+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:269 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.337+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 63 ==== osd_op_reply(269 gc.30 [call] v34'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.337+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-24T01:43:22.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.337+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:270 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 57 ==== osd_op_reply(270 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:271 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 58 ==== osd_op_reply(271 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:272 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 59 ==== osd_op_reply(272 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:273 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 60 ==== osd_op_reply(273 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:274 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 61 ==== osd_op_reply(274 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.339+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:275 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.340+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 62 ==== osd_op_reply(275 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.340+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.340+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:276 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.341+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 59 ==== osd_op_reply(276 gc.0 [call] v34'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.341+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:277 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 60 ==== osd_op_reply(277 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:278 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 61 ==== osd_op_reply(278 gc.0 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:279 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 62 ==== osd_op_reply(279 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:280 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 63 ==== osd_op_reply(280 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.342+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:281 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.343+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 64 ==== osd_op_reply(281 gc.0 [call] v34'53 uv53 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.343+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.343+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:282 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.344+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 64 ==== osd_op_reply(282 gc.1 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.344+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:283 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 65 ==== osd_op_reply(283 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:284 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 66 ==== osd_op_reply(284 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:285 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 67 ==== osd_op_reply(285 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:286 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 68 ==== osd_op_reply(286 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.345+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:287 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.346+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 69 ==== osd_op_reply(287 gc.1 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.346+0000 7f00a762f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.346+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:288 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f785970 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.347+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 93 ==== osd_op_reply(288 gc.2 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.347+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:289 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f785970 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 94 ==== osd_op_reply(289 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:290 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f785970 2024-04-24T01:43:22.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 95 ==== osd_op_reply(290 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:291 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f785970 2024-04-24T01:43:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 96 ==== osd_op_reply(291 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:43:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:292 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f785970 2024-04-24T01:43:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 97 ==== osd_op_reply(292 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.348+0000 7f00a762f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:43:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.349+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:293 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f785970 2024-04-24T01:43:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.349+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 98 ==== osd_op_reply(293 gc.2 [call] v34'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.350+0000 7eff597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.350+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94036152613712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.351+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94036152613712] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.351+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94036152590080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.352+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94036152590080] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.352+0000 7f00a762f800 20 remove_watcher() i=0 2024-04-24T01:43:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.352+0000 7f00a762f800 2 removed watcher, disabling cache 2024-04-24T01:43:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.352+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94036152595168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.353+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94036152595168] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.353+0000 7f00a762f800 20 remove_watcher() i=1 2024-04-24T01:43:22.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.353+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94036152597312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f785970 2024-04-24T01:43:22.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.354+0000 7f00a21bf640 1 -- 172.21.15.131:0/1391509947 <== osd.3 v2:172.21.15.131:6800/3849831825 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94036152597312] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0098071030 con 0x55867f785970 2024-04-24T01:43:22.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.354+0000 7f00a762f800 20 remove_watcher() i=2 2024-04-24T01:43:22.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.354+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94036152600864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f00980a3040 2024-04-24T01:43:22.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.355+0000 7f00a31c1640 1 -- 172.21.15.131:0/1391509947 <== osd.2 v2:172.21.15.131:6809/3673094383 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94036152600864] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c040040 con 0x7f00980a3040 2024-04-24T01:43:22.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.355+0000 7f00a762f800 20 remove_watcher() i=3 2024-04-24T01:43:22.356 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.355+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94036152587568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x55867f77f720 2024-04-24T01:43:22.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.356+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.1 v2:172.21.15.131:6808/2417718615 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94036152587568] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x55867f77f720 2024-04-24T01:43:22.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.356+0000 7f00a762f800 20 remove_watcher() i=4 2024-04-24T01:43:22.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.356+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94036152603216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.358+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 70 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94036152603216] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.358+0000 7f00a762f800 20 remove_watcher() i=5 2024-04-24T01:43:22.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.358+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94036152605840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.359+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 71 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94036152605840] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.359+0000 7f00a762f800 20 remove_watcher() i=6 2024-04-24T01:43:22.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.359+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94036152612240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55867f7cd2b0 con 0x7f009c031040 2024-04-24T01:43:22.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 <== osd.0 v2:172.21.15.107:6800/2413654117 72 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94036152612240] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009402b070 con 0x7f009c031040 2024-04-24T01:43:22.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 20 remove_watcher() i=7 2024-04-24T01:43:22.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f009c031040 msgr2=0x7f009c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f009c031040 0x7f009c032940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f77f720 msgr2=0x55867f781be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f77f720 0x55867f781be0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f00980a3040 msgr2=0x7f0098073a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f00980a3040 0x7f0098073a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55867f785970 msgr2=0x55867f787d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55867f785970 0x55867f787d60 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff6c036900 msgr2=0x7eff6c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff6c036900 0x7eff6c038dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55867f74b770 tx=0x7f009c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a29c0640 1 -- 172.21.15.131:0/1391509947 reap_dead start 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 msgr2=0x55867f773c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f773c60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0098052ce0 tx=0x7f009808db80 comp rx=0 tx=0).stop 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 shutdown_connections 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 --2- 172.21.15.131:0/1391509947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f76c630 0x55867f773c60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 >> 172.21.15.131:0/1391509947 conn(0x55867f768990 msgr2=0x55867f765ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 shutdown_connections 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.360+0000 7f00a762f800 1 -- 172.21.15.131:0/1391509947 wait complete. 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff7c036900 msgr2=0x7eff7c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff7c036900 0x7eff7c038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55867f74f430 tx=0x7f009c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f75f3f0 msgr2=0x55867f75f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f75f3f0 0x55867f75f810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0098044840 tx=0x7f0098002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 shutdown_connections 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff7c036900 0x7eff7c038dc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3906685139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f75f3f0 0x55867f75f810 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 >> 172.21.15.131:0/3906685139 conn(0x55867f753490 msgr2=0x55867f753890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 shutdown_connections 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3906685139 wait complete. 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f64c2d0 msgr2=0x55867f74e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f64c2d0 0x55867f74e250 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff88036900 msgr2=0x7eff88038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff88036900 0x7eff88038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0098054000 tx=0x7f009804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 msgr2=0x55867f7470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f7470b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f009400c010 tx=0x7f0094000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 shutdown_connections 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55867f64c2d0 0x55867f74e250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7eff88036900 0x7eff88038dc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 --2- 172.21.15.131:0/3526879057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867f64a790 0x55867f7470b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 >> 172.21.15.131:0/3526879057 conn(0x55867f646310 msgr2=0x55867f739610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 shutdown_connections 2024-04-24T01:43:22.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.361+0000 7f00a762f800 1 -- 172.21.15.131:0/3526879057 wait complete. 2024-04-24T01:43:22.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-24T01:43:22.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-24T01:43:22.370 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-24T01:43:22.452 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:22.452 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:22.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.452+0000 7f5b5932b800 1 Processor -- start 2024-04-24T01:43:22.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.452+0000 7f5b5932b800 1 -- start start 2024-04-24T01:43:22.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.452+0000 7f5b5932b800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f79d9db2a0 0x55f79d9e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.452+0000 7f5b5932b800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f79d899d40 con 0x55f79d9d9760 2024-04-24T01:43:22.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.452+0000 7f5b5932b800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55f79d86c4d0 con 0x55f79d9db2a0 2024-04-24T01:43:22.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.453+0000 7f5b548ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f79d9db2a0 0x55f79d9e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.453+0000 7f5b550ef640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f79d9d9760 0x55f79d9d9b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56918/0 (socket says 172.21.15.131:56918) 2024-04-24T01:43:22.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.453+0000 7f5b550ef640 1 -- 172.21.15.131:0/2051057694 learned_addr learned my addr 172.21.15.131:0/2051057694 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:22.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.453+0000 7f5b548ee640 1 -- 172.21.15.131:0/2051057694 >> v1:172.21.15.107:6789/0 conn(0x55f79d9d9760 legacy=0x55f79d9d9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.453+0000 7f5b548ee640 1 -- 172.21.15.131:0/2051057694 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79d898590 con 0x55f79d9db2a0 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b548ee640 1 --2- 172.21.15.131:0/2051057694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9db2a0 0x55f79d9e3da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00a470 tx=0x7f5b4c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79fa76666d33462 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b47fff640 1 -- 172.21.15.131:0/2051057694 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c057070 con 0x55f79d9db2a0 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b47fff640 1 -- 172.21.15.131:0/2051057694 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c052440 con 0x55f79d9db2a0 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b47fff640 1 -- 172.21.15.131:0/2051057694 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c052740 con 0x55f79d9db2a0 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b5932b800 1 -- 172.21.15.131:0/2051057694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9db2a0 msgr2=0x55f79d9e3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b5932b800 1 --2- 172.21.15.131:0/2051057694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9db2a0 0x55f79d9e3da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00a470 tx=0x7f5b4c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b5932b800 1 -- 172.21.15.131:0/2051057694 shutdown_connections 2024-04-24T01:43:22.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b5932b800 1 --2- 172.21.15.131:0/2051057694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9db2a0 0x55f79d9e3da0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.455+0000 7f5b5932b800 1 -- 172.21.15.131:0/2051057694 >> 172.21.15.131:0/2051057694 conn(0x55f79d9d5380 msgr2=0x55f79d9d77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.456+0000 7f5b5932b800 1 -- 172.21.15.131:0/2051057694 shutdown_connections 2024-04-24T01:43:22.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.456+0000 7f5b5932b800 1 -- 172.21.15.131:0/2051057694 wait complete. 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.467+0000 7f5b5932b800 1 Processor -- start 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.467+0000 7f5b5932b800 1 -- start start 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.467+0000 7f5b5932b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dace4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.467+0000 7f5b5932b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f79d9263c0 con 0x55f79d9d9760 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5b550ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dace4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5b550ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dace4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53888/0 (socket says 172.21.15.131:53888) 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5b550ef640 1 -- 172.21.15.131:0/342348939 learned_addr learned my addr 172.21.15.131:0/342348939 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5b550ef640 1 -- 172.21.15.131:0/342348939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79daceab0 con 0x55f79d9d9760 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5b550ef640 1 --2- 172.21.15.131:0/342348939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dace4e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5b480017a0 tx=0x7f5b48001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d921565ed2f1a1f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5a43606640 1 -- 172.21.15.131:0/342348939 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b48004520 con 0x55f79d9d9760 2024-04-24T01:43:22.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5a43606640 1 -- 172.21.15.131:0/342348939 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b480046c0 con 0x55f79d9d9760 2024-04-24T01:43:22.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.468+0000 7f5a43606640 1 -- 172.21.15.131:0/342348939 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b48004a00 con 0x55f79d9d9760 2024-04-24T01:43:22.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 -- 172.21.15.131:0/342348939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 msgr2=0x55f79dace4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 --2- 172.21.15.131:0/342348939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dace4e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5b480017a0 tx=0x7f5b48001c60 comp rx=0 tx=0).stop 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 -- 172.21.15.131:0/342348939 shutdown_connections 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 --2- 172.21.15.131:0/342348939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dace4e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 -- 172.21.15.131:0/342348939 >> 172.21.15.131:0/342348939 conn(0x55f79d9d5380 msgr2=0x55f79dac9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 -- 172.21.15.131:0/342348939 shutdown_connections 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 -- 172.21.15.131:0/342348939 wait complete. 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 Processor -- start 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.469+0000 7f5b5932b800 1 -- start start 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b5932b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dad6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b5932b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f79d9e65c0 con 0x55f79d9d9760 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b550ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dad6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b550ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dad6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53900/0 (socket says 172.21.15.131:53900) 2024-04-24T01:43:22.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b550ef640 1 -- 172.21.15.131:0/3437299823 learned_addr learned my addr 172.21.15.131:0/3437299823 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b550ef640 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79dad6550 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b550ef640 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dad6010 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5b48000f80 tx=0x7f5b48001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5a41e03640 1 -- 172.21.15.131:0/3437299823 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b48022020 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5a41e03640 1 -- 172.21.15.131:0/3437299823 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b48014980 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5a41e03640 1 -- 172.21.15.131:0/3437299823 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b48014d00 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f79dad67e0 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.470+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79dad9490 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.471+0000 7f5a41e03640 1 -- 172.21.15.131:0/3437299823 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5b48025020 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.471+0000 7f5a41e03640 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a3c036950 0x7f5a3c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.471+0000 7f5a41e03640 1 -- 172.21.15.131:0/3437299823 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f5b48018030 con 0x55f79d9d9760 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.471+0000 7f5b548ee640 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a3c036950 0x7f5a3c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.471+0000 7f5b5932b800 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79d9db2a0 0x55f79dadd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.471+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79dadd7e0 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.472+0000 7f5b558f0640 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79d9db2a0 0x55f79dadd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.472+0000 7f5b548ee640 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a3c036950 0x7f5a3c038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c054000 tx=0x7f5b4c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.472+0000 7f5b558f0640 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79d9db2a0 0x55f79dadd250 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.472+0000 7f5b558f0640 1 -- 172.21.15.131:0/3437299823 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b500083e0 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.472+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79dada7e0 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.472+0000 7f5b558f0640 1 -- 172.21.15.131:0/3437299823 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b500083e0 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.472+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79dadf600 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.473+0000 7f5b558f0640 1 -- 172.21.15.131:0/3437299823 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b500083e0 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.473+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79dade880 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.473+0000 7f5b558f0640 1 -- 172.21.15.131:0/3437299823 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b500083e0 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.473+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79dadec70 con 0x55f79d9db2a0 2024-04-24T01:43:22.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.473+0000 7f5b558f0640 1 -- 172.21.15.131:0/3437299823 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b500083e0 con 0x55f79d9db2a0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b5932b800 1 Processor -- start 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b5932b800 1 -- start start 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b5932b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79daee3e0 0x55f79daee800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b5932b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f79d8cc6b0 con 0x55f79daee3e0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b548ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79daee3e0 0x55f79daee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b548ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79daee3e0 0x55f79daee800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53912/0 (socket says 172.21.15.131:53912) 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b548ee640 1 -- 172.21.15.131:0/4090453523 learned_addr learned my addr 172.21.15.131:0/4090453523 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b548ee640 1 -- 172.21.15.131:0/4090453523 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79daeed40 con 0x55f79daee3e0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.474+0000 7f5b548ee640 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79daee3e0 0x55f79daee800 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c044840 tx=0x7f5b4c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.475+0000 7f5a3affd640 1 -- 172.21.15.131:0/4090453523 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c06f070 con 0x55f79daee3e0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.475+0000 7f5a3affd640 1 -- 172.21.15.131:0/4090453523 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c058040 con 0x55f79daee3e0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.475+0000 7f5a3affd640 1 -- 172.21.15.131:0/4090453523 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c057050 con 0x55f79daee3e0 2024-04-24T01:43:22.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.475+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f79daef7b0 con 0x55f79daee3e0 2024-04-24T01:43:22.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.475+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79daefc50 con 0x55f79daee3e0 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.475+0000 7f5a3affd640 1 -- 172.21.15.131:0/4090453523 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5b4c072070 con 0x55f79daee3e0 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5a3affd640 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a30036900 0x7f5a30038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5a3affd640 1 -- 172.21.15.131:0/4090453523 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f5b4c08f9c0 con 0x55f79daee3e0 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5b558f0640 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a30036900 0x7f5a30038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5b5932b800 1 Processor -- start 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5b558f0640 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a30036900 0x7f5a30038dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55f79dade3a0 tx=0x7f5b50000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5b5932b800 1 -- start start 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5b5932b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79dafba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5b5932b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f79dacee30 con 0x55f79dafb660 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.476+0000 7f5b548ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79dafba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b548ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79dafba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53914/0 (socket says 172.21.15.131:53914) 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b548ee640 1 -- 172.21.15.131:0/269254034 learned_addr learned my addr 172.21.15.131:0/269254034 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b548ee640 1 -- 172.21.15.131:0/269254034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79dafc050 con 0x55f79dafb660 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b548ee640 1 --2- 172.21.15.131:0/269254034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79dafba80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c08dc60 tx=0x7f5b4c08df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2a94ea028430d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5a38ff9640 1 -- 172.21.15.131:0/269254034 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c08b070 con 0x55f79dafb660 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5a38ff9640 1 -- 172.21.15.131:0/269254034 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c05e480 con 0x55f79dafb660 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5a38ff9640 1 -- 172.21.15.131:0/269254034 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c05d3e0 con 0x55f79dafb660 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b5932b800 1 -- 172.21.15.131:0/269254034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 msgr2=0x55f79dafba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b5932b800 1 --2- 172.21.15.131:0/269254034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79dafba80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c08dc60 tx=0x7f5b4c08df40 comp rx=0 tx=0).stop 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b5932b800 1 -- 172.21.15.131:0/269254034 shutdown_connections 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.477+0000 7f5b5932b800 1 --2- 172.21.15.131:0/269254034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79dafba80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b5932b800 1 -- 172.21.15.131:0/269254034 >> 172.21.15.131:0/269254034 conn(0x55f79daf79c0 msgr2=0x55f79daf5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b5932b800 1 -- 172.21.15.131:0/269254034 shutdown_connections 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b5932b800 1 -- 172.21.15.131:0/269254034 wait complete. 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b5932b800 1 Processor -- start 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b5932b800 1 -- start start 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b5932b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79db02d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b5932b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f79dafc7c0 con 0x55f79dafb660 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b548ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79db02d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b548ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79db02d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53928/0 (socket says 172.21.15.131:53928) 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 learned_addr learned my addr 172.21.15.131:0/767246763 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.478+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79db03240 con 0x55f79dafb660 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.479+0000 7f5b548ee640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79db02d00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c052ec0 tx=0x7f5b4c08dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.479+0000 7f5a26ffd640 1 -- 172.21.15.131:0/767246763 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c05d970 con 0x55f79dafb660 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.479+0000 7f5a26ffd640 1 -- 172.21.15.131:0/767246763 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c05fa40 con 0x55f79dafb660 2024-04-24T01:43:22.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.479+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f79db034d0 con 0x55f79dafb660 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.479+0000 7f5a26ffd640 1 -- 172.21.15.131:0/767246763 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c05fd60 con 0x55f79dafb660 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.479+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79db06180 con 0x55f79dafb660 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.479+0000 7f5a26ffd640 1 -- 172.21.15.131:0/767246763 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5b4c096030 con 0x55f79dafb660 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5a26ffd640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20036900 0x7f5a20038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5a26ffd640 1 -- 172.21.15.131:0/767246763 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f5b4c094070 con 0x55f79dafb660 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b558f0640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20036900 0x7f5a20038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79db0e7c0 0x55f79db10c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db113b0 con 0x55f79db0e7c0 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b550ef640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79db0e7c0 0x55f79db10c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b558f0640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20036900 0x7f5a20038dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000f010 tx=0x7f5b5000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b550ef640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79db0e7c0 0x55f79db10c60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b5932b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.480+0000 7f5b5932b800 20 realm 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db117c0 con 0x55f79db0e7c0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db12090 con 0x55f79db0e7c0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db12430 con 0x55f79db0e7c0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db12890 con 0x55f79db0e7c0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.481+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b5932b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b5932b800 20 searching for the correct realm 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f79db148e0 0x55f79db16cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db148e0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b548ee640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f79db148e0 0x55f79db16cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b548ee640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f79db148e0 0x55f79db16cd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b548ee640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5b4c074060 0x7f5b4c074440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b4c074060 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.482+0000 7f5b558f0640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5b4c074060 0x7f5b4c074440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.483+0000 7f5b558f0640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5b4c074060 0x7f5b4c074440 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.483+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.483+0000 7f5b558f0640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5b50019040 0x7f5b50019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.483+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b50019040 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.483+0000 7f5b550ef640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5b50019040 0x7f5b50019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.483+0000 7f5b550ef640 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5b50019040 0x7f5b50019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db0e7c0 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db0e7c0 2024-04-24T01:43:22.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b50019040 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.484+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b50019040 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b4c074060 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db148e0 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db0e7c0 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.485+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b50019040 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db0e7c0 2024-04-24T01:43:22.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b4c074060 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.486+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f79db17380 con 0x7f5b50019040 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db0e7c0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.487+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db0e7c0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.488+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.488+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x7f5b50019040 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.488+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.488+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db148e0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.488+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.488+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x7f5b4c074060 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db0e7c0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x7f5b4c074060 2024-04-24T01:43:22.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db148e0 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.489+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x7f5b50019040 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x7f5b4c074060 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db148e0 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x7f5b50019040 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.490+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x55f79db0e7c0 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5b4803d040 con 0x7f5b4c074060 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db13200 con 0x55f79db0e7c0 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db135f0 con 0x55f79db0e7c0 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.491+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db135f0 con 0x55f79db0e7c0 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 zone default found 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 4 Realm: () 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 zonegroup default 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db13a10 con 0x7f5b4c074060 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db13a10 con 0x55f79db148e0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.492+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db191c0 con 0x55f79db148e0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.493+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.493+0000 7f5b5932b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.493+0000 7f5b5932b800 20 started sync module instance, tier type = 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.493+0000 7f5b5932b800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:22.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.493+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db18660 con 0x7f5b4c074060 2024-04-24T01:43:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.494+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.494+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94521990941584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db18660 con 0x7f5b4c074060 2024-04-24T01:43:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.494+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db19c80 con 0x55f79db0e7c0 2024-04-24T01:43:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.495+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94521990941584] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.495+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.495+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94521990944624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db18660 con 0x55f79db0e7c0 2024-04-24T01:43:22.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.495+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1a700 con 0x55f79db148e0 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.496+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94521990944624] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.496+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.496+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94521990939056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db185d0 con 0x55f79db148e0 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.496+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1b5c0 con 0x7f5b4c074060 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.497+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.497+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94521990951664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1bda0 con 0x7f5b4c074060 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.497+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1c8c0 con 0x55f79db0e7c0 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.497+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94521990939056] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.498+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94521990951664] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.498+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.498+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94521990955920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1c880 con 0x55f79db0e7c0 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.498+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1d160 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.499+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.499+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94521990957184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1d1b0 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.499+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1dcb0 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.499+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94521990955920] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.500+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.500+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94521990961056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1dc70 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.500+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1e6b0 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.500+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94521990957184] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94521990961056] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94521990963584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1e670 con 0x7f5b50019040 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 20 add_watcher() i=0 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 20 add_watcher() i=1 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 20 add_watcher() i=2 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 20 add_watcher() i=3 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 20 add_watcher() i=4 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 20 add_watcher() i=5 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.501+0000 7f5b5932b800 20 add_watcher() i=6 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.502+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94521990963584] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.502+0000 7f5b5932b800 20 add_watcher() i=7 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.502+0000 7f5b5932b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.502+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db216a0 con 0x55f79db0e7c0 2024-04-24T01:43:22.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.502+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.502+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94521990958240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1eb20 con 0x55f79db0e7c0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.503+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94521990958240] v34'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.503+0000 7f5a0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.503+0000 7f5b5932b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.503+0000 7f5b5932b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.504+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db29c60 con 0x55f79db0e7c0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.505+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'54 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.505+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db29e30 con 0x7f5b50019040 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.506+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.506+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2a000 con 0x55f79db148e0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.507+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.507+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2a3a0 con 0x55f79db0e7c0 2024-04-24T01:43:22.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.508+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'175 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.508+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2a460 con 0x7f5b4c074060 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.509+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.509+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2ab40 con 0x55f79db148e0 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.510+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.510+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db29be0 con 0x55f79db0e7c0 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.511+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.511+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db29be0 con 0x7f5b50019040 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.512+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.512+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db29be0 con 0x7f5b4c074060 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.513+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.513+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2b560 con 0x55f79db148e0 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.514+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.514+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2b900 con 0x7f5b4c074060 2024-04-24T01:43:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.515+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.515+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2be70 con 0x7f5b50019040 2024-04-24T01:43:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.516+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.516+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2be90 con 0x7f5b4c074060 2024-04-24T01:43:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.517+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.517+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x7f5b50019040 2024-04-24T01:43:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.518+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.518+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db0e7c0 2024-04-24T01:43:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.519+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'176 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.519+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db148e0 2024-04-24T01:43:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.520+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.520+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x7f5b4c074060 2024-04-24T01:43:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.521+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.521+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db148e0 2024-04-24T01:43:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.522+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.522+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2b900 con 0x55f79db0e7c0 2024-04-24T01:43:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.523+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.523+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db0e7c0 2024-04-24T01:43:22.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.524+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'177 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.524+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db148e0 2024-04-24T01:43:22.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.525+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.525+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x7f5b4c074060 2024-04-24T01:43:22.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.526+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.526+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db148e0 2024-04-24T01:43:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.527+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.527+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db148e0 2024-04-24T01:43:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.528+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'42 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.528+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db148e0 2024-04-24T01:43:22.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.529+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.529+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x55f79db148e0 2024-04-24T01:43:22.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.530+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.530+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2c330 con 0x7f5b50019040 2024-04-24T01:43:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.531+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.531+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2aee0 con 0x55f79db148e0 2024-04-24T01:43:22.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.532+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.532+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2aee0 con 0x7f5b50019040 2024-04-24T01:43:22.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.533+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.533+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2aee0 con 0x55f79db148e0 2024-04-24T01:43:22.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.534+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.534+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2aee0 con 0x7f5b50019040 2024-04-24T01:43:22.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.535+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.535+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db2aee0 con 0x7f5b4c074060 2024-04-24T01:43:22.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.536+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f5a0a7e4640 20 reqs_thread_entry: start 2024-04-24T01:43:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f5b5932b800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f5b5932b800 20 Filter name: none 2024-04-24T01:43:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f597bfff640 20 reqs_thread_entry: start 2024-04-24T01:43:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.537+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv53 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.538+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.538+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.538+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.538+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.538+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.538+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.538+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.539+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.540+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.540+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.540+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.540+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.540+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.542 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.540+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.541+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.542+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv46 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.542+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.542+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.542+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.542+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.542+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.542+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.543+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.543+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.543+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.543+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.543+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.544+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.544+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.544+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.544+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.544+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.544+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.545+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.546+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.546+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.546+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.546+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.546+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.546+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.547+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.547+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.547+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.547+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.548+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.548+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.548+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.548+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.549+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.549+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.549+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.549+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.549+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.549+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.550+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.550+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.550+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.550+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.550+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.550+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.551+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.552+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.552+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.552+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.552+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.552+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.552+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.553+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.554+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db0e7c0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.555+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.556+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.557+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.557+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.557+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.557+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.557+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.557+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.558+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.559+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.559+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.559+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.559+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.559+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.559+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.559+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.560+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.561+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.562+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.562+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.562+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.562+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.562+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.562+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x55f79db148e0 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.563+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b50019040 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.564+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28160 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.565+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.565+0000 7f5a0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.565+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94521990958240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db28100 con 0x55f79db0e7c0 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.567+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94521990958240] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.567+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94521990941584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1cca0 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.568+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94521990941584] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.568+0000 7f5b5932b800 20 remove_watcher() i=0 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.568+0000 7f5b5932b800 2 removed watcher, disabling cache 2024-04-24T01:43:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.568+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94521990944624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1cca0 con 0x55f79db0e7c0 2024-04-24T01:43:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.569+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94521990944624] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.569+0000 7f5b5932b800 20 remove_watcher() i=1 2024-04-24T01:43:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.569+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94521990939056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db19770 con 0x55f79db148e0 2024-04-24T01:43:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.570+0000 7f5b548ee640 1 -- 172.21.15.131:0/767246763 <== osd.3 v2:172.21.15.131:6800/3849831825 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94521990939056] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c086070 con 0x55f79db148e0 2024-04-24T01:43:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.570+0000 7f5b5932b800 20 remove_watcher() i=2 2024-04-24T01:43:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.570+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94521990951664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1cca0 con 0x7f5b4c074060 2024-04-24T01:43:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.571+0000 7f5b558f0640 1 -- 172.21.15.131:0/767246763 <== osd.2 v2:172.21.15.131:6809/3673094383 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94521990951664] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5002f040 con 0x7f5b4c074060 2024-04-24T01:43:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.571+0000 7f5b5932b800 20 remove_watcher() i=3 2024-04-24T01:43:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.571+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94521990955920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db181b0 con 0x55f79db0e7c0 2024-04-24T01:43:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.572+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.1 v2:172.21.15.131:6808/2417718615 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94521990955920] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x55f79db0e7c0 2024-04-24T01:43:22.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.572+0000 7f5b5932b800 20 remove_watcher() i=4 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.572+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94521990957184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db19770 con 0x7f5b50019040 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.573+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94521990957184] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.573+0000 7f5b5932b800 20 remove_watcher() i=5 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.573+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94521990961056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1b2f0 con 0x7f5b50019040 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.574+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94521990961056] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.574+0000 7f5b5932b800 20 remove_watcher() i=6 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.574+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94521990963584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f79db1c390 con 0x7f5b50019040 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94521990963584] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4801b070 con 0x7f5b50019040 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 20 remove_watcher() i=7 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5b50019040 msgr2=0x7f5b50019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5b50019040 0x7f5b50019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79db0e7c0 msgr2=0x55f79db10c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79db0e7c0 0x55f79db10c60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5b4c074060 msgr2=0x7f5b4c074440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5b4c074060 0x7f5b4c074440 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f79db148e0 msgr2=0x55f79db16cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f79db148e0 0x55f79db16cd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20036900 msgr2=0x7f5a20038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a20036900 0x7f5a20038dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000f010 tx=0x7f5b5000c040 comp rx=0 tx=0).stop 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b550ef640 1 -- 172.21.15.131:0/767246763 reap_dead start 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 msgr2=0x55f79db02d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79db02d00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c052ec0 tx=0x7f5b4c08dbf0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 shutdown_connections 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/767246763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79dafb660 0x55f79db02d00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 >> 172.21.15.131:0/767246763 conn(0x55f79daf79c0 msgr2=0x55f79daf5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 shutdown_connections 2024-04-24T01:43:22.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/767246763 wait complete. 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a30036900 msgr2=0x7f5a30038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a30036900 0x7f5a30038dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55f79dade3a0 tx=0x7f5b50000f90 comp rx=0 tx=0).stop 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79daee3e0 msgr2=0x55f79daee800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79daee3e0 0x55f79daee800 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c044840 tx=0x7f5b4c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 shutdown_connections 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a30036900 0x7f5a30038dc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 --2- 172.21.15.131:0/4090453523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79daee3e0 0x55f79daee800 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.575+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 >> 172.21.15.131:0/4090453523 conn(0x55f79dae2480 msgr2=0x55f79dae2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 shutdown_connections 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/4090453523 wait complete. 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79d9db2a0 msgr2=0x55f79dadd250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79d9db2a0 0x55f79dadd250 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a3c036950 msgr2=0x7f5a3c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a3c036950 0x7f5a3c038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c054000 tx=0x7f5b4c04e000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 msgr2=0x55f79dad6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dad6010 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5b48000f80 tx=0x7f5b48001250 comp rx=0 tx=0).stop 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 shutdown_connections 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f79d9db2a0 0x55f79dadd250 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5a3c036950 0x7f5a3c038e10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 --2- 172.21.15.131:0/3437299823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f79d9d9760 0x55f79dad6010 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 >> 172.21.15.131:0/3437299823 conn(0x55f79d9d5380 msgr2=0x55f79dac8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 shutdown_connections 2024-04-24T01:43:22.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.576+0000 7f5b5932b800 1 -- 172.21.15.131:0/3437299823 wait complete. 2024-04-24T01:43:22.584 INFO:teuthology.orchestra.run.smithi131.stdout:[] 2024-04-24T01:43:22.585 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:43:22.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T01:43:22.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T01:43:22.585 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T01:43:22.668 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:22.668 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:22.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.668+0000 7f6899012800 1 Processor -- start 2024-04-24T01:43:22.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.668+0000 7f6899012800 1 -- start start 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.668+0000 7f6899012800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56252339a7a0 0x56252339abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.668+0000 7f6899012800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56252325ad40 con 0x56252339b100 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.668+0000 7f6899012800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x56252322d4d0 con 0x56252339a7a0 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.669+0000 7f689467d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56252339a7a0 0x56252339abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.669+0000 7f689467d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56252339a7a0 0x56252339abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53932/0 (socket says 172.21.15.131:53932) 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.669+0000 7f689467d640 1 -- 172.21.15.131:0/4147695575 learned_addr learned my addr 172.21.15.131:0/4147695575 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.669+0000 7f688bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x56252339b100 0x56252339b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56928/0 (socket says 172.21.15.131:56928) 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.669+0000 7f689467d640 1 -- 172.21.15.131:0/4147695575 >> v1:172.21.15.107:6789/0 conn(0x56252339b100 legacy=0x56252339b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.669+0000 7f689467d640 1 -- 172.21.15.131:0/4147695575 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562523259590 con 0x56252339a7a0 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.671+0000 7f689467d640 1 --2- 172.21.15.131:0/4147695575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252339abc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f688400a520 tx=0x7f688401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816ea5df08df5fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.671+0000 7f6893e7c640 1 -- 172.21.15.131:0/4147695575 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6884057070 con 0x56252339a7a0 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.671+0000 7f6893e7c640 1 -- 172.21.15.131:0/4147695575 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6884052570 con 0x56252339a7a0 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.671+0000 7f6893e7c640 1 -- 172.21.15.131:0/4147695575 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6884052870 con 0x56252339a7a0 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.671+0000 7f6899012800 1 -- 172.21.15.131:0/4147695575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 msgr2=0x56252339abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.671+0000 7f6899012800 1 --2- 172.21.15.131:0/4147695575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252339abc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f688400a520 tx=0x7f688401d010 comp rx=0 tx=0).stop 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.672+0000 7f6899012800 1 -- 172.21.15.131:0/4147695575 shutdown_connections 2024-04-24T01:43:22.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.672+0000 7f6899012800 1 --2- 172.21.15.131:0/4147695575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252339abc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.672+0000 7f6899012800 1 -- 172.21.15.131:0/4147695575 >> 172.21.15.131:0/4147695575 conn(0x562523396320 msgr2=0x562523398740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.672+0000 7f6899012800 1 -- 172.21.15.131:0/4147695575 shutdown_connections 2024-04-24T01:43:22.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.672+0000 7f6899012800 1 -- 172.21.15.131:0/4147695575 wait complete. 2024-04-24T01:43:22.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.683+0000 7f6899012800 1 Processor -- start 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.683+0000 7f6899012800 1 -- start start 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.683+0000 7f6899012800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252348f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.683+0000 7f6899012800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5625232e73c0 con 0x56252339a7a0 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.683+0000 7f689467d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252348f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.683+0000 7f689467d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252348f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53944/0 (socket says 172.21.15.131:53944) 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.683+0000 7f689467d640 1 -- 172.21.15.131:0/274706478 learned_addr learned my addr 172.21.15.131:0/274706478 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.684+0000 7f689467d640 1 -- 172.21.15.131:0/274706478 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252348f9d0 con 0x56252339a7a0 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.684+0000 7f689467d640 1 --2- 172.21.15.131:0/274706478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252348f400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6884055040 tx=0x7f688404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5a9ca75a5b5eae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.684+0000 7f678260c640 1 -- 172.21.15.131:0/274706478 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6884057040 con 0x56252339a7a0 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.684+0000 7f678260c640 1 -- 172.21.15.131:0/274706478 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6884052870 con 0x56252339a7a0 2024-04-24T01:43:22.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.684+0000 7f678260c640 1 -- 172.21.15.131:0/274706478 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6884052b90 con 0x56252339a7a0 2024-04-24T01:43:22.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 -- 172.21.15.131:0/274706478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 msgr2=0x56252348f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 --2- 172.21.15.131:0/274706478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252348f400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6884055040 tx=0x7f688404c000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 -- 172.21.15.131:0/274706478 shutdown_connections 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 --2- 172.21.15.131:0/274706478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x56252348f400 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 -- 172.21.15.131:0/274706478 >> 172.21.15.131:0/274706478 conn(0x562523396320 msgr2=0x56252348ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 -- 172.21.15.131:0/274706478 shutdown_connections 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 -- 172.21.15.131:0/274706478 wait complete. 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 Processor -- start 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 -- start start 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x562523496f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.685+0000 7f6899012800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56252339bf60 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f689467d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x562523496f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f689467d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x562523496f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53948/0 (socket says 172.21.15.131:53948) 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f689467d640 1 -- 172.21.15.131:0/4285053705 learned_addr learned my addr 172.21.15.131:0/4285053705 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f689467d640 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562523497480 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f689467d640 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x562523496f40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6884052540 tx=0x7f6884003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f6780e09640 1 -- 172.21.15.131:0/4285053705 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6884073070 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f6780e09640 1 -- 172.21.15.131:0/4285053705 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688405d570 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f6780e09640 1 -- 172.21.15.131:0/4285053705 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6884057070 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562523497710 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.686+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252349a320 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.687+0000 7f6780e09640 1 -- 172.21.15.131:0/4285053705 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6884076070 con 0x56252339a7a0 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.687+0000 7f6780e09640 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f677c036950 0x7f677c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.687+0000 7f6780e09640 1 -- 172.21.15.131:0/4285053705 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f688408ddd0 con 0x56252339a7a0 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.687+0000 7f688bfff640 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f677c036950 0x7f677c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.687+0000 7f6899012800 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56252339b100 0x56252349e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.687+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56252349e620 con 0x56252339b100 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.688+0000 7f6894e7e640 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56252339b100 0x56252349e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.688+0000 7f688bfff640 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f677c036950 0x7f677c038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f687c000f60 tx=0x7f687c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.688+0000 7f6894e7e640 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56252339b100 0x56252349e0e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.688+0000 7f6894e7e640 1 -- 172.21.15.131:0/4285053705 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f688c00a4a0 con 0x56252339b100 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.688+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56252349b6b0 con 0x56252339b100 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.688+0000 7f6894e7e640 1 -- 172.21.15.131:0/4285053705 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f688c00a4a0 con 0x56252339b100 2024-04-24T01:43:22.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.688+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234a0400 con 0x56252339b100 2024-04-24T01:43:22.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.689+0000 7f6894e7e640 1 -- 172.21.15.131:0/4285053705 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f688c00a4a0 con 0x56252339b100 2024-04-24T01:43:22.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.689+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56252349f740 con 0x56252339b100 2024-04-24T01:43:22.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.689+0000 7f6894e7e640 1 -- 172.21.15.131:0/4285053705 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f688c00a4a0 con 0x56252339b100 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.689+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56252349fb90 con 0x56252339b100 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.689+0000 7f6894e7e640 1 -- 172.21.15.131:0/4285053705 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f688c00a4a0 con 0x56252339b100 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f6899012800 1 Processor -- start 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f6899012800 1 -- start start 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f6899012800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234af1d0 0x5625234af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f6899012800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56252328d6b0 con 0x5625234af1d0 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f688bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234af1d0 0x5625234af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f688bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234af1d0 0x5625234af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53962/0 (socket says 172.21.15.131:53962) 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f688bfff640 1 -- 172.21.15.131:0/2266596054 learned_addr learned my addr 172.21.15.131:0/2266596054 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f688bfff640 1 -- 172.21.15.131:0/2266596054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625234afb30 con 0x5625234af1d0 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f688bfff640 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234af1d0 0x5625234af5f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f687c001ed0 tx=0x7f687c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.690+0000 7f6779ffb640 1 -- 172.21.15.131:0/2266596054 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c022070 con 0x5625234af1d0 2024-04-24T01:43:22.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.691+0000 7f6779ffb640 1 -- 172.21.15.131:0/2266596054 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c00d520 con 0x5625234af1d0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.691+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625234b05a0 con 0x5625234af1d0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.691+0000 7f6779ffb640 1 -- 172.21.15.131:0/2266596054 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c00d800 con 0x5625234af1d0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.691+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625234b0aa0 con 0x5625234af1d0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.691+0000 7f6779ffb640 1 -- 172.21.15.131:0/2266596054 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f687c025070 con 0x5625234af1d0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.691+0000 7f6779ffb640 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f676c036900 0x7f676c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f6779ffb640 1 -- 172.21.15.131:0/2266596054 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f687c04de10 con 0x5625234af1d0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f6894e7e640 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f676c036900 0x7f676c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f6899012800 1 Processor -- start 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f6894e7e640 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f676c036900 0x7f676c038dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56252349f260 tx=0x7f688c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f6899012800 1 -- start start 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f6899012800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f6899012800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56252348fc90 con 0x5625234bc510 2024-04-24T01:43:22.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f688bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f688bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53976/0 (socket says 172.21.15.131:53976) 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f688bfff640 1 -- 172.21.15.131:0/718507442 learned_addr learned my addr 172.21.15.131:0/718507442 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.692+0000 7f688bfff640 1 -- 172.21.15.131:0/718507442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625234bcf00 con 0x5625234bc510 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f688bfff640 1 --2- 172.21.15.131:0/718507442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234bc930 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f687c04c120 tx=0x7f687c024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a986791cd0f1a24 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f67737fe640 1 -- 172.21.15.131:0/718507442 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c04a030 con 0x5625234bc510 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f67737fe640 1 -- 172.21.15.131:0/718507442 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c025990 con 0x5625234bc510 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f67737fe640 1 -- 172.21.15.131:0/718507442 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c026730 con 0x5625234bc510 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f6899012800 1 -- 172.21.15.131:0/718507442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 msgr2=0x5625234bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f6899012800 1 --2- 172.21.15.131:0/718507442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234bc930 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f687c04c120 tx=0x7f687c024740 comp rx=0 tx=0).stop 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f6899012800 1 -- 172.21.15.131:0/718507442 shutdown_connections 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f6899012800 1 --2- 172.21.15.131:0/718507442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234bc930 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f6899012800 1 -- 172.21.15.131:0/718507442 >> 172.21.15.131:0/718507442 conn(0x5625234b8870 msgr2=0x5625234b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f6899012800 1 -- 172.21.15.131:0/718507442 shutdown_connections 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.693+0000 7f6899012800 1 -- 172.21.15.131:0/718507442 wait complete. 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f6899012800 1 Processor -- start 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f6899012800 1 -- start start 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f6899012800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f6899012800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5625234bd670 con 0x5625234bc510 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f688bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f688bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53988/0 (socket says 172.21.15.131:53988) 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 learned_addr learned my addr 172.21.15.131:0/3079303729 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625234c40b0 con 0x5625234bc510 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f688bfff640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234c3b70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f687c024a50 tx=0x7f687c04c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f6771ffb640 1 -- 172.21.15.131:0/3079303729 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c025570 con 0x5625234bc510 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f6771ffb640 1 -- 172.21.15.131:0/3079303729 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c00d9a0 con 0x5625234bc510 2024-04-24T01:43:22.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.694+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625234c40b0 con 0x5625234bc510 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.695+0000 7f6771ffb640 1 -- 172.21.15.131:0/3079303729 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c00dcc0 con 0x5625234bc510 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.695+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625234c40b0 con 0x5625234bc510 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.695+0000 7f6771ffb640 1 -- 172.21.15.131:0/3079303729 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f687c01a320 con 0x5625234bc510 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.695+0000 7f6771ffb640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6764036950 0x7f6764038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.695+0000 7f6771ffb640 1 -- 172.21.15.131:0/3079303729 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f687c045070 con 0x5625234bc510 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.695+0000 7f6894e7e640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6764036950 0x7f6764038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.696+0000 7f6894e7e640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6764036950 0x7f6764038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x56252349b600 tx=0x7f688c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.696+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.696+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5625234cf260 0x5625234d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.696+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d1e70 con 0x5625234cf260 2024-04-24T01:43:22.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.696+0000 7f689467d640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5625234cf260 0x5625234d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.696+0000 7f689467d640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5625234cf260 0x5625234d1720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6884075030 con 0x5625234cf260 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 realm 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d2280 con 0x5625234cf260 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6884075030 con 0x5625234cf260 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d2b50 con 0x5625234cf260 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6884075030 con 0x5625234cf260 2024-04-24T01:43:22.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d2ef0 con 0x5625234cf260 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6884075030 con 0x5625234cf260 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.697+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d3740 con 0x5625234cf260 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6884075030 con 0x5625234cf260 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f6899012800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f6899012800 20 searching for the correct realm 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5625234d54b0 0x5625234d78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f688bfff640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5625234d54b0 0x5625234d78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f688bfff640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5625234d54b0 0x5625234d78a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f688bfff640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f687c01ac20 0x7f687c027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f687c01ac20 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.698+0000 7f6894e7e640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f687c01ac20 0x7f687c027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.699+0000 7f6894e7e640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f687c01ac20 0x7f687c027440 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.699+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688c01f070 con 0x7f687c01ac20 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.699+0000 7f6894e7e640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f688c031040 0x7f688c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.699+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.699+0000 7f689467d640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f688c031040 0x7f688c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.700+0000 7f689467d640 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f688c031040 0x7f688c032940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.700+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.700+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.700+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.700+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.700+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.700+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f687c01ac20 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688c01f070 con 0x7f687c01ac20 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.701+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f687c01ac20 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f688c01f070 con 0x7f687c01ac20 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.702+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.703+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.704+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.704+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.704+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.704+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.704+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.704+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.704+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f687c01ac20 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688c01f070 con 0x7f687c01ac20 2024-04-24T01:43:22.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f687c01ac20 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688c01f070 con 0x7f687c01ac20 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.705+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f687c01ac20 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688c01f070 con 0x7f687c01ac20 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234d54b0 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f688c031040 2024-04-24T01:43:22.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.706+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x5625234cf260 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5625234d7e80 con 0x7f687c01ac20 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:22.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d4090 con 0x5625234cf260 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d4930 con 0x5625234cf260 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.707+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d8300 con 0x5625234cf260 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:22.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 zone default found 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 4 Realm: () 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 zonegroup default 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234d8370 con 0x7f687c01ac20 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234da640 con 0x5625234d54b0 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234daa10 con 0x5625234d54b0 2024-04-24T01:43:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 started sync module instance, tier type = 2024-04-24T01:43:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:22.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.708+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234d9ad0 con 0x7f687c01ac20 2024-04-24T01:43:22.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.709+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.710+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94717506068464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234d9ad0 con 0x7f687c01ac20 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.710+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234db4b0 con 0x5625234cf260 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.710+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94717506068464] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.711+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.711+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94717506072512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234d9ad0 con 0x5625234cf260 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.711+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dbec0 con 0x5625234d54b0 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.712+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94717506072512] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.712+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.712+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94717506065952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234d9a40 con 0x5625234d54b0 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.712+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dcd80 con 0x7f687c01ac20 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.713+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94717506065952] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.713+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.713+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94717506078928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dd1a0 con 0x7f687c01ac20 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.713+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ddb60 con 0x5625234cf260 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.714+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.714+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94717506082480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ddf80 con 0x5625234cf260 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.714+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dea60 con 0x7f688c031040 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.715+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94717506078928] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.715+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.715+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94717506079984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dea20 con 0x7f688c031040 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.715+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234df4a0 con 0x7f688c031040 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.716+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94717506082480] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.716+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94717506079984] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.717+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.717+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94717506086256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234deff0 con 0x7f688c031040 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.717+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234df9b0 con 0x7f688c031040 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.717+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94717506086256] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94717506087312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234df9b0 con 0x7f688c031040 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=0 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=1 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=2 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=3 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=4 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=5 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=6 2024-04-24T01:43:22.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94717506087312] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 20 add_watcher() i=7 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.718+0000 7f6899012800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.719+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625234e2cd0 con 0x5625234cf260 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.719+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.719+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94717506090608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dff40 con 0x5625234cf260 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.720+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94717506090608] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.720+0000 7f674a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.720+0000 7f6899012800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.720+0000 7f6899012800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.720+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234e2530 con 0x5625234cf260 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.721+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'55 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.721+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ebd90 con 0x7f688c031040 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.722+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.722+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ebd90 con 0x5625234d54b0 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.723+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.723+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ec230 con 0x5625234cf260 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.724+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'180 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.724+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ec1f0 con 0x7f687c01ac20 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.725+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.725+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ec780 con 0x5625234d54b0 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.726+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.726+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ecbb0 con 0x5625234cf260 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.728+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.728+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ecc40 con 0x7f688c031040 2024-04-24T01:43:22.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.729+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.729+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ecc40 con 0x7f687c01ac20 2024-04-24T01:43:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.730+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.730+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ed250 con 0x5625234d54b0 2024-04-24T01:43:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.731+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.731+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ed680 con 0x7f687c01ac20 2024-04-24T01:43:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.732+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.732+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234edbf0 con 0x7f688c031040 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.733+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.733+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234edbf0 con 0x7f687c01ac20 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.734+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.734+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x7f688c031040 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.735+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.735+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234cf260 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.736+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'181 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.736+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234d54b0 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.737+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.737+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee130 con 0x7f687c01ac20 2024-04-24T01:43:22.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.738+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.738+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee130 con 0x5625234d54b0 2024-04-24T01:43:22.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.739+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.739+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee130 con 0x5625234cf260 2024-04-24T01:43:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.740+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.740+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee130 con 0x5625234cf260 2024-04-24T01:43:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.741+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'182 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.741+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee130 con 0x5625234d54b0 2024-04-24T01:43:22.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.742+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.742+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x7f687c01ac20 2024-04-24T01:43:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.743+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.743+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234d54b0 2024-04-24T01:43:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.744+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.744+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234d54b0 2024-04-24T01:43:22.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.745+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'43 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.745+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234d54b0 2024-04-24T01:43:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.746+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.746+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234d54b0 2024-04-24T01:43:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.747+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.747+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x7f688c031040 2024-04-24T01:43:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.748+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.748+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234d54b0 2024-04-24T01:43:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.749+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.749+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x7f688c031040 2024-04-24T01:43:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.750+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.750+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x5625234d54b0 2024-04-24T01:43:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.751+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.751+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x7f688c031040 2024-04-24T01:43:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.752+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.752+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234ee0a0 con 0x7f687c01ac20 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f67497e2640 20 reqs_thread_entry: start 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f6899012800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f6899012800 20 Filter name: none 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f66baffd640 20 reqs_thread_entry: start 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f6899012800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f6899012800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.753+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562523518d30 con 0x5625234cf260 2024-04-24T01:43:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.754+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.754+0000 7f6899012800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.754+0000 7f6899012800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.754+0000 7f6899012800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.754+0000 7f6899012800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.754+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5625235187a0 con 0x7f687c01ac20 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.754+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.755+0000 7f674a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.755+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94717506090608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234cb4c0 con 0x5625234cf260 2024-04-24T01:43:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.756+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94717506090608] v34'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.756+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94717506068464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234df670 con 0x7f687c01ac20 2024-04-24T01:43:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.757+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94717506068464] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.757+0000 7f6899012800 20 remove_watcher() i=0 2024-04-24T01:43:22.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.757+0000 7f6899012800 2 removed watcher, disabling cache 2024-04-24T01:43:22.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.757+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94717506072512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234df670 con 0x5625234cf260 2024-04-24T01:43:22.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.758+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94717506072512] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.758+0000 7f6899012800 20 remove_watcher() i=1 2024-04-24T01:43:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.758+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94717506065952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234df670 con 0x5625234d54b0 2024-04-24T01:43:22.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.759+0000 7f688bfff640 1 -- 172.21.15.131:0/3079303729 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94717506065952] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f687c052020 con 0x5625234d54b0 2024-04-24T01:43:22.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.759+0000 7f6899012800 20 remove_watcher() i=2 2024-04-24T01:43:22.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.759+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94717506078928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234d9620 con 0x7f687c01ac20 2024-04-24T01:43:22.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.760+0000 7f6894e7e640 1 -- 172.21.15.131:0/3079303729 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94717506078928] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f688c040040 con 0x7f687c01ac20 2024-04-24T01:43:22.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.760+0000 7f6899012800 20 remove_watcher() i=3 2024-04-24T01:43:22.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.760+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94717506082480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234df670 con 0x5625234cf260 2024-04-24T01:43:22.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.761+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94717506082480] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x5625234cf260 2024-04-24T01:43:22.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.761+0000 7f6899012800 20 remove_watcher() i=4 2024-04-24T01:43:22.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.761+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94717506079984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dc8d0 con 0x7f688c031040 2024-04-24T01:43:22.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.762+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94717506079984] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.762+0000 7f6899012800 20 remove_watcher() i=5 2024-04-24T01:43:22.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.762+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94717506086256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234d9620 con 0x7f688c031040 2024-04-24T01:43:22.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.763+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94717506086256] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.763+0000 7f6899012800 20 remove_watcher() i=6 2024-04-24T01:43:22.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.763+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94717506087312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5625234dcd80 con 0x7f688c031040 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94717506087312] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6884086040 con 0x7f688c031040 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 20 remove_watcher() i=7 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f688c031040 msgr2=0x7f688c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f688c031040 0x7f688c032940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5625234cf260 msgr2=0x5625234d1720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5625234cf260 0x5625234d1720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f687c01ac20 msgr2=0x7f687c027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f687c01ac20 0x7f687c027440 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5625234d54b0 msgr2=0x5625234d78a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5625234d54b0 0x5625234d78a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6764036950 msgr2=0x7f6764038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6764036950 0x7f6764038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x56252349b600 tx=0x7f688c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 msgr2=0x5625234c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f689467d640 1 -- 172.21.15.131:0/3079303729 reap_dead start 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234c3b70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f687c024a50 tx=0x7f687c04c080 comp rx=0 tx=0).stop 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 shutdown_connections 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 --2- 172.21.15.131:0/3079303729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234bc510 0x5625234c3b70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 >> 172.21.15.131:0/3079303729 conn(0x5625234b8870 msgr2=0x5625234b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 shutdown_connections 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.764+0000 7f6899012800 1 -- 172.21.15.131:0/3079303729 wait complete. 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f676c036900 msgr2=0x7f676c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f676c036900 0x7f676c038dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56252349f260 tx=0x7f688c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:22.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234af1d0 msgr2=0x5625234af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234af1d0 0x5625234af5f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f687c001ed0 tx=0x7f687c00ea00 comp rx=0 tx=0).stop 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 shutdown_connections 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f676c036900 0x7f676c038dc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/2266596054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625234af1d0 0x5625234af5f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 >> 172.21.15.131:0/2266596054 conn(0x5625234a3270 msgr2=0x5625234a3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 shutdown_connections 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/2266596054 wait complete. 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56252339b100 msgr2=0x56252349e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56252339b100 0x56252349e0e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f677c036950 msgr2=0x7f677c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f677c036950 0x7f677c038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f687c000f60 tx=0x7f687c001370 comp rx=0 tx=0).stop 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 msgr2=0x562523496f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x562523496f40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6884052540 tx=0x7f6884003020 comp rx=0 tx=0).stop 2024-04-24T01:43:22.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 shutdown_connections 2024-04-24T01:43:22.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56252339b100 0x56252349e0e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f677c036950 0x7f677c038e10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 --2- 172.21.15.131:0/4285053705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56252339a7a0 0x562523496f40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 >> 172.21.15.131:0/4285053705 conn(0x562523396320 msgr2=0x562523489520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 shutdown_connections 2024-04-24T01:43:22.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.765+0000 7f6899012800 1 -- 172.21.15.131:0/4285053705 wait complete. 2024-04-24T01:43:22.774 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:43:22.782 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-24T01:43:22.787 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:22.819 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:22.828 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:22.875 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-24T01:43:22.879 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:22.879 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:43:22.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:43:22.880 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:43:22.923 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:22.923 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.923+0000 7fbbab20c800 1 Processor -- start 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.923+0000 7fbbab20c800 1 -- start start 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.923+0000 7fbbab20c800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d5a0f9e2e0 0x55d5a0fa6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.923+0000 7fbbab20c800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5a0e5cd40 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.923+0000 7fbbab20c800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55d5a0e2f4d0 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.924+0000 7fbba3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d5a0f9e2e0 0x55d5a0fa6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.924+0000 7fbba8d0b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55d5a0f9c7a0 0x55d5a0f9cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56934/0 (socket says 172.21.15.131:56934) 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.924+0000 7fbba8d0b640 1 -- 172.21.15.131:0/199767718 learned_addr learned my addr 172.21.15.131:0/199767718 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:22.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.924+0000 7fbba3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d5a0f9e2e0 0x55d5a0fa6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53992/0 (socket says 172.21.15.131:53992) 2024-04-24T01:43:22.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.924+0000 7fbba3fff640 1 -- 172.21.15.131:0/199767718 >> v1:172.21.15.107:6789/0 conn(0x55d5a0f9c7a0 legacy=0x55d5a0f9cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.924+0000 7fbba37fe640 1 -- 172.21.15.131:0/199767718 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 428759100 0 0) 0x55d5a0e5cd40 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.924+0000 7fbba3fff640 1 -- 172.21.15.131:0/199767718 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a0e5b590 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbba3fff640 1 --2- 172.21.15.131:0/199767718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9e2e0 0x55d5a0fa6de0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400a470 tx=0x7fbb9401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de71318239118be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbba37fe640 1 -- 172.21.15.131:0/199767718 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb94057070 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbba37fe640 1 -- 172.21.15.131:0/199767718 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94052570 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbba37fe640 1 -- 172.21.15.131:0/199767718 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb94052870 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbbab20c800 1 -- 172.21.15.131:0/199767718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9e2e0 msgr2=0x55d5a0fa6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbbab20c800 1 --2- 172.21.15.131:0/199767718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9e2e0 0x55d5a0fa6de0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400a470 tx=0x7fbb9401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbbab20c800 1 -- 172.21.15.131:0/199767718 shutdown_connections 2024-04-24T01:43:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbbab20c800 1 --2- 172.21.15.131:0/199767718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9e2e0 0x55d5a0fa6de0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbbab20c800 1 -- 172.21.15.131:0/199767718 >> 172.21.15.131:0/199767718 conn(0x55d5a0f983a0 msgr2=0x55d5a0f9a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbbab20c800 1 -- 172.21.15.131:0/199767718 shutdown_connections 2024-04-24T01:43:22.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.926+0000 7fbbab20c800 1 -- 172.21.15.131:0/199767718 wait complete. 2024-04-24T01:43:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.938+0000 7fbbab20c800 1 Processor -- start 2024-04-24T01:43:22.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.938+0000 7fbbab20c800 1 -- start start 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.938+0000 7fbbab20c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a10914a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.938+0000 7fbbab20c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d5a0ee93b0 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fbba8d0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a10914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fbba8d0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a10914a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:53994/0 (socket says 172.21.15.131:53994) 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fbba8d0b640 1 -- 172.21.15.131:0/1362190301 learned_addr learned my addr 172.21.15.131:0/1362190301 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fbba8d0b640 1 -- 172.21.15.131:0/1362190301 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a1091a70 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fbba8d0b640 1 --2- 172.21.15.131:0/1362190301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a10914a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b210 tx=0x7fbb9c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b6cc73cf79f4ba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fba96e05640 1 -- 172.21.15.131:0/1362190301 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c008070 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fba96e05640 1 -- 172.21.15.131:0/1362190301 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00d500 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.939+0000 7fba96e05640 1 -- 172.21.15.131:0/1362190301 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c00d840 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 -- 172.21.15.131:0/1362190301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 msgr2=0x55d5a10914a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 --2- 172.21.15.131:0/1362190301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a10914a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b210 tx=0x7fbb9c00b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 -- 172.21.15.131:0/1362190301 shutdown_connections 2024-04-24T01:43:22.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 --2- 172.21.15.131:0/1362190301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a10914a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 -- 172.21.15.131:0/1362190301 >> 172.21.15.131:0/1362190301 conn(0x55d5a0f983a0 msgr2=0x55d5a108cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 -- 172.21.15.131:0/1362190301 shutdown_connections 2024-04-24T01:43:22.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 -- 172.21.15.131:0/1362190301 wait complete. 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 Processor -- start 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 -- start start 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a1099010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.940+0000 7fbbab20c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d5a0fa9600 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fbba8d0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a1099010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fbba8d0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a1099010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54002/0 (socket says 172.21.15.131:54002) 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fbba8d0b640 1 -- 172.21.15.131:0/3124986230 learned_addr learned my addr 172.21.15.131:0/3124986230 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fbba8d0b640 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a1099550 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fbba8d0b640 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a1099010 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b210 tx=0x7fbb9c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fba95602640 1 -- 172.21.15.131:0/3124986230 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c00f950 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fba95602640 1 -- 172.21.15.131:0/3124986230 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00faf0 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5a10997e0 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fba95602640 1 -- 172.21.15.131:0/3124986230 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c00fdd0 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.941+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a109c490 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.942+0000 7fba95602640 1 -- 172.21.15.131:0/3124986230 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbb9c017040 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.942+0000 7fba95602640 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba90036900 0x7fba90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.942+0000 7fba95602640 1 -- 172.21.15.131:0/3124986230 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fbb9c015020 con 0x55d5a0f9c7a0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.942+0000 7fbba3fff640 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba90036900 0x7fba90038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.942+0000 7fbbab20c800 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a0f9e2e0 0x55d5a10a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.942+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10a0790 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.943+0000 7fbba950c640 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a0f9e2e0 0x55d5a10a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.943+0000 7fbba3fff640 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba90036900 0x7fba90038dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb94054000 tx=0x7fbb9404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.943+0000 7fbba950c640 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a0f9e2e0 0x55d5a10a0250 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.943+0000 7fbba950c640 1 -- 172.21.15.131:0/3124986230 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbba400a4a0 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.943+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a109d820 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.943+0000 7fbba950c640 1 -- 172.21.15.131:0/3124986230 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbba400a4a0 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.943+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10a2590 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.944+0000 7fbba950c640 1 -- 172.21.15.131:0/3124986230 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbba400a4a0 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.944+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10a18d0 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.944+0000 7fbba950c640 1 -- 172.21.15.131:0/3124986230 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbba400a4a0 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.944+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10a1d20 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.944+0000 7fbba950c640 1 -- 172.21.15.131:0/3124986230 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbba400a4a0 con 0x55d5a0f9e2e0 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbbab20c800 1 Processor -- start 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbbab20c800 1 -- start start 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbbab20c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10b1360 0x55d5a10b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbbab20c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d5a0e8f6b0 con 0x55d5a10b1360 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10b1360 0x55d5a10b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10b1360 0x55d5a10b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54018/0 (socket says 172.21.15.131:54018) 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbba3fff640 1 -- 172.21.15.131:0/2328961175 learned_addr learned my addr 172.21.15.131:0/2328961175 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.945+0000 7fbba3fff640 1 -- 172.21.15.131:0/2328961175 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a10b1cc0 con 0x55d5a10b1360 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.946+0000 7fbba3fff640 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10b1360 0x55d5a10b1780 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb94044840 tx=0x7fbb94002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.946+0000 7fba8e7fc640 1 -- 172.21.15.131:0/2328961175 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9406f070 con 0x55d5a10b1360 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.946+0000 7fba8e7fc640 1 -- 172.21.15.131:0/2328961175 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94058040 con 0x55d5a10b1360 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.946+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5a10b2730 con 0x55d5a10b1360 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.946+0000 7fba8e7fc640 1 -- 172.21.15.131:0/2328961175 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb94057050 con 0x55d5a10b1360 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.946+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a10b2bd0 con 0x55d5a10b1360 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fba8e7fc640 1 -- 172.21.15.131:0/2328961175 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbb94072070 con 0x55d5a10b1360 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fba8e7fc640 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba80036900 0x7fba80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fba8e7fc640 1 -- 172.21.15.131:0/2328961175 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fbb9408f8f0 con 0x55d5a10b1360 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fbba950c640 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba80036900 0x7fba80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fbbab20c800 1 Processor -- start 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fbba950c640 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba80036900 0x7fba80038dc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55d5a10a13f0 tx=0x7fbba4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fbbab20c800 1 -- start start 2024-04-24T01:43:22.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fbbab20c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10bea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fbbab20c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d5a1091df0 con 0x55d5a10be5e0 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.947+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10bea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54028/0 (socket says 172.21.15.131:54028) 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbba3fff640 1 -- 172.21.15.131:0/1511698824 learned_addr learned my addr 172.21.15.131:0/1511698824 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbba3fff640 1 -- 172.21.15.131:0/1511698824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a10befd0 con 0x55d5a10be5e0 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbba3fff640 1 --2- 172.21.15.131:0/1511698824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10bea00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbb94052fb0 tx=0x7fbb9408dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f710141ea508b93 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fba7ffff640 1 -- 172.21.15.131:0/1511698824 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb94085070 con 0x55d5a10be5e0 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fba7ffff640 1 -- 172.21.15.131:0/1511698824 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94069c70 con 0x55d5a10be5e0 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fba7ffff640 1 -- 172.21.15.131:0/1511698824 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb94072b80 con 0x55d5a10be5e0 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbbab20c800 1 -- 172.21.15.131:0/1511698824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 msgr2=0x55d5a10bea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbbab20c800 1 --2- 172.21.15.131:0/1511698824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10bea00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbb94052fb0 tx=0x7fbb9408dd90 comp rx=0 tx=0).stop 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbbab20c800 1 -- 172.21.15.131:0/1511698824 shutdown_connections 2024-04-24T01:43:22.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbbab20c800 1 --2- 172.21.15.131:0/1511698824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10bea00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbbab20c800 1 -- 172.21.15.131:0/1511698824 >> 172.21.15.131:0/1511698824 conn(0x55d5a10ba940 msgr2=0x55d5a10b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.948+0000 7fbbab20c800 1 -- 172.21.15.131:0/1511698824 shutdown_connections 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbbab20c800 1 -- 172.21.15.131:0/1511698824 wait complete. 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbbab20c800 1 Processor -- start 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbbab20c800 1 -- start start 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbbab20c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbbab20c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d5a10bf740 con 0x55d5a10be5e0 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54030/0 (socket says 172.21.15.131:54030) 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 learned_addr learned my addr 172.21.15.131:0/986043288 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a10c6190 con 0x55d5a10be5e0 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.949+0000 7fbba3fff640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10c5c50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb940728e0 tx=0x7fbb9408db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.950+0000 7fba7e7fc640 1 -- 172.21.15.131:0/986043288 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb94085070 con 0x55d5a10be5e0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.950+0000 7fba7e7fc640 1 -- 172.21.15.131:0/986043288 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94069e20 con 0x55d5a10be5e0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.950+0000 7fba7e7fc640 1 -- 172.21.15.131:0/986043288 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9408fcf0 con 0x55d5a10be5e0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.950+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5a10c6420 con 0x55d5a10be5e0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.950+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a10c90d0 con 0x55d5a10be5e0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.950+0000 7fba7e7fc640 1 -- 172.21.15.131:0/986043288 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbb94096020 con 0x55d5a10be5e0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.950+0000 7fba7e7fc640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba74036950 0x7fba74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fba7e7fc640 1 -- 172.21.15.131:0/986043288 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fbb94094020 con 0x55d5a10be5e0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fbba950c640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba74036950 0x7fba74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fbba950c640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba74036950 0x7fba74038e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d5a109d770 tx=0x7fbba401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a10d1790 0x55d5a10d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10d43a0 con 0x55d5a10d1790 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fbba8d0b640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a10d1790 0x55d5a10d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.951+0000 7fbba8d0b640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a10d1790 0x55d5a10d3c50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9c02d070 con 0x55d5a10d1790 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 realm 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10d47b0 con 0x55d5a10d1790 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9c02d070 con 0x55d5a10d1790 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10d5080 con 0x55d5a10d1790 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9c02d070 con 0x55d5a10d1790 2024-04-24T01:43:22.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10d5420 con 0x55d5a10d1790 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb9c02d070 con 0x55d5a10d1790 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.952+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10d5c70 con 0x55d5a10d1790 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.953+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb9c02d070 con 0x55d5a10d1790 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.953+0000 7fbbab20c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.953+0000 7fbbab20c800 20 searching for the correct realm 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.953+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d5a10d79e0 0x55d5a10d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.953+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.953+0000 7fbba3fff640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d5a10d79e0 0x55d5a10d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.953+0000 7fbba3fff640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d5a10d79e0 0x55d5a10d9dd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba3fff640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fbb94074060 0x7fbb9408f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbb94074060 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba950c640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fbb94074060 0x7fbb9408f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba950c640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fbb94074060 0x7fbb9408f210 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba401f070 con 0x7fbb94074060 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba950c640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fbba4031040 0x7fbba4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.954+0000 7fbba8d0b640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fbba4031040 0x7fbba4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.955+0000 7fbba8d0b640 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fbba4031040 0x7fbba4032940 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.955+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.955+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.955+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.955+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.955+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.956+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.956+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.956+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.956+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.956+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbb94074060 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.956+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba401f070 con 0x7fbb94074060 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.956+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.957+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbb94074060 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.958+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbba401f070 con 0x7fbb94074060 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.958+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.958+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.958+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.958+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.958+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.959+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.959+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.959+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.959+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.959+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.959+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.960+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbb94074060 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba401f070 con 0x7fbb94074060 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbb94074060 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba401f070 con 0x7fbb94074060 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.961+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.962+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.962+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbb94074060 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.962+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba401f070 con 0x7fbb94074060 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.962+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d79e0 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.962+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.962+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbba4031040 2024-04-24T01:43:22.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x55d5a10d1790 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da3b0 con 0x7fbb94074060 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10d6620 con 0x55d5a10d1790 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10d6ec0 con 0x55d5a10d1790 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.963+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10da830 con 0x55d5a10d1790 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 zone default found 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 4 Realm: () 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:22.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 zonegroup default 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dace0 con 0x7fbb94074060 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dca60 con 0x55d5a10d79e0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.964+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dcf40 con 0x55d5a10d79e0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.965+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.965+0000 7fbbab20c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:22.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.965+0000 7fbbab20c800 20 started sync module instance, tier type = 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.965+0000 7fbbab20c800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.965+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dbf00 con 0x7fbb94074060 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.966+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.966+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94376018428960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dbf00 con 0x7fbb94074060 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.966+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dd9c0 con 0x55d5a10d1790 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.967+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94376018428960] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.967+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.967+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94376018433808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dbf00 con 0x55d5a10d1790 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.967+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10de410 con 0x55d5a10d79e0 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.968+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94376018433808] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.968+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.968+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94376018426448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dbe70 con 0x55d5a10d79e0 2024-04-24T01:43:22.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.968+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10df2d0 con 0x7fbb94074060 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.969+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.969+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94376018426448] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.969+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94376018440192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dfb70 con 0x7fbb94074060 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.969+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10de800 con 0x55d5a10d1790 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.970+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94376018440192] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.971+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.971+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94376018441920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10dfae0 con 0x55d5a10d1790 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.971+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e0af0 con 0x7fbba4031040 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.972+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94376018441920] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.972+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.972+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94376018444592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e0ab0 con 0x7fbba4031040 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.972+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e1500 con 0x7fbba4031040 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.973+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94376018444592] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.973+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.973+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94376018445648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e1500 con 0x7fbba4031040 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.973+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e1f00 con 0x7fbba4031040 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94376018445648] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94376018450960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e20e0 con 0x7fbba4031040 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 20 add_watcher() i=0 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 20 add_watcher() i=1 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 20 add_watcher() i=2 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 20 add_watcher() i=3 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 20 add_watcher() i=4 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 20 add_watcher() i=5 2024-04-24T01:43:22.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.974+0000 7fbbab20c800 20 add_watcher() i=6 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.976+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94376018450960] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.976+0000 7fbbab20c800 20 add_watcher() i=7 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.976+0000 7fbbab20c800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.976+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e54b0 con 0x55d5a10d1790 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.976+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.976+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94376018452432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a10e28a0 con 0x55d5a10d1790 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.977+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94376018452432] v34'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.977+0000 7fba5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 5 note: GC not initialized 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fba5dfe3640 20 reqs_thread_entry: start 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 20 Filter name: none 2024-04-24T01:43:22.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fb9cf7fe640 20 reqs_thread_entry: start 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.978+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1118c50 con 0x7fbb94074060 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 : miss 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 20 rados->read ofs=0 len=0 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:63 8.1c 8:38174351:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a111a6d0 con 0x55d5a10d79e0 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(63 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:22.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 info.flags=0x17 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 to cache LRU end 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 20 get_obj_state: octx=0x7fbb9c003f80 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d5a111cd98 s->prefetch_data=0 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.979+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 3.2ds0 3:b4c61ad3:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a111dbc0 con 0x55d5a10d79e0 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.980+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(64 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.980+0000 7fbbab20c800 10 manifest: total_size = 5 2024-04-24T01:43:22.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.980+0000 7fbbab20c800 20 get_obj_state: setting s->obj_tag to _cTAXv5EYRktaHzPtWQALPt10y1B4GZf 2024-04-24T01:43:22.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.980+0000 7fba5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:22.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.980+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94376018452432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x55d5a10d1790 2024-04-24T01:43:22.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.982+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94376018452432] v34'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.982+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94376018428960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x7fbb94074060 2024-04-24T01:43:22.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.983+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94376018428960] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.983+0000 7fbbab20c800 20 remove_watcher() i=0 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.983+0000 7fbbab20c800 2 removed watcher, disabling cache 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.983+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94376018433808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x55d5a10d1790 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.984+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94376018433808] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.984+0000 7fbbab20c800 20 remove_watcher() i=1 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.984+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94376018426448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x55d5a10d79e0 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.985+0000 7fbba3fff640 1 -- 172.21.15.131:0/986043288 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94376018426448] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb94071030 con 0x55d5a10d79e0 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.985+0000 7fbbab20c800 20 remove_watcher() i=2 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.985+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94376018440192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x7fbb94074060 2024-04-24T01:43:22.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.986+0000 7fbba950c640 1 -- 172.21.15.131:0/986043288 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94376018440192] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba4040040 con 0x7fbb94074060 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.986+0000 7fbbab20c800 20 remove_watcher() i=3 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.986+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94376018441920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x55d5a10d1790 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.987+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94376018441920] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x55d5a10d1790 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.987+0000 7fbbab20c800 20 remove_watcher() i=4 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.987+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94376018444592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x7fbba4031040 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.988+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94376018444592] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.988+0000 7fbbab20c800 20 remove_watcher() i=5 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.988+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94376018445648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x7fbba4031040 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.989+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94376018445648] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.989+0000 7fbbab20c800 20 remove_watcher() i=6 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.989+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94376018450960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a11165a0 con 0x7fbba4031040 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94376018450960] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c048040 con 0x7fbba4031040 2024-04-24T01:43:22.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 20 remove_watcher() i=7 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fbba4031040 msgr2=0x7fbba4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fbba4031040 0x7fbba4032940 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a10d1790 msgr2=0x55d5a10d3c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a10d1790 0x55d5a10d3c50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fbb94074060 msgr2=0x7fbb9408f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fbb94074060 0x7fbb9408f210 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d5a10d79e0 msgr2=0x55d5a10d9dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d5a10d79e0 0x55d5a10d9dd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba74036950 msgr2=0x7fba74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba74036950 0x7fba74038e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d5a109d770 tx=0x7fbba401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 msgr2=0x55d5a10c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbba8d0b640 1 -- 172.21.15.131:0/986043288 reap_dead start 2024-04-24T01:43:22.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10c5c50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb940728e0 tx=0x7fbb9408db20 comp rx=0 tx=0).stop 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 shutdown_connections 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/986043288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10be5e0 0x55d5a10c5c50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 >> 172.21.15.131:0/986043288 conn(0x55d5a10ba940 msgr2=0x55d5a10b7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 shutdown_connections 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/986043288 wait complete. 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba80036900 msgr2=0x7fba80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba80036900 0x7fba80038dc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55d5a10a13f0 tx=0x7fbba4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10b1360 msgr2=0x55d5a10b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10b1360 0x55d5a10b1780 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb94044840 tx=0x7fbb94002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 shutdown_connections 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba80036900 0x7fba80038dc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 --2- 172.21.15.131:0/2328961175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a10b1360 0x55d5a10b1780 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.991+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 >> 172.21.15.131:0/2328961175 conn(0x55d5a10a5400 msgr2=0x55d5a10a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 shutdown_connections 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/2328961175 wait complete. 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a0f9e2e0 msgr2=0x55d5a10a0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a0f9e2e0 0x55d5a10a0250 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba90036900 msgr2=0x7fba90038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba90036900 0x7fba90038dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb94054000 tx=0x7fbb9404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 msgr2=0x55d5a1099010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a1099010 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b210 tx=0x7fbb9c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 shutdown_connections 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d5a0f9e2e0 0x55d5a10a0250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fba90036900 0x7fba90038dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 --2- 172.21.15.131:0/3124986230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d5a0f9c7a0 0x55d5a1099010 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 >> 172.21.15.131:0/3124986230 conn(0x55d5a0f983a0 msgr2=0x55d5a108b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 shutdown_connections 2024-04-24T01:43:23.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:22.992+0000 7fbbab20c800 1 -- 172.21.15.131:0/3124986230 wait complete. 2024-04-24T01:43:23.002 INFO:teuthology.orchestra.run.smithi131.stdout:fooFoofooFooFULL_CONTROL 2024-04-24T01:43:23.003 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-24T01:43:23.005 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-24T01:43:23.009 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:23.009 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:43:23.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:43:23.010 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:43:23.087 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:23.087 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.087+0000 7fe53fe0f800 1 Processor -- start 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.087+0000 7fe53fe0f800 1 -- start start 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe53fe0f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561c50ee63e0 0x561c50ee87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe53fe0f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c50da0d40 con 0x561c50ee28d0 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe53fe0f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x561c50d734d0 con 0x561c50ee63e0 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe533fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561c50ee63e0 0x561c50ee87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe533fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561c50ee63e0 0x561c50ee87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54046/0 (socket says 172.21.15.131:54046) 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe533fff640 1 -- 172.21.15.131:0/2656835756 learned_addr learned my addr 172.21.15.131:0/2656835756 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe53b56a640 1 --1- 172.21.15.131:0/2656835756 >> v1:172.21.15.107:6789/0 conn(0x561c50ee28d0 0x561c50ee4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56950/0 (socket says 172.21.15.131:56950) 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe533fff640 1 -- 172.21.15.131:0/2656835756 >> v1:172.21.15.107:6789/0 conn(0x561c50ee28d0 legacy=0x561c50ee4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe53ad69640 1 -- 172.21.15.131:0/2656835756 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699365161 0 0) 0x561c50da0d40 con 0x561c50ee28d0 2024-04-24T01:43:23.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.088+0000 7fe533fff640 1 -- 172.21.15.131:0/2656835756 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c50d9f590 con 0x561c50ee63e0 2024-04-24T01:43:23.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.090+0000 7fe533fff640 1 --2- 172.21.15.131:0/2656835756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee63e0 0x561c50ee87d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe52400a520 tx=0x7fe52401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be3de23aa8c0743 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.090+0000 7fe53ad69640 1 -- 172.21.15.131:0/2656835756 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe524057070 con 0x561c50ee63e0 2024-04-24T01:43:23.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.090+0000 7fe53ad69640 1 -- 172.21.15.131:0/2656835756 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe524052570 con 0x561c50ee63e0 2024-04-24T01:43:23.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.090+0000 7fe53ad69640 1 -- 172.21.15.131:0/2656835756 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52404ae60 con 0x561c50ee63e0 2024-04-24T01:43:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.091+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2656835756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee63e0 msgr2=0x561c50ee87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.091+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2656835756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee63e0 0x561c50ee87d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe52400a520 tx=0x7fe52401d010 comp rx=0 tx=0).stop 2024-04-24T01:43:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.091+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2656835756 shutdown_connections 2024-04-24T01:43:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.091+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2656835756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee63e0 0x561c50ee87d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.091+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2656835756 >> 172.21.15.131:0/2656835756 conn(0x561c50edc3a0 msgr2=0x561c50ede7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.091+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2656835756 shutdown_connections 2024-04-24T01:43:23.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.091+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2656835756 wait complete. 2024-04-24T01:43:23.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.102+0000 7fe53fe0f800 1 Processor -- start 2024-04-24T01:43:23.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.102+0000 7fe53fe0f800 1 -- start start 2024-04-24T01:43:23.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.103+0000 7fe53fe0f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50ee2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.103+0000 7fe53fe0f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561c50e2d3b0 con 0x561c50ee28d0 2024-04-24T01:43:23.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.103+0000 7fe53b56a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50ee2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.103+0000 7fe53b56a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50ee2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54062/0 (socket says 172.21.15.131:54062) 2024-04-24T01:43:23.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.103+0000 7fe53b56a640 1 -- 172.21.15.131:0/2405194884 learned_addr learned my addr 172.21.15.131:0/2405194884 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.103+0000 7fe53b56a640 1 -- 172.21.15.131:0/2405194884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c50ee07d0 con 0x561c50ee28d0 2024-04-24T01:43:23.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.103+0000 7fe53b56a640 1 --2- 172.21.15.131:0/2405194884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50ee2210 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00b210 tx=0x7fe52c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cb581030db6172 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe42960a640 1 -- 172.21.15.131:0/2405194884 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c008070 con 0x561c50ee28d0 2024-04-24T01:43:23.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe42960a640 1 -- 172.21.15.131:0/2405194884 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c00d500 con 0x561c50ee28d0 2024-04-24T01:43:23.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe42960a640 1 -- 172.21.15.131:0/2405194884 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c00d840 con 0x561c50ee28d0 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2405194884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 msgr2=0x561c50ee2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2405194884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50ee2210 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00b210 tx=0x7fe52c00b6d0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2405194884 shutdown_connections 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2405194884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50ee2210 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2405194884 >> 172.21.15.131:0/2405194884 conn(0x561c50edc3a0 msgr2=0x561c50fce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2405194884 shutdown_connections 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.104+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2405194884 wait complete. 2024-04-24T01:43:23.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53fe0f800 1 Processor -- start 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53fe0f800 1 -- start start 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53fe0f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50fdcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53fe0f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561c50ee9010 con 0x561c50ee28d0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53b56a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50fdcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53b56a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50fdcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54068/0 (socket says 172.21.15.131:54068) 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53b56a640 1 -- 172.21.15.131:0/2002712631 learned_addr learned my addr 172.21.15.131:0/2002712631 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.105+0000 7fe53b56a640 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c50fdd250 con 0x561c50ee28d0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.106+0000 7fe53b56a640 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50fdcd10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe52c001e60 tx=0x7fe52c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.106+0000 7fe427e07640 1 -- 172.21.15.131:0/2002712631 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c019870 con 0x561c50ee28d0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.106+0000 7fe427e07640 1 -- 172.21.15.131:0/2002712631 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c019a10 con 0x561c50ee28d0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.106+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c50fdd4e0 con 0x561c50ee28d0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.106+0000 7fe427e07640 1 -- 172.21.15.131:0/2002712631 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c019cf0 con 0x561c50ee28d0 2024-04-24T01:43:23.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.106+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c50fe0190 con 0x561c50ee28d0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.106+0000 7fe427e07640 1 -- 172.21.15.131:0/2002712631 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe52c017040 con 0x561c50ee28d0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe427e07640 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe420036950 0x7fe420038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe427e07640 1 -- 172.21.15.131:0/2002712631 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe52c015020 con 0x561c50ee28d0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe533fff640 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe420036950 0x7fe420038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c50ee63e0 0x561c50fe3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c50fe44e0 con 0x561c50ee63e0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c50ee63e0 0x561c50fe3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe533fff640 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe420036950 0x7fe420038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe524054000 tx=0x7fe52404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c50ee63e0 0x561c50fe3f50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.107+0000 7fe53bd6b640 1 -- 172.21.15.131:0/2002712631 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe53400a4a0 con 0x561c50ee63e0 2024-04-24T01:43:23.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.108+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c50fe1500 con 0x561c50ee63e0 2024-04-24T01:43:23.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.108+0000 7fe53bd6b640 1 -- 172.21.15.131:0/2002712631 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe53400a4a0 con 0x561c50ee63e0 2024-04-24T01:43:23.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.108+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c50fe6300 con 0x561c50ee63e0 2024-04-24T01:43:23.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.108+0000 7fe53bd6b640 1 -- 172.21.15.131:0/2002712631 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe53400a4a0 con 0x561c50ee63e0 2024-04-24T01:43:23.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.108+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c50fe5640 con 0x561c50ee63e0 2024-04-24T01:43:23.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.108+0000 7fe53bd6b640 1 -- 172.21.15.131:0/2002712631 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe53400a4a0 con 0x561c50ee63e0 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.108+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c50fe5a60 con 0x561c50ee63e0 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.109+0000 7fe53bd6b640 1 -- 172.21.15.131:0/2002712631 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe53400a4a0 con 0x561c50ee63e0 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.109+0000 7fe53fe0f800 1 Processor -- start 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.109+0000 7fe53fe0f800 1 -- start start 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.109+0000 7fe53fe0f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ff5110 0x561c50ff5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.109+0000 7fe53fe0f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561c50dd36b0 con 0x561c50ff5110 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.109+0000 7fe533fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ff5110 0x561c50ff5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe533fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ff5110 0x561c50ff5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54084/0 (socket says 172.21.15.131:54084) 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe533fff640 1 -- 172.21.15.131:0/3772738981 learned_addr learned my addr 172.21.15.131:0/3772738981 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe533fff640 1 -- 172.21.15.131:0/3772738981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c50ff5a70 con 0x561c50ff5110 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe533fff640 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ff5110 0x561c50ff5530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe524005930 tx=0x7fe524002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe425602640 1 -- 172.21.15.131:0/3772738981 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe524057040 con 0x561c50ff5110 2024-04-24T01:43:23.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe425602640 1 -- 172.21.15.131:0/3772738981 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52405d650 con 0x561c50ff5110 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c50ff64e0 con 0x561c50ff5110 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe425602640 1 -- 172.21.15.131:0/3772738981 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52405d950 con 0x561c50ff5110 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.110+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c50ff6980 con 0x561c50ff5110 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.111+0000 7fe425602640 1 -- 172.21.15.131:0/3772738981 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe524067070 con 0x561c50ff5110 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.111+0000 7fe425602640 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe414036900 0x7fe414038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.111+0000 7fe425602640 1 -- 172.21.15.131:0/3772738981 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe52408f7a0 con 0x561c50ff5110 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.111+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe414036900 0x7fe414038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.111+0000 7fe53fe0f800 1 Processor -- start 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.111+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe414036900 0x7fe414038dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x561c50fe59e0 tx=0x7fe534005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.111+0000 7fe53fe0f800 1 -- start start 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.112+0000 7fe53fe0f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51002770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.112+0000 7fe53fe0f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561c50ee0b50 con 0x561c51002350 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.112+0000 7fe533fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51002770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.112+0000 7fe533fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51002770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54092/0 (socket says 172.21.15.131:54092) 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.112+0000 7fe533fff640 1 -- 172.21.15.131:0/2210727859 learned_addr learned my addr 172.21.15.131:0/2210727859 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.112+0000 7fe533fff640 1 -- 172.21.15.131:0/2210727859 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c51002d40 con 0x561c51002350 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.112+0000 7fe533fff640 1 --2- 172.21.15.131:0/2210727859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51002770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe52408da40 tx=0x7fe52405df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e9cbb2fad4d32a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe41effd640 1 -- 172.21.15.131:0/2210727859 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe524082070 con 0x561c51002350 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe41effd640 1 -- 172.21.15.131:0/2210727859 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52408de50 con 0x561c51002350 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe41effd640 1 -- 172.21.15.131:0/2210727859 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52408b070 con 0x561c51002350 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2210727859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 msgr2=0x561c51002770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2210727859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51002770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe52408da40 tx=0x7fe52405df50 comp rx=0 tx=0).stop 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2210727859 shutdown_connections 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2210727859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51002770 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2210727859 >> 172.21.15.131:0/2210727859 conn(0x561c50ffe6b0 msgr2=0x561c50ffc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2210727859 shutdown_connections 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2210727859 wait complete. 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 Processor -- start 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 -- start start 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.113+0000 7fe53fe0f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51009a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe53fe0f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561c510034b0 con 0x561c51002350 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe533fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51009a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe533fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51009a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54102/0 (socket says 172.21.15.131:54102) 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 learned_addr learned my addr 172.21.15.131:0/3975316845 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c51009f40 con 0x561c51002350 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe533fff640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51009a00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe524080040 tx=0x7fe52408d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe41d7fa640 1 -- 172.21.15.131:0/3975316845 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe524093070 con 0x561c51002350 2024-04-24T01:43:23.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe41d7fa640 1 -- 172.21.15.131:0/3975316845 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe524083040 con 0x561c51002350 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c5100a1d0 con 0x561c51002350 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe41d7fa640 1 -- 172.21.15.131:0/3975316845 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe524082070 con 0x561c51002350 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.114+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c5100ce80 con 0x561c51002350 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.115+0000 7fe41d7fa640 1 -- 172.21.15.131:0/3975316845 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe524096070 con 0x561c51002350 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.115+0000 7fe41d7fa640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4040368b0 0x7fe404038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.115+0000 7fe41d7fa640 1 -- 172.21.15.131:0/3975316845 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe524099d40 con 0x561c51002350 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.115+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4040368b0 0x7fe404038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4040368b0 0x7fe404038d70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x561c50fe5160 tx=0x7fe53401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c510154e0 0x561c510179a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c510180f0 con 0x561c510154e0 2024-04-24T01:43:23.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53b56a640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c510154e0 0x561c510179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53b56a640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c510154e0 0x561c510179a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.116+0000 7fe53fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 realm 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c51018500 con 0x561c510154e0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c51018dd0 con 0x561c510154e0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c51019170 con 0x561c510154e0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c510199c0 con 0x561c510154e0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 20 searching for the correct realm 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561c5101b730 0x561c5101db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.117+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c5101b730 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.118+0000 7fe533fff640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561c5101b730 0x561c5101db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.118+0000 7fe533fff640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561c5101b730 0x561c5101db20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.118+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.118+0000 7fe533fff640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe524098070 0x7fe52407c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.118+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x7fe524098070 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.118+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe524098070 0x7fe52407c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.119+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe524098070 0x7fe52407c860 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.119+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53401f070 con 0x7fe524098070 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.119+0000 7fe53bd6b640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe534031040 0x7fe534032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.119+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x7fe534031040 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.119+0000 7fe53b56a640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe534031040 0x7fe534032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.119+0000 7fe53b56a640 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe534031040 0x7fe534032940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c510154e0 2024-04-24T01:43:23.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c510154e0 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x7fe534031040 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x7fe534031040 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.120+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x7fe524098070 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53401f070 con 0x7fe524098070 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c5101b730 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c510154e0 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x7fe534031040 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.121+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c510154e0 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x7fe524098070 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe53401f070 con 0x7fe524098070 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c5101b730 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e100 con 0x561c5101b730 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.122+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe534031040 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c5101b730 2024-04-24T01:43:23.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c5101b730 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c510154e0 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c510154e0 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.123+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe534031040 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c5101b730 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe524098070 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53401f070 con 0x7fe524098070 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c510154e0 2024-04-24T01:43:23.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.124+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe524098070 2024-04-24T01:43:23.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53401f070 con 0x7fe524098070 2024-04-24T01:43:23.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c5101b730 2024-04-24T01:43:23.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe534031040 2024-04-24T01:43:23.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe524098070 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53401f070 con 0x7fe524098070 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.125+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c5101b730 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe534031040 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x561c510154e0 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe5240af040 con 0x7fe524098070 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.126+0000 7fe53fe0f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c5101a370 con 0x561c510154e0 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c5101ac10 con 0x561c510154e0 2024-04-24T01:43:23.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c5101ac10 con 0x561c510154e0 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 zone default found 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 4 Realm: () 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 zonegroup default 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c5101e580 con 0x7fe524098070 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.127+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c510207b0 con 0x561c5101b730 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c51020b50 con 0x561c5101b730 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 20 started sync module instance, tier type = 2024-04-24T01:43:23.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.128+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c5101fbf0 con 0x7fe524098070 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.129+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.129+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94679618158912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c5101fbf0 con 0x7fe524098070 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.129+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c510213e0 con 0x561c510154e0 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.130+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94679618158912] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.130+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.130+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94679618162416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c5101fbf0 con 0x561c510154e0 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.130+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51021e30 con 0x561c5101b730 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.131+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94679618162416] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.131+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.132+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94679618156352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c510221d0 con 0x561c5101b730 2024-04-24T01:43:23.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.132+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51022c50 con 0x7fe524098070 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.133+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.133+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94679618168640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c510234f0 con 0x7fe524098070 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.133+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51023ff0 con 0x561c510154e0 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.133+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94679618156352] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.134+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94679618168640] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.134+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.134+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94679618173664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51023040 con 0x561c510154e0 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.134+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51024890 con 0x7fe534031040 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.135+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.135+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94679618175712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51024bb0 con 0x7fe534031040 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.135+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51025440 con 0x7fe534031040 2024-04-24T01:43:23.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.135+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94679618173664] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.136+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94679618175712] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.136+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.136+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94679618165056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51024bf0 con 0x7fe534031040 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.136+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51025ad0 con 0x7fe534031040 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94679618165056] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94679618180640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51025a40 con 0x7fe534031040 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 20 add_watcher() i=0 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 20 add_watcher() i=1 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 20 add_watcher() i=2 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 20 add_watcher() i=3 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 20 add_watcher() i=4 2024-04-24T01:43:23.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 20 add_watcher() i=5 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.137+0000 7fe53fe0f800 20 add_watcher() i=6 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.138+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94679618180640] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.138+0000 7fe53fe0f800 20 add_watcher() i=7 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.138+0000 7fe53fe0f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.138+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c51028f20 con 0x561c510154e0 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.138+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.138+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94679618181696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51026310 con 0x561c510154e0 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.139+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94679618181696] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.139+0000 7fe3f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.139+0000 7fe53fe0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.139+0000 7fe53fe0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.139+0000 7fe53fe0f800 5 note: GC not initialized 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe3f0fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:23.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 20 Filter name: none 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe36a7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c5105c620 con 0x7fe524098070 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 : miss 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.140+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:63 8.1c 8:38174351:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c5105e070 con 0x561c5101b730 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(63 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 info.flags=0x17 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 to cache LRU end 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 20 get_obj_state: octx=0x7fe52c0184d0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x561c51060738 s->prefetch_data=0 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 3.2ds0 3:b4c61ad3:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c51061870 con 0x561c5101b730 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(64 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 10 manifest: total_size = 5 2024-04-24T01:43:23.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.141+0000 7fe53fe0f800 20 get_obj_state: setting s->obj_tag to _M6_ETm9bJGo5Y-5YR-USnL9ow1tW0C- 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.142+0000 7fe3f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.142+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94679618181696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x561c510154e0 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.143+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94679618181696] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.143+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94679618158912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x7fe524098070 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.144+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94679618158912] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.144+0000 7fe53fe0f800 20 remove_watcher() i=0 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.144+0000 7fe53fe0f800 2 removed watcher, disabling cache 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.144+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94679618162416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x561c510154e0 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.145+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94679618162416] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.145+0000 7fe53fe0f800 20 remove_watcher() i=1 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.145+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94679618156352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x561c5101b730 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.146+0000 7fe533fff640 1 -- 172.21.15.131:0/3975316845 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94679618156352] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52409f070 con 0x561c5101b730 2024-04-24T01:43:23.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.146+0000 7fe53fe0f800 20 remove_watcher() i=2 2024-04-24T01:43:23.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.146+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94679618168640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x7fe524098070 2024-04-24T01:43:23.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.147+0000 7fe53bd6b640 1 -- 172.21.15.131:0/3975316845 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94679618168640] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534040040 con 0x7fe524098070 2024-04-24T01:43:23.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.147+0000 7fe53fe0f800 20 remove_watcher() i=3 2024-04-24T01:43:23.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.147+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94679618173664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x561c510154e0 2024-04-24T01:43:23.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.148+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94679618173664] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x561c510154e0 2024-04-24T01:43:23.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.148+0000 7fe53fe0f800 20 remove_watcher() i=4 2024-04-24T01:43:23.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.148+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94679618175712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x7fe534031040 2024-04-24T01:43:23.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.149+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94679618175712] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.149+0000 7fe53fe0f800 20 remove_watcher() i=5 2024-04-24T01:43:23.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.149+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94679618165056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x7fe534031040 2024-04-24T01:43:23.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.150+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94679618165056] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.150+0000 7fe53fe0f800 20 remove_watcher() i=6 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.150+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94679618180640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c51059f70 con 0x7fe534031040 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94679618180640] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c02d070 con 0x7fe534031040 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 20 remove_watcher() i=7 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe534031040 msgr2=0x7fe534032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe534031040 0x7fe534032940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c510154e0 msgr2=0x561c510179a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c510154e0 0x561c510179a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe524098070 msgr2=0x7fe52407c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe524098070 0x7fe52407c860 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561c5101b730 msgr2=0x561c5101db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561c5101b730 0x561c5101db20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4040368b0 msgr2=0x7fe404038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4040368b0 0x7fe404038d70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x561c50fe5160 tx=0x7fe53401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 msgr2=0x561c51009a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3975316845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c51002350 0x561c51009a00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe524080040 tx=0x7fe52408d9d0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 reap_dead start 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53b56a640 1 -- 172.21.15.131:0/3975316845 reap_dead start 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.151+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 shutdown_connections 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 >> 172.21.15.131:0/3975316845 conn(0x561c50ffe6b0 msgr2=0x561c50ffbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 shutdown_connections 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3975316845 wait complete. 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe414036900 msgr2=0x7fe414038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe414036900 0x7fe414038dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x561c50fe59e0 tx=0x7fe534005840 comp rx=0 tx=0).stop 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ff5110 msgr2=0x561c50ff5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ff5110 0x561c50ff5530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe524005930 tx=0x7fe524002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 shutdown_connections 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe414036900 0x7fe414038dc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/3772738981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ff5110 0x561c50ff5530 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 >> 172.21.15.131:0/3772738981 conn(0x561c50fe91b0 msgr2=0x561c50fe95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 shutdown_connections 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/3772738981 wait complete. 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c50ee63e0 msgr2=0x561c50fe3f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c50ee63e0 0x561c50fe3f50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe420036950 msgr2=0x7fe420038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe420036950 0x7fe420038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe524054000 tx=0x7fe52404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 msgr2=0x561c50fdcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50fdcd10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe52c001e60 tx=0x7fe52c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 shutdown_connections 2024-04-24T01:43:23.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561c50ee63e0 0x561c50fe3f50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe420036950 0x7fe420038e10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 --2- 172.21.15.131:0/2002712631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561c50ee28d0 0x561c50fdcd10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 >> 172.21.15.131:0/2002712631 conn(0x561c50edc3a0 msgr2=0x561c50ee10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.152+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 shutdown_connections 2024-04-24T01:43:23.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.153+0000 7fe53fe0f800 1 -- 172.21.15.131:0/2002712631 wait complete. 2024-04-24T01:43:23.169 INFO:teuthology.orchestra.run.smithi131.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-24T01:43:23.169 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-24T01:43:23.171 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-24T01:43:23.189 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:23.291 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-24T01:43:23.291 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-24T01:43:23.291 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:43:23.291 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-24T01:43:23.291 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-24T01:43:23.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-24T01:43:23.292 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-24T01:43:23.336 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:23.337 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7faddc40e800 1 Processor -- start 2024-04-24T01:43:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7faddc40e800 1 -- start start 2024-04-24T01:43:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7faddc40e800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55591697a360 0x555916978820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7faddc40e800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559168c3d40 con 0x555916978d60 2024-04-24T01:43:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7faddc40e800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5559168964d0 con 0x55591697a360 2024-04-24T01:43:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7fadd9f0d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55591697a360 0x555916978820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.338 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7fadd970c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x555916978d60 0x555916a0cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56960/0 (socket says 172.21.15.131:56960) 2024-04-24T01:43:23.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7fadd970c640 1 -- 172.21.15.131:0/2345069482 learned_addr learned my addr 172.21.15.131:0/2345069482 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:23.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2345069482 >> v1:172.21.15.107:6789/0 conn(0x555916978d60 legacy=0x555916a0cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.337+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2345069482 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559168c2590 con 0x55591697a360 2024-04-24T01:43:23.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.339+0000 7fadd9f0d640 1 --2- 172.21.15.131:0/2345069482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55591697a360 0x555916978820 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00a470 tx=0x7fadcc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b44369f29bc1f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.339+0000 7fadd8f0b640 1 -- 172.21.15.131:0/2345069482 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc057070 con 0x55591697a360 2024-04-24T01:43:23.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.339+0000 7fadd8f0b640 1 -- 172.21.15.131:0/2345069482 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc052570 con 0x55591697a360 2024-04-24T01:43:23.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.339+0000 7fadd8f0b640 1 -- 172.21.15.131:0/2345069482 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc052870 con 0x55591697a360 2024-04-24T01:43:23.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.340+0000 7faddc40e800 1 -- 172.21.15.131:0/2345069482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55591697a360 msgr2=0x555916978820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.340+0000 7faddc40e800 1 --2- 172.21.15.131:0/2345069482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55591697a360 0x555916978820 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00a470 tx=0x7fadcc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:23.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.340+0000 7faddc40e800 1 -- 172.21.15.131:0/2345069482 shutdown_connections 2024-04-24T01:43:23.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.340+0000 7faddc40e800 1 --2- 172.21.15.131:0/2345069482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55591697a360 0x555916978820 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.340+0000 7faddc40e800 1 -- 172.21.15.131:0/2345069482 >> 172.21.15.131:0/2345069482 conn(0x555916a004f0 msgr2=0x555916a02910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.340+0000 7faddc40e800 1 -- 172.21.15.131:0/2345069482 shutdown_connections 2024-04-24T01:43:23.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.340+0000 7faddc40e800 1 -- 172.21.15.131:0/2345069482 wait complete. 2024-04-24T01:43:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7faddc40e800 1 Processor -- start 2024-04-24T01:43:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7faddc40e800 1 -- start start 2024-04-24T01:43:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7faddc40e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916af8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7faddc40e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5559169503b0 con 0x555916978d60 2024-04-24T01:43:23.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7fadd9f0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916af8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7fadd9f0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916af8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54108/0 (socket says 172.21.15.131:54108) 2024-04-24T01:43:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7fadd9f0d640 1 -- 172.21.15.131:0/391421507 learned_addr learned my addr 172.21.15.131:0/391421507 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.352+0000 7fadd9f0d640 1 -- 172.21.15.131:0/391421507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555916af8d10 con 0x555916978d60 2024-04-24T01:43:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7fadd9f0d640 1 --2- 172.21.15.131:0/391421507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916af8740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c00 tx=0x7fadcc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ee1cc3918e1925 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7facc7e07640 1 -- 172.21.15.131:0/391421507 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc057070 con 0x555916978d60 2024-04-24T01:43:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7facc7e07640 1 -- 172.21.15.131:0/391421507 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc063070 con 0x555916978d60 2024-04-24T01:43:23.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7facc7e07640 1 -- 172.21.15.131:0/391421507 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc052720 con 0x555916978d60 2024-04-24T01:43:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7faddc40e800 1 -- 172.21.15.131:0/391421507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 msgr2=0x555916af8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7faddc40e800 1 --2- 172.21.15.131:0/391421507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916af8740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c00 tx=0x7fadcc04c000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7faddc40e800 1 -- 172.21.15.131:0/391421507 shutdown_connections 2024-04-24T01:43:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7faddc40e800 1 --2- 172.21.15.131:0/391421507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916af8740 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7faddc40e800 1 -- 172.21.15.131:0/391421507 >> 172.21.15.131:0/391421507 conn(0x555916a004f0 msgr2=0x555916af4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7faddc40e800 1 -- 172.21.15.131:0/391421507 shutdown_connections 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.353+0000 7faddc40e800 1 -- 172.21.15.131:0/391421507 wait complete. 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7faddc40e800 1 Processor -- start 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7faddc40e800 1 -- start start 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7faddc40e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916b001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7faddc40e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555916a10730 con 0x555916978d60 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7fadd9f0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916b001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7fadd9f0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916b001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54124/0 (socket says 172.21.15.131:54124) 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7fadd9f0d640 1 -- 172.21.15.131:0/809963240 learned_addr learned my addr 172.21.15.131:0/809963240 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.354+0000 7fadd9f0d640 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555916b00720 con 0x555916978d60 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.355+0000 7fadd9f0d640 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916b001e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c00 tx=0x7fadcc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.355+0000 7facc6604640 1 -- 172.21.15.131:0/809963240 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc052c70 con 0x555916978d60 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.355+0000 7facc6604640 1 -- 172.21.15.131:0/809963240 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc06c070 con 0x555916978d60 2024-04-24T01:43:23.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.355+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555916b009b0 con 0x555916978d60 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.355+0000 7facc6604640 1 -- 172.21.15.131:0/809963240 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc05e480 con 0x555916978d60 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.355+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555916b03660 con 0x555916978d60 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7facc6604640 1 -- 172.21.15.131:0/809963240 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fadcc06e030 con 0x555916978d60 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7facc6604640 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facc0036950 0x7facc0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7facc6604640 1 -- 172.21.15.131:0/809963240 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fadcc08e280 con 0x555916978d60 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7fadd970c640 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facc0036950 0x7facc0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7faddc40e800 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55591697a360 0x555916b07420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b07960 con 0x55591697a360 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7fadda70e640 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55591697a360 0x555916b07420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7fadd970c640 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facc0036950 0x7facc0038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000f60 tx=0x7fadc40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.356+0000 7fadda70e640 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55591697a360 0x555916b07420 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.357+0000 7fadda70e640 1 -- 172.21.15.131:0/809963240 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadd400a4a0 con 0x55591697a360 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.357+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b049f0 con 0x55591697a360 2024-04-24T01:43:23.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.357+0000 7fadda70e640 1 -- 172.21.15.131:0/809963240 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadd400a4a0 con 0x55591697a360 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.357+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b09780 con 0x55591697a360 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.357+0000 7fadda70e640 1 -- 172.21.15.131:0/809963240 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fadd400a4a0 con 0x55591697a360 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.357+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b08ac0 con 0x55591697a360 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.358+0000 7fadda70e640 1 -- 172.21.15.131:0/809963240 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadd400a4a0 con 0x55591697a360 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.358+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b08ee0 con 0x55591697a360 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.358+0000 7fadda70e640 1 -- 172.21.15.131:0/809963240 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fadd400a4a0 con 0x55591697a360 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.358+0000 7faddc40e800 1 Processor -- start 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.358+0000 7faddc40e800 1 -- start start 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.358+0000 7faddc40e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b18590 0x555916b189b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.358+0000 7faddc40e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5559168f66b0 con 0x555916b18590 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7fadd970c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b18590 0x555916b189b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7fadd970c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b18590 0x555916b189b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54126/0 (socket says 172.21.15.131:54126) 2024-04-24T01:43:23.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7fadd970c640 1 -- 172.21.15.131:0/795169827 learned_addr learned my addr 172.21.15.131:0/795169827 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7fadd970c640 1 -- 172.21.15.131:0/795169827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555916b18ef0 con 0x555916b18590 2024-04-24T01:43:23.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7fadd970c640 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b18590 0x555916b189b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fadc4001ed0 tx=0x7fadc400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7facbf7fe640 1 -- 172.21.15.131:0/795169827 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc401b550 con 0x555916b18590 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7facbf7fe640 1 -- 172.21.15.131:0/795169827 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc401b6f0 con 0x555916b18590 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555916b19960 con 0x555916b18590 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7facbf7fe640 1 -- 172.21.15.131:0/795169827 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc401b9d0 con 0x555916b18590 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.359+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555916b19e60 con 0x555916b18590 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.360+0000 7facbf7fe640 1 -- 172.21.15.131:0/795169827 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fadc4023020 con 0x555916b18590 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.360+0000 7facbf7fe640 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facb4036900 0x7facb4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.360+0000 7facbf7fe640 1 -- 172.21.15.131:0/795169827 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fadc4021020 con 0x555916b18590 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.360+0000 7fadda70e640 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facb4036900 0x7facb4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.360+0000 7faddc40e800 1 Processor -- start 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7faddc40e800 1 -- start start 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7fadda70e640 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facb4036900 0x7facb4038dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555916b08e60 tx=0x7fadd4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7faddc40e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b25cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7faddc40e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555916af8fd0 con 0x555916b258d0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7fadd970c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b25cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7fadd970c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b25cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54136/0 (socket says 172.21.15.131:54136) 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7fadd970c640 1 -- 172.21.15.131:0/3857894028 learned_addr learned my addr 172.21.15.131:0/3857894028 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7fadd970c640 1 -- 172.21.15.131:0/3857894028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555916b262c0 con 0x555916b258d0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7fadd970c640 1 --2- 172.21.15.131:0/3857894028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b25cf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fadc404cec0 tx=0x7fadc40468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21007ea8cb1fcb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7facbd7fa640 1 -- 172.21.15.131:0/3857894028 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc401be20 con 0x555916b258d0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7facbd7fa640 1 -- 172.21.15.131:0/3857894028 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc400c360 con 0x555916b258d0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.361+0000 7facbd7fa640 1 -- 172.21.15.131:0/3857894028 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc4041130 con 0x555916b258d0 2024-04-24T01:43:23.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 -- 172.21.15.131:0/3857894028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 msgr2=0x555916b25cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 --2- 172.21.15.131:0/3857894028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b25cf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fadc404cec0 tx=0x7fadc40468f0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 -- 172.21.15.131:0/3857894028 shutdown_connections 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 --2- 172.21.15.131:0/3857894028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b25cf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 -- 172.21.15.131:0/3857894028 >> 172.21.15.131:0/3857894028 conn(0x555916b21c30 msgr2=0x555916b1fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 -- 172.21.15.131:0/3857894028 shutdown_connections 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 -- 172.21.15.131:0/3857894028 wait complete. 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 Processor -- start 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 -- start start 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b2cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.362+0000 7faddc40e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555916b26a30 con 0x555916b258d0 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7fadd970c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b2cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7fadd970c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b2cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54150/0 (socket says 172.21.15.131:54150) 2024-04-24T01:43:23.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 learned_addr learned my addr 172.21.15.131:0/2144935134 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555916b2d470 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7fadd970c640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b2cf30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fadc404cf20 tx=0x7fadc404ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7facab7fe640 1 -- 172.21.15.131:0/2144935134 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc4034020 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7facab7fe640 1 -- 172.21.15.131:0/2144935134 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc40460d0 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555916b2d700 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7facab7fe640 1 -- 172.21.15.131:0/2144935134 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc40462e0 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.363+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555916b2d700 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.364+0000 7facab7fe640 1 -- 172.21.15.131:0/2144935134 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fadc4037020 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.364+0000 7facab7fe640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faca40368b0 0x7faca4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.364+0000 7facab7fe640 1 -- 172.21.15.131:0/2144935134 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fadc403acf0 con 0x555916b258d0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.364+0000 7fadda70e640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faca40368b0 0x7faca4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.364+0000 7fadda70e640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faca40368b0 0x7faca4038d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555916b085e0 tx=0x7fadd401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.364+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555916b38820 0x555916b3ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b3b430 con 0x555916b38820 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7fadd9f0d640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555916b38820 0x555916b3ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7fadd9f0d640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555916b38820 0x555916b3ace0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 20 realm 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b3b840 con 0x555916b38820 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.365+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b3c110 con 0x555916b38820 2024-04-24T01:43:23.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b3c4b0 con 0x555916b38820 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b3cd00 con 0x555916b38820 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 20 searching for the correct realm 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555916b3ea70 0x555916b40e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.366+0000 7fadd970c640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555916b3ea70 0x555916b40e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.367+0000 7fadd970c640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555916b3ea70 0x555916b40e60 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.367+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.367+0000 7fadd970c640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fadc4039020 0x7fadc4015670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.367+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadc4039020 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.367+0000 7fadda70e640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fadc4039020 0x7fadc4015670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.367+0000 7fadda70e640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fadc4039020 0x7fadc4015670 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.367+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd401f070 con 0x7fadc4039020 2024-04-24T01:43:23.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.368+0000 7fadda70e640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fadd4031040 0x7fadd4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.368+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.368+0000 7fadd9f0d640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fadd4031040 0x7fadd4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.368+0000 7fadd9f0d640 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fadd4031040 0x7fadd4032940 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.368+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.368+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.369+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadc4039020 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd401f070 con 0x7fadc4039020 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.370+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadc4039020 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fadd401f070 con 0x7fadc4039020 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.371+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.372+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadc4039020 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd401f070 con 0x7fadc4039020 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.373+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadc4039020 2024-04-24T01:43:23.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.374+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd401f070 con 0x7fadc4039020 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.374+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.374+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.374+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.374+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.374+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadc4039020 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.375+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd401f070 con 0x7fadc4039020 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.375+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b3ea70 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.375+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.375+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadd4031040 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.375+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.375+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x555916b38820 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555916b41470 con 0x7fadc4039020 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b3d650 con 0x555916b38820 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b3def0 con 0x555916b38820 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.376+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b418f0 con 0x555916b38820 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 zone default found 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 4 Realm: () 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 zonegroup default 2024-04-24T01:43:23.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b418f0 con 0x7fadc4039020 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b43ba0 con 0x555916b3ea70 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b43f40 con 0x555916b3ea70 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 started sync module instance, tier type = 2024-04-24T01:43:23.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.377+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b43030 con 0x7fadc4039020 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.378+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.378+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93841121359200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b43030 con 0x7fadc4039020 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.378+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b44950 con 0x555916b38820 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.379+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93841121359200] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.380+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.380+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93841121363616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b43030 con 0x555916b38820 2024-04-24T01:43:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.380+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b45360 con 0x555916b3ea70 2024-04-24T01:43:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.381+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93841121363616] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.381+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.381+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93841121356672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b42fa0 con 0x555916b3ea70 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.381+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b46250 con 0x7fadc4039020 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.382+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93841121356672] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.382+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.382+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93841121369504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b46670 con 0x7fadc4039020 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.382+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b47030 con 0x555916b38820 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.383+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93841121369504] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.383+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.383+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93841121371040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b47030 con 0x555916b38820 2024-04-24T01:43:23.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.384+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b479f0 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.384+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93841121371040] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.385+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.385+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93841121376032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b47030 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.385+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b48430 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.386+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.386+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93841121378176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b48850 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.386+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b49370 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.386+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93841121376032] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93841121378176] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93841121381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b483a0 con 0x7fadd4031040 2024-04-24T01:43:23.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 20 add_watcher() i=0 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 20 add_watcher() i=1 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 20 add_watcher() i=2 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 20 add_watcher() i=3 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 20 add_watcher() i=4 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 20 add_watcher() i=5 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.387+0000 7faddc40e800 20 add_watcher() i=6 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.388+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93841121381952] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.388+0000 7faddc40e800 20 add_watcher() i=7 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.388+0000 7faddc40e800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.388+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b4c470 con 0x555916b38820 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.388+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.388+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93841121373056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b498f0 con 0x555916b38820 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.389+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93841121373056] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.389+0000 7fac8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.389+0000 7faddc40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.389+0000 7faddc40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.390+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b54bd0 con 0x555916b38820 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.391+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.391+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b552a0 con 0x7fadd4031040 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.392+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.392+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b552a0 con 0x555916b3ea70 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.393+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.393+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b55640 con 0x555916b38820 2024-04-24T01:43:23.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.394+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'189 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.394+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b55750 con 0x7fadc4039020 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.395+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.395+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b55e00 con 0x555916b3ea70 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.396+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.396+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b561a0 con 0x555916b38820 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.398+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.398+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b561a0 con 0x7fadd4031040 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.399+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.399+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b561a0 con 0x7fadc4039020 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.400+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.400+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b56710 con 0x555916b3ea70 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.400+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.401+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b56710 con 0x7fadc4039020 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.401+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'70 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.401+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b56c80 con 0x7fadd4031040 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.403+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.403+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b56c80 con 0x7fadc4039020 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.403+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.403+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x7fadd4031040 2024-04-24T01:43:23.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.405+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.405+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b38820 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.406+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'190 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.406+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.407+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.407+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x7fadc4039020 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.408+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'71 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.408+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.409+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.409+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b38820 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.410+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.410+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b38820 2024-04-24T01:43:23.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.411+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'191 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.411+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.412+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.412+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x7fadc4039020 2024-04-24T01:43:23.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.413+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.413+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.414+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.414+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.415+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'44 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.415+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.416+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.416+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.417+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.417+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x7fadd4031040 2024-04-24T01:43:23.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.418+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.418+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.419+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.419+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x7fadd4031040 2024-04-24T01:43:23.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.420+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.420+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x555916b3ea70 2024-04-24T01:43:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.421+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.421+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x7fadd4031040 2024-04-24T01:43:23.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.422+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'62 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.422+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b57130 con 0x7fadc4039020 2024-04-24T01:43:23.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.423+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.423+0000 7fac8a7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.423+0000 7faddc40e800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.423+0000 7faddc40e800 20 Filter name: none 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.423+0000 7fabfffff640 20 reqs_thread_entry: start 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.423+0000 7faddc40e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.423+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b81fa0 con 0x7fadc4039020 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:43:23.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 : miss 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:95 8.1c 8:38174351:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b839d0 con 0x555916b3ea70 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(95 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 info.flags=0x17 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 to cache LRU end 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:43:23.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.424+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:96 4.1e 4:7bb72c04:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01200 con 0x7fadd4031040 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.425+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(96 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.425+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:97 4.19 4:984dcab5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01200 con 0x7fadc4039020 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.425+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(97 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.425+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 4.2a 4:54beece1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01200 con 0x555916b38820 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.426+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(98 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.426+0000 7faddc40e800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.426+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:99 4.b 4:d271c808:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01270 con 0x7fadc4039020 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.426+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(99 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.426+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 4.9 4:93210315:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01710 con 0x555916b38820 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.426+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(100 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.426+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 4.2d 4:b40c97b1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01710 con 0x7fadd4031040 2024-04-24T01:43:23.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.427+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(101 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.427+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 4.21 4:867fad95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01710 con 0x7fadd4031040 2024-04-24T01:43:23.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.427+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(102 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.427+0000 7faddc40e800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.427+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 4.35 4:aebd8718:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01710 con 0x555916b38820 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(103 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:104 4.20 4:0752d7bb:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01710 con 0x555916b38820 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(104 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7faddc40e800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:105 4.1f 4:fb246c95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01730 con 0x7fadc4039020 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(105 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:106 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c01730 con 0x7fadc4039020 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(106 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [call out=698b] v0'0 uv9 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7faddc40e800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7faddc40e800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:43:23.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.428+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:107 3.12s0 3:4ad65d5d:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bfed60 con 0x7fadc4039020 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(107 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7faddc40e800 10 manifest: total_size = 6 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7faddc40e800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.17164556119565324760 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7faddc40e800 20 prepare_atomic_modification: state is not atomic. state=0x555916c00868 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7faddc40e800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.429+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:108 4.2a 4:54beece1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b88f10 con 0x555916b38820 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.430+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(108 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.430+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:109 3.12s0 3:4ad65d5d:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b88f10 con 0x7fadc4039020 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.431+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(109 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_9c8454ddf7aa50116496bac348d7550d [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fadd4040040 con 0x7fadc4039020 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.431+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:110 4.2a 4:54beece1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b899a0 con 0x555916b38820 2024-04-24T01:43:23.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.431+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.431+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 3.4s0 3:23b7a6f9:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bff460 con 0x7fadd4031040 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.432+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(111 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.432+0000 7faddc40e800 10 manifest: total_size = 3 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.432+0000 7faddc40e800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11603255221282675635 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.432+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.432+0000 7faddc40e800 20 prepare_atomic_modification: state is not atomic. state=0x555916c00868 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.432+0000 7faddc40e800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.432+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:112 4.21 4:867fad95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b899a0 con 0x7fadd4031040 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.433+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(110 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.433+0000 7facbd7fa640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-24T01:43:23.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.433+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(112 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.433+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:113 3.4s0 3:23b7a6f9:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b899a0 con 0x7fadd4031040 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.434+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(113 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.434+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:114 4.21 4:867fad95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b89920 con 0x7fadd4031040 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.434+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.434+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:115 3.25s0 3:a6d48e69:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b89920 con 0x555916b38820 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.435+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(115 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.435+0000 7faddc40e800 10 manifest: total_size = 4 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.435+0000 7faddc40e800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.1220679340655925139 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.435+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.435+0000 7faddc40e800 20 prepare_atomic_modification: state is not atomic. state=0x555916c00868 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.435+0000 7faddc40e800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.435+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:116 4.20 4:0752d7bb:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b89920 con 0x555916b38820 2024-04-24T01:43:23.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.436+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(114 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.436+0000 7facbcff9640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.436+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(116 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.436+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:117 3.25s0 3:a6d48e69:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b89920 con 0x555916b38820 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.437+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(117 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.437+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:118 4.20 4:0752d7bb:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b8a9e0 con 0x555916b38820 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.437+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.437+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:119 3.as0 3:5238ef1f:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b8af90 con 0x555916b3ea70 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(119 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7faddc40e800 10 manifest: total_size = 5 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7faddc40e800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.17700083429351303671 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7faddc40e800 20 prepare_atomic_modification: state is not atomic. state=0x555916c00868 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7faddc40e800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:120 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b8f3d0 con 0x7fadc4039020 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(118 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.438+0000 7facbd7fa640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.439+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(120 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.439+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:121 3.as0 3:5238ef1f:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b8a160 con 0x555916b3ea70 2024-04-24T01:43:23.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.440+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(121 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.440+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:122 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b8b390 con 0x7fadc4039020 2024-04-24T01:43:23.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.440+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.440+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:123 3.2ds0 3:b4c61ad3:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b8c040 con 0x555916b3ea70 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.441+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(123 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.441+0000 7faddc40e800 10 manifest: total_size = 5 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.441+0000 7faddc40e800 20 get_obj_state: setting s->obj_tag to _M6_ETm9bJGo5Y-5YR-USnL9ow1tW0C- 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.441+0000 7faddc40e800 20 get_obj_state: octx=0x7fadcc05ee70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555916c00868 s->prefetch_data=0 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.441+0000 7faddc40e800 20 prepare_atomic_modification: state is not atomic. state=0x555916c00868 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.441+0000 7faddc40e800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.441+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:124 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b8f070 con 0x7fadc4039020 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.442+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(122 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.442+0000 7facbcff9640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.442+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(124 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.442+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:125 3.2ds0 3:b4c61ad3:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b868a0 con 0x555916b3ea70 2024-04-24T01:43:23.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(125 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:126 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916b8c040 con 0x7fadc4039020 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:127 4.1e 4:7bb72c04:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b8c040 con 0x7fadd4031040 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:128 4.19 4:984dcab5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c00b30 con 0x7fadc4039020 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:129 4.2a 4:54beece1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b8c040 con 0x555916b38820 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:130 4.b 4:d271c808:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b8f030 con 0x7fadc4039020 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:131 4.9 4:93210315:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b98290 con 0x555916b38820 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:132 4.2d 4:b40c97b1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b9ad60 con 0x7fadd4031040 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:133 4.21 4:867fad95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b9d670 con 0x7fadd4031040 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.443+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:134 4.35 4:aebd8718:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916ba0430 con 0x555916b38820 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(128 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== osd_op_reply(130 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:135 4.20 4:0752d7bb:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916ba0870 con 0x555916b38820 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:136 4.1f 4:fb246c95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916ba11e0 con 0x7fadc4039020 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:137 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916ba3b00 con 0x7fadc4039020 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(136 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(127 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(129 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.444+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(131 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(134 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(135 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== osd_op_reply(126 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(132 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7facbd7fa640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(133 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(137 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5])"; uploads.size()=0; is_truncated=0 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:138 4.1e 4:7bb72c04:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:139 4.19 4:984dcab5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c00680 con 0x7fadc4039020 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:140 4.2a 4:54beece1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x555916b38820 2024-04-24T01:43:23.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:141 4.b 4:d271c808:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c00680 con 0x7fadc4039020 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:142 4.9 4:93210315:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x555916b38820 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:143 4.2d 4:b40c97b1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c00680 con 0x7fadd4031040 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:144 4.21 4:867fad95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:145 4.35 4:aebd8718:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916c00680 con 0x555916b38820 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:146 4.20 4:0752d7bb:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916ba0760 con 0x555916b38820 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:147 4.1f 4:fb246c95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916b94ee0 con 0x7fadc4039020 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:148 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916ba4020 con 0x7fadc4039020 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(138 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(143 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(144 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.445+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(140 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== osd_op_reply(139 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 36 ==== osd_op_reply(141 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(145 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(142 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(146 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 37 ==== osd_op_reply(147 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 38 ==== osd_op_reply(148 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.446+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadc4039020 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.447+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 39 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.447+0000 7faddc40e800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.447+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadc4039020 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 40 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7faddc40e800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7faddc40e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:43:23.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93841122133632 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== watch-notify(notify (1) cookie 93841121378176 notify 146028888087 ret 0) ==== 191+0+0 (crc 0 0 0) 0x555916b56710 con 0x7fadd4031040 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7facbcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 93841121378176 notifier 4646 bl.length()=149 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7facbcff9640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fac0c0032c0 con 0x7fadd4031040 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== osd_op_reply(151 notify.6 [notify cookie 93841122133632 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.448+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.449+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== watch-notify(notify_complete (2) cookie 93841122133632 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555916b533f0 con 0x7fadd4031040 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.449+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:153 8.1c 8:38174351:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x555916b3ea70 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(153 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 from cache 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5, ofs0, ns] 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 93841121755168 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== watch-notify(notify (1) cookie 93841121376032 notify 146028888088 ret 0) ==== 248+0+0 (crc 0 0 0) 0x555916b533f0 con 0x7fadd4031040 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7facbd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 93841121376032 notifier 4646 bl.length()=206 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7facbd7fa640 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fac9c003d60 con 0x7fadd4031040 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(154 notify.5 [notify cookie 93841121755168 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== watch-notify(notify_complete (2) cookie 93841121755168 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555916b03660 con 0x7fadd4031040 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:156 4.1e 4:7bb72c04:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:157 4.19 4:984dcab5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916ba4020 con 0x7fadc4039020 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:158 4.2a 4:54beece1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916c00680 con 0x555916b38820 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:159 4.b 4:d271c808:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadc4039020 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:160 4.9 4:93210315:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916ba0170 con 0x555916b38820 2024-04-24T01:43:23.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:161 4.2d 4:b40c97b1:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916ba4020 con 0x7fadd4031040 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:162 4.21 4:867fad95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:163 4.35 4:aebd8718:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916ba0170 con 0x555916b38820 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:164 4.20 4:0752d7bb:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916ba4020 con 0x555916b38820 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:165 4.1f 4:fb246c95:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadc4039020 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.450+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:166 4.a 4:53fa476a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916ba0170 con 0x7fadc4039020 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.452+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 41 ==== osd_op_reply(159 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.452+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 42 ==== osd_op_reply(157 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.452+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== osd_op_reply(156 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.0 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.452+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 43 ==== osd_op_reply(165 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.9 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.452+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 47 ==== osd_op_reply(160 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.452+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 48 ==== osd_op_reply(163 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.7 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.452+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 49 ==== osd_op_reply(158 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.2 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 44 ==== osd_op_reply(166 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.10 [delete] v34'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 50 ==== osd_op_reply(164 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.8 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== osd_op_reply(162 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.6 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(161 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5.5 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7faddc40e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 : miss 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7faddc40e800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:167 6.e 6:7550814a:::pubsub..bucket.myfoo%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555916ba4020 con 0x555916b38820 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.454+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 51 ==== osd_op_reply(167 pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.455+0000 7faddc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.455+0000 7faddc40e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 info.flags=0x0 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.455+0000 7faddc40e800 10 adding default.rgw.log++pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 to cache LRU end 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.455+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:168 6.e 6:7550814a:::pubsub..bucket.myfoo%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x555916b38820 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.456+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 52 ==== osd_op_reply(168 pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.5 [delete] v34'33 uv29 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.456+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916c00ce0 con 0x7fadc4039020 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.457+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 45 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.457+0000 7fac8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.457+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93841121373056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x555916b38820 2024-04-24T01:43:23.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.458+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 53 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93841121373056] v34'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.458+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93841121359200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916c00ce0 con 0x7fadc4039020 2024-04-24T01:43:23.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.459+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 46 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93841121359200] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.459+0000 7faddc40e800 20 remove_watcher() i=0 2024-04-24T01:43:23.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.459+0000 7faddc40e800 2 removed watcher, disabling cache 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.459+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93841121363616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x555916b38820 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.460+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 54 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93841121363616] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.460+0000 7faddc40e800 20 remove_watcher() i=1 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.460+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93841121356672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916c00ce0 con 0x555916b3ea70 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.461+0000 7fadd970c640 1 -- 172.21.15.131:0/2144935134 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93841121356672] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadc4009050 con 0x555916b3ea70 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.461+0000 7faddc40e800 20 remove_watcher() i=2 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.461+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93841121369504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadc4039020 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.462+0000 7fadda70e640 1 -- 172.21.15.131:0/2144935134 <== osd.2 v2:172.21.15.131:6809/3673094383 47 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93841121369504] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadd404e040 con 0x7fadc4039020 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.462+0000 7faddc40e800 20 remove_watcher() i=3 2024-04-24T01:43:23.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.462+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93841121371040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916c00ce0 con 0x555916b38820 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.463+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.1 v2:172.21.15.131:6808/2417718615 55 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93841121371040] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x555916b38820 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.463+0000 7faddc40e800 20 remove_watcher() i=4 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.464+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93841121376032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.464+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 46 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93841121376032] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.464+0000 7faddc40e800 20 remove_watcher() i=5 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.464+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93841121378176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916c00ce0 con 0x7fadd4031040 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.465+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 47 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93841121378176] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.465+0000 7faddc40e800 20 remove_watcher() i=6 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.465+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93841121381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555916bfef50 con 0x7fadd4031040 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.466+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 <== osd.0 v2:172.21.15.107:6800/2413654117 48 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93841121381952] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadcc070410 con 0x7fadd4031040 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.466+0000 7faddc40e800 20 remove_watcher() i=7 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fadd4031040 msgr2=0x7fadd4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fadd4031040 0x7fadd4032940 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555916b38820 msgr2=0x555916b3ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555916b38820 0x555916b3ace0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fadc4039020 msgr2=0x7fadc4015670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fadc4039020 0x7fadc4015670 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555916b3ea70 msgr2=0x555916b40e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555916b3ea70 0x555916b40e60 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faca40368b0 msgr2=0x7faca4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faca40368b0 0x7faca4038d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555916b085e0 tx=0x7fadd401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 msgr2=0x555916b2cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/2144935134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b258d0 0x555916b2cf30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fadc404cf20 tx=0x7fadc404ce20 comp rx=0 tx=0).stop 2024-04-24T01:43:23.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 reap_dead start 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7fadd9f0d640 1 -- 172.21.15.131:0/2144935134 reap_dead start 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 shutdown_connections 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 >> 172.21.15.131:0/2144935134 conn(0x555916b21c30 msgr2=0x555916b1f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 shutdown_connections 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/2144935134 wait complete. 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facb4036900 msgr2=0x7facb4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facb4036900 0x7facb4038dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555916b08e60 tx=0x7fadd4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b18590 msgr2=0x555916b189b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b18590 0x555916b189b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fadc4001ed0 tx=0x7fadc400d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 shutdown_connections 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facb4036900 0x7facb4038dc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 --2- 172.21.15.131:0/795169827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916b18590 0x555916b189b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 >> 172.21.15.131:0/795169827 conn(0x555916b0c630 msgr2=0x555916b0ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 shutdown_connections 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.467+0000 7faddc40e800 1 -- 172.21.15.131:0/795169827 wait complete. 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55591697a360 msgr2=0x555916b07420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55591697a360 0x555916b07420 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facc0036950 msgr2=0x7facc0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facc0036950 0x7facc0038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000f60 tx=0x7fadc40012b0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 msgr2=0x555916b001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916b001e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c00 tx=0x7fadcc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 shutdown_connections 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55591697a360 0x555916b07420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7facc0036950 0x7facc0038e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 --2- 172.21.15.131:0/809963240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555916978d60 0x555916b001e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 >> 172.21.15.131:0/809963240 conn(0x555916a004f0 msgr2=0x555916af2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 shutdown_connections 2024-04-24T01:43:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.468+0000 7faddc40e800 1 -- 172.21.15.131:0/809963240 wait complete. 2024-04-24T01:43:23.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:43:23.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:43:23.482 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-24T01:43:23.527 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:23.527 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:23.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.527+0000 7fe9d9c10800 1 Processor -- start 2024-04-24T01:43:23.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9d9c10800 1 -- start start 2024-04-24T01:43:23.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9d9c10800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5631c6d01990 0x5631c6d03d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9d9c10800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631c6bbfd40 con 0x5631c6d042c0 2024-04-24T01:43:23.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9d9c10800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5631c6b924d0 con 0x5631c6d01990 2024-04-24T01:43:23.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9d53b9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5631c6d01990 0x5631c6d03d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9cffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5631c6d042c0 0x5631c6d066b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56968/0 (socket says 172.21.15.131:56968) 2024-04-24T01:43:23.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9cffff640 1 -- 172.21.15.131:0/192411271 learned_addr learned my addr 172.21.15.131:0/192411271 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:23.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9d4bb8640 1 -- 172.21.15.131:0/192411271 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361580351 0 0) 0x5631c6bbfd40 con 0x5631c6d042c0 2024-04-24T01:43:23.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.528+0000 7fe9d4bb8640 1 -- 172.21.15.131:0/192411271 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9c4001e10 con 0x5631c6d042c0 2024-04-24T01:43:23.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.529+0000 7fe9d53b9640 1 -- 172.21.15.131:0/192411271 >> v1:172.21.15.107:6789/0 conn(0x5631c6d042c0 legacy=0x5631c6d066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.529+0000 7fe9d53b9640 1 -- 172.21.15.131:0/192411271 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6bbe590 con 0x5631c6d01990 2024-04-24T01:43:23.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.530+0000 7fe9d53b9640 1 --2- 172.21.15.131:0/192411271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d03d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800a470 tx=0x7fe9c801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0f755c458809bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.530+0000 7fe9d4bb8640 1 -- 172.21.15.131:0/192411271 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c8057070 con 0x5631c6d01990 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.530+0000 7fe9d4bb8640 1 -- 172.21.15.131:0/192411271 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c8052570 con 0x5631c6d01990 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d4bb8640 1 -- 172.21.15.131:0/192411271 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c8052870 con 0x5631c6d01990 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d9c10800 1 -- 172.21.15.131:0/192411271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 msgr2=0x5631c6d03d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/192411271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d03d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800a470 tx=0x7fe9c801cdb0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d9c10800 1 -- 172.21.15.131:0/192411271 shutdown_connections 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/192411271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d03d80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d9c10800 1 -- 172.21.15.131:0/192411271 >> 172.21.15.131:0/192411271 conn(0x5631c6cfb340 msgr2=0x5631c6cfd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d9c10800 1 -- 172.21.15.131:0/192411271 shutdown_connections 2024-04-24T01:43:23.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.531+0000 7fe9d9c10800 1 -- 172.21.15.131:0/192411271 wait complete. 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d9c10800 1 Processor -- start 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d9c10800 1 -- start start 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d9c10800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6df1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d9c10800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5631c6c4c3b0 con 0x5631c6d01990 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d53b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6df1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d53b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6df1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54164/0 (socket says 172.21.15.131:54164) 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1361070949 learned_addr learned my addr 172.21.15.131:0/1361070949 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.543+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1361070949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6df24f0 con 0x5631c6d01990 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe9d53b9640 1 --2- 172.21.15.131:0/1361070949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6df1f20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8055040 tx=0x7fe9c804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156a9ea9c00332c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe8c3606640 1 -- 172.21.15.131:0/1361070949 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c8057070 con 0x5631c6d01990 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe8c3606640 1 -- 172.21.15.131:0/1361070949 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c8063070 con 0x5631c6d01990 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe8c3606640 1 -- 172.21.15.131:0/1361070949 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c8052720 con 0x5631c6d01990 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1361070949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 msgr2=0x5631c6df1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1361070949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6df1f20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8055040 tx=0x7fe9c804c000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1361070949 shutdown_connections 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1361070949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6df1f20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.544+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1361070949 >> 172.21.15.131:0/1361070949 conn(0x5631c6cfb340 msgr2=0x5631c6ded840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1361070949 shutdown_connections 2024-04-24T01:43:23.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1361070949 wait complete. 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d9c10800 1 Processor -- start 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d9c10800 1 -- start start 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d9c10800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d9c10800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5631c6d0a0e0 con 0x5631c6d01990 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d53b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d53b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54172/0 (socket says 172.21.15.131:54172) 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.545+0000 7fe9d53b9640 1 -- 172.21.15.131:0/3468969517 learned_addr learned my addr 172.21.15.131:0/3468969517 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.546+0000 7fe9d53b9640 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6cff9c0 con 0x5631c6d01990 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.546+0000 7fe9d53b9640 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d012d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8060040 tx=0x7fe9c8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.546+0000 7fe8c1e03640 1 -- 172.21.15.131:0/3468969517 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c8052e30 con 0x5631c6d01990 2024-04-24T01:43:23.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.546+0000 7fe8c1e03640 1 -- 172.21.15.131:0/3468969517 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c806c070 con 0x5631c6d01990 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.546+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631c6cffc50 con 0x5631c6d01990 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.546+0000 7fe8c1e03640 1 -- 172.21.15.131:0/3468969517 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c805e5f0 con 0x5631c6d01990 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.546+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c6d00170 con 0x5631c6d01990 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe8c1e03640 1 -- 172.21.15.131:0/3468969517 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe9c805e790 con 0x5631c6d01990 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe8c1e03640 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8bc036900 0x7fe8bc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe8c1e03640 1 -- 172.21.15.131:0/3468969517 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe9c808e9c0 con 0x5631c6d01990 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe9cffff640 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8bc036900 0x7fe8bc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6d042c0 0x5631c6e02dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e03390 con 0x5631c6d042c0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6d042c0 0x5631c6e02dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe9cffff640 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8bc036900 0x7fe8bc038dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c00010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.547+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6d042c0 0x5631c6e02dc0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d5bba640 1 -- 172.21.15.131:0/3468969517 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9d000a4a0 con 0x5631c6d042c0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e03ca0 con 0x5631c6d042c0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d5bba640 1 -- 172.21.15.131:0/3468969517 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9d000a4a0 con 0x5631c6d042c0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e05050 con 0x5631c6d042c0 2024-04-24T01:43:23.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d5bba640 1 -- 172.21.15.131:0/3468969517 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9d000a4a0 con 0x5631c6d042c0 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e044f0 con 0x5631c6d042c0 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d5bba640 1 -- 172.21.15.131:0/3468969517 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9d000a4a0 con 0x5631c6d042c0 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.548+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e04910 con 0x5631c6d042c0 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9d5bba640 1 -- 172.21.15.131:0/3468969517 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe9d000a4a0 con 0x5631c6d042c0 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9d9c10800 1 Processor -- start 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9d9c10800 1 -- start start 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9d9c10800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e14130 0x5631c6e14550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9d9c10800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5631c6d01810 con 0x5631c6e14130 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e14130 0x5631c6e14550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e14130 0x5631c6e14550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54174/0 (socket says 172.21.15.131:54174) 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.549+0000 7fe9cffff640 1 -- 172.21.15.131:0/2670297050 learned_addr learned my addr 172.21.15.131:0/2670297050 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.550+0000 7fe9cffff640 1 -- 172.21.15.131:0/2670297050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6e14a90 con 0x5631c6e14130 2024-04-24T01:43:23.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.550+0000 7fe9cffff640 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e14130 0x5631c6e14550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000bec0 tx=0x7fe9c000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.550+0000 7fe8baffd640 1 -- 172.21.15.131:0/2670297050 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c001b550 con 0x5631c6e14130 2024-04-24T01:43:23.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.550+0000 7fe8baffd640 1 -- 172.21.15.131:0/2670297050 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c001b6f0 con 0x5631c6e14130 2024-04-24T01:43:23.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.550+0000 7fe8baffd640 1 -- 172.21.15.131:0/2670297050 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c001ba10 con 0x5631c6e14130 2024-04-24T01:43:23.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.550+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631c6e15500 con 0x5631c6e14130 2024-04-24T01:43:23.577 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.550+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c6e15a00 con 0x5631c6e14130 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe8baffd640 1 -- 172.21.15.131:0/2670297050 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe9c0023020 con 0x5631c6e14130 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe8baffd640 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8ac036900 0x7fe8ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe8baffd640 1 -- 172.21.15.131:0/2670297050 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe9c0021020 con 0x5631c6e14130 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8ac036900 0x7fe8ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe9d9c10800 1 Processor -- start 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8ac036900 0x7fe8ac038dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5631c6e04890 tx=0x7fe9d0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe9d9c10800 1 -- start start 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe9d9c10800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e21890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.551+0000 7fe9d9c10800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5631c6bf26b0 con 0x5631c6e21470 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e21890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e21890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54186/0 (socket says 172.21.15.131:54186) 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe9cffff640 1 -- 172.21.15.131:0/1191597413 learned_addr learned my addr 172.21.15.131:0/1191597413 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe9cffff640 1 -- 172.21.15.131:0/1191597413 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6e21e60 con 0x5631c6e21470 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe9cffff640 1 --2- 172.21.15.131:0/1191597413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e21890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c010 tx=0x7fe9c0041050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f997500613b405e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe8b8ff9640 1 -- 172.21.15.131:0/1191597413 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c0025410 con 0x5631c6e21470 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe8b8ff9640 1 -- 172.21.15.131:0/1191597413 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c0019320 con 0x5631c6e21470 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.552+0000 7fe8b8ff9640 1 -- 172.21.15.131:0/1191597413 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c00255b0 con 0x5631c6e21470 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1191597413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 msgr2=0x5631c6e21890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1191597413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e21890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c010 tx=0x7fe9c0041050 comp rx=0 tx=0).stop 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1191597413 shutdown_connections 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1191597413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e21890 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1191597413 >> 172.21.15.131:0/1191597413 conn(0x5631c6e1d7d0 msgr2=0x5631c6e1b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1191597413 shutdown_connections 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1191597413 wait complete. 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 Processor -- start 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 -- start start 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e28910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9d9c10800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5631c6e223f0 con 0x5631c6e21470 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e28910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9cffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e28910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54202/0 (socket says 172.21.15.131:54202) 2024-04-24T01:43:23.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 learned_addr learned my addr 172.21.15.131:0/1428983799 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.553+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c6e28e50 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.554+0000 7fe9cffff640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e28910 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000dcf0 tx=0x7fe9c004cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.554+0000 7fe8aaffd640 1 -- 172.21.15.131:0/1428983799 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c0019bb0 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.554+0000 7fe8aaffd640 1 -- 172.21.15.131:0/1428983799 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c004e460 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.554+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631c6e290e0 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.554+0000 7fe8aaffd640 1 -- 172.21.15.131:0/1428983799 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c004e740 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.554+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c6e290e0 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.554+0000 7fe8aaffd640 1 -- 172.21.15.131:0/1428983799 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe9c000c360 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe8aaffd640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8a0036950 0x7fe8a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe8aaffd640 1 -- 172.21.15.131:0/1428983799 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe9c003ad30 con 0x5631c6e21470 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8a0036950 0x7fe8a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8a0036950 0x7fe8a0038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5631c6d00730 tx=0x7fe9d001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6e34220 0x5631c6e366e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e36e30 con 0x5631c6e34220 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.555+0000 7fe9d53b9640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6e34220 0x5631c6e366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d53b9640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6e34220 0x5631c6e366e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 realm 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e37240 con 0x5631c6e34220 2024-04-24T01:43:23.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e37b10 con 0x5631c6e34220 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e37eb0 con 0x5631c6e34220 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.556+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9d9c10800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9d9c10800 20 searching for the correct realm 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5631c6e3a470 0x5631c6e3c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3ce90 con 0x5631c6e3a470 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9cffff640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5631c6e3a470 0x5631c6e3c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9cffff640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5631c6e3a470 0x5631c6e3c860 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9cffff640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe9c004ec20 0x7fe9c000c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.557+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3ce90 con 0x7fe9c004ec20 2024-04-24T01:43:23.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.558+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe9c004ec20 0x7fe9c000c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.558+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe9c004ec20 0x7fe9c000c650 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.558+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9d001f070 con 0x7fe9c004ec20 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.558+0000 7fe9d5bba640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe9d0031040 0x7fe9d0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.558+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3ce90 con 0x7fe9d0031040 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.558+0000 7fe9d53b9640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe9d0031040 0x7fe9d0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.559+0000 7fe9d53b9640 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe9d0031040 0x7fe9d0032430 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.559+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x7fe9d0031040 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.559+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.559+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.559+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.559+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.559+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9d0031040 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x7fe9d0031040 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9d0031040 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x7fe9d0031040 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9c004ec20 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9d001f070 con 0x7fe9c004ec20 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.560+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9d0031040 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x7fe9d0031040 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9c004ec20 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe9d001f070 con 0x7fe9c004ec20 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.561+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9d0031040 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8071990 con 0x7fe9d0031040 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.562+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe9c8071990 con 0x5631c6e34220 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9d0031040 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.563+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9c004ec20 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9d001f070 con 0x7fe9c004ec20 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9c004ec20 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9d001f070 con 0x7fe9c004ec20 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.564+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9d0031040 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.565+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.565+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9c004ec20 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.565+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9d001f070 con 0x7fe9c004ec20 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.565+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e3a470 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.566+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.566+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9d0031040 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.566+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.566+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x5631c6e34220 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.566+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.566+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38700 con 0x7fe9c004ec20 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.566+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e38f50 con 0x5631c6e34220 2024-04-24T01:43:23.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e39340 con 0x5631c6e34220 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e39340 con 0x5631c6e34220 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 zone default found 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 4 Realm: () 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:23.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 zonegroup default 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3d2f0 con 0x7fe9c004ec20 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.567+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3f070 con 0x5631c6e3a470 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9d9c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3f410 con 0x5631c6e3a470 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9d9c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9d9c10800 20 started sync module instance, tier type = 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9d9c10800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.568+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3e510 con 0x7fe9c004ec20 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.569+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.569+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94771790211648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3e510 con 0x7fe9c004ec20 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.569+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3fca0 con 0x5631c6e34220 2024-04-24T01:43:23.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.570+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94771790211648] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.570+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.570+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94771790215088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3e510 con 0x5631c6e34220 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.570+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e40730 con 0x5631c6e3a470 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.571+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94771790215088] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.571+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.571+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94771790209120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3e480 con 0x5631c6e3a470 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.571+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e415f0 con 0x7fe9c004ec20 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.572+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94771790209120] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.572+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.572+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94771790221632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e41a10 con 0x7fe9c004ec20 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.573+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e423d0 con 0x5631c6e34220 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.574+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94771790221632] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.574+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.574+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94771790223168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e423d0 con 0x5631c6e34220 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.574+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e42d90 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.574+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94771790223168] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.575+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.575+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94771790228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e423d0 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.575+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e437a0 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.576+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94771790228160] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.576+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.576+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94771790225184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e43980 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.576+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e441d0 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94771790225184] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94771790231216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e43fe0 con 0x7fe9d0031040 2024-04-24T01:43:23.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 20 add_watcher() i=0 2024-04-24T01:43:23.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 20 add_watcher() i=1 2024-04-24T01:43:23.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 20 add_watcher() i=2 2024-04-24T01:43:23.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 20 add_watcher() i=3 2024-04-24T01:43:23.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 20 add_watcher() i=4 2024-04-24T01:43:23.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 20 add_watcher() i=5 2024-04-24T01:43:23.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.577+0000 7fe9d9c10800 20 add_watcher() i=6 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.578+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94771790231216] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.578+0000 7fe9d9c10800 20 add_watcher() i=7 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.578+0000 7fe9d9c10800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.578+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e475f0 con 0x5631c6e34220 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.578+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.578+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94771790232272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e44af0 con 0x5631c6e34220 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94771790232272] v34'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe88b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe9d9c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe9d9c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:23.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe9d9c10800 5 note: GC not initialized 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe88a7e4640 20 reqs_thread_entry: start 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe9d9c10800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.579+0000 7fe9d9c10800 20 Filter name: none 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe7fbfff640 20 reqs_thread_entry: start 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e7a8f0 con 0x5631c6e34220 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:23.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.580+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e80a70 con 0x5631c6e34220 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.581+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.581+0000 7fe9d9c10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.581+0000 7fe9d9c10800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.581+0000 7fe9d9c10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.581+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94771790480608 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e7c370 con 0x5631c6e34220 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94771790223168 notify 146028888082 ret 0) ==== 621+0+0 (crc 0 0 0) 0x5631c6d00170 con 0x5631c6e34220 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe8b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94771790223168 notifier 4653 bl.length()=579 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe8b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe8b8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(64 notify.4 [notify cookie 94771790480608 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe8b8ff9640 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe898003ea0 con 0x5631c6e34220 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.582+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 94771790480608 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5631c6cffc50 con 0x5631c6e34220 2024-04-24T01:43:23.603 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:23.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.583+0000 7fe88b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.583+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94771790232272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e471a0 con 0x5631c6e34220 2024-04-24T01:43:23.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.584+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94771790232272] v34'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.584+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94771790211648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e43ad0 con 0x7fe9c004ec20 2024-04-24T01:43:23.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.585+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94771790211648] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.585+0000 7fe9d9c10800 20 remove_watcher() i=0 2024-04-24T01:43:23.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.585+0000 7fe9d9c10800 2 removed watcher, disabling cache 2024-04-24T01:43:23.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.585+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94771790215088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3ea40 con 0x5631c6e34220 2024-04-24T01:43:23.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.586+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94771790215088] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.586+0000 7fe9d9c10800 20 remove_watcher() i=1 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.586+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94771790209120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3ea40 con 0x5631c6e3a470 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.587+0000 7fe9cffff640 1 -- 172.21.15.131:0/1428983799 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94771790209120] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c0009050 con 0x5631c6e3a470 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.587+0000 7fe9d9c10800 20 remove_watcher() i=2 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.587+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94771790221632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3e060 con 0x7fe9c004ec20 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.588+0000 7fe9d5bba640 1 -- 172.21.15.131:0/1428983799 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94771790221632] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9d0040040 con 0x7fe9c004ec20 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.588+0000 7fe9d9c10800 20 remove_watcher() i=3 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.588+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94771790223168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e41140 con 0x5631c6e34220 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.589+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94771790223168] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x5631c6e34220 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.589+0000 7fe9d9c10800 20 remove_watcher() i=4 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.589+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94771790228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3e060 con 0x7fe9d0031040 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.590+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94771790228160] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.590+0000 7fe9d9c10800 20 remove_watcher() i=5 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.590+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94771790225184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e41140 con 0x7fe9d0031040 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.591+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94771790225184] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.591+0000 7fe9d9c10800 20 remove_watcher() i=6 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.591+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94771790231216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631c6e3e060 con 0x7fe9d0031040 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94771790231216] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c80a4040 con 0x7fe9d0031040 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 20 remove_watcher() i=7 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe9d0031040 msgr2=0x7fe9d0032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe9d0031040 0x7fe9d0032430 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6e34220 msgr2=0x5631c6e366e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6e34220 0x5631c6e366e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe9c004ec20 msgr2=0x7fe9c000c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe9c004ec20 0x7fe9c000c650 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5631c6e3a470 msgr2=0x5631c6e3c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5631c6e3a470 0x5631c6e3c860 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8a0036950 msgr2=0x7fe8a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8a0036950 0x7fe8a0038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5631c6d00730 tx=0x7fe9d001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 msgr2=0x5631c6e28910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/1428983799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e21470 0x5631c6e28910 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000dcf0 tx=0x7fe9c004cd70 comp rx=0 tx=0).stop 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 reap_dead start 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d53b9640 1 -- 172.21.15.131:0/1428983799 reap_dead start 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 shutdown_connections 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 >> 172.21.15.131:0/1428983799 conn(0x5631c6e1d7d0 msgr2=0x5631c6e1ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 shutdown_connections 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.592+0000 7fe9d9c10800 1 -- 172.21.15.131:0/1428983799 wait complete. 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8ac036900 msgr2=0x7fe8ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8ac036900 0x7fe8ac038dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5631c6e04890 tx=0x7fe9d0005840 comp rx=0 tx=0).stop 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e14130 msgr2=0x5631c6e14550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e14130 0x5631c6e14550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000bec0 tx=0x7fe9c000d7a0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 shutdown_connections 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8ac036900 0x7fe8ac038dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/2670297050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6e14130 0x5631c6e14550 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 >> 172.21.15.131:0/2670297050 conn(0x5631c6e081d0 msgr2=0x5631c6e085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 shutdown_connections 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/2670297050 wait complete. 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6d042c0 msgr2=0x5631c6e02dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6d042c0 0x5631c6e02dc0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8bc036900 msgr2=0x7fe8bc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8bc036900 0x7fe8bc038dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c00010a0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 msgr2=0x5631c6d012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d012d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8060040 tx=0x7fe9c8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 shutdown_connections 2024-04-24T01:43:23.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5631c6d042c0 0x5631c6e02dc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe8bc036900 0x7fe8bc038dc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 --2- 172.21.15.131:0/3468969517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5631c6d01990 0x5631c6d012d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 >> 172.21.15.131:0/3468969517 conn(0x5631c6cfb340 msgr2=0x5631c6dec040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 shutdown_connections 2024-04-24T01:43:23.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.593+0000 7fe9d9c10800 1 -- 172.21.15.131:0/3468969517 wait complete. 2024-04-24T01:43:23.618 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:23.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:43:23.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:43:23.619 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-24T01:43:23.664 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:23.664 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.664+0000 7fc8db7a2800 1 Processor -- start 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.664+0000 7fc8db7a2800 1 -- start start 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.664+0000 7fc8db7a2800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e7d6ee84a0 0x55e7d6eea890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.664+0000 7fc8db7a2800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7d6da2d40 con 0x55e7d6ee4990 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.664+0000 7fc8db7a2800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55e7d6d754d0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.665+0000 7fc8d3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e7d6ee84a0 0x55e7d6eea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.665+0000 7fc8d92a8640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55e7d6ee4990 0x55e7d6ee6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56984/0 (socket says 172.21.15.131:56984) 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.665+0000 7fc8d92a8640 1 -- 172.21.15.131:0/3678399918 learned_addr learned my addr 172.21.15.131:0/3678399918 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.665+0000 7fc8d3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e7d6ee84a0 0x55e7d6eea890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54204/0 (socket says 172.21.15.131:54204) 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.665+0000 7fc8d3fff640 1 -- 172.21.15.131:0/3678399918 >> v1:172.21.15.107:6789/0 conn(0x55e7d6ee4990 legacy=0x55e7d6ee6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.665+0000 7fc8d3fff640 1 -- 172.21.15.131:0/3678399918 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d6da1590 con 0x55e7d6ee84a0 2024-04-24T01:43:23.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.667+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/3678399918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee84a0 0x55e7d6eea890 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400a470 tx=0x7fc8c401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4c6c45e981dc29 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.667+0000 7fc8d8aa7640 1 -- 172.21.15.131:0/3678399918 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4057070 con 0x55e7d6ee84a0 2024-04-24T01:43:23.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.667+0000 7fc8d8aa7640 1 -- 172.21.15.131:0/3678399918 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c4052570 con 0x55e7d6ee84a0 2024-04-24T01:43:23.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.667+0000 7fc8d8aa7640 1 -- 172.21.15.131:0/3678399918 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4052870 con 0x55e7d6ee84a0 2024-04-24T01:43:23.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.668+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3678399918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee84a0 msgr2=0x55e7d6eea890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.668+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3678399918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee84a0 0x55e7d6eea890 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400a470 tx=0x7fc8c401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:23.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.668+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3678399918 shutdown_connections 2024-04-24T01:43:23.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.668+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3678399918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee84a0 0x55e7d6eea890 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.668+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3678399918 >> 172.21.15.131:0/3678399918 conn(0x55e7d6ede340 msgr2=0x55e7d6ee0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.668+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3678399918 shutdown_connections 2024-04-24T01:43:23.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.668+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3678399918 wait complete. 2024-04-24T01:43:23.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.679+0000 7fc8db7a2800 1 Processor -- start 2024-04-24T01:43:23.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.679+0000 7fc8db7a2800 1 -- start start 2024-04-24T01:43:23.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.679+0000 7fc8db7a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6ee42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.679+0000 7fc8db7a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7d6e2f3b0 con 0x55e7d6ee4990 2024-04-24T01:43:23.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc8d92a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6ee42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc8d92a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6ee42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54216/0 (socket says 172.21.15.131:54216) 2024-04-24T01:43:23.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc8d92a8640 1 -- 172.21.15.131:0/3632174731 learned_addr learned my addr 172.21.15.131:0/3632174731 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc8d92a8640 1 -- 172.21.15.131:0/3632174731 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d6ee2890 con 0x55e7d6ee4990 2024-04-24T01:43:23.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc8d92a8640 1 --2- 172.21.15.131:0/3632174731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6ee42d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc001de0 tx=0x7fc8cc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2759b72248dff61 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc7c7606640 1 -- 172.21.15.131:0/3632174731 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8cc012020 con 0x55e7d6ee4990 2024-04-24T01:43:23.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc7c7606640 1 -- 172.21.15.131:0/3632174731 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc00e5a0 con 0x55e7d6ee4990 2024-04-24T01:43:23.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.680+0000 7fc7c7606640 1 -- 172.21.15.131:0/3632174731 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8cc00e8c0 con 0x55e7d6ee4990 2024-04-24T01:43:23.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3632174731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 msgr2=0x55e7d6ee42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3632174731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6ee42d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc001de0 tx=0x7fc8cc00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3632174731 shutdown_connections 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3632174731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6ee42d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3632174731 >> 172.21.15.131:0/3632174731 conn(0x55e7d6ede340 msgr2=0x55e7d6fd0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3632174731 shutdown_connections 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3632174731 wait complete. 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 Processor -- start 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 -- start start 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6fdee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.681+0000 7fc8db7a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7d6eed0e0 con 0x55e7d6ee4990 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc8d92a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6fdee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc8d92a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6fdee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54228/0 (socket says 172.21.15.131:54228) 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc8d92a8640 1 -- 172.21.15.131:0/3428835361 learned_addr learned my addr 172.21.15.131:0/3428835361 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc8d92a8640 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d6fdf3d0 con 0x55e7d6ee4990 2024-04-24T01:43:23.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc8d92a8640 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6fdee90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c010 tx=0x7fc8cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc7c5e03640 1 -- 172.21.15.131:0/3428835361 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8cc012070 con 0x55e7d6ee4990 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc7c5e03640 1 -- 172.21.15.131:0/3428835361 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc01a7a0 con 0x55e7d6ee4990 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7d6fdf660 con 0x55e7d6ee4990 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc7c5e03640 1 -- 172.21.15.131:0/3428835361 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8cc01aa80 con 0x55e7d6ee4990 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.682+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d6fe2310 con 0x55e7d6ee4990 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.683+0000 7fc7c5e03640 1 -- 172.21.15.131:0/3428835361 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc8cc015020 con 0x55e7d6ee4990 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.683+0000 7fc7c5e03640 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7c00369a0 0x7fc7c0038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.683+0000 7fc7c5e03640 1 -- 172.21.15.131:0/3428835361 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc8cc020070 con 0x55e7d6ee4990 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.683+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7c00369a0 0x7fc7c0038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.683+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d6ee84a0 0x55e7d6fe60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.683+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d6fe6610 con 0x55e7d6ee84a0 2024-04-24T01:43:23.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.683+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d6ee84a0 0x55e7d6fe60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.684+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7c00369a0 0x7fc7c0038e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4054000 tx=0x7fc8c404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.684+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d6ee84a0 0x55e7d6fe60d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.684+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/3428835361 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8d400a4a0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.684+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d6fe36a0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.684+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/3428835361 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8d400a4a0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.684+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d6fe84a0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.685+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/3428835361 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8d400a4a0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.685+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d6fe77e0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.685+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/3428835361 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8d400a4a0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.685+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d6fe7b80 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.685+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/3428835361 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8d400a4a0 con 0x55e7d6ee84a0 2024-04-24T01:43:23.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.685+0000 7fc8db7a2800 1 Processor -- start 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.685+0000 7fc8db7a2800 1 -- start start 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8db7a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ff72b0 0x55e7d6ff76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8db7a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7d6dd56b0 con 0x55e7d6ff72b0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ff72b0 0x55e7d6ff76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ff72b0 0x55e7d6ff76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54238/0 (socket says 172.21.15.131:54238) 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8d3fff640 1 -- 172.21.15.131:0/361842704 learned_addr learned my addr 172.21.15.131:0/361842704 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8d3fff640 1 -- 172.21.15.131:0/361842704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d6ff7c10 con 0x55e7d6ff72b0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ff72b0 0x55e7d6ff76d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4044840 tx=0x7fc8c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc7beffd640 1 -- 172.21.15.131:0/361842704 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c406f070 con 0x55e7d6ff72b0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc7beffd640 1 -- 172.21.15.131:0/361842704 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c4058040 con 0x55e7d6ff72b0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7d6ff8680 con 0x55e7d6ff72b0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc7beffd640 1 -- 172.21.15.131:0/361842704 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4057050 con 0x55e7d6ff72b0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.686+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d6ff8b20 con 0x55e7d6ff72b0 2024-04-24T01:43:23.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.687+0000 7fc7beffd640 1 -- 172.21.15.131:0/361842704 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc8c4072070 con 0x55e7d6ff72b0 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.687+0000 7fc7beffd640 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7b0036900 0x7fc7b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.687+0000 7fc7beffd640 1 -- 172.21.15.131:0/361842704 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc8c408fb00 con 0x55e7d6ff72b0 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.687+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7b0036900 0x7fc7b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8db7a2800 1 Processor -- start 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8db7a2800 1 -- start start 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7b0036900 0x7fc7b0038dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55e7d6fe7300 tx=0x7fc8d4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8db7a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d7004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8db7a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7d6ee2c10 con 0x55e7d7004570 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d7004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d7004990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54254/0 (socket says 172.21.15.131:54254) 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8d3fff640 1 -- 172.21.15.131:0/824180217 learned_addr learned my addr 172.21.15.131:0/824180217 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8d3fff640 1 -- 172.21.15.131:0/824180217 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d7004f60 con 0x55e7d7004570 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/824180217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d7004990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc8c408dda0 tx=0x7fc8c408e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2a9ed0e998a1ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc7bcff9640 1 -- 172.21.15.131:0/824180217 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4087070 con 0x55e7d7004570 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc7bcff9640 1 -- 172.21.15.131:0/824180217 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c405e480 con 0x55e7d7004570 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.688+0000 7fc7bcff9640 1 -- 172.21.15.131:0/824180217 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4072360 con 0x55e7d7004570 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 -- 172.21.15.131:0/824180217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 msgr2=0x55e7d7004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/824180217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d7004990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc8c408dda0 tx=0x7fc8c408e050 comp rx=0 tx=0).stop 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 -- 172.21.15.131:0/824180217 shutdown_connections 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/824180217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d7004990 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 -- 172.21.15.131:0/824180217 >> 172.21.15.131:0/824180217 conn(0x55e7d70008d0 msgr2=0x55e7d6ffe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 -- 172.21.15.131:0/824180217 shutdown_connections 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 -- 172.21.15.131:0/824180217 wait complete. 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 Processor -- start 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 -- start start 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d700bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.689+0000 7fc8db7a2800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7d70056d0 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d700bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d700bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54270/0 (socket says 172.21.15.131:54270) 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 learned_addr learned my addr 172.21.15.131:0/1840402476 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d700c160 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d700bc20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc8c408ccc0 tx=0x7fc8c408dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc7aeffd640 1 -- 172.21.15.131:0/1840402476 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4087030 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc7aeffd640 1 -- 172.21.15.131:0/1840402476 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c405fd50 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7d700c3f0 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc7aeffd640 1 -- 172.21.15.131:0/1840402476 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8c4072810 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.690+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d700f0a0 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.691+0000 7fc7aeffd640 1 -- 172.21.15.131:0/1840402476 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc8c40693a0 con 0x55e7d7004570 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.691+0000 7fc7aeffd640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7a4036950 0x7fc7a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.691+0000 7fc7aeffd640 1 -- 172.21.15.131:0/1840402476 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc8c4088070 con 0x55e7d7004570 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.691+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7a4036950 0x7fc7a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.691+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7a4036950 0x7fc7a4038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e7d6fe00b0 tx=0x7fc8d401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d70176b0 0x55e7d7019b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701a2c0 con 0x55e7d70176b0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8d92a8640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d70176b0 0x55e7d7019b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8d92a8640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d70176b0 0x55e7d7019b70 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8db7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8db7a2800 20 realm 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701a6d0 con 0x55e7d70176b0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.692+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701afa0 con 0x55e7d70176b0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701b340 con 0x55e7d70176b0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701bb90 con 0x55e7d70176b0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 20 searching for the correct realm 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e7d701d900 0x55e7d701fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.693+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e7d701d900 0x55e7d701fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.694+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e7d701d900 0x55e7d701fcf0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.694+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.694+0000 7fc8d3fff640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc8c4082070 0x7fc8c405c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.694+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8c4082070 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.694+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc8c4082070 0x7fc8c405c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.694+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc8c4082070 0x7fc8c405c5b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8d401f070 con 0x7fc8c4082070 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d9aa9640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc8d4031040 0x7fc8d4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d92a8640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc8d4031040 0x7fc8d4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d92a8640 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc8d4031040 0x7fc8d4032430 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.695+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8c4082070 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8d401f070 con 0x7fc8c4082070 2024-04-24T01:43:23.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.696+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.697+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8c4082070 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8d401f070 con 0x7fc8c4082070 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.698+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.699+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8c4082070 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8d401f070 con 0x7fc8c4082070 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8c4082070 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8d401f070 con 0x7fc8c4082070 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.700+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8c4082070 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8d401f070 con 0x7fc8c4082070 2024-04-24T01:43:23.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d701d900 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.701+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8d4031040 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x55e7d70176b0 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70202d0 con 0x7fc8c4082070 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:23.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701c540 con 0x55e7d70176b0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.702+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701cde0 con 0x55e7d70176b0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701cde0 con 0x55e7d70176b0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:23.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 zone default found 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 4 Realm: () 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 zonegroup default 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7020750 con 0x7fc8c4082070 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d701cbb0 con 0x55e7d701d900 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.703+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8db7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7022b00 con 0x55e7d701d900 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8db7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8db7a2800 20 started sync module instance, tier type = 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8db7a2800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.704+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021e10 con 0x7fc8c4082070 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.705+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.705+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94454233047856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021e10 con 0x7fc8c4082070 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.705+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70235c0 con 0x55e7d70176b0 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.706+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94454233047856] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.706+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.706+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94454233051344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021e10 con 0x55e7d70176b0 2024-04-24T01:43:23.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.706+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7024010 con 0x55e7d701d900 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.707+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94454233051344] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.707+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.707+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94454233045344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021d80 con 0x55e7d701d900 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.707+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7024f00 con 0x7fc8c4082070 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.708+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94454233045344] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.709+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.709+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94454233057872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7025320 con 0x7fc8c4082070 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.709+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7025ce0 con 0x55e7d70176b0 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.710+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94454233057872] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.710+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.710+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94454233059408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7025ce0 con 0x55e7d70176b0 2024-04-24T01:43:23.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.710+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70266a0 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.711+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94454233059408] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.711+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.711+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94454233064400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7025ce0 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.711+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70270b0 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.712+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94454233064400] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.712+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.712+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94454233061728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70270b0 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.712+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7027a70 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94454233061728] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94454233066496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7027c50 con 0x7fc8d4031040 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 20 add_watcher() i=0 2024-04-24T01:43:23.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 20 add_watcher() i=1 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 20 add_watcher() i=2 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 20 add_watcher() i=3 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 20 add_watcher() i=4 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 20 add_watcher() i=5 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.713+0000 7fc8db7a2800 20 add_watcher() i=6 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.714+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94454233066496] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.714+0000 7fc8db7a2800 20 add_watcher() i=7 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.714+0000 7fc8db7a2800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.714+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d702adf0 con 0x55e7d70176b0 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.714+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.714+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94454233081824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7027bc0 con 0x55e7d70176b0 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.715+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94454233081824] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.715+0000 7fc78f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.715+0000 7fc8db7a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.715+0000 7fc8db7a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.715+0000 7fc8db7a2800 5 note: GC not initialized 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.715+0000 7fc78e7e4640 20 reqs_thread_entry: start 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 20 Filter name: none 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc6fffff640 20 reqs_thread_entry: start 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d705e220 con 0x55e7d70176b0 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 20 rados_obj.operate() r=0 bl.length=403 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:23.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.716+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70643c0 con 0x55e7d70176b0 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.717+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.717+0000 7fc8db7a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.717+0000 7fc8db7a2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.717+0000 7fc8db7a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.717+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94454233316944 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7d705fca0 con 0x55e7d70176b0 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify (1) cookie 94454233059408 notify 146028888083 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55e7d6fe2310 con 0x55e7d70176b0 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc7bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94454233059408 notifier 4660 bl.length()=567 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc7bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc7bcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc7bcff9640 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc79c003ea0 con 0x55e7d70176b0 2024-04-24T01:43:23.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(64 notify.4 [notify cookie 94454233316944 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.718+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== watch-notify(notify_complete (2) cookie 94454233316944 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7d6fdf660 con 0x55e7d70176b0 2024-04-24T01:43:23.826 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:42:59.606300Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:42:59.606285Z","tags":[],"group_ids":[]} 2024-04-24T01:43:23.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.719+0000 7fc78f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.719+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94454233081824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7063640 con 0x55e7d70176b0 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.720+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94454233081824] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.720+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94454233047856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7063640 con 0x7fc8c4082070 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.721+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94454233047856] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.721+0000 7fc8db7a2800 20 remove_watcher() i=0 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.721+0000 7fc8db7a2800 2 removed watcher, disabling cache 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.721+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94454233051344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7022330 con 0x55e7d70176b0 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.722+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94454233051344] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.722+0000 7fc8db7a2800 20 remove_watcher() i=1 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.722+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94454233045344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d70230d0 con 0x55e7d701d900 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.723+0000 7fc8d3fff640 1 -- 172.21.15.131:0/1840402476 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94454233045344] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8c4071030 con 0x55e7d701d900 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.723+0000 7fc8db7a2800 20 remove_watcher() i=2 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.723+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94454233057872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021960 con 0x7fc8c4082070 2024-04-24T01:43:23.832 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.724+0000 7fc8d9aa9640 1 -- 172.21.15.131:0/1840402476 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94454233057872] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8d4040040 con 0x7fc8c4082070 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.724+0000 7fc8db7a2800 20 remove_watcher() i=3 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.724+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94454233059408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021960 con 0x55e7d70176b0 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.725+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94454233059408] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x55e7d70176b0 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.725+0000 7fc8db7a2800 20 remove_watcher() i=4 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.725+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94454233064400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7025050 con 0x7fc8d4031040 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.726+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94454233064400] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.726+0000 7fc8db7a2800 20 remove_watcher() i=5 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.726+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94454233061728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021960 con 0x7fc8d4031040 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.727+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94454233061728] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.727+0000 7fc8db7a2800 20 remove_watcher() i=6 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.727+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94454233066496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e7d7021960 con 0x7fc8d4031040 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.728+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94454233066496] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8cc02b070 con 0x7fc8d4031040 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.728+0000 7fc8db7a2800 20 remove_watcher() i=7 2024-04-24T01:43:23.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc8d4031040 msgr2=0x7fc8d4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fc8d4031040 0x7fc8d4032430 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d70176b0 msgr2=0x55e7d7019b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d70176b0 0x55e7d7019b70 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc8c4082070 msgr2=0x7fc8c405c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fc8c4082070 0x7fc8c405c5b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e7d701d900 msgr2=0x55e7d701fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e7d701d900 0x55e7d701fcf0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7a4036950 msgr2=0x7fc7a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7a4036950 0x7fc7a4038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e7d6fe00b0 tx=0x7fc8d401f000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 msgr2=0x55e7d700bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8d92a8640 1 -- 172.21.15.131:0/1840402476 reap_dead start 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d700bc20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc8c408ccc0 tx=0x7fc8c408dd30 comp rx=0 tx=0).stop 2024-04-24T01:43:23.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 shutdown_connections 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/1840402476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d7004570 0x55e7d700bc20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 >> 172.21.15.131:0/1840402476 conn(0x55e7d70008d0 msgr2=0x55e7d6ffdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 shutdown_connections 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/1840402476 wait complete. 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7b0036900 msgr2=0x7fc7b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7b0036900 0x7fc7b0038dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55e7d6fe7300 tx=0x7fc8d4005840 comp rx=0 tx=0).stop 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ff72b0 msgr2=0x55e7d6ff76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ff72b0 0x55e7d6ff76d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4044840 tx=0x7fc8c4002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 shutdown_connections 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7b0036900 0x7fc7b0038dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/361842704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ff72b0 0x55e7d6ff76d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 >> 172.21.15.131:0/361842704 conn(0x55e7d6feb350 msgr2=0x55e7d6feb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 shutdown_connections 2024-04-24T01:43:23.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/361842704 wait complete. 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d6ee84a0 msgr2=0x55e7d6fe60d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.729+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d6ee84a0 0x55e7d6fe60d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7c00369a0 msgr2=0x7fc7c0038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7c00369a0 0x7fc7c0038e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4054000 tx=0x7fc8c404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 msgr2=0x55e7d6fdee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6fdee90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c010 tx=0x7fc8cc000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 shutdown_connections 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7d6ee84a0 0x55e7d6fe60d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc7c00369a0 0x7fc7c0038e60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 --2- 172.21.15.131:0/3428835361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7d6ee4990 0x55e7d6fdee90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 >> 172.21.15.131:0/3428835361 conn(0x55e7d6ede340 msgr2=0x55e7d6ee3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 shutdown_connections 2024-04-24T01:43:23.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.730+0000 7fc8db7a2800 1 -- 172.21.15.131:0/3428835361 wait complete. 2024-04-24T01:43:23.837 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:42:59.606300Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:42:59.606285Z', 'tags': [], 'group_ids': []} 2024-04-24T01:43:23.848 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:23.848 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T01:43:23.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T01:43:23.849 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T01:43:23.892 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:23.892 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:23.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.892+0000 7f0ff3416800 1 Processor -- start 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.892+0000 7f0ff3416800 1 -- start start 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0ff3416800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d22b96c330 0x55d22b96e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0ff3416800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d22b826d40 con 0x55d22b967f90 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0ff3416800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55d22b7f94d0 con 0x55d22b96c330 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0fe7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d22b96c330 0x55d22b96e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0feeb5c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55d22b967f90 0x55d22b9683b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:56994/0 (socket says 172.21.15.131:56994) 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0fe7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d22b96c330 0x55d22b96e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54272/0 (socket says 172.21.15.131:54272) 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0feeb5c640 1 -- 172.21.15.131:0/2156703942 learned_addr learned my addr 172.21.15.131:0/2156703942 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0fe7fff640 1 -- 172.21.15.131:0/2156703942 >> v1:172.21.15.107:6789/0 conn(0x55d22b967f90 legacy=0x55d22b9683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.893+0000 7f0fe7fff640 1 -- 172.21.15.131:0/2156703942 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22b825590 con 0x55d22b96c330 2024-04-24T01:43:23.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.895+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/2156703942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b96c330 0x55d22b96e720 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800a470 tx=0x7f0fd801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cd68c6fe018c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.895+0000 7f0fee35b640 1 -- 172.21.15.131:0/2156703942 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd8057070 con 0x55d22b96c330 2024-04-24T01:43:23.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.895+0000 7f0fee35b640 1 -- 172.21.15.131:0/2156703942 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd8052570 con 0x55d22b96c330 2024-04-24T01:43:23.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.895+0000 7f0fee35b640 1 -- 172.21.15.131:0/2156703942 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd8052870 con 0x55d22b96c330 2024-04-24T01:43:23.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.895+0000 7f0ff3416800 1 -- 172.21.15.131:0/2156703942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b96c330 msgr2=0x55d22b96e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.895+0000 7f0ff3416800 1 --2- 172.21.15.131:0/2156703942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b96c330 0x55d22b96e720 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800a470 tx=0x7f0fd801ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:23.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.896+0000 7f0ff3416800 1 -- 172.21.15.131:0/2156703942 shutdown_connections 2024-04-24T01:43:23.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.896+0000 7f0ff3416800 1 --2- 172.21.15.131:0/2156703942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b96c330 0x55d22b96e720 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.896+0000 7f0ff3416800 1 -- 172.21.15.131:0/2156703942 >> 172.21.15.131:0/2156703942 conn(0x55d22b963530 msgr2=0x55d22b965950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.896+0000 7f0ff3416800 1 -- 172.21.15.131:0/2156703942 shutdown_connections 2024-04-24T01:43:23.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.896+0000 7f0ff3416800 1 -- 172.21.15.131:0/2156703942 wait complete. 2024-04-24T01:43:23.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.907+0000 7f0ff3416800 1 Processor -- start 2024-04-24T01:43:23.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.907+0000 7f0ff3416800 1 -- start start 2024-04-24T01:43:23.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.907+0000 7f0ff3416800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22ba590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.907+0000 7f0ff3416800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d22b8b33c0 con 0x55d22b967f90 2024-04-24T01:43:23.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0feeb5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22ba590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0feeb5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22ba590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54280/0 (socket says 172.21.15.131:54280) 2024-04-24T01:43:23.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0feeb5c640 1 -- 172.21.15.131:0/3618447680 learned_addr learned my addr 172.21.15.131:0/3618447680 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0feeb5c640 1 -- 172.21.15.131:0/3618447680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22ba596c0 con 0x55d22b967f90 2024-04-24T01:43:23.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0feeb5c640 1 --2- 172.21.15.131:0/3618447680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22ba590f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0001e10 tx=0x7f0fe000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87ce223fbd538f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0edce09640 1 -- 172.21.15.131:0/3618447680 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe0012020 con 0x55d22b967f90 2024-04-24T01:43:23.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0edce09640 1 -- 172.21.15.131:0/3618447680 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe000e5a0 con 0x55d22b967f90 2024-04-24T01:43:23.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.908+0000 7f0edce09640 1 -- 172.21.15.131:0/3618447680 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe000e8e0 con 0x55d22b967f90 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 -- 172.21.15.131:0/3618447680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 msgr2=0x55d22ba590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 --2- 172.21.15.131:0/3618447680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22ba590f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0001e10 tx=0x7f0fe000b780 comp rx=0 tx=0).stop 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 -- 172.21.15.131:0/3618447680 shutdown_connections 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 --2- 172.21.15.131:0/3618447680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22ba590f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 -- 172.21.15.131:0/3618447680 >> 172.21.15.131:0/3618447680 conn(0x55d22b963530 msgr2=0x55d22ba54a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 -- 172.21.15.131:0/3618447680 shutdown_connections 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 -- 172.21.15.131:0/3618447680 wait complete. 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 Processor -- start 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.909+0000 7f0ff3416800 1 -- start start 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0ff3416800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22b8dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0ff3416800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d22b96eff0 con 0x55d22b967f90 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0feeb5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22b8dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0feeb5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22b8dd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54282/0 (socket says 172.21.15.131:54282) 2024-04-24T01:43:23.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0feeb5c640 1 -- 172.21.15.131:0/1628202041 learned_addr learned my addr 172.21.15.131:0/1628202041 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0feeb5c640 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22b8dc090 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0feeb5c640 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22b8dd9a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000b7c0 tx=0x7f0fe0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0edb606640 1 -- 172.21.15.131:0/1628202041 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe0012030 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0edb606640 1 -- 172.21.15.131:0/1628202041 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe0001470 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d22b8dc320 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0edb606640 1 -- 172.21.15.131:0/1628202041 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe001a8d0 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.910+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22b8dc840 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.911+0000 7f0edb606640 1 -- 172.21.15.131:0/1628202041 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0fe0015020 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.911+0000 7f0edb606640 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ed4036950 0x7f0ed4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.911+0000 7f0edb606640 1 -- 172.21.15.131:0/1628202041 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0fe0020030 con 0x55d22b967f90 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.911+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ed4036950 0x7f0ed4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.911+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22b96c330 0x55d22ba6a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.911+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba6a620 con 0x55d22b96c330 2024-04-24T01:43:23.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.912+0000 7f0fef35d640 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22b96c330 0x55d22ba6a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.912+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ed4036950 0x7f0ed4038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8054000 tx=0x7f0fd804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.912+0000 7f0fef35d640 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22b96c330 0x55d22ba6a090 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.912+0000 7f0fef35d640 1 -- 172.21.15.131:0/1628202041 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe800a4a0 con 0x55d22b96c330 2024-04-24T01:43:23.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.912+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba6af00 con 0x55d22b96c330 2024-04-24T01:43:23.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.912+0000 7f0fef35d640 1 -- 172.21.15.131:0/1628202041 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fe800a4a0 con 0x55d22b96c330 2024-04-24T01:43:23.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.912+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba6c2f0 con 0x55d22b96c330 2024-04-24T01:43:23.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.913+0000 7f0fef35d640 1 -- 172.21.15.131:0/1628202041 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0fe800a4a0 con 0x55d22b96c330 2024-04-24T01:43:23.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.913+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba6b750 con 0x55d22b96c330 2024-04-24T01:43:23.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.913+0000 7f0fef35d640 1 -- 172.21.15.131:0/1628202041 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fe800a4a0 con 0x55d22b96c330 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.913+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba6bb30 con 0x55d22b96c330 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.913+0000 7f0fef35d640 1 -- 172.21.15.131:0/1628202041 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0fe800a4a0 con 0x55d22b96c330 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0ff3416800 1 Processor -- start 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0ff3416800 1 -- start start 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0ff3416800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba7b420 0x55d22ba7b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0ff3416800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d22b8ddee0 con 0x55d22ba7b420 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0fe7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba7b420 0x55d22ba7b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0fe7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba7b420 0x55d22ba7b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54288/0 (socket says 172.21.15.131:54288) 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0fe7fff640 1 -- 172.21.15.131:0/1295050377 learned_addr learned my addr 172.21.15.131:0/1295050377 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0fe7fff640 1 -- 172.21.15.131:0/1295050377 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22ba7bd80 con 0x55d22ba7b420 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.914+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba7b420 0x55d22ba7b840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8044840 tx=0x7f0fd8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.915+0000 7f0ed8e01640 1 -- 172.21.15.131:0/1295050377 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd806f070 con 0x55d22ba7b420 2024-04-24T01:43:23.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.915+0000 7f0ed8e01640 1 -- 172.21.15.131:0/1295050377 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd8058040 con 0x55d22ba7b420 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.915+0000 7f0ed8e01640 1 -- 172.21.15.131:0/1295050377 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd8057050 con 0x55d22ba7b420 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.915+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d22ba7c7f0 con 0x55d22ba7b420 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.915+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22ba7cc90 con 0x55d22ba7b420 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.915+0000 7f0ed8e01640 1 -- 172.21.15.131:0/1295050377 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0fd8072070 con 0x55d22ba7b420 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.915+0000 7f0ed8e01640 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ec8036900 0x7f0ec8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0ed8e01640 1 -- 172.21.15.131:0/1295050377 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0fd808fb00 con 0x55d22ba7b420 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0fef35d640 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ec8036900 0x7f0ec8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0ff3416800 1 Processor -- start 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0ff3416800 1 -- start start 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0fef35d640 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ec8036900 0x7f0ec8038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55d22b8dce80 tx=0x7f0fe8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0ff3416800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0ff3416800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d22b8596b0 con 0x55d22ba886e0 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0fe7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0fe7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba88b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54298/0 (socket says 172.21.15.131:54298) 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0fe7fff640 1 -- 172.21.15.131:0/3208221197 learned_addr learned my addr 172.21.15.131:0/3208221197 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.916+0000 7f0fe7fff640 1 -- 172.21.15.131:0/3208221197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22ba890d0 con 0x55d22ba886e0 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/3208221197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba88b00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0fd808dda0 tx=0x7f0fd808e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53be36b28b2d8bb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ed27fc640 1 -- 172.21.15.131:0/3208221197 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd8087070 con 0x55d22ba886e0 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ed27fc640 1 -- 172.21.15.131:0/3208221197 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd805e480 con 0x55d22ba886e0 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ed27fc640 1 -- 172.21.15.131:0/3208221197 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd8072360 con 0x55d22ba886e0 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 -- 172.21.15.131:0/3208221197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 msgr2=0x55d22ba88b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 --2- 172.21.15.131:0/3208221197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba88b00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0fd808dda0 tx=0x7f0fd808e050 comp rx=0 tx=0).stop 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 -- 172.21.15.131:0/3208221197 shutdown_connections 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 --2- 172.21.15.131:0/3208221197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba88b00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 -- 172.21.15.131:0/3208221197 >> 172.21.15.131:0/3208221197 conn(0x55d22ba84a40 msgr2=0x55d22ba82aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 -- 172.21.15.131:0/3208221197 shutdown_connections 2024-04-24T01:43:23.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 -- 172.21.15.131:0/3208221197 wait complete. 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.917+0000 7f0ff3416800 1 Processor -- start 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.918+0000 7f0ff3416800 1 -- start start 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.918+0000 7f0ff3416800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba8fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.918+0000 7f0ff3416800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d22ba896c0 con 0x55d22ba886e0 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.918+0000 7f0fe7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba8fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.918+0000 7f0fe7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba8fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54310/0 (socket says 172.21.15.131:54310) 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.918+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 learned_addr learned my addr 172.21.15.131:0/585002696 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.918+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22ba90150 con 0x55d22ba886e0 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.919+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba8fc10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0fd808ccc0 tx=0x7f0fd808dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.919+0000 7f0ed0ff9640 1 -- 172.21.15.131:0/585002696 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd8087030 con 0x55d22ba886e0 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.919+0000 7f0ed0ff9640 1 -- 172.21.15.131:0/585002696 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd805fd50 con 0x55d22ba886e0 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.919+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d22ba903e0 con 0x55d22ba886e0 2024-04-24T01:43:23.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.919+0000 7f0ed0ff9640 1 -- 172.21.15.131:0/585002696 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd8072810 con 0x55d22ba886e0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.919+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22ba93090 con 0x55d22ba886e0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.919+0000 7f0ed0ff9640 1 -- 172.21.15.131:0/585002696 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0fd80693a0 con 0x55d22ba886e0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0ed0ff9640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0eb80368b0 0x7f0eb8038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0ed0ff9640 1 -- 172.21.15.131:0/585002696 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0fd8088070 con 0x55d22ba886e0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0fef35d640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0eb80368b0 0x7f0eb8038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0fef35d640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0eb80368b0 0x7f0eb8038d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55d22b8dce50 tx=0x7f0fe801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22ba9b690 0x55d22ba9db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba9e2a0 con 0x55d22ba9b690 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.920+0000 7f0feeb5c640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22ba9b690 0x55d22ba9db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0feeb5c640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22ba9b690 0x55d22ba9db50 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 20 realm 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba9e6b0 con 0x55d22ba9b690 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba9ef80 con 0x55d22ba9b690 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.921+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba9f320 con 0x55d22ba9b690 2024-04-24T01:43:23.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0ff3416800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba9fb70 con 0x55d22ba9b690 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0ff3416800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0ff3416800 20 searching for the correct realm 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d22baa18e0 0x55d22baa3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d22baa18e0 0x55d22baa3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.922+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d22baa18e0 0x55d22baa3cd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fe7fff640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0fd8082070 0x7f0fd8097630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fd8082070 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fef35d640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0fd8082070 0x7f0fd8097630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fef35d640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0fd8082070 0x7f0fd8097630 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe801f070 con 0x7f0fd8082070 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fef35d640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0fe8031040 0x7f0fe8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fe8031040 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.923+0000 7f0feeb5c640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0fe8031040 0x7f0fe8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.924+0000 7f0feeb5c640 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0fe8031040 0x7f0fe8032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.924+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.924+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22ba9b690 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.924+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.924+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22ba9b690 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.924+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.924+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fe8031040 2024-04-24T01:43:23.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.925+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.925+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fe8031040 2024-04-24T01:43:23.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.925+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.925+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fd8082070 2024-04-24T01:43:23.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.925+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe801f070 con 0x7f0fd8082070 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.925+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22ba9b690 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fe8031040 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22ba9b690 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.926+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fd8082070 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0fe801f070 con 0x7f0fd8082070 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fe8031040 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.927+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22ba9b690 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22ba9b690 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.928+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fe8031040 2024-04-24T01:43:23.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fd8082070 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe801f070 con 0x7f0fd8082070 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22ba9b690 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.929+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fd8082070 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe801f070 con 0x7f0fd8082070 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x55d22baa18e0 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa42b0 con 0x7f0fe8031040 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fe0055040 con 0x7f0fd8082070 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe801f070 con 0x7f0fd8082070 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.930+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fe0055040 con 0x55d22baa18e0 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.931+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.931+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fe0055040 con 0x7f0fe8031040 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.931+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.931+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fe0055040 con 0x55d22ba9b690 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.931+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.931+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fe0055040 con 0x7f0fd8082070 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:23.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa04f0 con 0x55d22ba9b690 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa0d90 con 0x55d22ba9b690 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa0d90 con 0x55d22ba9b690 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 zone default found 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 4 Realm: () 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 zonegroup default 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa4730 con 0x7f0fd8082070 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.932+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa0b30 con 0x55d22baa18e0 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa6aa0 con 0x55d22baa18e0 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 20 started sync module instance, tier type = 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.933+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa5df0 con 0x7f0fd8082070 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.934+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.934+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94361164079888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa5df0 con 0x7f0fd8082070 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.934+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa7520 con 0x55d22ba9b690 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.935+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94361164079888] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.935+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.935+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94361164083792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa5df0 con 0x55d22ba9b690 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.935+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa7f70 con 0x55d22baa18e0 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.937+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94361164083792] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.937+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.937+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94361164077376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa5d60 con 0x55d22baa18e0 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.937+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa8e30 con 0x7f0fd8082070 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.938+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94361164077376] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.938+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.938+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94361164089728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa8da0 con 0x7f0fd8082070 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.938+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa9cf0 con 0x55d22ba9b690 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.939+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.939+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94361164093504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baaa110 con 0x55d22ba9b690 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.939+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94361164089728] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.939+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baaac00 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.940+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94361164093504] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.940+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.940+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94361164097232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baaa110 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.940+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baab0b0 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.941+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94361164097232] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.941+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.941+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94361164098496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baaa110 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.941+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baabac0 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94361164098496] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94361164094560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baabca0 con 0x7f0fe8031040 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 20 add_watcher() i=0 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 20 add_watcher() i=1 2024-04-24T01:43:23.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 20 add_watcher() i=2 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 20 add_watcher() i=3 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 20 add_watcher() i=4 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 20 add_watcher() i=5 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.942+0000 7f0ff3416800 20 add_watcher() i=6 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.943+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94361164094560] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.943+0000 7f0ff3416800 20 add_watcher() i=7 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.943+0000 7f0ff3416800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.943+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22baaee50 con 0x55d22ba9b690 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.944+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.944+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94361164113920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baabc10 con 0x55d22ba9b690 2024-04-24T01:43:23.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.945+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94361164113920] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.945+0000 7f0ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.945+0000 7f0ff3416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:23.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.945+0000 7f0ff3416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:23.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.945+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baae140 con 0x55d22ba9b690 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.946+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.946+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab7f10 con 0x7f0fe8031040 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.947+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.947+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab7f10 con 0x55d22baa18e0 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.948+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.948+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab83c0 con 0x55d22ba9b690 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.949+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'198 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.949+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab83c0 con 0x7f0fd8082070 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.950+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.950+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab8930 con 0x55d22baa18e0 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.951+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'55 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.951+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab8cd0 con 0x55d22ba9b690 2024-04-24T01:43:23.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.952+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.952+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab8cd0 con 0x7f0fe8031040 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.953+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.953+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab8cd0 con 0x7f0fd8082070 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.954+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.954+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab92e0 con 0x55d22baa18e0 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.955+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.955+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab9680 con 0x7f0fd8082070 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.956+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'73 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.956+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab9bf0 con 0x7f0fe8031040 2024-04-24T01:43:23.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.957+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.957+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22bab9bf0 con 0x7f0fd8082070 2024-04-24T01:43:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.958+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.958+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x7f0fe8031040 2024-04-24T01:43:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.960+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.960+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22ba9b690 2024-04-24T01:43:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.961+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'199 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.961+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.962+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.962+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x7f0fd8082070 2024-04-24T01:43:23.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.963+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'74 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.963+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.964+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.964+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22ba9b690 2024-04-24T01:43:23.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.965+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.965+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22ba9b690 2024-04-24T01:43:23.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.966+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'200 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.966+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.967+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.967+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x7f0fd8082070 2024-04-24T01:43:23.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.968+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.968+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.969+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'34 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.969+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.970+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'45 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.970+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.971+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.971+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.972+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'56 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.972+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x7f0fe8031040 2024-04-24T01:43:23.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.973+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.973+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.974+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.974+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x7f0fe8031040 2024-04-24T01:43:23.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.975+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.975+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x55d22baa18e0 2024-04-24T01:43:23.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.976+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.976+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x7f0fe8031040 2024-04-24T01:43:23.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.977+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'64 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.977+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baba0a0 con 0x7f0fd8082070 2024-04-24T01:43:23.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.978+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0e1ffff640 20 reqs_thread_entry: start 2024-04-24T01:43:23.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:23.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 20 Filter name: none 2024-04-24T01:43:23.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0e1dffb640 20 reqs_thread_entry: start 2024-04-24T01:43:23.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:43:23.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 20 rados->read ofs=0 len=0 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22bae4fa0 con 0x55d22ba9b690 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.979+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d22bae4f20 con 0x7f0fd8082070 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.980+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.981 INFO:teuthology.orchestra.run.smithi131.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T01:43:23.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.981+0000 7f0ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:23.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.981+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94361164113920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22ba97950 con 0x55d22ba9b690 2024-04-24T01:43:23.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.982+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94361164113920] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.982+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94361164079888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baae800 con 0x7f0fd8082070 2024-04-24T01:43:23.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.982+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94361164079888] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.982+0000 7f0ff3416800 20 remove_watcher() i=0 2024-04-24T01:43:23.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.983+0000 7f0ff3416800 2 removed watcher, disabling cache 2024-04-24T01:43:23.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.983+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94361164083792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa6310 con 0x55d22ba9b690 2024-04-24T01:43:23.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.984+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94361164083792] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.984+0000 7f0ff3416800 20 remove_watcher() i=1 2024-04-24T01:43:23.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.984+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94361164077376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa7250 con 0x55d22baa18e0 2024-04-24T01:43:23.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.985+0000 7f0fe7fff640 1 -- 172.21.15.131:0/585002696 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94361164077376] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd8071030 con 0x55d22baa18e0 2024-04-24T01:43:23.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.985+0000 7f0ff3416800 20 remove_watcher() i=2 2024-04-24T01:43:23.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.985+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94361164089728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa5940 con 0x7f0fd8082070 2024-04-24T01:43:23.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.985+0000 7f0fef35d640 1 -- 172.21.15.131:0/585002696 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94361164089728] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8040040 con 0x7f0fd8082070 2024-04-24T01:43:23.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.986+0000 7f0ff3416800 20 remove_watcher() i=3 2024-04-24T01:43:23.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.986+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94361164093504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa5940 con 0x55d22ba9b690 2024-04-24T01:43:23.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.986+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94361164093504] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x55d22ba9b690 2024-04-24T01:43:23.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.986+0000 7f0ff3416800 20 remove_watcher() i=4 2024-04-24T01:43:23.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.986+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94361164097232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa9840 con 0x7f0fe8031040 2024-04-24T01:43:23.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.987+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94361164097232] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.987+0000 7f0ff3416800 20 remove_watcher() i=5 2024-04-24T01:43:23.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.987+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94361164098496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa5940 con 0x7f0fe8031040 2024-04-24T01:43:23.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.988+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94361164098496] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.988+0000 7f0ff3416800 20 remove_watcher() i=6 2024-04-24T01:43:23.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.988+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94361164094560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d22baa9840 con 0x7f0fe8031040 2024-04-24T01:43:23.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.989+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94361164094560] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0018950 con 0x7f0fe8031040 2024-04-24T01:43:23.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.989+0000 7f0ff3416800 20 remove_watcher() i=7 2024-04-24T01:43:23.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0fe8031040 msgr2=0x7f0fe8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f0fe8031040 0x7f0fe8032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22ba9b690 msgr2=0x55d22ba9db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22ba9b690 0x55d22ba9db50 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0fd8082070 msgr2=0x7f0fd8097630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f0fd8082070 0x7f0fd8097630 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d22baa18e0 msgr2=0x55d22baa3cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55d22baa18e0 0x55d22baa3cd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0eb80368b0 msgr2=0x7f0eb8038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0eb80368b0 0x7f0eb8038d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55d22b8dce50 tx=0x7f0fe801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 msgr2=0x55d22ba8fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0feeb5c640 1 -- 172.21.15.131:0/585002696 reap_dead start 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba8fc10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0fd808ccc0 tx=0x7f0fd808dd30 comp rx=0 tx=0).stop 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 shutdown_connections 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/585002696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba886e0 0x55d22ba8fc10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 >> 172.21.15.131:0/585002696 conn(0x55d22ba84a40 msgr2=0x55d22ba820a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 shutdown_connections 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/585002696 wait complete. 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ec8036900 msgr2=0x7f0ec8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ec8036900 0x7f0ec8038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55d22b8dce80 tx=0x7f0fe8005840 comp rx=0 tx=0).stop 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba7b420 msgr2=0x55d22ba7b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba7b420 0x55d22ba7b840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8044840 tx=0x7f0fd8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 shutdown_connections 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ec8036900 0x7f0ec8038dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1295050377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22ba7b420 0x55d22ba7b840 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 >> 172.21.15.131:0/1295050377 conn(0x55d22ba6f4c0 msgr2=0x55d22ba6f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 shutdown_connections 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/1295050377 wait complete. 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.990+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22b96c330 msgr2=0x55d22ba6a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22b96c330 0x55d22ba6a090 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ed4036950 msgr2=0x7f0ed4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ed4036950 0x7f0ed4038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8054000 tx=0x7f0fd804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 msgr2=0x55d22b8dd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22b8dd9a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000b7c0 tx=0x7f0fe0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 shutdown_connections 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55d22b96c330 0x55d22ba6a090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0ed4036950 0x7f0ed4038e10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 --2- 172.21.15.131:0/1628202041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d22b967f90 0x55d22b8dd9a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 >> 172.21.15.131:0/1628202041 conn(0x55d22b963530 msgr2=0x55d22ba53210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 shutdown_connections 2024-04-24T01:43:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:23.991+0000 7f0ff3416800 1 -- 172.21.15.131:0/1628202041 wait complete. 2024-04-24T01:43:23.999 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:43:24.021 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:43:24.026 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-24T01:43:59.027 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-24T01:43:59.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-24T01:43:59.028 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-24T01:43:59.078 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:59.078 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:59.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.078+0000 7f42e0e3a800 1 Processor -- start 2024-04-24T01:43:59.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.078+0000 7f42e0e3a800 1 -- start start 2024-04-24T01:43:59.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.078+0000 7f42e0e3a800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56140c6721e0 0x56140c67ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.078+0000 7f42e0e3a800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56140c530d40 con 0x56140c6706a0 2024-04-24T01:43:59.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.078+0000 7f42e0e3a800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x56140c5034d0 con 0x56140c6721e0 2024-04-24T01:43:59.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.079+0000 7f42db2d4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56140c6721e0 0x56140c67ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.079+0000 7f42db2d4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56140c6721e0 0x56140c67ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:41990/0 (socket says 172.21.15.131:41990) 2024-04-24T01:43:59.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.079+0000 7f42db2d4640 1 -- 172.21.15.131:0/39936684 learned_addr learned my addr 172.21.15.131:0/39936684 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.079+0000 7f42db2d4640 1 -- 172.21.15.131:0/39936684 >> v1:172.21.15.107:6789/0 conn(0x56140c6706a0 legacy=0x56140c670ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.079+0000 7f42db2d4640 1 -- 172.21.15.131:0/39936684 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140c52f590 con 0x56140c6721e0 2024-04-24T01:43:59.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.081+0000 7f42db2d4640 1 --2- 172.21.15.131:0/39936684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6721e0 0x56140c67ace0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f42d000a520 tx=0x7f42d001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0a68ed24b54123 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.081+0000 7f42daad3640 1 -- 172.21.15.131:0/39936684 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d0057070 con 0x56140c6721e0 2024-04-24T01:43:59.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.081+0000 7f42daad3640 1 -- 172.21.15.131:0/39936684 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d0052570 con 0x56140c6721e0 2024-04-24T01:43:59.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.081+0000 7f42daad3640 1 -- 172.21.15.131:0/39936684 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d004ae60 con 0x56140c6721e0 2024-04-24T01:43:59.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.082+0000 7f42e0e3a800 1 -- 172.21.15.131:0/39936684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6721e0 msgr2=0x56140c67ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.082+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/39936684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6721e0 0x56140c67ace0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f42d000a520 tx=0x7f42d001d010 comp rx=0 tx=0).stop 2024-04-24T01:43:59.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.082+0000 7f42e0e3a800 1 -- 172.21.15.131:0/39936684 shutdown_connections 2024-04-24T01:43:59.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.082+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/39936684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6721e0 0x56140c67ace0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.082+0000 7f42e0e3a800 1 -- 172.21.15.131:0/39936684 >> 172.21.15.131:0/39936684 conn(0x56140c66c380 msgr2=0x56140c66e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.082+0000 7f42e0e3a800 1 -- 172.21.15.131:0/39936684 shutdown_connections 2024-04-24T01:43:59.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.082+0000 7f42e0e3a800 1 -- 172.21.15.131:0/39936684 wait complete. 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.096+0000 7f42e0e3a800 1 Processor -- start 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.096+0000 7f42e0e3a800 1 -- start start 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.096+0000 7f42e0e3a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c765590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.096+0000 7f42e0e3a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56140c5bd3c0 con 0x56140c6706a0 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.096+0000 7f42dbad5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c765590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.096+0000 7f42dbad5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c765590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42004/0 (socket says 172.21.15.131:42004) 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.096+0000 7f42dbad5640 1 -- 172.21.15.131:0/2631990118 learned_addr learned my addr 172.21.15.131:0/2631990118 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.097+0000 7f42dbad5640 1 -- 172.21.15.131:0/2631990118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140c765b60 con 0x56140c6706a0 2024-04-24T01:43:59.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.097+0000 7f42dbad5640 1 --2- 172.21.15.131:0/2631990118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c765590 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0015f0 tx=0x7f42cc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844805c217c6434f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.097+0000 7f41c9e0b640 1 -- 172.21.15.131:0/2631990118 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc017070 con 0x56140c6706a0 2024-04-24T01:43:59.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.097+0000 7f41c9e0b640 1 -- 172.21.15.131:0/2631990118 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc00f640 con 0x56140c6706a0 2024-04-24T01:43:59.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.097+0000 7f41c9e0b640 1 -- 172.21.15.131:0/2631990118 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc00f980 con 0x56140c6706a0 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 -- 172.21.15.131:0/2631990118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 msgr2=0x56140c765590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/2631990118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c765590 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0015f0 tx=0x7f42cc001ab0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 -- 172.21.15.131:0/2631990118 shutdown_connections 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/2631990118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c765590 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 -- 172.21.15.131:0/2631990118 >> 172.21.15.131:0/2631990118 conn(0x56140c66c380 msgr2=0x56140c760eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 -- 172.21.15.131:0/2631990118 shutdown_connections 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 -- 172.21.15.131:0/2631990118 wait complete. 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 Processor -- start 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.098+0000 7f42e0e3a800 1 -- start start 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.099+0000 7f42e0e3a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c76d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.099+0000 7f42e0e3a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56140c67d500 con 0x56140c6706a0 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.099+0000 7f42dbad5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c76d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.099+0000 7f42dbad5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c76d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42006/0 (socket says 172.21.15.131:42006) 2024-04-24T01:43:59.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.099+0000 7f42dbad5640 1 -- 172.21.15.131:0/3466731993 learned_addr learned my addr 172.21.15.131:0/3466731993 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.099+0000 7f42dbad5640 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140c76d670 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.099+0000 7f42dbad5640 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c76d130 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000f80 tx=0x7f42cc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.100+0000 7f41c3fff640 1 -- 172.21.15.131:0/3466731993 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc017040 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.100+0000 7f41c3fff640 1 -- 172.21.15.131:0/3466731993 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc006160 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.100+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56140c76d900 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.100+0000 7f41c3fff640 1 -- 172.21.15.131:0/3466731993 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc0128f0 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.100+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140c7705b0 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f41c3fff640 1 -- 172.21.15.131:0/3466731993 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42cc012a90 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f41c3fff640 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41c4036950 0x7f41c4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f41c3fff640 1 -- 172.21.15.131:0/3466731993 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f42cc04c5e0 con 0x56140c6706a0 2024-04-24T01:43:59.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f42db2d4640 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41c4036950 0x7f41c4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c6721e0 0x56140c774370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7748f0 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c6721e0 0x56140c774370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.101+0000 7f42db2d4640 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41c4036950 0x7f41c4038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42d0054000 tx=0x7f42d004c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.102+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c6721e0 0x56140c774370 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.102+0000 7f42dc2d6640 1 -- 172.21.15.131:0/3466731993 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42d40083e0 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.102+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c771920 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.102+0000 7f42dc2d6640 1 -- 172.21.15.131:0/3466731993 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42d40083e0 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.102+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c776710 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.102+0000 7f42dc2d6640 1 -- 172.21.15.131:0/3466731993 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42d40083e0 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.102+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c775a50 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.103+0000 7f42dc2d6640 1 -- 172.21.15.131:0/3466731993 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42d40083e0 con 0x56140c6721e0 2024-04-24T01:43:59.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.103+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c775e40 con 0x56140c6721e0 2024-04-24T01:43:59.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.103+0000 7f42dc2d6640 1 -- 172.21.15.131:0/3466731993 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f42d40083e0 con 0x56140c6721e0 2024-04-24T01:43:59.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.103+0000 7f42e0e3a800 1 Processor -- start 2024-04-24T01:43:59.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.103+0000 7f42e0e3a800 1 -- start start 2024-04-24T01:43:59.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.104+0000 7f42e0e3a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c785520 0x56140c785940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.104+0000 7f42e0e3a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56140c5636b0 con 0x56140c785520 2024-04-24T01:43:59.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.104+0000 7f42db2d4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c785520 0x56140c785940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.104+0000 7f42db2d4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c785520 0x56140c785940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42010/0 (socket says 172.21.15.131:42010) 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.104+0000 7f42db2d4640 1 -- 172.21.15.131:0/1929629934 learned_addr learned my addr 172.21.15.131:0/1929629934 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.104+0000 7f42db2d4640 1 -- 172.21.15.131:0/1929629934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140c785e80 con 0x56140c785520 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.104+0000 7f42db2d4640 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c785520 0x56140c785940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f42d0000c00 tx=0x56140c5e5550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.105+0000 7f41c17fa640 1 -- 172.21.15.131:0/1929629934 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d0057040 con 0x56140c785520 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.105+0000 7f41c17fa640 1 -- 172.21.15.131:0/1929629934 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d005d440 con 0x56140c785520 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.105+0000 7f41c17fa640 1 -- 172.21.15.131:0/1929629934 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d005d720 con 0x56140c785520 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.105+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56140c7868f0 con 0x56140c785520 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.105+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140c786d90 con 0x56140c785520 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f41c17fa640 1 -- 172.21.15.131:0/1929629934 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42d0067070 con 0x56140c785520 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f41c17fa640 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41b4036970 0x7f41b4038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f41c17fa640 1 -- 172.21.15.131:0/1929629934 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f42d008f570 con 0x56140c785520 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41b4036970 0x7f41b4038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f42e0e3a800 1 Processor -- start 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41b4036970 0x7f41b4038e30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x56140c775570 tx=0x7f42d4000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f42e0e3a800 1 -- start start 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f42e0e3a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c792bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.106+0000 7f42e0e3a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56140c765ee0 con 0x56140c7927a0 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f42db2d4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c792bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f42db2d4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c792bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42016/0 (socket says 172.21.15.131:42016) 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f42db2d4640 1 -- 172.21.15.131:0/899315027 learned_addr learned my addr 172.21.15.131:0/899315027 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f42db2d4640 1 -- 172.21.15.131:0/899315027 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140c793190 con 0x56140c7927a0 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f42db2d4640 1 --2- 172.21.15.131:0/899315027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c792bc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f42d008d900 tx=0x7f42d0006fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2be51030e7b3bc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f41baffd640 1 -- 172.21.15.131:0/899315027 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d0068c50 con 0x56140c7927a0 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f41baffd640 1 -- 172.21.15.131:0/899315027 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d0068df0 con 0x56140c7927a0 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.107+0000 7f41baffd640 1 -- 172.21.15.131:0/899315027 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d008f0d0 con 0x56140c7927a0 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 -- 172.21.15.131:0/899315027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 msgr2=0x56140c792bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/899315027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c792bc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f42d008d900 tx=0x7f42d0006fc0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 -- 172.21.15.131:0/899315027 shutdown_connections 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/899315027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c792bc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 -- 172.21.15.131:0/899315027 >> 172.21.15.131:0/899315027 conn(0x56140c78eb00 msgr2=0x56140c78cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 -- 172.21.15.131:0/899315027 shutdown_connections 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 -- 172.21.15.131:0/899315027 wait complete. 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 Processor -- start 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 -- start start 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c799dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42e0e3a800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56140c793900 con 0x56140c7927a0 2024-04-24T01:43:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42db2d4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c799dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42db2d4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c799dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42020/0 (socket says 172.21.15.131:42020) 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.108+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 learned_addr learned my addr 172.21.15.131:0/424209794 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.109+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140c79a310 con 0x56140c7927a0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.109+0000 7f42db2d4640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c799dd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f42d0052e80 tx=0x7f42d008d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.109+0000 7f41b97fa640 1 -- 172.21.15.131:0/424209794 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d0068c50 con 0x56140c7927a0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.109+0000 7f41b97fa640 1 -- 172.21.15.131:0/424209794 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d0093030 con 0x56140c7927a0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.109+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56140c79a5a0 con 0x56140c7927a0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.109+0000 7f41b97fa640 1 -- 172.21.15.131:0/424209794 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d008dd90 con 0x56140c7927a0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.109+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140c79d250 con 0x56140c7927a0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f41b97fa640 1 -- 172.21.15.131:0/424209794 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42d005d950 con 0x56140c7927a0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f41b97fa640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41a4036950 0x7f41a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f41b97fa640 1 -- 172.21.15.131:0/424209794 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f42d00a9d00 con 0x56140c7927a0 2024-04-24T01:43:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41a4036950 0x7f41a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c7a59a0 0x56140c7a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7a85b0 con 0x56140c7a59a0 2024-04-24T01:43:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.110+0000 7f42dbad5640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c7a59a0 0x56140c7a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41a4036950 0x7f41a4038e10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42d400f010 tx=0x7f42d400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42dbad5640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c7a59a0 0x56140c7a7e60 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 20 realm 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7a89c0 con 0x56140c7a59a0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7a9260 con 0x56140c7a59a0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.111+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7a9600 con 0x56140c7a59a0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42e0e3a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7a8eb0 con 0x56140c7a59a0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42e0e3a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42e0e3a800 20 searching for the correct realm 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56140c7abab0 0x56140c7adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7abab0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42db2d4640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56140c7abab0 0x56140c7adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.112+0000 7f42db2d4640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56140c7abab0 0x56140c7adec0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.113+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.113+0000 7f42db2d4640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f42d0086050 0x7f42d0098880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.113+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d0086050 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.113+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f42d0086050 0x7f42d0098880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.113+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f42d0086050 0x7f42d0098880 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.113+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.114+0000 7f42dc2d6640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f42d4019040 0x7f42d4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.114+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d4019040 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.114+0000 7f42dbad5640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f42d4019040 0x7f42d4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.114+0000 7f42dbad5640 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f42d4019040 0x7f42d4019930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7a59a0 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7a59a0 2024-04-24T01:43:59.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d4019040 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.115+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d4019040 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d0086050 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7abab0 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7a59a0 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.116+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d4019040 2024-04-24T01:43:59.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.117+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.117+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7a59a0 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.117+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.117+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d0086050 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.117+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.117+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7abab0 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.117+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.118+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7abab0 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.118+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.118+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d4019040 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.118+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.118+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7abab0 2024-04-24T01:43:59.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.118+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.118+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7abab0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.119+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.119+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7a59a0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.119+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.119+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x56140c7a59a0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.119+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.119+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ae590 con 0x7f42d4019040 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.119+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x56140c7abab0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x7f42d0086050 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x56140c7a59a0 2024-04-24T01:43:59.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x7f42d0086050 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.120+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x56140c7abab0 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.121+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.121+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x7f42d4019040 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.121+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.121+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x7f42d0086050 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.121+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.121+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x56140c7abab0 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.122+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.122+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x7f42d4019040 2024-04-24T01:43:59.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.122+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.122+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x56140c7a59a0 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.122+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.122+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42cc055040 con 0x7f42d0086050 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.122+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7aa550 con 0x56140c7a59a0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7aadf0 con 0x56140c7a59a0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7aa190 con 0x56140c7a59a0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 zone default found 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 4 Realm: () 2024-04-24T01:43:59.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 zonegroup default 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.123+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7aea10 con 0x7f42d0086050 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b08a0 con 0x56140c7abab0 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b0c40 con 0x56140c7abab0 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 20 started sync module instance, tier type = 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.124+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7afd30 con 0x7f42d0086050 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.125+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.125+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644108722768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7afd30 con 0x7f42d0086050 2024-04-24T01:43:59.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.125+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b1640 con 0x56140c7a59a0 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.127+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644108722768] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.127+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.127+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644108726608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7afd30 con 0x56140c7a59a0 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.127+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b20c0 con 0x56140c7abab0 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.128+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644108726608] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.129+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.129+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644108720256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7afca0 con 0x56140c7abab0 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.129+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b2f80 con 0x7f42d0086050 2024-04-24T01:43:59.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.130+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.130+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644108733616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b3820 con 0x7f42d0086050 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.130+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b42f0 con 0x56140c7a59a0 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.130+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644108720256] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.131+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644108733616] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.131+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.131+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644108738016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b3370 con 0x56140c7a59a0 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.131+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b4b90 con 0x7f42d4019040 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.132+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644108738016] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.132+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.132+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644108731568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b3370 con 0x7f42d4019040 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.132+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b51d0 con 0x7f42d4019040 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.133+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644108731568] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.133+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.133+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644108741824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b5190 con 0x7f42d4019040 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.133+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b5b90 con 0x7f42d4019040 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644108744352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b5fb0 con 0x7f42d4019040 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 20 add_watcher() i=0 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 20 add_watcher() i=1 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 20 add_watcher() i=2 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 20 add_watcher() i=3 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 20 add_watcher() i=4 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 20 add_watcher() i=5 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644108741824] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.135+0000 7f42e0e3a800 20 add_watcher() i=6 2024-04-24T01:43:59.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.136+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644108744352] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.136+0000 7f42e0e3a800 20 add_watcher() i=7 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.136+0000 7f42e0e3a800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.136+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b4570 con 0x56140c7a59a0 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.136+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.136+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644108745408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b4570 con 0x56140c7a59a0 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.137+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644108745408] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.137+0000 7f4191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.137+0000 7f42e0e3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.137+0000 7f42e0e3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.137+0000 7f42e0e3a800 5 note: GC not initialized 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.137+0000 7f4190fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:59.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f42e0e3a800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f42e0e3a800 20 Filter name: none 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f410a7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ec960 con 0x56140c7a59a0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ec920 con 0x7f42d0086050 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.138+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ec920 con 0x56140c7a59a0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ec920 con 0x56140c7abab0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ece00 con 0x56140c7abab0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ed240 con 0x56140c7abab0 2024-04-24T01:43:59.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ed650 con 0x56140c7a59a0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.139+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ed650 con 0x56140c7a59a0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.140+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.140+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ed650 con 0x56140c7abab0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.140+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.140+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ed650 con 0x56140c7abab0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.140+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.140+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ed600 con 0x7f42d4019040 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7a59a0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d0086050 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7abab0 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.141+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d4019040 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.142+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.142+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d4019040 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.142+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.142+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7abab0 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.142+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.142+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d4019040 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7a59a0 2024-04-24T01:43:59.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7abab0 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d4019040 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.143+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d0086050 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d4019040 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7a59a0 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7a59a0 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.144+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7a59a0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7a59a0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.145+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.146+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.146+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56140c7ef160 con 0x7f42d4019040 2024-04-24T01:43:59.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.146+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.147+0000 7f4191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.147+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644108745408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7eab80 con 0x56140c7a59a0 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.148+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94644108745408] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.148+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644108722768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b5ac0 con 0x7f42d0086050 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.149+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94644108722768] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.149+0000 7f42e0e3a800 20 remove_watcher() i=0 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.149+0000 7f42e0e3a800 2 removed watcher, disabling cache 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.149+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644108726608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b0250 con 0x56140c7a59a0 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.150+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94644108726608] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.150+0000 7f42e0e3a800 20 remove_watcher() i=1 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.150+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644108720256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b0250 con 0x56140c7abab0 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.151+0000 7f42db2d4640 1 -- 172.21.15.131:0/424209794 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94644108720256] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d0066030 con 0x56140c7abab0 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.151+0000 7f42e0e3a800 20 remove_watcher() i=2 2024-04-24T01:43:59.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.151+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644108733616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7af880 con 0x7f42d0086050 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.152+0000 7f42dc2d6640 1 -- 172.21.15.131:0/424209794 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94644108733616] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d402f040 con 0x7f42d0086050 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.152+0000 7f42e0e3a800 20 remove_watcher() i=3 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.152+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644108738016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b0250 con 0x56140c7a59a0 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.153+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94644108738016] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x56140c7a59a0 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.153+0000 7f42e0e3a800 20 remove_watcher() i=4 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.153+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644108731568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7af880 con 0x7f42d4019040 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.154+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94644108731568] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.154+0000 7f42e0e3a800 20 remove_watcher() i=5 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.154+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644108741824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b3de0 con 0x7f42d4019040 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.155+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94644108741824] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.155+0000 7f42e0e3a800 20 remove_watcher() i=6 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.155+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644108744352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56140c7b0250 con 0x7f42d4019040 2024-04-24T01:43:59.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94644108744352] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc024020 con 0x7f42d4019040 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 20 remove_watcher() i=7 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f42d4019040 msgr2=0x7f42d4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f42d4019040 0x7f42d4019930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c7a59a0 msgr2=0x56140c7a7e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c7a59a0 0x56140c7a7e60 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f42d0086050 msgr2=0x7f42d0098880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f42d0086050 0x7f42d0098880 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56140c7abab0 msgr2=0x56140c7adec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56140c7abab0 0x56140c7adec0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41a4036950 msgr2=0x7f41a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41a4036950 0x7f41a4038e10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42d400f010 tx=0x7f42d400c040 comp rx=0 tx=0).stop 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 msgr2=0x56140c799dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42dbad5640 1 -- 172.21.15.131:0/424209794 reap_dead start 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c799dd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f42d0052e80 tx=0x7f42d008d860 comp rx=0 tx=0).stop 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 shutdown_connections 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/424209794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c7927a0 0x56140c799dd0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 >> 172.21.15.131:0/424209794 conn(0x56140c78eb00 msgr2=0x56140c78c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 shutdown_connections 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/424209794 wait complete. 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41b4036970 msgr2=0x7f41b4038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41b4036970 0x7f41b4038e30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x56140c775570 tx=0x7f42d4000f90 comp rx=0 tx=0).stop 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c785520 msgr2=0x56140c785940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c785520 0x56140c785940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f42d0000c00 tx=0x56140c5e5550 comp rx=0 tx=0).stop 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 shutdown_connections 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41b4036970 0x7f41b4038e30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/1929629934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c785520 0x56140c785940 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 >> 172.21.15.131:0/1929629934 conn(0x56140c7795c0 msgr2=0x56140c7799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 shutdown_connections 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.157+0000 7f42e0e3a800 1 -- 172.21.15.131:0/1929629934 wait complete. 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c6721e0 msgr2=0x56140c774370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c6721e0 0x56140c774370 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41c4036950 msgr2=0x7f41c4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41c4036950 0x7f41c4038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42d0054000 tx=0x7f42d004c000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 msgr2=0x56140c76d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c76d130 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000f80 tx=0x7f42cc001250 comp rx=0 tx=0).stop 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 shutdown_connections 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56140c6721e0 0x56140c774370 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41c4036950 0x7f41c4038e10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 --2- 172.21.15.131:0/3466731993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56140c6706a0 0x56140c76d130 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 >> 172.21.15.131:0/3466731993 conn(0x56140c66c380 msgr2=0x56140c75f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 shutdown_connections 2024-04-24T01:43:59.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.158+0000 7f42e0e3a800 1 -- 172.21.15.131:0/3466731993 wait complete. 2024-04-24T01:43:59.168 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-24T01:43:59.168 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T01:43:59.168 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-24T01:43:59.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-24T01:43:59.169 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-24T01:43:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:59.209 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf5f2d800 1 Processor -- start 2024-04-24T01:43:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf5f2d800 1 -- start start 2024-04-24T01:43:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf5f2d800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562f87f9d3b0 0x562f87f9f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf5f2d800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f87e57d40 con 0x562f87f998a0 2024-04-24T01:43:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf5f2d800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x562f87e2a4d0 con 0x562f87f9d3b0 2024-04-24T01:43:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf137e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562f87f9d3b0 0x562f87f9f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf137e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562f87f9d3b0 0x562f87f9f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42026/0 (socket says 172.21.15.131:42026) 2024-04-24T01:43:59.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf137e640 1 -- 172.21.15.131:0/316369775 learned_addr learned my addr 172.21.15.131:0/316369775 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf1b7f640 1 --1- 172.21.15.131:0/316369775 >> v1:172.21.15.107:6789/0 conn(0x562f87f998a0 0x562f87f9bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:55538/0 (socket says 172.21.15.131:55538) 2024-04-24T01:43:59.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf137e640 1 -- 172.21.15.131:0/316369775 >> v1:172.21.15.107:6789/0 conn(0x562f87f998a0 legacy=0x562f87f9bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.210+0000 7fccf137e640 1 -- 172.21.15.131:0/316369775 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f87e56590 con 0x562f87f9d3b0 2024-04-24T01:43:59.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.212+0000 7fccf137e640 1 --2- 172.21.15.131:0/316369775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f9d3b0 0x562f87f9f7a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcce800a520 tx=0x7fcce801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7175141db7d0d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.212+0000 7fccf0b7d640 1 -- 172.21.15.131:0/316369775 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8057070 con 0x562f87f9d3b0 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.212+0000 7fccf0b7d640 1 -- 172.21.15.131:0/316369775 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce8052570 con 0x562f87f9d3b0 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.212+0000 7fccf0b7d640 1 -- 172.21.15.131:0/316369775 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce804ae60 con 0x562f87f9d3b0 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.213+0000 7fccf5f2d800 1 -- 172.21.15.131:0/316369775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f9d3b0 msgr2=0x562f87f9f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.213+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/316369775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f9d3b0 0x562f87f9f7a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcce800a520 tx=0x7fcce801d010 comp rx=0 tx=0).stop 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.213+0000 7fccf5f2d800 1 -- 172.21.15.131:0/316369775 shutdown_connections 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.213+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/316369775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f9d3b0 0x562f87f9f7a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.213+0000 7fccf5f2d800 1 -- 172.21.15.131:0/316369775 >> 172.21.15.131:0/316369775 conn(0x562f87f93370 msgr2=0x562f87f95790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.213+0000 7fccf5f2d800 1 -- 172.21.15.131:0/316369775 shutdown_connections 2024-04-24T01:43:59.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.213+0000 7fccf5f2d800 1 -- 172.21.15.131:0/316369775 wait complete. 2024-04-24T01:43:59.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.224+0000 7fccf5f2d800 1 Processor -- start 2024-04-24T01:43:59.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.224+0000 7fccf5f2d800 1 -- start start 2024-04-24T01:43:59.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.225+0000 7fccf5f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f87f991e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.225+0000 7fccf5f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562f87ee43b0 con 0x562f87f998a0 2024-04-24T01:43:59.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.225+0000 7fccf1b7f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f87f991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.225+0000 7fccf1b7f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f87f991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42034/0 (socket says 172.21.15.131:42034) 2024-04-24T01:43:59.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.225+0000 7fccf1b7f640 1 -- 172.21.15.131:0/4281263262 learned_addr learned my addr 172.21.15.131:0/4281263262 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.225+0000 7fccf1b7f640 1 -- 172.21.15.131:0/4281263262 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f87f977a0 con 0x562f87f998a0 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.226+0000 7fccf1b7f640 1 --2- 172.21.15.131:0/4281263262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f87f991e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcce4001e90 tx=0x7fcce400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17973376310add9b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.226+0000 7fcbdfe07640 1 -- 172.21.15.131:0/4281263262 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce400e5c0 con 0x562f87f998a0 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.226+0000 7fcbdfe07640 1 -- 172.21.15.131:0/4281263262 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce4006070 con 0x562f87f998a0 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.226+0000 7fcbdfe07640 1 -- 172.21.15.131:0/4281263262 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce400e890 con 0x562f87f998a0 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.226+0000 7fccf5f2d800 1 -- 172.21.15.131:0/4281263262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 msgr2=0x562f87f991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.226+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/4281263262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f87f991e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcce4001e90 tx=0x7fcce400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 -- 172.21.15.131:0/4281263262 shutdown_connections 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/4281263262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f87f991e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 -- 172.21.15.131:0/4281263262 >> 172.21.15.131:0/4281263262 conn(0x562f87f93370 msgr2=0x562f88085a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 -- 172.21.15.131:0/4281263262 shutdown_connections 2024-04-24T01:43:59.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 -- 172.21.15.131:0/4281263262 wait complete. 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 Processor -- start 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 -- start start 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f88093e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf5f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562f87f9ffe0 con 0x562f87f998a0 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf1b7f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f88093e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf1b7f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f88093e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42042/0 (socket says 172.21.15.131:42042) 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.227+0000 7fccf1b7f640 1 -- 172.21.15.131:0/897659100 learned_addr learned my addr 172.21.15.131:0/897659100 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.228+0000 7fccf1b7f640 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f88094370 con 0x562f87f998a0 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.228+0000 7fccf1b7f640 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f88093e30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fcce4001ed0 tx=0x7fcce4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.228+0000 7fcbde604640 1 -- 172.21.15.131:0/897659100 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce401a880 con 0x562f87f998a0 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.228+0000 7fcbde604640 1 -- 172.21.15.131:0/897659100 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce401aa20 con 0x562f87f998a0 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.228+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f88094600 con 0x562f87f998a0 2024-04-24T01:43:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.228+0000 7fcbde604640 1 -- 172.21.15.131:0/897659100 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce401ad40 con 0x562f87f998a0 2024-04-24T01:43:59.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.228+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f880972b0 con 0x562f87f998a0 2024-04-24T01:43:59.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.229+0000 7fcbde604640 1 -- 172.21.15.131:0/897659100 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcce4017070 con 0x562f87f998a0 2024-04-24T01:43:59.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.229+0000 7fcbde604640 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbd80369a0 0x7fcbd8038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.229+0000 7fcbde604640 1 -- 172.21.15.131:0/897659100 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fcce4015020 con 0x562f87f998a0 2024-04-24T01:43:59.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.229+0000 7fccf137e640 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbd80369a0 0x7fcbd8038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.229+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f87f9d3b0 0x562f8809b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.229+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f8809b600 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.229+0000 7fccf2380640 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f87f9d3b0 0x562f8809b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf137e640 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbd80369a0 0x7fcbd8038e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcce8054000 tx=0x7fcce804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf2380640 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f87f9d3b0 0x562f8809b070 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf2380640 1 -- 172.21.15.131:0/897659100 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccec00a4a0 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88098640 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf2380640 1 -- 172.21.15.131:0/897659100 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccec00a4a0 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f8809d440 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf2380640 1 -- 172.21.15.131:0/897659100 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fccec00a4a0 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.230+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f8809c780 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.231+0000 7fccf2380640 1 -- 172.21.15.131:0/897659100 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccec00a4a0 con 0x562f87f9d3b0 2024-04-24T01:43:59.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.231+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f8809cbd0 con 0x562f87f9d3b0 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.231+0000 7fccf2380640 1 -- 172.21.15.131:0/897659100 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fccec00a4a0 con 0x562f87f9d3b0 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.231+0000 7fccf5f2d800 1 Processor -- start 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.231+0000 7fccf5f2d800 1 -- start start 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.231+0000 7fccf5f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880ac220 0x562f880ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.231+0000 7fccf5f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562f87e8a6b0 con 0x562f880ac220 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.232+0000 7fccf137e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880ac220 0x562f880ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.232+0000 7fccf137e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880ac220 0x562f880ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42056/0 (socket says 172.21.15.131:42056) 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.232+0000 7fccf137e640 1 -- 172.21.15.131:0/3599946356 learned_addr learned my addr 172.21.15.131:0/3599946356 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.232+0000 7fccf137e640 1 -- 172.21.15.131:0/3599946356 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f880acb80 con 0x562f880ac220 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.232+0000 7fccf137e640 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880ac220 0x562f880ac640 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcce8000c00 tx=0x7fcce8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.232+0000 7fcbd77fe640 1 -- 172.21.15.131:0/3599946356 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8057040 con 0x562f880ac220 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.233+0000 7fcbd77fe640 1 -- 172.21.15.131:0/3599946356 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce805d650 con 0x562f880ac220 2024-04-24T01:43:59.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.233+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f880ad5f0 con 0x562f880ac220 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.233+0000 7fcbd77fe640 1 -- 172.21.15.131:0/3599946356 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce805d930 con 0x562f880ac220 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.233+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f880ada90 con 0x562f880ac220 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.233+0000 7fcbd77fe640 1 -- 172.21.15.131:0/3599946356 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcce8067070 con 0x562f880ac220 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fcbd77fe640 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbcc036900 0x7fcbcc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fcbd77fe640 1 -- 172.21.15.131:0/3599946356 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fcce808f860 con 0x562f880ac220 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf2380640 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbcc036900 0x7fcbcc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf5f2d800 1 Processor -- start 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf2380640 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbcc036900 0x7fcbcc038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x562f8809c2a0 tx=0x7fccec005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf5f2d800 1 -- start start 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf5f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf5f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562f87f97b20 con 0x562f880b9460 2024-04-24T01:43:59.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf137e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf137e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880b9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42070/0 (socket says 172.21.15.131:42070) 2024-04-24T01:43:59.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.234+0000 7fccf137e640 1 -- 172.21.15.131:0/355136270 learned_addr learned my addr 172.21.15.131:0/355136270 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf137e640 1 -- 172.21.15.131:0/355136270 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f880b9e50 con 0x562f880b9460 2024-04-24T01:43:59.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf137e640 1 --2- 172.21.15.131:0/355136270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880b9880 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcce808db70 tx=0x7fcce808ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6f00a1cf6b81dc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fcbd57fa640 1 -- 172.21.15.131:0/355136270 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8000ed0 con 0x562f880b9460 2024-04-24T01:43:59.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fcbd57fa640 1 -- 172.21.15.131:0/355136270 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce8068c50 con 0x562f880b9460 2024-04-24T01:43:59.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fcbd57fa640 1 -- 172.21.15.131:0/355136270 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8001070 con 0x562f880b9460 2024-04-24T01:43:59.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf5f2d800 1 -- 172.21.15.131:0/355136270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 msgr2=0x562f880b9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/355136270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880b9880 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcce808db70 tx=0x7fcce808ddf0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf5f2d800 1 -- 172.21.15.131:0/355136270 shutdown_connections 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/355136270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880b9880 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf5f2d800 1 -- 172.21.15.131:0/355136270 >> 172.21.15.131:0/355136270 conn(0x562f880b57c0 msgr2=0x562f880b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf5f2d800 1 -- 172.21.15.131:0/355136270 shutdown_connections 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.235+0000 7fccf5f2d800 1 -- 172.21.15.131:0/355136270 wait complete. 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf5f2d800 1 Processor -- start 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf5f2d800 1 -- start start 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf5f2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf5f2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562f880ba5c0 con 0x562f880b9460 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf137e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf137e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42080/0 (socket says 172.21.15.131:42080) 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 learned_addr learned my addr 172.21.15.131:0/523398527 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f880c0ff0 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.236+0000 7fccf137e640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880c0ab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcce8052e80 tx=0x7fcce808dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.237+0000 7fcbc37fe640 1 -- 172.21.15.131:0/523398527 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce808f610 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.237+0000 7fcbc37fe640 1 -- 172.21.15.131:0/523398527 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce8093030 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.237+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f880c1280 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.237+0000 7fcbc37fe640 1 -- 172.21.15.131:0/523398527 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8068e00 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.237+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f880c3f30 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.237+0000 7fcbc37fe640 1 -- 172.21.15.131:0/523398527 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcce808fb80 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fcbc37fe640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbbc036900 0x7fcbbc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fcbc37fe640 1 -- 172.21.15.131:0/523398527 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fcce8099d10 con 0x562f880b9460 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf2380640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbbc036900 0x7fcbbc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f880cc5b0 0x562f880cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880cf170 con 0x562f880cc5b0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf1b7f640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f880cc5b0 0x562f880cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf2380640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbbc036900 0x7fcbbc038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x562f88095050 tx=0x7fccec01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf1b7f640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f880cc5b0 0x562f880cea20 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf5f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf5f2d800 20 realm 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.238+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880cf580 con 0x562f880cc5b0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880cfe50 con 0x562f880cc5b0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d01f0 con 0x562f880cc5b0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.239+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d0650 con 0x562f880cc5b0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf5f2d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:59.256 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf5f2d800 20 searching for the correct realm 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562f880d2640 0x562f880d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf137e640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562f880d2640 0x562f880d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf137e640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562f880d2640 0x562f880d4a90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf137e640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcce8086050 0x7fcce80877f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fcce8086050 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.240+0000 7fccf2380640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcce8086050 0x7fcce80877f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.241+0000 7fccf2380640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcce8086050 0x7fcce80877f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.241+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccec01f070 con 0x7fcce8086050 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.241+0000 7fccf2380640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fccec031040 0x7fccec032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.241+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.241+0000 7fccf1b7f640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fccec031040 0x7fccec032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.242+0000 7fccf1b7f640 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fccec031040 0x7fccec032940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.242+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x7fccec031040 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.242+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.242+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.242+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.242+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.242+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x7fccec031040 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x7fccec031040 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fcce8086050 2024-04-24T01:43:59.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccec01f070 con 0x7fcce8086050 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.243+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x7fccec031040 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fcce8086050 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fccec01f070 con 0x7fcce8086050 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.244+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.245+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.245+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.245+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.245+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.245+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x7fccec031040 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.245+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x7fccec031040 2024-04-24T01:43:59.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.246+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fcce8086050 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccec01f070 con 0x7fcce8086050 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce402e070 con 0x562f880cc5b0 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fcce8086050 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccec01f070 con 0x7fcce8086050 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.247+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.248+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.248+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.248+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.248+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fcce8086050 2024-04-24T01:43:59.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.248+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccec01f070 con 0x7fcce8086050 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.248+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880d2640 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fccec031040 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x562f880cc5b0 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f880d5160 con 0x7fcce8086050 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:59.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.249+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d1090 con 0x562f880cc5b0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d1930 con 0x562f880cc5b0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d0cd0 con 0x562f880cc5b0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 zone default found 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 4 Realm: () 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 zonegroup default 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d1930 con 0x7fcce8086050 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.250+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d7470 con 0x562f880d2640 2024-04-24T01:43:59.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880d7810 con 0x562f880d2640 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 20 started sync module instance, tier type = 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.251+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d68b0 con 0x7fcce8086050 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.252+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.252+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94762146033072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d68b0 con 0x7fcce8086050 2024-04-24T01:43:59.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.252+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d81d0 con 0x562f880cc5b0 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.253+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94762146033072] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.253+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.253+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94762146037568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d68b0 con 0x562f880cc5b0 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.253+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d8c20 con 0x562f880d2640 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.254+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94762146037568] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.255+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.255+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94762146030592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d6820 con 0x562f880d2640 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.255+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d9b10 con 0x7fcce8086050 2024-04-24T01:43:59.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.256+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94762146030592] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.256+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.256+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94762146043488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d9f30 con 0x7fcce8086050 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.256+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880da8f0 con 0x562f880cc5b0 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.257+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94762146043488] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.257+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.257+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94762146045024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880da8f0 con 0x562f880cc5b0 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.257+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880db2f0 con 0x7fccec031040 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.258+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.258+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94762146049536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880db220 con 0x7fccec031040 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.258+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880dc240 con 0x7fccec031040 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.258+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94762146045024] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.259+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94762146049536] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.259+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.259+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94762146053424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880dc200 con 0x7fccec031040 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.259+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880dcae0 con 0x7fccec031040 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94762146055728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880dc200 con 0x7fccec031040 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 20 add_watcher() i=0 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 20 add_watcher() i=1 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 20 add_watcher() i=2 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 20 add_watcher() i=3 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 20 add_watcher() i=4 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 20 add_watcher() i=5 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94762146053424] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.260+0000 7fccf5f2d800 20 add_watcher() i=6 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.261+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94762146055728] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.261+0000 7fccf5f2d800 20 add_watcher() i=7 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.261+0000 7fccf5f2d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.261+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f880da440 con 0x562f880cc5b0 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.261+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.262+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94762146047040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880dcff0 con 0x562f880cc5b0 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94762146047040] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fcba37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf5f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf5f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf5f2d800 5 note: GC not initialized 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fcba27fc640 20 reqs_thread_entry: start 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf5f2d800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf5f2d800 20 Filter name: none 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fcb13fff640 20 reqs_thread_entry: start 2024-04-24T01:43:59.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88113360 con 0x562f880cc5b0 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.263+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88113360 con 0x7fcce8086050 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88113320 con 0x562f880cc5b0 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88113320 con 0x562f880d2640 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88113830 con 0x562f880d2640 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.264+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88113c80 con 0x562f880d2640 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88114100 con 0x562f880cc5b0 2024-04-24T01:43:59.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88114100 con 0x562f880cc5b0 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88114100 con 0x562f880d2640 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88114100 con 0x562f880d2640 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.265+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88114080 con 0x7fccec031040 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.266+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.266+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880cc5b0 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.266+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.266+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fcce8086050 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.266+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.266+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880d2640 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.266+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.267+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fccec031040 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.267+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.267+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fccec031040 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.267+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.267+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880d2640 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.267+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.267+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fccec031040 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880cc5b0 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880d2640 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fccec031040 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.268+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fcce8086050 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fccec031040 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880cc5b0 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880cc5b0 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880d2640 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.269+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880cc5b0 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880cc5b0 2024-04-24T01:43:59.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880d2640 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880d2640 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x562f880d2640 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.270+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f88115b40 con 0x7fccec031040 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.271+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.272+0000 7fcba37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.272+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94762146047040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f88111230 con 0x562f880cc5b0 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.273+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94762146047040] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.273+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94762146033072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880da440 con 0x7fcce8086050 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.274+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94762146033072] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.274+0000 7fccf5f2d800 20 remove_watcher() i=0 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.274+0000 7fccf5f2d800 2 removed watcher, disabling cache 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.274+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94762146037568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d6db0 con 0x562f880cc5b0 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.275+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94762146037568] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.275+0000 7fccf5f2d800 20 remove_watcher() i=1 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.275+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94762146030592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d6db0 con 0x562f880d2640 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.276+0000 7fccf137e640 1 -- 172.21.15.131:0/523398527 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94762146030592] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce8066030 con 0x562f880d2640 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.276+0000 7fccf5f2d800 20 remove_watcher() i=2 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.276+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94762146043488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d6db0 con 0x7fcce8086050 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.277+0000 7fccf2380640 1 -- 172.21.15.131:0/523398527 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94762146043488] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccec040040 con 0x7fcce8086050 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.277+0000 7fccf5f2d800 20 remove_watcher() i=3 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.277+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94762146045024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d9660 con 0x562f880cc5b0 2024-04-24T01:43:59.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.278+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94762146045024] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x562f880cc5b0 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.278+0000 7fccf5f2d800 20 remove_watcher() i=4 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.278+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94762146049536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d6db0 con 0x7fccec031040 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.279+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94762146049536] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.279+0000 7fccf5f2d800 20 remove_watcher() i=5 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.279+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94762146053424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d9c60 con 0x7fccec031040 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.280+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94762146053424] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.280+0000 7fccf5f2d800 20 remove_watcher() i=6 2024-04-24T01:43:59.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.280+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94762146055728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f880d9660 con 0x7fccec031040 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.281+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94762146055728] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcce405c040 con 0x7fccec031040 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.281+0000 7fccf5f2d800 20 remove_watcher() i=7 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fccec031040 msgr2=0x7fccec032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fccec031040 0x7fccec032940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f880cc5b0 msgr2=0x562f880cea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f880cc5b0 0x562f880cea20 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcce8086050 msgr2=0x7fcce80877f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcce8086050 0x7fcce80877f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562f880d2640 msgr2=0x562f880d4a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562f880d2640 0x562f880d4a90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbbc036900 msgr2=0x7fcbbc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbbc036900 0x7fcbbc038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x562f88095050 tx=0x7fccec01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 msgr2=0x562f880c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880c0ab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcce8052e80 tx=0x7fcce808dad0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf1b7f640 1 -- 172.21.15.131:0/523398527 reap_dead start 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 shutdown_connections 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/523398527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880b9460 0x562f880c0ab0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 >> 172.21.15.131:0/523398527 conn(0x562f880b57c0 msgr2=0x562f880b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 shutdown_connections 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/523398527 wait complete. 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbcc036900 msgr2=0x7fcbcc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbcc036900 0x7fcbcc038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x562f8809c2a0 tx=0x7fccec005840 comp rx=0 tx=0).stop 2024-04-24T01:43:59.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880ac220 msgr2=0x562f880ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880ac220 0x562f880ac640 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcce8000c00 tx=0x7fcce8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 shutdown_connections 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbcc036900 0x7fcbcc038dc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/3599946356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f880ac220 0x562f880ac640 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 >> 172.21.15.131:0/3599946356 conn(0x562f880a02c0 msgr2=0x562f880a06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 shutdown_connections 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.282+0000 7fccf5f2d800 1 -- 172.21.15.131:0/3599946356 wait complete. 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f87f9d3b0 msgr2=0x562f8809b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f87f9d3b0 0x562f8809b070 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbd80369a0 msgr2=0x7fcbd8038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbd80369a0 0x7fcbd8038e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcce8054000 tx=0x7fcce804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 msgr2=0x562f88093e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f88093e30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fcce4001ed0 tx=0x7fcce4000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 shutdown_connections 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562f87f9d3b0 0x562f8809b070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcbd80369a0 0x7fcbd8038e60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 --2- 172.21.15.131:0/897659100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f87f998a0 0x562f88093e30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 >> 172.21.15.131:0/897659100 conn(0x562f87f93370 msgr2=0x562f87f98080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 shutdown_connections 2024-04-24T01:43:59.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.283+0000 7fccf5f2d800 1 -- 172.21.15.131:0/897659100 wait complete. 2024-04-24T01:43:59.298 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-24T01:43:59.298 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-24T01:43:59.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-24T01:43:59.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-24T01:43:59.299 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-24T01:43:59.381 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:59.381 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:59.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.381+0000 7fd33222f800 1 Processor -- start 2024-04-24T01:43:59.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.381+0000 7fd33222f800 1 -- start start 2024-04-24T01:43:59.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.381+0000 7fd33222f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55de19522970 0x55de19524d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.381+0000 7fd33222f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de193e0d40 con 0x55de195252a0 2024-04-24T01:43:59.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.381+0000 7fd33222f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55de193b34d0 con 0x55de19522970 2024-04-24T01:43:59.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.382+0000 7fd32d5c0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55de19522970 0x55de19524d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.382+0000 7fd32d5c0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55de19522970 0x55de19524d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42090/0 (socket says 172.21.15.131:42090) 2024-04-24T01:43:59.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.382+0000 7fd32d5c0640 1 -- 172.21.15.131:0/2150603366 learned_addr learned my addr 172.21.15.131:0/2150603366 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.382+0000 7fd32cdbf640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55de195252a0 0x55de19527690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:55556/0 (socket says 172.21.15.131:55556) 2024-04-24T01:43:59.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.382+0000 7fd32d5c0640 1 -- 172.21.15.131:0/2150603366 >> v1:172.21.15.107:6789/0 conn(0x55de195252a0 legacy=0x55de19527690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.382+0000 7fd32d5c0640 1 -- 172.21.15.131:0/2150603366 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de193df590 con 0x55de19522970 2024-04-24T01:43:59.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.384+0000 7fd32d5c0640 1 --2- 172.21.15.131:0/2150603366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19524d60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd32000a520 tx=0x7fd32001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9674c800c01cb92a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.384+0000 7fd31ffff640 1 -- 172.21.15.131:0/2150603366 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd320057070 con 0x55de19522970 2024-04-24T01:43:59.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.384+0000 7fd31ffff640 1 -- 172.21.15.131:0/2150603366 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd320052570 con 0x55de19522970 2024-04-24T01:43:59.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.384+0000 7fd31ffff640 1 -- 172.21.15.131:0/2150603366 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd32004ae60 con 0x55de19522970 2024-04-24T01:43:59.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.385+0000 7fd33222f800 1 -- 172.21.15.131:0/2150603366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 msgr2=0x55de19524d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.385+0000 7fd33222f800 1 --2- 172.21.15.131:0/2150603366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19524d60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd32000a520 tx=0x7fd32001d010 comp rx=0 tx=0).stop 2024-04-24T01:43:59.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.385+0000 7fd33222f800 1 -- 172.21.15.131:0/2150603366 shutdown_connections 2024-04-24T01:43:59.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.385+0000 7fd33222f800 1 --2- 172.21.15.131:0/2150603366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19524d60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.385+0000 7fd33222f800 1 -- 172.21.15.131:0/2150603366 >> 172.21.15.131:0/2150603366 conn(0x55de1951c320 msgr2=0x55de1951e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.385+0000 7fd33222f800 1 -- 172.21.15.131:0/2150603366 shutdown_connections 2024-04-24T01:43:59.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.385+0000 7fd33222f800 1 -- 172.21.15.131:0/2150603366 wait complete. 2024-04-24T01:43:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.396+0000 7fd33222f800 1 Processor -- start 2024-04-24T01:43:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.396+0000 7fd33222f800 1 -- start start 2024-04-24T01:43:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.396+0000 7fd33222f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19613110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.396+0000 7fd33222f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55de1946d3c0 con 0x55de19522970 2024-04-24T01:43:59.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.397+0000 7fd32d5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19613110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.397+0000 7fd32d5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19613110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42092/0 (socket says 172.21.15.131:42092) 2024-04-24T01:43:59.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.397+0000 7fd32d5c0640 1 -- 172.21.15.131:0/3702476012 learned_addr learned my addr 172.21.15.131:0/3702476012 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.397+0000 7fd32d5c0640 1 -- 172.21.15.131:0/3702476012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de196136e0 con 0x55de19522970 2024-04-24T01:43:59.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd32d5c0640 1 --2- 172.21.15.131:0/3702476012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19613110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd320055040 tx=0x7fd32004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9cb2e1d4d8bdb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd21b606640 1 -- 172.21.15.131:0/3702476012 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd320057040 con 0x55de19522970 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd21b606640 1 -- 172.21.15.131:0/3702476012 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd320052720 con 0x55de19522970 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd21b606640 1 -- 172.21.15.131:0/3702476012 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd320052a40 con 0x55de19522970 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd33222f800 1 -- 172.21.15.131:0/3702476012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 msgr2=0x55de19613110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd33222f800 1 --2- 172.21.15.131:0/3702476012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19613110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd320055040 tx=0x7fd32004c000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd33222f800 1 -- 172.21.15.131:0/3702476012 shutdown_connections 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd33222f800 1 --2- 172.21.15.131:0/3702476012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de19613110 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd33222f800 1 -- 172.21.15.131:0/3702476012 >> 172.21.15.131:0/3702476012 conn(0x55de1951c320 msgr2=0x55de1960ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.398+0000 7fd33222f800 1 -- 172.21.15.131:0/3702476012 shutdown_connections 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd33222f800 1 -- 172.21.15.131:0/3702476012 wait complete. 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd33222f800 1 Processor -- start 2024-04-24T01:43:59.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd33222f800 1 -- start start 2024-04-24T01:43:59.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd33222f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de195222b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd33222f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55de1952b0c0 con 0x55de19522970 2024-04-24T01:43:59.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd32d5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de195222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd32d5c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de195222b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42108/0 (socket says 172.21.15.131:42108) 2024-04-24T01:43:59.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd32d5c0640 1 -- 172.21.15.131:0/4175181562 learned_addr learned my addr 172.21.15.131:0/4175181562 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.399+0000 7fd32d5c0640 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de195209a0 con 0x55de19522970 2024-04-24T01:43:59.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.400+0000 7fd32d5c0640 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de195222b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd320052540 tx=0x7fd320003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.400+0000 7fd219e03640 1 -- 172.21.15.131:0/4175181562 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd320073070 con 0x55de19522970 2024-04-24T01:43:59.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.400+0000 7fd219e03640 1 -- 172.21.15.131:0/4175181562 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32005d440 con 0x55de19522970 2024-04-24T01:43:59.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.400+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de19520c30 con 0x55de19522970 2024-04-24T01:43:59.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.400+0000 7fd219e03640 1 -- 172.21.15.131:0/4175181562 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd320057070 con 0x55de19522970 2024-04-24T01:43:59.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.400+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de19521150 con 0x55de19522970 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd219e03640 1 -- 172.21.15.131:0/4175181562 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd320076070 con 0x55de19522970 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd219e03640 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd214036950 0x7fd214038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd219e03640 1 -- 172.21.15.131:0/4175181562 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd32008dc50 con 0x55de19522970 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd214036950 0x7fd214038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd33222f800 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de195252a0 0x55de19623fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de196244f0 con 0x55de195252a0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de195252a0 0x55de19623fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.401+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd214036950 0x7fd214038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd324000f60 tx=0x7fd324001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.402+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de195252a0 0x55de19623fb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.402+0000 7fd32ddc1640 1 -- 172.21.15.131:0/4175181562 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd32800a4a0 con 0x55de195252a0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.402+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19624e20 con 0x55de195252a0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.402+0000 7fd32ddc1640 1 -- 172.21.15.131:0/4175181562 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd32800a4a0 con 0x55de195252a0 2024-04-24T01:43:59.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.402+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19626210 con 0x55de195252a0 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.402+0000 7fd32ddc1640 1 -- 172.21.15.131:0/4175181562 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd32800a4a0 con 0x55de195252a0 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.403+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19625670 con 0x55de195252a0 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.403+0000 7fd32ddc1640 1 -- 172.21.15.131:0/4175181562 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd32800a4a0 con 0x55de195252a0 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.403+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19625ad0 con 0x55de195252a0 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.403+0000 7fd32ddc1640 1 -- 172.21.15.131:0/4175181562 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd32800a4a0 con 0x55de195252a0 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.403+0000 7fd33222f800 1 Processor -- start 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.403+0000 7fd33222f800 1 -- start start 2024-04-24T01:43:59.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.403+0000 7fd33222f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19635330 0x55de19635750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.404+0000 7fd33222f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55de195227f0 con 0x55de19635330 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.404+0000 7fd32cdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19635330 0x55de19635750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.404+0000 7fd32cdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19635330 0x55de19635750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42114/0 (socket says 172.21.15.131:42114) 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.404+0000 7fd32cdbf640 1 -- 172.21.15.131:0/2385760140 learned_addr learned my addr 172.21.15.131:0/2385760140 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.404+0000 7fd32cdbf640 1 -- 172.21.15.131:0/2385760140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de19635c90 con 0x55de19635330 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.404+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19635330 0x55de19635750 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd324001ed0 tx=0x7fd32400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.405+0000 7fd212ffd640 1 -- 172.21.15.131:0/2385760140 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd324022070 con 0x55de19635330 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.405+0000 7fd212ffd640 1 -- 172.21.15.131:0/2385760140 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32400d520 con 0x55de19635330 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.405+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de19636700 con 0x55de19635330 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.405+0000 7fd212ffd640 1 -- 172.21.15.131:0/2385760140 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd32400d800 con 0x55de19635330 2024-04-24T01:43:59.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.405+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de19636c00 con 0x55de19635330 2024-04-24T01:43:59.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.405+0000 7fd212ffd640 1 -- 172.21.15.131:0/2385760140 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd324025070 con 0x55de19635330 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd212ffd640 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd204036900 0x7fd204038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd212ffd640 1 -- 172.21.15.131:0/2385760140 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd32404de10 con 0x55de19635330 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd204036900 0x7fd204038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd33222f800 1 Processor -- start 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd33222f800 1 -- start start 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd204036900 0x7fd204038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55de19521760 tx=0x7fd328005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd33222f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19642a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd33222f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55de194136b0 con 0x55de19642670 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd32cdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19642a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd32cdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19642a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42118/0 (socket says 172.21.15.131:42118) 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.406+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1998636730 learned_addr learned my addr 172.21.15.131:0/1998636730 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1998636730 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de19643060 con 0x55de19642670 2024-04-24T01:43:59.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/1998636730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19642a90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd32404c120 tx=0x7fd324024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8329a029b6ffda94 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd210ff9640 1 -- 172.21.15.131:0/1998636730 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd32404a030 con 0x55de19642670 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd210ff9640 1 -- 172.21.15.131:0/1998636730 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd324025990 con 0x55de19642670 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd210ff9640 1 -- 172.21.15.131:0/1998636730 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd324026730 con 0x55de19642670 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd33222f800 1 -- 172.21.15.131:0/1998636730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 msgr2=0x55de19642a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd33222f800 1 --2- 172.21.15.131:0/1998636730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19642a90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd32404c120 tx=0x7fd324024740 comp rx=0 tx=0).stop 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd33222f800 1 -- 172.21.15.131:0/1998636730 shutdown_connections 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd33222f800 1 --2- 172.21.15.131:0/1998636730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19642a90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd33222f800 1 -- 172.21.15.131:0/1998636730 >> 172.21.15.131:0/1998636730 conn(0x55de1963e9d0 msgr2=0x55de1963ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd33222f800 1 -- 172.21.15.131:0/1998636730 shutdown_connections 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.407+0000 7fd33222f800 1 -- 172.21.15.131:0/1998636730 wait complete. 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd33222f800 1 Processor -- start 2024-04-24T01:43:59.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd33222f800 1 -- start start 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd33222f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19649b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd33222f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55de19643650 con 0x55de19642670 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd32cdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19649b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd32cdbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19649b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42128/0 (socket says 172.21.15.131:42128) 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 learned_addr learned my addr 172.21.15.131:0/1597734546 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de1964a0d0 con 0x55de19642670 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.408+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19649b90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd324024a50 tx=0x7fd32404c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.409+0000 7fd202ffd640 1 -- 172.21.15.131:0/1597734546 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd324025570 con 0x55de19642670 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.409+0000 7fd202ffd640 1 -- 172.21.15.131:0/1597734546 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32400d9a0 con 0x55de19642670 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.409+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de1964a0d0 con 0x55de19642670 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.409+0000 7fd202ffd640 1 -- 172.21.15.131:0/1597734546 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd32400dca0 con 0x55de19642670 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.409+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de1964a0d0 con 0x55de19642670 2024-04-24T01:43:59.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.409+0000 7fd202ffd640 1 -- 172.21.15.131:0/1597734546 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd32401a320 con 0x55de19642670 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.409+0000 7fd202ffd640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd1f8036950 0x7fd1f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd202ffd640 1 -- 172.21.15.131:0/1597734546 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd324045070 con 0x55de19642670 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd1f8036950 0x7fd1f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de196552a0 0x55de196576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19657e40 con 0x55de196552a0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd32d5c0640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de196552a0 0x55de196576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd1f8036950 0x7fd1f8038e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55de19521790 tx=0x7fd32801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd32d5c0640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de196552a0 0x55de196576f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd33222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd33222f800 20 realm 2024-04-24T01:43:59.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.410+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de196582a0 con 0x55de196552a0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19658b40 con 0x55de196552a0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19658ee0 con 0x55de196552a0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19659730 con 0x55de196552a0 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 20 searching for the correct realm 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55de1965b4a0 0x55de1965d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.411+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55de1965b4a0 0x55de1965d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.412+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55de1965b4a0 0x55de1965d890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.412+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324024030 con 0x55de1965b4a0 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.412+0000 7fd32cdbf640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd32401ac20 0x7fd3240030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.412+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd32401ac20 2024-04-24T01:43:59.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.412+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd32401ac20 0x7fd3240030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.412+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd32401ac20 0x7fd3240030d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.413+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd32801f070 con 0x7fd32401ac20 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.413+0000 7fd32ddc1640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd328031040 0x7fd328032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.413+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.413+0000 7fd32d5c0640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd328031040 0x7fd328032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.413+0000 7fd32d5c0640 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd328031040 0x7fd328032430 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.414+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd32401ac20 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd32801f070 con 0x7fd32401ac20 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324024030 con 0x55de1965b4a0 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.415+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd32401ac20 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd32801f070 con 0x7fd32401ac20 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324024030 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.416+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.433 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.417+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.418+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.418+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.418+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.418+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.418+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.418+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd32401ac20 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd32801f070 con 0x7fd32401ac20 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd32401ac20 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd32801f070 con 0x7fd32401ac20 2024-04-24T01:43:59.434 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.419+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd32401ac20 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd32801f070 con 0x7fd32401ac20 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de1965b4a0 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd328031040 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x55de196552a0 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.420+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55de1965de70 con 0x7fd32401ac20 2024-04-24T01:43:59.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de1965a0b0 con 0x55de196552a0 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de1965a950 con 0x55de196552a0 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19659cf0 con 0x55de196552a0 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 zone default found 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 4 Realm: () 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 zonegroup default 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.421+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de1965e2f0 con 0x7fd32401ac20 2024-04-24T01:43:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19660520 con 0x55de1965b4a0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de196608c0 con 0x55de1965b4a0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 20 started sync module instance, tier type = 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.422+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de1965f960 con 0x7fd32401ac20 2024-04-24T01:43:59.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.423+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.423+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94412397213120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de1965ffd0 con 0x7fd32401ac20 2024-04-24T01:43:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.423+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19661280 con 0x55de196552a0 2024-04-24T01:43:59.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.424+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94412397213120] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.424+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.425+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94412397214240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19661280 con 0x55de196552a0 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.425+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19661ca0 con 0x55de1965b4a0 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.426+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94412397214240] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.426+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.426+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94412397219280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de196611f0 con 0x55de1965b4a0 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.426+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19662b60 con 0x7fd32401ac20 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.427+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.427+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94412397226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19663400 con 0x7fd32401ac20 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.427+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19663ef0 con 0x55de196552a0 2024-04-24T01:43:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.427+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94412397219280] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.428+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94412397226160] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.428+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.428+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94412397230528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19662f50 con 0x55de196552a0 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.428+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19664790 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.430+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.430+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94412397232560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19664a80 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.430+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19665310 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.430+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94412397230528] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.430+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94412397232560] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.431+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.431+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94412397233616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19664ea0 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.431+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19665860 con 0x7fd328031040 2024-04-24T01:43:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94412397233616] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94412397234944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19665860 con 0x7fd328031040 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 20 add_watcher() i=0 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 20 add_watcher() i=1 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 20 add_watcher() i=2 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 20 add_watcher() i=3 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 20 add_watcher() i=4 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 20 add_watcher() i=5 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.432+0000 7fd33222f800 20 add_watcher() i=6 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.433+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94412397234944] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.433+0000 7fd33222f800 20 add_watcher() i=7 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.433+0000 7fd33222f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:59.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.433+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de19668b30 con 0x55de196552a0 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.433+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.433+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94412397237536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19665df0 con 0x55de196552a0 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94412397237536] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd1e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd33222f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd33222f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd33222f800 5 note: GC not initialized 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd1e27e4640 20 reqs_thread_entry: start 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd33222f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.434+0000 7fd33222f800 20 Filter name: none 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.435+0000 7fd153fff640 20 reqs_thread_entry: start 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.435+0000 7fd33222f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.435+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de1969b9d0 con 0x55de196552a0 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.435+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.435+0000 7fd33222f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.435+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de1969cf20 con 0x7fd328031040 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.435+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.436+0000 7fd1e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.436+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94412397237536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19667aa0 con 0x55de196552a0 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.437+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94412397237536] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.437+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94412397213120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19665520 con 0x7fd32401ac20 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.438+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94412397213120] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.438+0000 7fd33222f800 20 remove_watcher() i=0 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.438+0000 7fd33222f800 2 removed watcher, disabling cache 2024-04-24T01:43:59.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.438+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94412397214240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19665520 con 0x55de196552a0 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.439+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94412397214240] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.439+0000 7fd33222f800 20 remove_watcher() i=1 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.439+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94412397219280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19665520 con 0x55de1965b4a0 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.441+0000 7fd32cdbf640 1 -- 172.21.15.131:0/1597734546 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94412397219280] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd324063040 con 0x55de1965b4a0 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.441+0000 7fd33222f800 20 remove_watcher() i=2 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.441+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94412397226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19660dd0 con 0x7fd32401ac20 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.442+0000 7fd32ddc1640 1 -- 172.21.15.131:0/1597734546 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94412397226160] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd328040040 con 0x7fd32401ac20 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.442+0000 7fd33222f800 20 remove_watcher() i=3 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.442+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94412397230528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19660dd0 con 0x55de196552a0 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.443+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94412397230528] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x55de196552a0 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.443+0000 7fd33222f800 20 remove_watcher() i=4 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.443+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94412397232560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19660dd0 con 0x7fd328031040 2024-04-24T01:43:59.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.444+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94412397232560] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.444+0000 7fd33222f800 20 remove_watcher() i=5 2024-04-24T01:43:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.444+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94412397233616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19660dd0 con 0x7fd328031040 2024-04-24T01:43:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.445+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94412397233616] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.445+0000 7fd33222f800 20 remove_watcher() i=6 2024-04-24T01:43:59.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.445+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94412397234944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de19660dd0 con 0x7fd328031040 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94412397234944] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd320075030 con 0x7fd328031040 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 20 remove_watcher() i=7 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd328031040 msgr2=0x7fd328032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd328031040 0x7fd328032430 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de196552a0 msgr2=0x55de196576f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de196552a0 0x55de196576f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd32401ac20 msgr2=0x7fd3240030d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd32401ac20 0x7fd3240030d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55de1965b4a0 msgr2=0x55de1965d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55de1965b4a0 0x55de1965d890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd1f8036950 msgr2=0x7fd1f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd1f8036950 0x7fd1f8038e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55de19521790 tx=0x7fd32801f000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 msgr2=0x55de19649b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 --2- 172.21.15.131:0/1597734546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19642670 0x55de19649b90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd324024a50 tx=0x7fd32404c080 comp rx=0 tx=0).stop 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 reap_dead start 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd32d5c0640 1 -- 172.21.15.131:0/1597734546 reap_dead start 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 shutdown_connections 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 >> 172.21.15.131:0/1597734546 conn(0x55de1963e9d0 msgr2=0x55de1963c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 shutdown_connections 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.446+0000 7fd33222f800 1 -- 172.21.15.131:0/1597734546 wait complete. 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd204036900 msgr2=0x7fd204038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd204036900 0x7fd204038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55de19521760 tx=0x7fd328005840 comp rx=0 tx=0).stop 2024-04-24T01:43:59.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19635330 msgr2=0x55de19635750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19635330 0x55de19635750 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd324001ed0 tx=0x7fd32400ea00 comp rx=0 tx=0).stop 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 shutdown_connections 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd204036900 0x7fd204038dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/2385760140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19635330 0x55de19635750 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 >> 172.21.15.131:0/2385760140 conn(0x55de196293d0 msgr2=0x55de196297d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 shutdown_connections 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/2385760140 wait complete. 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de195252a0 msgr2=0x55de19623fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de195252a0 0x55de19623fb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd214036950 msgr2=0x7fd214038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd214036950 0x7fd214038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd324000f60 tx=0x7fd324001370 comp rx=0 tx=0).stop 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 msgr2=0x55de195222b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de195222b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd320052540 tx=0x7fd320003020 comp rx=0 tx=0).stop 2024-04-24T01:43:59.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 shutdown_connections 2024-04-24T01:43:59.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55de195252a0 0x55de19623fb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd214036950 0x7fd214038e10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 --2- 172.21.15.131:0/4175181562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de19522970 0x55de195222b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 >> 172.21.15.131:0/4175181562 conn(0x55de1951c320 msgr2=0x55de1960d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 shutdown_connections 2024-04-24T01:43:59.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.447+0000 7fd33222f800 1 -- 172.21.15.131:0/4175181562 wait complete. 2024-04-24T01:43:59.459 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-24T01:43:59.459 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-24T01:43:59.459 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-24T01:43:59.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-24T01:43:59.460 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-24T01:43:59.544 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:59.544 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.544+0000 7f509f533800 1 Processor -- start 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.544+0000 7f509f533800 1 -- start start 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.544+0000 7f509f533800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5559944572e0 0x55599445fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.544+0000 7f509f533800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555994315d40 con 0x5559944557a0 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.544+0000 7f509f533800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5559942e84d0 con 0x5559944572e0 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.544+0000 7f509a9d0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5559944572e0 0x55599445fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.545+0000 7f509b1d1640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5559944557a0 0x555994455bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:55584/0 (socket says 172.21.15.131:55584) 2024-04-24T01:43:59.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.545+0000 7f509b1d1640 1 -- 172.21.15.131:0/329883851 learned_addr learned my addr 172.21.15.131:0/329883851 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:43:59.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.545+0000 7f509a9d0640 1 -- 172.21.15.131:0/329883851 >> v1:172.21.15.107:6789/0 conn(0x5559944557a0 legacy=0x555994455bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.545+0000 7f509a9d0640 1 -- 172.21.15.131:0/329883851 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555994314590 con 0x5559944572e0 2024-04-24T01:43:59.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509a9d0640 1 --2- 172.21.15.131:0/329883851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944572e0 0x55599445fde0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f508400a470 tx=0x7f508401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a361ddea4edc9f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509a1cf640 1 -- 172.21.15.131:0/329883851 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084057070 con 0x5559944572e0 2024-04-24T01:43:59.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509a1cf640 1 -- 172.21.15.131:0/329883851 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508404adc0 con 0x5559944572e0 2024-04-24T01:43:59.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509a1cf640 1 -- 172.21.15.131:0/329883851 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084052590 con 0x5559944572e0 2024-04-24T01:43:59.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509f533800 1 -- 172.21.15.131:0/329883851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944572e0 msgr2=0x55599445fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509f533800 1 --2- 172.21.15.131:0/329883851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944572e0 0x55599445fde0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f508400a470 tx=0x7f508401ce90 comp rx=0 tx=0).stop 2024-04-24T01:43:59.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509f533800 1 -- 172.21.15.131:0/329883851 shutdown_connections 2024-04-24T01:43:59.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509f533800 1 --2- 172.21.15.131:0/329883851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944572e0 0x55599445fde0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509f533800 1 -- 172.21.15.131:0/329883851 >> 172.21.15.131:0/329883851 conn(0x555994451340 msgr2=0x555994453760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509f533800 1 -- 172.21.15.131:0/329883851 shutdown_connections 2024-04-24T01:43:59.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.547+0000 7f509f533800 1 -- 172.21.15.131:0/329883851 wait complete. 2024-04-24T01:43:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.559+0000 7f509f533800 1 Processor -- start 2024-04-24T01:43:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.559+0000 7f509f533800 1 -- start start 2024-04-24T01:43:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.559+0000 7f509f533800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x55599454a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.559+0000 7f509f533800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5559943a23b0 con 0x5559944557a0 2024-04-24T01:43:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.559+0000 7f509b1d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x55599454a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.559+0000 7f509b1d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x55599454a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42144/0 (socket says 172.21.15.131:42144) 2024-04-24T01:43:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.559+0000 7f509b1d1640 1 -- 172.21.15.131:0/1549077538 learned_addr learned my addr 172.21.15.131:0/1549077538 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.560+0000 7f509b1d1640 1 -- 172.21.15.131:0/1549077538 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55599454ac60 con 0x5559944557a0 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.560+0000 7f509b1d1640 1 --2- 172.21.15.131:0/1549077538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x55599454a690 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f508c0017a0 tx=0x7f508c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6af9a792ad19c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.560+0000 7f4f8960a640 1 -- 172.21.15.131:0/1549077538 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c004520 con 0x5559944557a0 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.560+0000 7f4f8960a640 1 -- 172.21.15.131:0/1549077538 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c0046c0 con 0x5559944557a0 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.560+0000 7f4f8960a640 1 -- 172.21.15.131:0/1549077538 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c004a00 con 0x5559944557a0 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 -- 172.21.15.131:0/1549077538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 msgr2=0x55599454a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 --2- 172.21.15.131:0/1549077538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x55599454a690 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f508c0017a0 tx=0x7f508c001c60 comp rx=0 tx=0).stop 2024-04-24T01:43:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 -- 172.21.15.131:0/1549077538 shutdown_connections 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 --2- 172.21.15.131:0/1549077538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x55599454a690 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 -- 172.21.15.131:0/1549077538 >> 172.21.15.131:0/1549077538 conn(0x555994451340 msgr2=0x555994545fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 -- 172.21.15.131:0/1549077538 shutdown_connections 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 -- 172.21.15.131:0/1549077538 wait complete. 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 Processor -- start 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 -- start start 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x5559945521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.561+0000 7f509f533800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555994462600 con 0x5559944557a0 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.562+0000 7f509b1d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x5559945521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.562+0000 7f509b1d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x5559945521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42160/0 (socket says 172.21.15.131:42160) 2024-04-24T01:43:59.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.562+0000 7f509b1d1640 1 -- 172.21.15.131:0/1346696276 learned_addr learned my addr 172.21.15.131:0/1346696276 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.562+0000 7f509b1d1640 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555994552710 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.562+0000 7f509b1d1640 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x5559945521d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f508c000f80 tx=0x7f508c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.563+0000 7f4f87e07640 1 -- 172.21.15.131:0/1346696276 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c022020 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.563+0000 7f4f87e07640 1 -- 172.21.15.131:0/1346696276 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c014870 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.563+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559945529a0 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.563+0000 7f4f87e07640 1 -- 172.21.15.131:0/1346696276 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c014bb0 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.563+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555994555650 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f4f87e07640 1 -- 172.21.15.131:0/1346696276 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f508c025020 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f4f87e07640 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f80036900 0x7f4f80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f4f87e07640 1 -- 172.21.15.131:0/1346696276 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f508c018030 con 0x5559944557a0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f509a9d0640 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f80036900 0x7f4f80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f509f533800 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5559944572e0 0x555994559410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559945599e0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f509b9d2640 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5559944572e0 0x555994559410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f509a9d0640 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f80036900 0x7f4f80038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5084054000 tx=0x7f508404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.564+0000 7f509b9d2640 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5559944572e0 0x555994559410 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509b9d2640 1 -- 172.21.15.131:0/1346696276 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50940083e0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559945569c0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509b9d2640 1 -- 172.21.15.131:0/1346696276 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50940083e0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599455b7c0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509b9d2640 1 -- 172.21.15.131:0/1346696276 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50940083e0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599455ab00 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509b9d2640 1 -- 172.21.15.131:0/1346696276 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50940083e0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.565+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599455aef0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509b9d2640 1 -- 172.21.15.131:0/1346696276 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50940083e0 con 0x5559944572e0 2024-04-24T01:43:59.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509f533800 1 Processor -- start 2024-04-24T01:43:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509f533800 1 -- start start 2024-04-24T01:43:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509f533800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55599456a5d0 0x55599456a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509f533800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5559943486b0 con 0x55599456a5d0 2024-04-24T01:43:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509a9d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55599456a5d0 0x55599456a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509a9d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55599456a5d0 0x55599456a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42174/0 (socket says 172.21.15.131:42174) 2024-04-24T01:43:59.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.566+0000 7f509a9d0640 1 -- 172.21.15.131:0/1583418197 learned_addr learned my addr 172.21.15.131:0/1583418197 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.567+0000 7f509a9d0640 1 -- 172.21.15.131:0/1583418197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55599456af30 con 0x55599456a5d0 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.567+0000 7f509a9d0640 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55599456a5d0 0x55599456a9f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5084044730 tx=0x7f5084002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.567+0000 7f4f85602640 1 -- 172.21.15.131:0/1583418197 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508406e070 con 0x55599456a5d0 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.567+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55599456b9a0 con 0x55599456a5d0 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.567+0000 7f4f85602640 1 -- 172.21.15.131:0/1583418197 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084069540 con 0x55599456a5d0 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.567+0000 7f4f85602640 1 -- 172.21.15.131:0/1583418197 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084057040 con 0x55599456a5d0 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.567+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55599456be40 con 0x55599456a5d0 2024-04-24T01:43:59.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.568+0000 7f4f85602640 1 -- 172.21.15.131:0/1583418197 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5084071070 con 0x55599456a5d0 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.568+0000 7f4f85602640 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f74036970 0x7f4f74038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.568+0000 7f4f85602640 1 -- 172.21.15.131:0/1583418197 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f5084066070 con 0x55599456a5d0 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.568+0000 7f509b9d2640 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f74036970 0x7f4f74038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.568+0000 7f509f533800 1 Processor -- start 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.568+0000 7f509f533800 1 -- start start 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509b9d2640 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f74036970 0x7f4f74038e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55599455a620 tx=0x7f5094000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509f533800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x555994577cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509f533800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55599454afe0 con 0x555994577890 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509a9d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x555994577cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509a9d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x555994577cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42188/0 (socket says 172.21.15.131:42188) 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509a9d0640 1 -- 172.21.15.131:0/1389094715 learned_addr learned my addr 172.21.15.131:0/1389094715 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509a9d0640 1 -- 172.21.15.131:0/1389094715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555994578280 con 0x555994577890 2024-04-24T01:43:59.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f509a9d0640 1 --2- 172.21.15.131:0/1389094715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x555994577cb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5084007000 tx=0x7f5084006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74284e96341a759 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f4f7effd640 1 -- 172.21.15.131:0/1389094715 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084071360 con 0x555994577890 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f4f7effd640 1 -- 172.21.15.131:0/1389094715 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084071500 con 0x555994577890 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.569+0000 7f4f7effd640 1 -- 172.21.15.131:0/1389094715 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084050ab0 con 0x555994577890 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 -- 172.21.15.131:0/1389094715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 msgr2=0x555994577cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 --2- 172.21.15.131:0/1389094715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x555994577cb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5084007000 tx=0x7f5084006ea0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 -- 172.21.15.131:0/1389094715 shutdown_connections 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 --2- 172.21.15.131:0/1389094715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x555994577cb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 -- 172.21.15.131:0/1389094715 >> 172.21.15.131:0/1389094715 conn(0x555994573bb0 msgr2=0x555994571c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 -- 172.21.15.131:0/1389094715 shutdown_connections 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 -- 172.21.15.131:0/1389094715 wait complete. 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 Processor -- start 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 -- start start 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x55599457ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.570+0000 7f509f533800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555994578a00 con 0x555994577890 2024-04-24T01:43:59.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f509a9d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x55599457ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f509a9d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x55599457ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42198/0 (socket says 172.21.15.131:42198) 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 learned_addr learned my addr 172.21.15.131:0/2953507949 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55599457f440 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f509a9d0640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x55599457ef00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f50840506e0 tx=0x7f508408d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f4f7d7fa640 1 -- 172.21.15.131:0/2953507949 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084069a70 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f4f7d7fa640 1 -- 172.21.15.131:0/2953507949 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084082040 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55599457f6d0 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f4f7d7fa640 1 -- 172.21.15.131:0/2953507949 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084069d80 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.571+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555994582380 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.572+0000 7f4f7d7fa640 1 -- 172.21.15.131:0/2953507949 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f508405c410 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.572+0000 7f4f7d7fa640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f640368b0 0x7f4f64038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.572+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.572+0000 7f4f7d7fa640 1 -- 172.21.15.131:0/2953507949 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f508409da90 con 0x555994577890 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.572+0000 7f509b9d2640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f640368b0 0x7f4f64038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.572+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55599458a9d0 0x55599458ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.572+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458d5c0 con 0x55599458a9d0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509b1d1640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55599458a9d0 0x55599458ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509b9d2640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f640368b0 0x7f4f64038d70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f509400f010 tx=0x7f509400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509b1d1640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55599458a9d0 0x55599458ce70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 20 realm 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458d9d0 con 0x55599458a9d0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458e2a0 con 0x55599458a9d0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.573+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458e640 con 0x55599458a9d0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509f533800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458eaa0 con 0x55599458a9d0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509f533800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509f533800 20 searching for the correct realm 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555994590a90 0x555994592f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509a9d0640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555994590a90 0x555994592f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.574+0000 7f509a9d0640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555994590a90 0x555994592f00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509a9d0640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5084073060 0x7f508404c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5084073060 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509b9d2640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5084073060 0x7f508404c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509b9d2640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5084073060 0x7f508404c840 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509b9d2640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5094019040 0x7f5094019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.575+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.576+0000 7f509b1d1640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5094019040 0x7f5094019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.576+0000 7f509b1d1640 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5094019040 0x7f5094019930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.576+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.576+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.577+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5084073060 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.578+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5084073060 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.579+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.580+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5084073060 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.581+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5084073060 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.582+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5084073060 2024-04-24T01:43:59.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.583+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.583+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x555994590a90 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.583+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.583+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5094019040 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.583+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.583+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x55599458a9d0 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.583+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559945935d0 con 0x7f5084073060 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:59.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458f510 con 0x55599458a9d0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458fdb0 con 0x55599458a9d0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.584+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458f150 con 0x55599458a9d0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:59.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 zone default found 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 4 Realm: () 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 zonegroup default 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599458fdb0 con 0x7f5084073060 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555994595430 con 0x555994590a90 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559945957d0 con 0x555994590a90 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 started sync module instance, tier type = 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.585+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559945948d0 con 0x7f5084073060 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.586+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.587+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843229330896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559945948d0 con 0x7f5084073060 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.587+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994596240 con 0x55599458a9d0 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.587+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843229330896] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.588+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.588+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843229334832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559945948d0 con 0x55599458a9d0 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.588+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994596cb0 con 0x555994590a90 2024-04-24T01:43:59.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.589+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843229334832] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.589+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.589+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843229328416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994594840 con 0x555994590a90 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.589+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994597b70 con 0x7f5084073060 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.590+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.590+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843229341856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994598410 con 0x7f5084073060 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.590+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994598f00 con 0x55599458a9d0 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.591+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843229328416] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.592+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843229341856] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.592+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.592+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843229346256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994597f60 con 0x55599458a9d0 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.592+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559945997a0 con 0x7f5094019040 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.593+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843229346256] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.593+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.593+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843229339808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559945996c0 con 0x7f5094019040 2024-04-24T01:43:59.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.593+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994599f10 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.594+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.594+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843229349840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55599459a240 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.594+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55599459ad60 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.594+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843229339808] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843229349840] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843229354032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994599c90 con 0x7f5094019040 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 20 add_watcher() i=0 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 20 add_watcher() i=1 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 20 add_watcher() i=2 2024-04-24T01:43:59.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 20 add_watcher() i=3 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 20 add_watcher() i=4 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 20 add_watcher() i=5 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.595+0000 7f509f533800 20 add_watcher() i=6 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.596+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843229354032] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.596+0000 7f509f533800 20 add_watcher() i=7 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.596+0000 7f509f533800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.596+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55599459dd50 con 0x55599458a9d0 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.596+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.597+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843229348368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55599459b1d0 con 0x55599458a9d0 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.597+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843229348368] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f4f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f509f533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:59.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f509f533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f509f533800 5 note: GC not initialized 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f4f50fe1640 20 reqs_thread_entry: start 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f509f533800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f509f533800 20 Filter name: none 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f4eca7fc640 20 reqs_thread_entry: start 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f509f533800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.598+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559945d0a80 con 0x55599458a9d0 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.599+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.599+0000 7f509f533800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.599+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559945d1fd0 con 0x7f5094019040 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.599+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.600+0000 7f4f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.600+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843229348368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559945cf200 con 0x55599458a9d0 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.601+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93843229348368] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.601+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843229330896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994599210 con 0x7f5084073060 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.604+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93843229330896] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.604+0000 7f509f533800 20 remove_watcher() i=0 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.604+0000 7f509f533800 2 removed watcher, disabling cache 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.604+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843229334832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994594dd0 con 0x55599458a9d0 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.605+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93843229334832] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.605+0000 7f509f533800 20 remove_watcher() i=1 2024-04-24T01:43:59.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.605+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843229328416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994594dd0 con 0x555994590a90 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.606+0000 7f509a9d0640 1 -- 172.21.15.131:0/2953507949 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93843229328416] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5084070030 con 0x555994590a90 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.606+0000 7f509f533800 20 remove_watcher() i=2 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.606+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843229341856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994594420 con 0x7f5084073060 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.607+0000 7f509b9d2640 1 -- 172.21.15.131:0/2953507949 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93843229341856] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509402f040 con 0x7f5084073060 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.607+0000 7f509f533800 20 remove_watcher() i=3 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.607+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843229346256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994594420 con 0x55599458a9d0 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.608+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93843229346256] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x55599458a9d0 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.608+0000 7f509f533800 20 remove_watcher() i=4 2024-04-24T01:43:59.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.608+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843229339808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559945989d0 con 0x7f5094019040 2024-04-24T01:43:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.609+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93843229339808] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.609+0000 7f509f533800 20 remove_watcher() i=5 2024-04-24T01:43:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.609+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843229349840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994594420 con 0x7f5094019040 2024-04-24T01:43:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.610+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93843229349840] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.610+0000 7f509f533800 20 remove_watcher() i=6 2024-04-24T01:43:59.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.610+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843229354032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555994594420 con 0x7f5094019040 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93843229354032] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c01b070 con 0x7f5094019040 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 20 remove_watcher() i=7 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5094019040 msgr2=0x7f5094019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f5094019040 0x7f5094019930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55599458a9d0 msgr2=0x55599458ce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55599458a9d0 0x55599458ce70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5084073060 msgr2=0x7f508404c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5084073060 0x7f508404c840 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555994590a90 msgr2=0x555994592f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555994590a90 0x555994592f00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f640368b0 msgr2=0x7f4f64038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.611+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f640368b0 0x7f4f64038d70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f509400f010 tx=0x7f509400c040 comp rx=0 tx=0).stop 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 msgr2=0x55599457ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/2953507949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555994577890 0x55599457ef00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f50840506e0 tx=0x7f508408d150 comp rx=0 tx=0).stop 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509b1d1640 1 -- 172.21.15.131:0/2953507949 reap_dead start 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 shutdown_connections 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 >> 172.21.15.131:0/2953507949 conn(0x555994573bb0 msgr2=0x555994571210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 shutdown_connections 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/2953507949 wait complete. 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f74036970 msgr2=0x7f4f74038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f74036970 0x7f4f74038e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55599455a620 tx=0x7f5094000f90 comp rx=0 tx=0).stop 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55599456a5d0 msgr2=0x55599456a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55599456a5d0 0x55599456a9f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5084044730 tx=0x7f5084002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 shutdown_connections 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f74036970 0x7f4f74038e30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1583418197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55599456a5d0 0x55599456a9f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 >> 172.21.15.131:0/1583418197 conn(0x55599455e670 msgr2=0x55599455ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 shutdown_connections 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1583418197 wait complete. 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5559944572e0 msgr2=0x555994559410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5559944572e0 0x555994559410 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f80036900 msgr2=0x7f4f80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f80036900 0x7f4f80038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5084054000 tx=0x7f508404e000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 msgr2=0x5559945521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x5559945521d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f508c000f80 tx=0x7f508c001250 comp rx=0 tx=0).stop 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 shutdown_connections 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5559944572e0 0x555994559410 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4f80036900 0x7f4f80038dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 --2- 172.21.15.131:0/1346696276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5559944557a0 0x5559945521d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.612+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 >> 172.21.15.131:0/1346696276 conn(0x555994451340 msgr2=0x5559945447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.613+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 shutdown_connections 2024-04-24T01:43:59.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.613+0000 7f509f533800 1 -- 172.21.15.131:0/1346696276 wait complete. 2024-04-24T01:43:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-04-24T01:43:59.621 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-04-24T01:43:59.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-24T01:43:59.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-24T01:43:59.621 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-24T01:43:59.665 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:59.666 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f1755b3f800 1 Processor -- start 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f1755b3f800 1 -- start start 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f1755b3f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fb08da1150 0x55fb08da3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f1755b3f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb08c5bd40 con 0x55fb08d101e0 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f1755b3f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55fb08c2e4d0 con 0x55fb08da1150 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f175109a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fb08da1150 0x55fb08da3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f175109a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fb08da1150 0x55fb08da3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42200/0 (socket says 172.21.15.131:42200) 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.666+0000 7f175109a640 1 -- 172.21.15.131:0/3232568527 learned_addr learned my addr 172.21.15.131:0/3232568527 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.667+0000 7f175109a640 1 -- 172.21.15.131:0/3232568527 >> v1:172.21.15.107:6789/0 conn(0x55fb08d101e0 legacy=0x55fb08d9fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.667+0000 7f1750899640 1 -- 172.21.15.131:0/3232568527 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766162844 0 0) 0x55fb08c5bd40 con 0x55fb08d101e0 2024-04-24T01:43:59.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.667+0000 7f175109a640 1 -- 172.21.15.131:0/3232568527 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb08c5a590 con 0x55fb08da1150 2024-04-24T01:43:59.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.668+0000 7f175109a640 1 --2- 172.21.15.131:0/3232568527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08da1150 0x55fb08da3610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f174800a520 tx=0x7f174801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1978bec426860e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1750899640 1 -- 172.21.15.131:0/3232568527 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1748057070 con 0x55fb08da1150 2024-04-24T01:43:59.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1750899640 1 -- 172.21.15.131:0/3232568527 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1748052570 con 0x55fb08da1150 2024-04-24T01:43:59.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1750899640 1 -- 172.21.15.131:0/3232568527 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174804ae60 con 0x55fb08da1150 2024-04-24T01:43:59.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1755b3f800 1 -- 172.21.15.131:0/3232568527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08da1150 msgr2=0x55fb08da3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1755b3f800 1 --2- 172.21.15.131:0/3232568527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08da1150 0x55fb08da3610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f174800a520 tx=0x7f174801d010 comp rx=0 tx=0).stop 2024-04-24T01:43:59.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1755b3f800 1 -- 172.21.15.131:0/3232568527 shutdown_connections 2024-04-24T01:43:59.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1755b3f800 1 --2- 172.21.15.131:0/3232568527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08da1150 0x55fb08da3610 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1755b3f800 1 -- 172.21.15.131:0/3232568527 >> 172.21.15.131:0/3232568527 conn(0x55fb08d973a0 msgr2=0x55fb08d997c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1755b3f800 1 -- 172.21.15.131:0/3232568527 shutdown_connections 2024-04-24T01:43:59.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.669+0000 7f1755b3f800 1 -- 172.21.15.131:0/3232568527 wait complete. 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.681+0000 7f1755b3f800 1 Processor -- start 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.681+0000 7f1755b3f800 1 -- start start 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.681+0000 7f1755b3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08d9d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.681+0000 7f1755b3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb08ce83b0 con 0x55fb08d101e0 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.681+0000 7f175189b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08d9d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.681+0000 7f175189b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08d9d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42208/0 (socket says 172.21.15.131:42208) 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.681+0000 7f175189b640 1 -- 172.21.15.131:0/3028874123 learned_addr learned my addr 172.21.15.131:0/3028874123 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.682+0000 7f175189b640 1 -- 172.21.15.131:0/3028874123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb08d9b8f0 con 0x55fb08d101e0 2024-04-24T01:43:59.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.682+0000 7f175189b640 1 --2- 172.21.15.131:0/3028874123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08d9d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1744001e00 tx=0x7f174400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc38bc4410c0166 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.682+0000 7f163fe07640 1 -- 172.21.15.131:0/3028874123 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1744016070 con 0x55fb08d101e0 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.682+0000 7f163fe07640 1 -- 172.21.15.131:0/3028874123 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174400d4b0 con 0x55fb08d101e0 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.682+0000 7f163fe07640 1 -- 172.21.15.131:0/3028874123 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174400d810 con 0x55fb08d101e0 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 -- 172.21.15.131:0/3028874123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 msgr2=0x55fb08d9d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 --2- 172.21.15.131:0/3028874123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08d9d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1744001e00 tx=0x7f174400b650 comp rx=0 tx=0).stop 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 -- 172.21.15.131:0/3028874123 shutdown_connections 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 --2- 172.21.15.131:0/3028874123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08d9d330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 -- 172.21.15.131:0/3028874123 >> 172.21.15.131:0/3028874123 conn(0x55fb08d973a0 msgr2=0x55fb08e89890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 -- 172.21.15.131:0/3028874123 shutdown_connections 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 -- 172.21.15.131:0/3028874123 wait complete. 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 Processor -- start 2024-04-24T01:43:59.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 -- start start 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08e97d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f1755b3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb08da3fc0 con 0x55fb08d101e0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f175189b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08e97d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f175189b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08e97d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42220/0 (socket says 172.21.15.131:42220) 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.683+0000 7f175189b640 1 -- 172.21.15.131:0/2404059046 learned_addr learned my addr 172.21.15.131:0/2404059046 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.684+0000 7f175189b640 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb08e98290 con 0x55fb08d101e0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.684+0000 7f175189b640 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08e97d50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1744001ed0 tx=0x7f1744000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.684+0000 7f163e604640 1 -- 172.21.15.131:0/2404059046 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1744016070 con 0x55fb08d101e0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.684+0000 7f163e604640 1 -- 172.21.15.131:0/2404059046 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1744023070 con 0x55fb08d101e0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.684+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb08e98520 con 0x55fb08d101e0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.684+0000 7f163e604640 1 -- 172.21.15.131:0/2404059046 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1744011a90 con 0x55fb08d101e0 2024-04-24T01:43:59.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.684+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb08e9b1d0 con 0x55fb08d101e0 2024-04-24T01:43:59.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.685+0000 7f163e604640 1 -- 172.21.15.131:0/2404059046 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1744011c30 con 0x55fb08d101e0 2024-04-24T01:43:59.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.685+0000 7f163e604640 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1638036950 0x7f1638038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.685+0000 7f163e604640 1 -- 172.21.15.131:0/2404059046 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f174404c660 con 0x55fb08d101e0 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.685+0000 7f175109a640 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1638036950 0x7f1638038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.685+0000 7f1755b3f800 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08da1150 0x55fb08e9ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.685+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08e9f510 con 0x55fb08da1150 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.685+0000 7f175209c640 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08da1150 0x55fb08e9ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.686+0000 7f175109a640 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1638036950 0x7f1638038e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1748054000 tx=0x7f174804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.686+0000 7f175209c640 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08da1150 0x55fb08e9ef90 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.686+0000 7f175209c640 1 -- 172.21.15.131:0/2404059046 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f174c00a4a0 con 0x55fb08da1150 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.686+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08e9c560 con 0x55fb08da1150 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.686+0000 7f175209c640 1 -- 172.21.15.131:0/2404059046 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f174c00a4a0 con 0x55fb08da1150 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.686+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ea1350 con 0x55fb08da1150 2024-04-24T01:43:59.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.687+0000 7f175209c640 1 -- 172.21.15.131:0/2404059046 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f174c00a4a0 con 0x55fb08da1150 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.687+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ea0690 con 0x55fb08da1150 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.687+0000 7f175209c640 1 -- 172.21.15.131:0/2404059046 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f174c00a4a0 con 0x55fb08da1150 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.687+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ea0ab0 con 0x55fb08da1150 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.687+0000 7f175209c640 1 -- 172.21.15.131:0/2404059046 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f174c00a4a0 con 0x55fb08da1150 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f1755b3f800 1 Processor -- start 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f1755b3f800 1 -- start start 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f1755b3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08eb0180 0x55fb08eb05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f1755b3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb08c8e6b0 con 0x55fb08eb0180 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f175109a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08eb0180 0x55fb08eb05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f175109a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08eb0180 0x55fb08eb05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42226/0 (socket says 172.21.15.131:42226) 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f175109a640 1 -- 172.21.15.131:0/1015031736 learned_addr learned my addr 172.21.15.131:0/1015031736 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.688+0000 7f175109a640 1 -- 172.21.15.131:0/1015031736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb08eb0ae0 con 0x55fb08eb0180 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.689+0000 7f175109a640 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08eb0180 0x55fb08eb05a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1748005930 tx=0x7f1748002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.689+0000 7f16377fe640 1 -- 172.21.15.131:0/1015031736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1748057040 con 0x55fb08eb0180 2024-04-24T01:43:59.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.689+0000 7f16377fe640 1 -- 172.21.15.131:0/1015031736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174805d650 con 0x55fb08eb0180 2024-04-24T01:43:59.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.689+0000 7f16377fe640 1 -- 172.21.15.131:0/1015031736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174805d950 con 0x55fb08eb0180 2024-04-24T01:43:59.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.689+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb08eb1550 con 0x55fb08eb0180 2024-04-24T01:43:59.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.689+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb08eb19f0 con 0x55fb08eb0180 2024-04-24T01:43:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.690+0000 7f16377fe640 1 -- 172.21.15.131:0/1015031736 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1748067070 con 0x55fb08eb0180 2024-04-24T01:43:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.690+0000 7f16377fe640 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f162c036900 0x7f162c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.690+0000 7f16377fe640 1 -- 172.21.15.131:0/1015031736 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f174808f7a0 con 0x55fb08eb0180 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.690+0000 7f175209c640 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f162c036900 0x7f162c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.690+0000 7f1755b3f800 1 Processor -- start 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.690+0000 7f175209c640 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f162c036900 0x7f162c038dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55fb08ea0a30 tx=0x7f174c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.690+0000 7f1755b3f800 1 -- start start 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f1755b3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ebd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f1755b3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb08d9bc70 con 0x55fb08ebd3c0 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f175109a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ebd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f175109a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ebd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42232/0 (socket says 172.21.15.131:42232) 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f175109a640 1 -- 172.21.15.131:0/874569736 learned_addr learned my addr 172.21.15.131:0/874569736 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f175109a640 1 -- 172.21.15.131:0/874569736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb08ebddb0 con 0x55fb08ebd3c0 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f175109a640 1 --2- 172.21.15.131:0/874569736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ebd7e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f174808da40 tx=0x7f174805df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ec9d5632ec3ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f16357fa640 1 -- 172.21.15.131:0/874569736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1748082070 con 0x55fb08ebd3c0 2024-04-24T01:43:59.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f16357fa640 1 -- 172.21.15.131:0/874569736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174808de50 con 0x55fb08ebd3c0 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.691+0000 7f16357fa640 1 -- 172.21.15.131:0/874569736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174808b070 con 0x55fb08ebd3c0 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 -- 172.21.15.131:0/874569736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 msgr2=0x55fb08ebd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 --2- 172.21.15.131:0/874569736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ebd7e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f174808da40 tx=0x7f174805df50 comp rx=0 tx=0).stop 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 -- 172.21.15.131:0/874569736 shutdown_connections 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 --2- 172.21.15.131:0/874569736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ebd7e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 -- 172.21.15.131:0/874569736 >> 172.21.15.131:0/874569736 conn(0x55fb08eb9720 msgr2=0x55fb08eb7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 -- 172.21.15.131:0/874569736 shutdown_connections 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 -- 172.21.15.131:0/874569736 wait complete. 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 Processor -- start 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 -- start start 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ec4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f1755b3f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb08ebe520 con 0x55fb08ebd3c0 2024-04-24T01:43:59.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f175109a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ec4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f175109a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ec4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42244/0 (socket says 172.21.15.131:42244) 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.692+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 learned_addr learned my addr 172.21.15.131:0/1232291925 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.693+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb08ec4f60 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.693+0000 7f175109a640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ec4a20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1748080040 tx=0x7f174808d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.693+0000 7f16237fe640 1 -- 172.21.15.131:0/1232291925 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1748093070 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.693+0000 7f16237fe640 1 -- 172.21.15.131:0/1232291925 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1748083040 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.693+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb08ec51f0 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.693+0000 7f16237fe640 1 -- 172.21.15.131:0/1232291925 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1748082070 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.693+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb08ec7ea0 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f16237fe640 1 -- 172.21.15.131:0/1232291925 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1748096070 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f16237fe640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c0368b0 0x7f161c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f16237fe640 1 -- 172.21.15.131:0/1232291925 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1748099d40 con 0x55fb08ebd3c0 2024-04-24T01:43:59.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f175209c640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c0368b0 0x7f161c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08ed0500 0x55fb08ed2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed30e0 con 0x55fb08ed0500 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.694+0000 7f175189b640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08ed0500 0x55fb08ed2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f175209c640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c0368b0 0x7f161c038d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55fb08ea01b0 tx=0x7f174c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f175189b640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08ed0500 0x55fb08ed2990 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 realm 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed34f0 con 0x55fb08ed0500 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed3dc0 con 0x55fb08ed0500 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed4160 con 0x55fb08ed0500 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.695+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed45c0 con 0x55fb08ed0500 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f1755b3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f1755b3f800 20 searching for the correct realm 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fb08ed6610 0x55fb08ed8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed6610 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f175109a640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fb08ed6610 0x55fb08ed8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f175109a640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fb08ed6610 0x55fb08ed8a00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f175109a640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1748098070 0x7f17480065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.696+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x7f1748098070 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.697+0000 7f175209c640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1748098070 0x7f17480065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.697+0000 7f175209c640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1748098070 0x7f17480065b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.697+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c01f070 con 0x7f1748098070 2024-04-24T01:43:59.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.697+0000 7f175209c640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f174c031040 0x7f174c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.697+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x7f174c031040 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.697+0000 7f175189b640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f174c031040 0x7f174c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.698+0000 7f175189b640 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f174c031040 0x7f174c032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.698+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.698+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed0500 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.698+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.698+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed0500 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.698+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x7f174c031040 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x7f174c031040 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x7f1748098070 2024-04-24T01:43:59.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c01f070 con 0x7f1748098070 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed6610 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.699+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed0500 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.700+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.700+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x7f174c031040 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.700+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.700+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed0500 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.700+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.700+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x7f1748098070 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f174c01f070 con 0x7f1748098070 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed6610 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed90b0 con 0x55fb08ed6610 2024-04-24T01:43:59.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f174c031040 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.701+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed6610 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed6610 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed0500 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed0500 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.702+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f174c031040 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed6610 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f1748098070 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c01f070 con 0x7f1748098070 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed0500 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f1748098070 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c01f070 con 0x7f1748098070 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.703+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed6610 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f174c031040 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f1748098070 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c01f070 con 0x7f1748098070 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed6610 2024-04-24T01:43:59.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.704+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f174c031040 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x55fb08ed0500 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f17480b0040 con 0x7f1748098070 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed5060 con 0x55fb08ed0500 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.705+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed5900 con 0x55fb08ed0500 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed4ca0 con 0x55fb08ed0500 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 zone default found 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 4 Realm: () 2024-04-24T01:43:59.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 zonegroup default 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ed5900 con 0x7f1748098070 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.706+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edb3a0 con 0x55fb08ed6610 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f1755b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edb740 con 0x55fb08ed6610 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f1755b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f1755b3f800 20 started sync module instance, tier type = 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f1755b3f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.707+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08eda7e0 con 0x7f1748098070 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.708+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.708+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94536674946304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08eda7e0 con 0x7f1748098070 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.708+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edc140 con 0x55fb08ed0500 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.709+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94536674946304] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.709+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.709+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94536674950224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08eda7e0 con 0x55fb08ed0500 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.709+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edcb90 con 0x55fb08ed6610 2024-04-24T01:43:59.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.710+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94536674950224] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.711+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.711+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94536674943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08eda750 con 0x55fb08ed6610 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.711+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edda80 con 0x7f1748098070 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.712+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94536674943792] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.712+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.712+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94536674956752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08eddea0 con 0x7f1748098070 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.712+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ede860 con 0x55fb08ed0500 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.713+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.713+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94536674960304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edec80 con 0x55fb08ed0500 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.713+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edf760 con 0x7f174c031040 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.713+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94536674956752] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.714+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94536674960304] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.716+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.716+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94536674964080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ede7d0 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.716+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee0000 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.717+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94536674964080] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.717+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.717+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94536674957808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ede7d0 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.717+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee0620 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94536674957808] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94536674966192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee0620 con 0x7f174c031040 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 20 add_watcher() i=0 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 20 add_watcher() i=1 2024-04-24T01:43:59.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 20 add_watcher() i=2 2024-04-24T01:43:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 20 add_watcher() i=3 2024-04-24T01:43:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 20 add_watcher() i=4 2024-04-24T01:43:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 20 add_watcher() i=5 2024-04-24T01:43:59.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.718+0000 7f1755b3f800 20 add_watcher() i=6 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.719+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94536674966192] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.719+0000 7f1755b3f800 20 add_watcher() i=7 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.719+0000 7f1755b3f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.719+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee3930 con 0x55fb08ed0500 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.719+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.719+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94536674968288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee0bb0 con 0x55fb08ed0500 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.720+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94536674968288] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.720+0000 7f1603fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1755b3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:59.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1755b3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1755b3f800 5 note: GC not initialized 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1602ffd640 20 reqs_thread_entry: start 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1755b3f800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1755b3f800 20 Filter name: none 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1600ff9640 20 reqs_thread_entry: start 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1755b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08f16840 con 0x55fb08ed0500 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.721+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.722+0000 7f1755b3f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.722+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb08f17d90 con 0x7f174c031040 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.722+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.723+0000 7f1603fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.723+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94536674968288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee2930 con 0x55fb08ed0500 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.724+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94536674968288] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.724+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94536674946304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee02e0 con 0x7f1748098070 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.725+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94536674946304] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.725+0000 7f1755b3f800 20 remove_watcher() i=0 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.725+0000 7f1755b3f800 2 removed watcher, disabling cache 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.725+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94536674950224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee02e0 con 0x55fb08ed0500 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.727+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94536674950224] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.727+0000 7f1755b3f800 20 remove_watcher() i=1 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.727+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94536674943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edbc50 con 0x55fb08ed6610 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.728+0000 7f175109a640 1 -- 172.21.15.131:0/1232291925 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94536674943792] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1748095030 con 0x55fb08ed6610 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.728+0000 7f1755b3f800 20 remove_watcher() i=2 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.728+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94536674956752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee02e0 con 0x7f1748098070 2024-04-24T01:43:59.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.729+0000 7f175209c640 1 -- 172.21.15.131:0/1232291925 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94536674956752] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c040040 con 0x7f1748098070 2024-04-24T01:43:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.729+0000 7f1755b3f800 20 remove_watcher() i=3 2024-04-24T01:43:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.729+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94536674960304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08eda330 con 0x55fb08ed0500 2024-04-24T01:43:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.730+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94536674960304] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x55fb08ed0500 2024-04-24T01:43:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.730+0000 7f1755b3f800 20 remove_watcher() i=4 2024-04-24T01:43:59.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.730+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94536674964080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08edd5d0 con 0x7f174c031040 2024-04-24T01:43:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.731+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94536674964080] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.731+0000 7f1755b3f800 20 remove_watcher() i=5 2024-04-24T01:43:59.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.731+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94536674957808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ee02e0 con 0x7f174c031040 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.732+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94536674957808] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.732+0000 7f1755b3f800 20 remove_watcher() i=6 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.732+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94536674966192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb08ede3b0 con 0x7f174c031040 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94536674966192] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401dc90 con 0x7f174c031040 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 20 remove_watcher() i=7 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f174c031040 msgr2=0x7f174c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f174c031040 0x7f174c032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08ed0500 msgr2=0x55fb08ed2990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08ed0500 0x55fb08ed2990 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1748098070 msgr2=0x7f17480065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1748098070 0x7f17480065b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fb08ed6610 msgr2=0x55fb08ed8a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fb08ed6610 0x55fb08ed8a00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c0368b0 msgr2=0x7f161c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f161c0368b0 0x7f161c038d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55fb08ea01b0 tx=0x7f174c01f000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 msgr2=0x55fb08ec4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f175189b640 1 -- 172.21.15.131:0/1232291925 reap_dead start 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ec4a20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1748080040 tx=0x7f174808d9d0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 shutdown_connections 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1232291925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08ebd3c0 0x55fb08ec4a20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 >> 172.21.15.131:0/1232291925 conn(0x55fb08eb9720 msgr2=0x55fb08eb6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 shutdown_connections 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.733+0000 7f1755b3f800 1 -- 172.21.15.131:0/1232291925 wait complete. 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f162c036900 msgr2=0x7f162c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f162c036900 0x7f162c038dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55fb08ea0a30 tx=0x7f174c005840 comp rx=0 tx=0).stop 2024-04-24T01:43:59.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08eb0180 msgr2=0x55fb08eb05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08eb0180 0x55fb08eb05a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1748005930 tx=0x7f1748002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 shutdown_connections 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f162c036900 0x7f162c038dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/1015031736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08eb0180 0x55fb08eb05a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 >> 172.21.15.131:0/1015031736 conn(0x55fb08ea4220 msgr2=0x55fb08ea4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 shutdown_connections 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/1015031736 wait complete. 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08da1150 msgr2=0x55fb08e9ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08da1150 0x55fb08e9ef90 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1638036950 msgr2=0x7f1638038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1638036950 0x7f1638038e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1748054000 tx=0x7f174804e000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 msgr2=0x55fb08e97d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08e97d50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1744001ed0 tx=0x7f1744000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 shutdown_connections 2024-04-24T01:43:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fb08da1150 0x55fb08e9ef90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1638036950 0x7f1638038e10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 --2- 172.21.15.131:0/2404059046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb08d101e0 0x55fb08e97d50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 >> 172.21.15.131:0/2404059046 conn(0x55fb08d973a0 msgr2=0x55fb08d9c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 shutdown_connections 2024-04-24T01:43:59.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.734+0000 7f1755b3f800 1 -- 172.21.15.131:0/2404059046 wait complete. 2024-04-24T01:43:59.742 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-04-24T01:43:59.743 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-04-24T01:43:59.743 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-24T01:43:59.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-24T01:43:59.743 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-24T01:43:59.828 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:59.828 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:59.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.828+0000 7f1d5d430800 1 Processor -- start 2024-04-24T01:43:59.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.828+0000 7f1d5d430800 1 -- start start 2024-04-24T01:43:59.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.828+0000 7f1d5d430800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556a8fe75350 0x556a8fe77740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.828+0000 7f1d5d430800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a8fd2fd40 con 0x556a8fe70fb0 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.828+0000 7f1d5d430800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x556a8fd024d0 con 0x556a8fe75350 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.829+0000 7f1d4ff2d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556a8fe75350 0x556a8fe77740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.829+0000 7f1d4ff2d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556a8fe75350 0x556a8fe77740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42254/0 (socket says 172.21.15.131:42254) 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.829+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/488910455 learned_addr learned my addr 172.21.15.131:0/488910455 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.829+0000 7f1d5872e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x556a8fe70fb0 0x556a8fe713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:55622/0 (socket says 172.21.15.131:55622) 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.829+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/488910455 >> v1:172.21.15.107:6789/0 conn(0x556a8fe70fb0 legacy=0x556a8fe713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.829+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/488910455 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8fd2e590 con 0x556a8fe75350 2024-04-24T01:43:59.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.831+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/488910455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe75350 0x556a8fe77740 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a520 tx=0x7f1d4001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec0dcf3d4d17e33 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.832+0000 7f1d57f2d640 1 -- 172.21.15.131:0/488910455 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40057070 con 0x556a8fe75350 2024-04-24T01:43:59.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.832+0000 7f1d57f2d640 1 -- 172.21.15.131:0/488910455 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40052570 con 0x556a8fe75350 2024-04-24T01:43:59.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.832+0000 7f1d57f2d640 1 -- 172.21.15.131:0/488910455 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4004ae60 con 0x556a8fe75350 2024-04-24T01:43:59.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.833+0000 7f1d5d430800 1 -- 172.21.15.131:0/488910455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe75350 msgr2=0x556a8fe77740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.833+0000 7f1d5d430800 1 --2- 172.21.15.131:0/488910455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe75350 0x556a8fe77740 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a520 tx=0x7f1d4001d010 comp rx=0 tx=0).stop 2024-04-24T01:43:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.833+0000 7f1d5d430800 1 -- 172.21.15.131:0/488910455 shutdown_connections 2024-04-24T01:43:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.833+0000 7f1d5d430800 1 --2- 172.21.15.131:0/488910455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe75350 0x556a8fe77740 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.833+0000 7f1d5d430800 1 -- 172.21.15.131:0/488910455 >> 172.21.15.131:0/488910455 conn(0x556a8fe6c550 msgr2=0x556a8fe6e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.833+0000 7f1d5d430800 1 -- 172.21.15.131:0/488910455 shutdown_connections 2024-04-24T01:43:59.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.833+0000 7f1d5d430800 1 -- 172.21.15.131:0/488910455 wait complete. 2024-04-24T01:43:59.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.844+0000 7f1d5d430800 1 Processor -- start 2024-04-24T01:43:59.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.845+0000 7f1d5d430800 1 -- start start 2024-04-24T01:43:59.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.845+0000 7f1d5d430800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff62160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.845+0000 7f1d5d430800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a8fdbc3b0 con 0x556a8fe70fb0 2024-04-24T01:43:59.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.845+0000 7f1d5872e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff62160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.845+0000 7f1d5872e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff62160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42270/0 (socket says 172.21.15.131:42270) 2024-04-24T01:43:59.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.845+0000 7f1d5872e640 1 -- 172.21.15.131:0/549054133 learned_addr learned my addr 172.21.15.131:0/549054133 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.845+0000 7f1d5872e640 1 -- 172.21.15.131:0/549054133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8ff62730 con 0x556a8fe70fb0 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.846+0000 7f1d5872e640 1 --2- 172.21.15.131:0/549054133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff62160 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b230 tx=0x7f1d4800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594b6ec2697cedea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.846+0000 7f1c4660c640 1 -- 172.21.15.131:0/549054133 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4800e5c0 con 0x556a8fe70fb0 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.846+0000 7f1c4660c640 1 -- 172.21.15.131:0/549054133 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d48006070 con 0x556a8fe70fb0 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.846+0000 7f1c4660c640 1 -- 172.21.15.131:0/549054133 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4800e890 con 0x556a8fe70fb0 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.846+0000 7f1d5d430800 1 -- 172.21.15.131:0/549054133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 msgr2=0x556a8ff62160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.846+0000 7f1d5d430800 1 --2- 172.21.15.131:0/549054133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff62160 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b230 tx=0x7f1d4800b6f0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 -- 172.21.15.131:0/549054133 shutdown_connections 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 --2- 172.21.15.131:0/549054133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff62160 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 -- 172.21.15.131:0/549054133 >> 172.21.15.131:0/549054133 conn(0x556a8fe6c550 msgr2=0x556a8ff5da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 -- 172.21.15.131:0/549054133 shutdown_connections 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 -- 172.21.15.131:0/549054133 wait complete. 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 Processor -- start 2024-04-24T01:43:59.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 -- start start 2024-04-24T01:43:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff69d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5d430800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a8fe78010 con 0x556a8fe70fb0 2024-04-24T01:43:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5872e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff69d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5872e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff69d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42272/0 (socket says 172.21.15.131:42272) 2024-04-24T01:43:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5872e640 1 -- 172.21.15.131:0/3294986582 learned_addr learned my addr 172.21.15.131:0/3294986582 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.847+0000 7f1d5872e640 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8ff6a2a0 con 0x556a8fe70fb0 2024-04-24T01:43:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.848+0000 7f1d5872e640 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff69d60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000fd0 tx=0x7f1d48000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.848+0000 7f1c44e09640 1 -- 172.21.15.131:0/3294986582 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4800f8d0 con 0x556a8fe70fb0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.848+0000 7f1c44e09640 1 -- 172.21.15.131:0/3294986582 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4800fa90 con 0x556a8fe70fb0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.848+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a8ff6a530 con 0x556a8fe70fb0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.848+0000 7f1c44e09640 1 -- 172.21.15.131:0/3294986582 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4800fdb0 con 0x556a8fe70fb0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.848+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a8ff6d190 con 0x556a8fe70fb0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1c44e09640 1 -- 172.21.15.131:0/3294986582 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d48017070 con 0x556a8fe70fb0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1c44e09640 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c40036950 0x7f1c40038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1c44e09640 1 -- 172.21.15.131:0/3294986582 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1d48015020 con 0x556a8fe70fb0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c40036950 0x7f1c40038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1d5d430800 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8fe75350 0x556a8ff70f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ff714d0 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8fe75350 0x556a8ff70f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c40036950 0x7f1c40038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1d40054000 tx=0x7f1d4004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.849+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8fe75350 0x556a8ff70f50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.850+0000 7f1d58f2f640 1 -- 172.21.15.131:0/3294986582 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d5000a4a0 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.850+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ff6e520 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.850+0000 7f1d58f2f640 1 -- 172.21.15.131:0/3294986582 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d5000a4a0 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.850+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ff73310 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.850+0000 7f1d58f2f640 1 -- 172.21.15.131:0/3294986582 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d5000a4a0 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.850+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ff72650 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.851+0000 7f1d58f2f640 1 -- 172.21.15.131:0/3294986582 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d5000a4a0 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.851+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ff72aa0 con 0x556a8fe75350 2024-04-24T01:43:59.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.851+0000 7f1d58f2f640 1 -- 172.21.15.131:0/3294986582 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d5000a4a0 con 0x556a8fe75350 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.851+0000 7f1d5d430800 1 Processor -- start 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.851+0000 7f1d5d430800 1 -- start start 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.851+0000 7f1d5d430800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff820e0 0x556a8ff82500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.851+0000 7f1d5d430800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a8fd626b0 con 0x556a8ff820e0 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1d4ff2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff820e0 0x556a8ff82500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1d4ff2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff820e0 0x556a8ff82500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42280/0 (socket says 172.21.15.131:42280) 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/4075923927 learned_addr learned my addr 172.21.15.131:0/4075923927 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/4075923927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8ff82a40 con 0x556a8ff820e0 2024-04-24T01:43:59.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff820e0 0x556a8ff82500 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d40000c00 tx=0x7f1d40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1c3dffb640 1 -- 172.21.15.131:0/4075923927 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40057040 con 0x556a8ff820e0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1c3dffb640 1 -- 172.21.15.131:0/4075923927 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4005d650 con 0x556a8ff820e0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a8ff834b0 con 0x556a8ff820e0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.852+0000 7f1c3dffb640 1 -- 172.21.15.131:0/4075923927 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4005d930 con 0x556a8ff820e0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.853+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a8ff83950 con 0x556a8ff820e0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.853+0000 7f1c3dffb640 1 -- 172.21.15.131:0/4075923927 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d40067070 con 0x556a8ff820e0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.853+0000 7f1c3dffb640 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c30036900 0x7f1c30038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.853+0000 7f1c3dffb640 1 -- 172.21.15.131:0/4075923927 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1d4008f8a0 con 0x556a8ff820e0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.853+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c30036900 0x7f1c30038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d5d430800 1 Processor -- start 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c30036900 0x7f1c30038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x556a8ff72170 tx=0x7f1d50005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d5d430800 1 -- start start 2024-04-24T01:43:59.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d5d430800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff8f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d5d430800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a8ff62ab0 con 0x556a8ff8f320 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d4ff2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff8f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d4ff2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff8f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42298/0 (socket says 172.21.15.131:42298) 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/2321126611 learned_addr learned my addr 172.21.15.131:0/2321126611 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.854+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/2321126611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8ff8fd10 con 0x556a8ff8f320 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/2321126611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff8f740 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1d4008db70 tx=0x7f1d4008ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c28682b30fe78bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1c377fe640 1 -- 172.21.15.131:0/2321126611 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40000ed0 con 0x556a8ff8f320 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1c377fe640 1 -- 172.21.15.131:0/2321126611 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40068c50 con 0x556a8ff8f320 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1c377fe640 1 -- 172.21.15.131:0/2321126611 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40001070 con 0x556a8ff8f320 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 -- 172.21.15.131:0/2321126611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 msgr2=0x556a8ff8f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 --2- 172.21.15.131:0/2321126611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff8f740 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1d4008db70 tx=0x7f1d4008ddf0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 -- 172.21.15.131:0/2321126611 shutdown_connections 2024-04-24T01:43:59.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 --2- 172.21.15.131:0/2321126611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff8f740 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 -- 172.21.15.131:0/2321126611 >> 172.21.15.131:0/2321126611 conn(0x556a8ff8b680 msgr2=0x556a8ff896e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 -- 172.21.15.131:0/2321126611 shutdown_connections 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 -- 172.21.15.131:0/2321126611 wait complete. 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.855+0000 7f1d5d430800 1 Processor -- start 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d5d430800 1 -- start start 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d5d430800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff96960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d5d430800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a8ff90480 con 0x556a8ff8f320 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d4ff2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff96960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d4ff2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff96960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42304/0 (socket says 172.21.15.131:42304) 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 learned_addr learned my addr 172.21.15.131:0/1536047763 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8ff96ea0 con 0x556a8ff8f320 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff96960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1d40052e80 tx=0x7f1d4008dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1c35ffb640 1 -- 172.21.15.131:0/1536047763 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40068e00 con 0x556a8ff8f320 2024-04-24T01:43:59.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1c35ffb640 1 -- 172.21.15.131:0/1536047763 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40093030 con 0x556a8ff8f320 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a8ff97130 con 0x556a8ff8f320 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.856+0000 7f1c35ffb640 1 -- 172.21.15.131:0/1536047763 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4008fdd0 con 0x556a8ff8f320 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.857+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a8ff99de0 con 0x556a8ff8f320 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.857+0000 7f1c35ffb640 1 -- 172.21.15.131:0/1536047763 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d4008f3e0 con 0x556a8ff8f320 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.857+0000 7f1c35ffb640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c280368b0 0x7f1c28038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.857+0000 7f1c35ffb640 1 -- 172.21.15.131:0/1536047763 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1d40099d10 con 0x556a8ff8f320 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.857+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c280368b0 0x7f1c28038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.857+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8ffa2420 0x556a8ffa48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa5030 con 0x556a8ffa2420 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5872e640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8ffa2420 0x556a8ffa48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c280368b0 0x7f1c28038d70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556a8ff6ab80 tx=0x7f1d5001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5872e640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8ffa2420 0x556a8ffa48e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d4802e070 con 0x556a8ffa2420 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 20 realm 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa5440 con 0x556a8ffa2420 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d4802e070 con 0x556a8ffa2420 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.858+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa5d10 con 0x556a8ffa2420 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d4802e070 con 0x556a8ffa2420 2024-04-24T01:43:59.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa60b0 con 0x556a8ffa2420 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d4802e070 con 0x556a8ffa2420 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa6510 con 0x556a8ffa2420 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d4802e070 con 0x556a8ffa2420 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 20 searching for the correct realm 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556a8ffa8560 0x556a8ffaa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.859+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556a8ffa8560 0x556a8ffaa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.860+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556a8ffa8560 0x556a8ffaa950 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.860+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.860+0000 7f1d4ff2d640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1d40086050 0x7f1d4007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.860+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d40086050 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.860+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1d40086050 0x7f1d4007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.860+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1d40086050 0x7f1d4007b680 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.860+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5001f070 con 0x7f1d40086050 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.861+0000 7f1d58f2f640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1d50031040 0x7f1d50032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.861+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.861+0000 7f1d5872e640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1d50031040 0x7f1d50032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.861+0000 7f1d5872e640 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1d50031040 0x7f1d50032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.861+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4802e070 con 0x7f1d50031040 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.861+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d4802e070 con 0x556a8ffa2420 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4802e070 con 0x556a8ffa2420 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4802e070 con 0x7f1d50031040 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4802e070 con 0x7f1d50031040 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.862+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d40086050 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5001f070 con 0x7f1d40086050 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48051040 con 0x556a8ffa2420 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48051040 con 0x7f1d50031040 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.863+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48051040 con 0x556a8ffa2420 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d40086050 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d5001f070 con 0x7f1d40086050 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.864+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.865+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48051040 con 0x7f1d50031040 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.865+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.865+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.865+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.865+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.865+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d48051040 con 0x556a8ffa2420 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d48051040 con 0x556a8ffa2420 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48051040 con 0x7f1d50031040 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.866+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d40086050 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5001f070 con 0x7f1d40086050 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48051040 con 0x556a8ffa2420 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d40086050 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5001f070 con 0x7f1d40086050 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.867+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d40086050 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5001f070 con 0x7f1d40086050 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa8560 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d50031040 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.868+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x556a8ffa2420 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab000 con 0x7f1d40086050 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:43:59.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa6fb0 con 0x556a8ffa2420 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.869+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa7850 con 0x556a8ffa2420 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffa6bf0 con 0x556a8ffa2420 2024-04-24T01:43:59.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 zone default found 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 4 Realm: () 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 zonegroup default 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffab460 con 0x7f1d40086050 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffad690 con 0x556a8ffa8560 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.870+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffada30 con 0x556a8ffa8560 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.871+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.871+0000 7f1d5d430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.871+0000 7f1d5d430800 20 started sync module instance, tier type = 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.871+0000 7f1d5d430800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.871+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffacad0 con 0x7f1d40086050 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.872+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.872+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93916170473504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffacad0 con 0x7f1d40086050 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.872+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffae450 con 0x556a8ffa2420 2024-04-24T01:43:59.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.873+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93916170473504] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.873+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.873+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93916170477376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffacad0 con 0x556a8ffa2420 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.873+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffaeee0 con 0x556a8ffa8560 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.874+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93916170477376] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.874+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.874+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93916170470944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffaca40 con 0x556a8ffa8560 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.874+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffafda0 con 0x7f1d40086050 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.875+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.875+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93916170484432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb0540 con 0x7f1d40086050 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.875+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb1060 con 0x556a8ffa2420 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.876+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93916170470944] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.876+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.876+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93916170488624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb1020 con 0x556a8ffa2420 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.877+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb1a90 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.877+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93916170484432] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.877+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93916170488624] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.878+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.878+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93916170482384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb1a90 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.878+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb1ec0 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.879+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.879+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93916170485648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb2330 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.879+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb2e30 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.879+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93916170482384] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93916170485648] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93916170496288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb1e90 con 0x7f1d50031040 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 20 add_watcher() i=0 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 20 add_watcher() i=1 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 20 add_watcher() i=2 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 20 add_watcher() i=3 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 20 add_watcher() i=4 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 20 add_watcher() i=5 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.881+0000 7f1d5d430800 20 add_watcher() i=6 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.882+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93916170496288] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.882+0000 7f1d5d430800 20 add_watcher() i=7 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.882+0000 7f1d5d430800 2 all 8 watchers are set, enabling cache 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.882+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb5f30 con 0x556a8ffa2420 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.883+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.883+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93916170491328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb33b0 con 0x556a8ffa2420 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93916170491328] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1c0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5d430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5d430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5d430800 5 note: GC not initialized 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1c0d7e2640 20 reqs_thread_entry: start 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5d430800 20 init_complete bucket index max shards: 11 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5d430800 20 Filter name: none 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1b7effd640 20 reqs_thread_entry: start 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5d430800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.884+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffe8ba0 con 0x556a8ffa2420 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.885+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.885+0000 7f1d5d430800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:43:59.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.885+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffea0f0 con 0x7f1d50031040 2024-04-24T01:43:59.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.885+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.886+0000 7f1c0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.886+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93916170491328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb2f00 con 0x556a8ffa2420 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.887+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93916170491328] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.887+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93916170473504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb15c0 con 0x7f1d40086050 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.888+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93916170473504] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.888+0000 7f1d5d430800 20 remove_watcher() i=0 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.888+0000 7f1d5d430800 2 removed watcher, disabling cache 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.888+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93916170477376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb15c0 con 0x556a8ffa2420 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.889+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93916170477376] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.889+0000 7f1d5d430800 20 remove_watcher() i=1 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.889+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93916170470944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb15c0 con 0x556a8ffa8560 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.890+0000 7f1d4ff2d640 1 -- 172.21.15.131:0/1536047763 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93916170470944] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4009f070 con 0x556a8ffa8560 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.890+0000 7f1d5d430800 20 remove_watcher() i=2 2024-04-24T01:43:59.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.891+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93916170484432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffac620 con 0x7f1d40086050 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.891+0000 7f1d58f2f640 1 -- 172.21.15.131:0/1536047763 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93916170484432] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d50040040 con 0x7f1d40086050 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.891+0000 7f1d5d430800 20 remove_watcher() i=3 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.891+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93916170488624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffafad0 con 0x556a8ffa2420 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.893+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93916170488624] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x556a8ffa2420 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.893+0000 7f1d5d430800 20 remove_watcher() i=4 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.893+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93916170482384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffac620 con 0x7f1d50031040 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.894+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93916170482384] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.894+0000 7f1d5d430800 20 remove_watcher() i=5 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.894+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93916170485648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb0b30 con 0x7f1d50031040 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.895+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93916170485648] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.895+0000 7f1d5d430800 20 remove_watcher() i=6 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.895+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93916170496288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a8ffb0b30 con 0x7f1d50031040 2024-04-24T01:43:59.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93916170496288] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d4805e040 con 0x7f1d50031040 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 20 remove_watcher() i=7 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1d50031040 msgr2=0x7f1d50032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1d50031040 0x7f1d50032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8ffa2420 msgr2=0x556a8ffa48e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8ffa2420 0x556a8ffa48e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1d40086050 msgr2=0x7f1d4007b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1d40086050 0x7f1d4007b680 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556a8ffa8560 msgr2=0x556a8ffaa950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x556a8ffa8560 0x556a8ffaa950 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c280368b0 msgr2=0x7f1c28038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c280368b0 0x7f1c28038d70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556a8ff6ab80 tx=0x7f1d5001f000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 msgr2=0x556a8ff96960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5872e640 1 -- 172.21.15.131:0/1536047763 reap_dead start 2024-04-24T01:43:59.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff96960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1d40052e80 tx=0x7f1d4008dad0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 shutdown_connections 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 --2- 172.21.15.131:0/1536047763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff8f320 0x556a8ff96960 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 >> 172.21.15.131:0/1536047763 conn(0x556a8ff8b680 msgr2=0x556a8ff88ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 shutdown_connections 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.896+0000 7f1d5d430800 1 -- 172.21.15.131:0/1536047763 wait complete. 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c30036900 msgr2=0x7f1c30038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c30036900 0x7f1c30038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x556a8ff72170 tx=0x7f1d50005840 comp rx=0 tx=0).stop 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff820e0 msgr2=0x556a8ff82500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff820e0 0x556a8ff82500 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d40000c00 tx=0x7f1d40002fb0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 shutdown_connections 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c30036900 0x7f1c30038dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/4075923927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8ff820e0 0x556a8ff82500 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 >> 172.21.15.131:0/4075923927 conn(0x556a8ff76180 msgr2=0x556a8ff76580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 shutdown_connections 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/4075923927 wait complete. 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8fe75350 msgr2=0x556a8ff70f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8fe75350 0x556a8ff70f50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c40036950 msgr2=0x7f1c40038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c40036950 0x7f1c40038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1d40054000 tx=0x7f1d4004e000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 msgr2=0x556a8ff69d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff69d60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000fd0 tx=0x7f1d48000ed0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 shutdown_connections 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x556a8fe75350 0x556a8ff70f50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1c40036950 0x7f1c40038e10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 --2- 172.21.15.131:0/3294986582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a8fe70fb0 0x556a8ff69d60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 >> 172.21.15.131:0/3294986582 conn(0x556a8fe6c550 msgr2=0x556a8ff5c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 shutdown_connections 2024-04-24T01:43:59.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.897+0000 7f1d5d430800 1 -- 172.21.15.131:0/3294986582 wait complete. 2024-04-24T01:43:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-24T01:43:59.906 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T01:43:59.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-24T01:43:59.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-24T01:43:59.906 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-24T01:43:59.955 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:43:59.955 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:43:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f345872d800 1 Processor -- start 2024-04-24T01:43:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f345872d800 1 -- start start 2024-04-24T01:43:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f345872d800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5597944a5fb0 0x5597944a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f345872d800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559794364d40 con 0x5597944a7120 2024-04-24T01:43:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f345872d800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5597943374d0 con 0x5597944a5fb0 2024-04-24T01:43:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f34543ae640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5597944a5fb0 0x5597944a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f34543ae640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5597944a5fb0 0x5597944a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42320/0 (socket says 172.21.15.131:42320) 2024-04-24T01:43:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f34543ae640 1 -- 172.21.15.131:0/322645180 learned_addr learned my addr 172.21.15.131:0/322645180 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.955+0000 7f3453bad640 1 --1- 172.21.15.131:0/322645180 >> v1:172.21.15.107:6789/0 conn(0x5597944a7120 0x5597944a75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:55640/0 (socket says 172.21.15.131:55640) 2024-04-24T01:43:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.956+0000 7f34543ae640 1 -- 172.21.15.131:0/322645180 >> v1:172.21.15.107:6789/0 conn(0x5597944a7120 legacy=0x5597944a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.956+0000 7f34543ae640 1 -- 172.21.15.131:0/322645180 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559794363590 con 0x5597944a5fb0 2024-04-24T01:43:59.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.957+0000 7f34543ae640 1 --2- 172.21.15.131:0/322645180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597944a63d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f344400a520 tx=0x7f344401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327f5fcb46d78a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f34533ac640 1 -- 172.21.15.131:0/322645180 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3444057070 con 0x5597944a5fb0 2024-04-24T01:43:59.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f34533ac640 1 -- 172.21.15.131:0/322645180 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3444052570 con 0x5597944a5fb0 2024-04-24T01:43:59.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f34533ac640 1 -- 172.21.15.131:0/322645180 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f344404ae60 con 0x5597944a5fb0 2024-04-24T01:43:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f345872d800 1 -- 172.21.15.131:0/322645180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 msgr2=0x5597944a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f345872d800 1 --2- 172.21.15.131:0/322645180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597944a63d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f344400a520 tx=0x7f344401d010 comp rx=0 tx=0).stop 2024-04-24T01:43:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f345872d800 1 -- 172.21.15.131:0/322645180 shutdown_connections 2024-04-24T01:43:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f345872d800 1 --2- 172.21.15.131:0/322645180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597944a63d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f345872d800 1 -- 172.21.15.131:0/322645180 >> 172.21.15.131:0/322645180 conn(0x5597944a1550 msgr2=0x5597944a3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f345872d800 1 -- 172.21.15.131:0/322645180 shutdown_connections 2024-04-24T01:43:59.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.958+0000 7f345872d800 1 -- 172.21.15.131:0/322645180 wait complete. 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.970+0000 7f345872d800 1 Processor -- start 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.970+0000 7f345872d800 1 -- start start 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.970+0000 7f345872d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597945975f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.970+0000 7f345872d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5597943f13b0 con 0x5597944a5fb0 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.970+0000 7f34543ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597945975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.970+0000 7f34543ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597945975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42332/0 (socket says 172.21.15.131:42332) 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.970+0000 7f34543ae640 1 -- 172.21.15.131:0/3982496959 learned_addr learned my addr 172.21.15.131:0/3982496959 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.971+0000 7f34543ae640 1 -- 172.21.15.131:0/3982496959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559794597bc0 con 0x5597944a5fb0 2024-04-24T01:43:59.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.971+0000 7f34543ae640 1 --2- 172.21.15.131:0/3982496959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597945975f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3444055040 tx=0x7f344404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf5ad904cd88f62 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.971+0000 7f334260c640 1 -- 172.21.15.131:0/3982496959 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3444057040 con 0x5597944a5fb0 2024-04-24T01:43:59.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.971+0000 7f334260c640 1 -- 172.21.15.131:0/3982496959 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3444052720 con 0x5597944a5fb0 2024-04-24T01:43:59.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.971+0000 7f334260c640 1 -- 172.21.15.131:0/3982496959 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3444052a40 con 0x5597944a5fb0 2024-04-24T01:43:59.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 -- 172.21.15.131:0/3982496959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 msgr2=0x5597945975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 --2- 172.21.15.131:0/3982496959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597945975f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3444055040 tx=0x7f344404c000 comp rx=0 tx=0).stop 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 -- 172.21.15.131:0/3982496959 shutdown_connections 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 --2- 172.21.15.131:0/3982496959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x5597945975f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 -- 172.21.15.131:0/3982496959 >> 172.21.15.131:0/3982496959 conn(0x5597944a1550 msgr2=0x559794592f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 -- 172.21.15.131:0/3982496959 shutdown_connections 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 -- 172.21.15.131:0/3982496959 wait complete. 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 Processor -- start 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 -- start start 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x55979459f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.972+0000 7f345872d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5597944af590 con 0x5597944a5fb0 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f34543ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x55979459f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f34543ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x55979459f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42342/0 (socket says 172.21.15.131:42342) 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f34543ae640 1 -- 172.21.15.131:0/3867816609 learned_addr learned my addr 172.21.15.131:0/3867816609 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f34543ae640 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55979459f540 con 0x5597944a5fb0 2024-04-24T01:43:59.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f34543ae640 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x55979459f000 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f34440524f0 tx=0x7f3444003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f3340e09640 1 -- 172.21.15.131:0/3867816609 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3444073070 con 0x5597944a5fb0 2024-04-24T01:43:59.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f3340e09640 1 -- 172.21.15.131:0/3867816609 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3444052c90 con 0x5597944a5fb0 2024-04-24T01:43:59.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55979459f7d0 con 0x5597944a5fb0 2024-04-24T01:43:59.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f3340e09640 1 -- 172.21.15.131:0/3867816609 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3444057070 con 0x5597944a5fb0 2024-04-24T01:43:59.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.973+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597945a2480 con 0x5597944a5fb0 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.974+0000 7f3340e09640 1 -- 172.21.15.131:0/3867816609 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3444076070 con 0x5597944a5fb0 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.974+0000 7f3340e09640 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f333c036950 0x7f333c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.974+0000 7f3340e09640 1 -- 172.21.15.131:0/3867816609 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f344408db40 con 0x5597944a5fb0 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.974+0000 7f3453bad640 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f333c036950 0x7f333c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.974+0000 7f345872d800 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597944a7120 0x5597945a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.974+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945a6780 con 0x5597944a7120 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.975+0000 7f3454baf640 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597944a7120 0x5597945a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.975+0000 7f3453bad640 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f333c036950 0x7f333c038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3448000f60 tx=0x7f3448001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.975+0000 7f3454baf640 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597944a7120 0x5597945a6240 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.975+0000 7f3454baf640 1 -- 172.21.15.131:0/3867816609 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f344c00a4a0 con 0x5597944a7120 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.975+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945a3810 con 0x5597944a7120 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.975+0000 7f3454baf640 1 -- 172.21.15.131:0/3867816609 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f344c00a4a0 con 0x5597944a7120 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.975+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945a85c0 con 0x5597944a7120 2024-04-24T01:43:59.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.976+0000 7f3454baf640 1 -- 172.21.15.131:0/3867816609 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f344c00a4a0 con 0x5597944a7120 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.976+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945a7900 con 0x5597944a7120 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.976+0000 7f3454baf640 1 -- 172.21.15.131:0/3867816609 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f344c00a4a0 con 0x5597944a7120 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.976+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945a7ca0 con 0x5597944a7120 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.976+0000 7f3454baf640 1 -- 172.21.15.131:0/3867816609 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f344c00a4a0 con 0x5597944a7120 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f345872d800 1 Processor -- start 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f345872d800 1 -- start start 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f345872d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945b73e0 0x5597945b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f345872d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5597943976b0 con 0x5597945b73e0 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f3453bad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945b73e0 0x5597945b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f3453bad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945b73e0 0x5597945b7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42360/0 (socket says 172.21.15.131:42360) 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f3453bad640 1 -- 172.21.15.131:0/4176986049 learned_addr learned my addr 172.21.15.131:0/4176986049 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.977+0000 7f3453bad640 1 -- 172.21.15.131:0/4176986049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597945b7d40 con 0x5597945b73e0 2024-04-24T01:43:59.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.978+0000 7f3453bad640 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945b73e0 0x5597945b7800 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3448001ed0 tx=0x7f344800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.978+0000 7f3339ffb640 1 -- 172.21.15.131:0/4176986049 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3448022070 con 0x5597945b73e0 2024-04-24T01:43:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.978+0000 7f3339ffb640 1 -- 172.21.15.131:0/4176986049 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344800d520 con 0x5597945b73e0 2024-04-24T01:43:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.978+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597945b87b0 con 0x5597945b73e0 2024-04-24T01:43:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.978+0000 7f3339ffb640 1 -- 172.21.15.131:0/4176986049 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f344800d800 con 0x5597945b73e0 2024-04-24T01:43:59.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.978+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597945b8cb0 con 0x5597945b73e0 2024-04-24T01:43:59.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.978+0000 7f3339ffb640 1 -- 172.21.15.131:0/4176986049 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3448025070 con 0x5597945b73e0 2024-04-24T01:43:59.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f3339ffb640 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f332c036900 0x7f332c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f3339ffb640 1 -- 172.21.15.131:0/4176986049 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f344804de50 con 0x5597945b73e0 2024-04-24T01:43:59.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f3454baf640 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f332c036900 0x7f332c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f345872d800 1 Processor -- start 2024-04-24T01:43:59.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f3454baf640 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f332c036900 0x7f332c038dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5597945a7420 tx=0x7f344c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f345872d800 1 -- start start 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f345872d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f345872d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559794597e80 con 0x5597945c4720 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f3453bad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f3453bad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42366/0 (socket says 172.21.15.131:42366) 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.979+0000 7f3453bad640 1 -- 172.21.15.131:0/1203227332 learned_addr learned my addr 172.21.15.131:0/1203227332 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f3453bad640 1 -- 172.21.15.131:0/1203227332 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597945c5110 con 0x5597945c4720 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f3453bad640 1 --2- 172.21.15.131:0/1203227332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945c4b40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f344804c120 tx=0x7f3448024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc568a19f9e98cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f33337fe640 1 -- 172.21.15.131:0/1203227332 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f344804a030 con 0x5597945c4720 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f33337fe640 1 -- 172.21.15.131:0/1203227332 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3448025990 con 0x5597945c4720 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f33337fe640 1 -- 172.21.15.131:0/1203227332 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3448026730 con 0x5597945c4720 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f345872d800 1 -- 172.21.15.131:0/1203227332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 msgr2=0x5597945c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:43:59.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f345872d800 1 --2- 172.21.15.131:0/1203227332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945c4b40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f344804c120 tx=0x7f3448024740 comp rx=0 tx=0).stop 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f345872d800 1 -- 172.21.15.131:0/1203227332 shutdown_connections 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f345872d800 1 --2- 172.21.15.131:0/1203227332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945c4b40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f345872d800 1 -- 172.21.15.131:0/1203227332 >> 172.21.15.131:0/1203227332 conn(0x5597945c0a80 msgr2=0x5597945beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f345872d800 1 -- 172.21.15.131:0/1203227332 shutdown_connections 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.980+0000 7f345872d800 1 -- 172.21.15.131:0/1203227332 wait complete. 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f345872d800 1 Processor -- start 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f345872d800 1 -- start start 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f345872d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f345872d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5597945c5880 con 0x5597945c4720 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f3453bad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f3453bad640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42368/0 (socket says 172.21.15.131:42368) 2024-04-24T01:43:59.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 learned_addr learned my addr 172.21.15.131:0/245081343 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.981+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597945cc2c0 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.982+0000 7f3453bad640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945cbd80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3448024a50 tx=0x7f344804c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.982+0000 7f3331ffb640 1 -- 172.21.15.131:0/245081343 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3448025570 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.982+0000 7f3331ffb640 1 -- 172.21.15.131:0/245081343 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344800d9a0 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.982+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597945cc2c0 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.982+0000 7f3331ffb640 1 -- 172.21.15.131:0/245081343 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f344800dc80 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.982+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597945cc2c0 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.982+0000 7f3331ffb640 1 -- 172.21.15.131:0/245081343 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f344801a320 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f3331ffb640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3324036900 0x7f3324038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f3331ffb640 1 -- 172.21.15.131:0/245081343 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3448045070 con 0x5597945c4720 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f3454baf640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3324036900 0x7f3324038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597945d74d0 0x5597945d9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945da0e0 con 0x5597945d74d0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f3454baf640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3324036900 0x7f3324038dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5597945a3760 tx=0x7f344c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f34543ae640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597945d74d0 0x5597945d9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.983+0000 7f34543ae640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597945d74d0 0x5597945d9990 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 realm 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945da4f0 con 0x5597945d74d0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:43:59.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945dadc0 con 0x5597945d74d0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945db160 con 0x5597945d74d0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.984+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945db600 con 0x5597945d74d0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f345872d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f345872d800 20 searching for the correct realm 2024-04-24T01:43:59.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5597945dd600 0x5597945dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f3453bad640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5597945dd600 0x5597945dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f3453bad640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5597945dd600 0x5597945dfa10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f3453bad640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f344801ac20 0x7f34480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344801ac20 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.985+0000 7f3454baf640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f344801ac20 0x7f34480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.986+0000 7f3454baf640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f344801ac20 0x7f34480039f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.986+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344c01f070 con 0x7f344801ac20 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.986+0000 7f3454baf640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f344c031040 0x7f344c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.986+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.986+0000 7f34543ae640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f344c031040 0x7f344c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:43:59.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.986+0000 7f34543ae640 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f344c031040 0x7f344c032940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.987+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344801ac20 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344c01f070 con 0x7f344801ac20 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:43:59.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.988+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344801ac20 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f344c01f070 con 0x7f344801ac20 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.989+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.990+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.990+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.990+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.990+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.990+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.990+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.990+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.991+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344801ac20 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344c01f070 con 0x7f344801ac20 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:44:00.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344801ac20 2024-04-24T01:44:00.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344c01f070 con 0x7f344801ac20 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.992+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.993+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.993+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344801ac20 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.993+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344c01f070 con 0x7f344801ac20 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.993+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945dd600 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.993+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.993+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344c031040 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.993+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x5597945d74d0 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5597945e00e0 con 0x7f344801ac20 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945dc0a0 con 0x5597945d74d0 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.994+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945dc940 con 0x5597945d74d0 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945dbce0 con 0x5597945d74d0 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 zone default found 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 4 Realm: () 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 zonegroup default 2024-04-24T01:44:00.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945e0560 con 0x7f344801ac20 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.995+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945e2790 con 0x5597945dd600 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f345872d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945e2b30 con 0x5597945dd600 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f345872d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f345872d800 20 started sync module instance, tier type = 2024-04-24T01:44:00.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f345872d800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.996+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e1bd0 con 0x7f344801ac20 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.997+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.997+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94109517619440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e1bd0 con 0x7f344801ac20 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.997+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e34f0 con 0x5597945d74d0 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.998+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94109517619440] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.998+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.998+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94109517623840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e1bd0 con 0x5597945d74d0 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:43:59.998+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e3f30 con 0x5597945dd600 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.000+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94109517623840] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.000+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.000+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94109517616928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e1b40 con 0x5597945dd600 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.000+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e4df0 con 0x7f344801ac20 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.001+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94109517616928] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.001+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.001+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94109517629760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e4d60 con 0x7f344801ac20 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.001+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e5cb0 con 0x5597945d74d0 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.002+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.002+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94109517633536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e60d0 con 0x5597945d74d0 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.002+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e6b90 con 0x7f344c031040 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.002+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94109517629760] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.003+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.003+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94109517637216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e6b50 con 0x7f344c031040 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.003+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e75a0 con 0x7f344c031040 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.003+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94109517633536] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.004+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94109517637216] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.004+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.004+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94109517631968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e70f0 con 0x7f344c031040 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.004+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e7ab0 con 0x7f344c031040 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94109517631968] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94109517634592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e7ab0 con 0x7f344c031040 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 20 add_watcher() i=0 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 20 add_watcher() i=1 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 20 add_watcher() i=2 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 20 add_watcher() i=3 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 20 add_watcher() i=4 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 20 add_watcher() i=5 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.005+0000 7f345872d800 20 add_watcher() i=6 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.006+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94109517634592] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.006+0000 7f345872d800 20 add_watcher() i=7 2024-04-24T01:44:00.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.006+0000 7f345872d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.006+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5597945eadc0 con 0x5597945d74d0 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.006+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.006+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94109517653968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e7c20 con 0x5597945d74d0 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.007+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94109517653968] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.007+0000 7f330a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.007+0000 7f345872d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.007+0000 7f345872d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f345872d800 5 note: GC not initialized 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f33097e2640 20 reqs_thread_entry: start 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f345872d800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f345872d800 20 Filter name: none 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f327affd640 20 reqs_thread_entry: start 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f345872d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55979461dcc0 con 0x5597945d74d0 2024-04-24T01:44:00.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f345872d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:44:00.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.008+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55979461f210 con 0x7f344c031040 2024-04-24T01:44:00.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.009+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.010+0000 7f330a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:00.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.010+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94109517653968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945d4960 con 0x5597945d74d0 2024-04-24T01:44:00.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.011+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94109517653968] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.011+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94109517619440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945ea7d0 con 0x7f344801ac20 2024-04-24T01:44:00.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.012+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94109517619440] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.012+0000 7f345872d800 20 remove_watcher() i=0 2024-04-24T01:44:00.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.012+0000 7f345872d800 2 removed watcher, disabling cache 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.012+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94109517623840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e20d0 con 0x5597945d74d0 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.013+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94109517623840] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.013+0000 7f345872d800 20 remove_watcher() i=1 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.013+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94109517616928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e3220 con 0x5597945dd600 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.014+0000 7f3453bad640 1 -- 172.21.15.131:0/245081343 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94109517616928] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3448052020 con 0x5597945dd600 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.014+0000 7f345872d800 20 remove_watcher() i=2 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.014+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94109517629760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e1720 con 0x7f344801ac20 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.015+0000 7f3454baf640 1 -- 172.21.15.131:0/245081343 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94109517629760] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f344c040040 con 0x7f344801ac20 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.015+0000 7f345872d800 20 remove_watcher() i=3 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.015+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94109517633536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e1720 con 0x5597945d74d0 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.016+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94109517633536] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x5597945d74d0 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.016+0000 7f345872d800 20 remove_watcher() i=4 2024-04-24T01:44:00.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.016+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94109517637216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e5800 con 0x7f344c031040 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.017+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94109517637216] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.017+0000 7f345872d800 20 remove_watcher() i=5 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.017+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94109517631968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e1720 con 0x7f344c031040 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.018+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94109517631968] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.018+0000 7f345872d800 20 remove_watcher() i=6 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.018+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94109517634592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5597945e5800 con 0x7f344c031040 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94109517634592] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3444075030 con 0x7f344c031040 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 20 remove_watcher() i=7 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f344c031040 msgr2=0x7f344c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f344c031040 0x7f344c032940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597945d74d0 msgr2=0x5597945d9990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597945d74d0 0x5597945d9990 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f344801ac20 msgr2=0x7f34480039f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f344801ac20 0x7f34480039f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5597945dd600 msgr2=0x5597945dfa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5597945dd600 0x5597945dfa10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3324036900 msgr2=0x7f3324038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3324036900 0x7f3324038dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5597945a3760 tx=0x7f344c01f000 comp rx=0 tx=0).stop 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 msgr2=0x5597945cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 --2- 172.21.15.131:0/245081343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945c4720 0x5597945cbd80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3448024a50 tx=0x7f344804c080 comp rx=0 tx=0).stop 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 reap_dead start 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f34543ae640 1 -- 172.21.15.131:0/245081343 reap_dead start 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 shutdown_connections 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 >> 172.21.15.131:0/245081343 conn(0x5597945c0a80 msgr2=0x5597945be0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 shutdown_connections 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.019+0000 7f345872d800 1 -- 172.21.15.131:0/245081343 wait complete. 2024-04-24T01:44:00.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f332c036900 msgr2=0x7f332c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f332c036900 0x7f332c038dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5597945a7420 tx=0x7f344c005840 comp rx=0 tx=0).stop 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945b73e0 msgr2=0x5597945b7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945b73e0 0x5597945b7800 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3448001ed0 tx=0x7f344800ea00 comp rx=0 tx=0).stop 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 shutdown_connections 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f332c036900 0x7f332c038dc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/4176986049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597945b73e0 0x5597945b7800 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 >> 172.21.15.131:0/4176986049 conn(0x5597945ab480 msgr2=0x5597945ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 shutdown_connections 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/4176986049 wait complete. 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597944a7120 msgr2=0x5597945a6240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597944a7120 0x5597945a6240 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f333c036950 msgr2=0x7f333c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f333c036950 0x7f333c038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3448000f60 tx=0x7f3448001370 comp rx=0 tx=0).stop 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 msgr2=0x55979459f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x55979459f000 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f34440524f0 tx=0x7f3444003020 comp rx=0 tx=0).stop 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 shutdown_connections 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5597944a7120 0x5597945a6240 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f333c036950 0x7f333c038e10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 --2- 172.21.15.131:0/3867816609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5597944a5fb0 0x55979459f000 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 >> 172.21.15.131:0/3867816609 conn(0x5597944a1550 msgr2=0x559794591710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 shutdown_connections 2024-04-24T01:44:00.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.020+0000 7f345872d800 1 -- 172.21.15.131:0/3867816609 wait complete. 2024-04-24T01:44:00.030 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-04-24T01:44:00.030 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-04-24T01:44:00.030 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-24T01:44:00.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-24T01:44:00.031 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-24T01:44:00.082 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:00.082 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff717c12800 1 Processor -- start 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff717c12800 1 -- start start 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff717c12800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56286a6d3450 0x56286a6d5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff717c12800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56286a58dd40 con 0x56286a6cf940 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff717c12800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x56286a5604d0 con 0x56286a6d3450 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff7129ed640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56286a6d3450 0x56286a6d5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff7129ed640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56286a6d3450 0x56286a6d5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42380/0 (socket says 172.21.15.131:42380) 2024-04-24T01:44:00.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff7129ed640 1 -- 172.21.15.131:0/827348894 learned_addr learned my addr 172.21.15.131:0/827348894 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.082+0000 7ff7131ee640 1 --1- 172.21.15.131:0/827348894 >> v1:172.21.15.107:6789/0 conn(0x56286a6cf940 0x56286a6d1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:55662/0 (socket says 172.21.15.131:55662) 2024-04-24T01:44:00.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.083+0000 7ff7129ed640 1 -- 172.21.15.131:0/827348894 >> v1:172.21.15.107:6789/0 conn(0x56286a6cf940 legacy=0x56286a6d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.083+0000 7ff7129ed640 1 -- 172.21.15.131:0/827348894 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56286a58c590 con 0x56286a6d3450 2024-04-24T01:44:00.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.084+0000 7ff7129ed640 1 --2- 172.21.15.131:0/827348894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6d3450 0x56286a6d5840 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff70800a520 tx=0x7ff70801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32011ab5052f511 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff7121ec640 1 -- 172.21.15.131:0/827348894 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff708057070 con 0x56286a6d3450 2024-04-24T01:44:00.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff7121ec640 1 -- 172.21.15.131:0/827348894 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708052570 con 0x56286a6d3450 2024-04-24T01:44:00.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff7121ec640 1 -- 172.21.15.131:0/827348894 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70804ae60 con 0x56286a6d3450 2024-04-24T01:44:00.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff717c12800 1 -- 172.21.15.131:0/827348894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6d3450 msgr2=0x56286a6d5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff717c12800 1 --2- 172.21.15.131:0/827348894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6d3450 0x56286a6d5840 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff70800a520 tx=0x7ff70801d010 comp rx=0 tx=0).stop 2024-04-24T01:44:00.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff717c12800 1 -- 172.21.15.131:0/827348894 shutdown_connections 2024-04-24T01:44:00.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff717c12800 1 --2- 172.21.15.131:0/827348894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6d3450 0x56286a6d5840 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff717c12800 1 -- 172.21.15.131:0/827348894 >> 172.21.15.131:0/827348894 conn(0x56286a6c9370 msgr2=0x56286a6cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff717c12800 1 -- 172.21.15.131:0/827348894 shutdown_connections 2024-04-24T01:44:00.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.085+0000 7ff717c12800 1 -- 172.21.15.131:0/827348894 wait complete. 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.097+0000 7ff717c12800 1 Processor -- start 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.097+0000 7ff717c12800 1 -- start start 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.097+0000 7ff717c12800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a6cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.097+0000 7ff717c12800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56286a61a3e0 con 0x56286a6cf940 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.097+0000 7ff7131ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a6cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.097+0000 7ff7131ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a6cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42392/0 (socket says 172.21.15.131:42392) 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.097+0000 7ff7131ee640 1 -- 172.21.15.131:0/134263201 learned_addr learned my addr 172.21.15.131:0/134263201 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.098+0000 7ff7131ee640 1 -- 172.21.15.131:0/134263201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56286a6cd840 con 0x56286a6cf940 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.098+0000 7ff7131ee640 1 --2- 172.21.15.131:0/134263201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a6cf280 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff704001e90 tx=0x7ff70400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa2fa1d191bcf31 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.098+0000 7ff60160a640 1 -- 172.21.15.131:0/134263201 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70400e5c0 con 0x56286a6cf940 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.098+0000 7ff60160a640 1 -- 172.21.15.131:0/134263201 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff704006070 con 0x56286a6cf940 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.098+0000 7ff60160a640 1 -- 172.21.15.131:0/134263201 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70400e890 con 0x56286a6cf940 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 -- 172.21.15.131:0/134263201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 msgr2=0x56286a6cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 --2- 172.21.15.131:0/134263201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a6cf280 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff704001e90 tx=0x7ff70400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 -- 172.21.15.131:0/134263201 shutdown_connections 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 --2- 172.21.15.131:0/134263201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a6cf280 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 -- 172.21.15.131:0/134263201 >> 172.21.15.131:0/134263201 conn(0x56286a6c9370 msgr2=0x56286a7bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 -- 172.21.15.131:0/134263201 shutdown_connections 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 -- 172.21.15.131:0/134263201 wait complete. 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 Processor -- start 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.099+0000 7ff717c12800 1 -- start start 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff717c12800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a7ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff717c12800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56286a6d6080 con 0x56286a6cf940 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff7131ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a7ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff7131ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a7ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42398/0 (socket says 172.21.15.131:42398) 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff7131ee640 1 -- 172.21.15.131:0/3114052316 learned_addr learned my addr 172.21.15.131:0/3114052316 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff7131ee640 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56286a7ce8e0 con 0x56286a6cf940 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff7131ee640 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a7ce3a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff704001ed0 tx=0x7ff704000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff5ffe07640 1 -- 172.21.15.131:0/3114052316 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70401a880 con 0x56286a6cf940 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff5ffe07640 1 -- 172.21.15.131:0/3114052316 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70401aa20 con 0x56286a6cf940 2024-04-24T01:44:00.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56286a7ceb70 con 0x56286a6cf940 2024-04-24T01:44:00.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff5ffe07640 1 -- 172.21.15.131:0/3114052316 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70401ad40 con 0x56286a6cf940 2024-04-24T01:44:00.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.100+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56286a7d1820 con 0x56286a6cf940 2024-04-24T01:44:00.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.101+0000 7ff5ffe07640 1 -- 172.21.15.131:0/3114052316 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff704017070 con 0x56286a6cf940 2024-04-24T01:44:00.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.101+0000 7ff5ffe07640 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5f8036900 0x7ff5f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.101+0000 7ff5ffe07640 1 -- 172.21.15.131:0/3114052316 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff704015020 con 0x56286a6cf940 2024-04-24T01:44:00.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.101+0000 7ff7129ed640 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5f8036900 0x7ff5f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.101+0000 7ff717c12800 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a6d3450 0x56286a7d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.101+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a7d5b70 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.102+0000 7ff7139ef640 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a6d3450 0x56286a7d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.102+0000 7ff7129ed640 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5f8036900 0x7ff5f8038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff708054000 tx=0x7ff70804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.102+0000 7ff7139ef640 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a6d3450 0x56286a7d55e0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.102+0000 7ff7139ef640 1 -- 172.21.15.131:0/3114052316 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff70c00a4a0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.102+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a7d2bb0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.102+0000 7ff7139ef640 1 -- 172.21.15.131:0/3114052316 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff70c00a4a0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.102+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a7d79b0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.103+0000 7ff7139ef640 1 -- 172.21.15.131:0/3114052316 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff70c00a4a0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.103+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a7d6cf0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.103+0000 7ff7139ef640 1 -- 172.21.15.131:0/3114052316 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff70c00a4a0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.103+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a7d7140 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.103+0000 7ff7139ef640 1 -- 172.21.15.131:0/3114052316 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff70c00a4a0 con 0x56286a6d3450 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.103+0000 7ff717c12800 1 Processor -- start 2024-04-24T01:44:00.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff717c12800 1 -- start start 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff717c12800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7e6780 0x56286a7e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff717c12800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56286a5c06b0 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff7129ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7e6780 0x56286a7e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff7129ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7e6780 0x56286a7e6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42404/0 (socket says 172.21.15.131:42404) 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff7129ed640 1 -- 172.21.15.131:0/588694364 learned_addr learned my addr 172.21.15.131:0/588694364 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff7129ed640 1 -- 172.21.15.131:0/588694364 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56286a7e70e0 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.104+0000 7ff7129ed640 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7e6780 0x56286a7e6ba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff708000c00 tx=0x7ff708002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.105+0000 7ff5fd602640 1 -- 172.21.15.131:0/588694364 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff708057040 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.105+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56286a7e7b50 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.105+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56286a7e7ff0 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.105+0000 7ff5fd602640 1 -- 172.21.15.131:0/588694364 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70805d650 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.105+0000 7ff5fd602640 1 -- 172.21.15.131:0/588694364 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70805d930 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff5fd602640 1 -- 172.21.15.131:0/588694364 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff708067070 con 0x56286a7e6780 2024-04-24T01:44:00.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff5fd602640 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5ec036900 0x7ff5ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff5fd602640 1 -- 172.21.15.131:0/588694364 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff70808f810 con 0x56286a7e6780 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff7139ef640 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5ec036900 0x7ff5ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff717c12800 1 Processor -- start 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff717c12800 1 -- start start 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff7139ef640 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5ec036900 0x7ff5ec038dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x56286a7d6810 tx=0x7ff70c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff717c12800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff717c12800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56286a6cdbc0 con 0x56286a7f39b0 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.106+0000 7ff7129ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff7129ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42418/0 (socket says 172.21.15.131:42418) 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff7129ed640 1 -- 172.21.15.131:0/3783331437 learned_addr learned my addr 172.21.15.131:0/3783331437 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff7129ed640 1 -- 172.21.15.131:0/3783331437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56286a7f43a0 con 0x56286a7f39b0 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff7129ed640 1 --2- 172.21.15.131:0/3783331437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7f3dd0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff70808db70 tx=0x7ff70805bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34033d98b1b049c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff5f6ffd640 1 -- 172.21.15.131:0/3783331437 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff708082070 con 0x56286a7f39b0 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff5f6ffd640 1 -- 172.21.15.131:0/3783331437 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708068c50 con 0x56286a7f39b0 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff5f6ffd640 1 -- 172.21.15.131:0/3783331437 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70808b070 con 0x56286a7f39b0 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff717c12800 1 -- 172.21.15.131:0/3783331437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 msgr2=0x56286a7f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff717c12800 1 --2- 172.21.15.131:0/3783331437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7f3dd0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff70808db70 tx=0x7ff70805bf90 comp rx=0 tx=0).stop 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff717c12800 1 -- 172.21.15.131:0/3783331437 shutdown_connections 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff717c12800 1 --2- 172.21.15.131:0/3783331437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7f3dd0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.107+0000 7ff717c12800 1 -- 172.21.15.131:0/3783331437 >> 172.21.15.131:0/3783331437 conn(0x56286a7efd10 msgr2=0x56286a7edd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff717c12800 1 -- 172.21.15.131:0/3783331437 shutdown_connections 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff717c12800 1 -- 172.21.15.131:0/3783331437 wait complete. 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff717c12800 1 Processor -- start 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff717c12800 1 -- start start 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff717c12800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff717c12800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56286a7f4b10 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff7129ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff7129ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42428/0 (socket says 172.21.15.131:42428) 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 learned_addr learned my addr 172.21.15.131:0/2342696837 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.108+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56286a7fb590 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.109+0000 7ff7129ed640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7fb050 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff708071c30 tx=0x7ff70808db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.109+0000 7ff5f57fa640 1 -- 172.21.15.131:0/2342696837 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff708093070 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.109+0000 7ff5f57fa640 1 -- 172.21.15.131:0/2342696837 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708068e00 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.109+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56286a7fb820 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.109+0000 7ff5f57fa640 1 -- 172.21.15.131:0/2342696837 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff708082030 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.109+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56286a7fe4d0 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.109+0000 7ff5f57fa640 1 -- 172.21.15.131:0/2342696837 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff708096070 con 0x56286a7f39b0 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff5f57fa640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5dc0368b0 0x7ff5dc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff5f57fa640 1 -- 172.21.15.131:0/2342696837 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff708083070 con 0x56286a7f39b0 2024-04-24T01:44:00.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff7139ef640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5dc0368b0 0x7ff5dc038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff7139ef640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5dc0368b0 0x7ff5dc038d70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56286a7d2b00 tx=0x7ff70c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a806b60 0x56286a809020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a809770 con 0x56286a806b60 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.110+0000 7ff7131ee640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a806b60 0x56286a809020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff7131ee640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a806b60 0x56286a809020 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 realm 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a809b80 con 0x56286a806b60 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a80a450 con 0x56286a806b60 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a80a7f0 con 0x56286a806b60 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.111+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a80b040 con 0x56286a806b60 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.112+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.112+0000 7ff717c12800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:00.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.112+0000 7ff717c12800 20 searching for the correct realm 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.112+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56286a80cdb0 0x56286a80f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.112+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.112+0000 7ff7129ed640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56286a80cdb0 0x56286a80f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.112+0000 7ff7129ed640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56286a80cdb0 0x56286a80f1a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7129ed640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff708098070 0x7ff70808f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff708098070 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7139ef640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff708098070 0x7ff70808f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7139ef640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff708098070 0x7ff70808f070 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70c01f070 con 0x7ff708098070 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7139ef640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff70c031040 0x7ff70c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.113+0000 7ff7131ee640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff70c031040 0x7ff70c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.114+0000 7ff7131ee640 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff70c031040 0x7ff70c032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.114+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.114+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.114+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.114+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.114+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.114+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff708098070 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70c01f070 con 0x7ff708098070 2024-04-24T01:44:00.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.115+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff708098070 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff70c01f070 con 0x7ff708098070 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.116+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.117+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.118+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff708098070 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70c01f070 con 0x7ff708098070 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff708098070 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70c01f070 con 0x7ff708098070 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.119+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.120+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.120+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.120+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff708098070 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.120+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70c01f070 con 0x7ff708098070 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.120+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a80cdb0 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.120+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.120+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff70c031040 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.121+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.121+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x56286a806b60 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56286a80f7b0 con 0x7ff708098070 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:00.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a80b9c0 con 0x56286a806b60 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a80c260 con 0x56286a806b60 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.122+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a80c260 con 0x56286a806b60 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 zone default found 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 4 Realm: () 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 zonegroup default 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a80fc10 con 0x7ff708098070 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a811a20 con 0x56286a80cdb0 2024-04-24T01:44:00.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a811ef0 con 0x56286a80cdb0 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 started sync module instance, tier type = 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.123+0000 7ff717c12800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.124+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a810e30 con 0x7ff708098070 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.124+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.125+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94731585524560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a810e30 con 0x7ff708098070 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.125+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a8129b0 con 0x56286a806b60 2024-04-24T01:44:00.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.126+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94731585524560] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.126+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.126+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94731585529024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a810e30 con 0x56286a806b60 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.126+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a813420 con 0x56286a80cdb0 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.127+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94731585529024] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.127+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.127+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94731585522048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a810da0 con 0x56286a80cdb0 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.127+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a8142e0 con 0x7ff708098070 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.128+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94731585522048] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.128+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.128+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94731585535536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a814250 con 0x7ff708098070 2024-04-24T01:44:00.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.128+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a8150a0 con 0x56286a806b60 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.129+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.129+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94731585538944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a8150a0 con 0x56286a806b60 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.129+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a816020 con 0x7ff70c031040 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.129+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94731585535536] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.130+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.130+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94731585542928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a815fe0 con 0x7ff70c031040 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.130+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a816a30 con 0x7ff70c031040 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.130+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94731585538944] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.131+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94731585542928] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.131+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.131+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94731585537744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a816580 con 0x7ff70c031040 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.131+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a816f40 con 0x7ff70c031040 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94731585537744] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94731585541216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a816f40 con 0x7ff70c031040 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 20 add_watcher() i=0 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 20 add_watcher() i=1 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 20 add_watcher() i=2 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 20 add_watcher() i=3 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 20 add_watcher() i=4 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 20 add_watcher() i=5 2024-04-24T01:44:00.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.132+0000 7ff717c12800 20 add_watcher() i=6 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.133+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94731585541216] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.133+0000 7ff717c12800 20 add_watcher() i=7 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.133+0000 7ff717c12800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.133+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a81a2a0 con 0x56286a806b60 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.134+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.134+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94731585547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a8174d0 con 0x56286a806b60 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94731585547264] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff5c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 5 note: GC not initialized 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff5c8fe1640 20 reqs_thread_entry: start 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:00.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 20 Filter name: none 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff5427fc640 20 reqs_thread_entry: start 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.135+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a84d6e0 con 0x7ff70c031040 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a84be80 con 0x56286a806b60 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.136+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a84c750 con 0x7ff70c031040 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.137+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.137+0000 7ff717c12800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.137+0000 7ff717c12800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.137+0000 7ff717c12800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.137+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94731585766048 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a84c900 con 0x7ff70c031040 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== watch-notify(notify (1) cookie 94731585541216 notify 146028888093 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56286a84d130 con 0x7ff70c031040 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff5f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94731585541216 notifier 4723 bl.length()=556 2024-04-24T01:44:00.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(65 notify.7 [notify cookie 94731585766048 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff5f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff5f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff5f6ffd640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff5d8003ea0 con 0x7ff70c031040 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== watch-notify(notify_complete (2) cookie 94731585766048 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff704038040 con 0x7ff70c031040 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.138+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a84c220 con 0x56286a806b60 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff717c12800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff717c12800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff717c12800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94731585767296 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56286a84c220 con 0x7ff70c031040 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== watch-notify(notify (1) cookie 94731585542928 notify 146028888094 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7ff704038040 con 0x7ff70c031040 2024-04-24T01:44:00.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff5f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94731585542928 notifier 4723 bl.length()=177 2024-04-24T01:44:00.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff5f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:44:00.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff5f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:44:00.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff5f6ffd640 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff5d8003ea0 con 0x7ff70c031040 2024-04-24T01:44:00.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.139+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(68 notify.5 [notify cookie 94731585767296 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.140+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.140+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== watch-notify(notify_complete (2) cookie 94731585767296 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56286a7d1820 con 0x7ff70c031040 2024-04-24T01:44:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-24T01:44:00.137431Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:00.137419Z","tags":[],"group_ids":[]} 2024-04-24T01:44:00.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.140+0000 7ff5c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:00.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.141+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94731585547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a819920 con 0x56286a806b60 2024-04-24T01:44:00.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.141+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94731585547264] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.141+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94731585524560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a816c00 con 0x7ff708098070 2024-04-24T01:44:00.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.143+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94731585524560] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.143+0000 7ff717c12800 20 remove_watcher() i=0 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.143+0000 7ff717c12800 2 removed watcher, disabling cache 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.143+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94731585529024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a816c00 con 0x56286a806b60 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.144+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94731585529024] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.144+0000 7ff717c12800 20 remove_watcher() i=1 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.144+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94731585522048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a8124c0 con 0x56286a80cdb0 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.145+0000 7ff7129ed640 1 -- 172.21.15.131:0/2342696837 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94731585522048] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70809f070 con 0x56286a80cdb0 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.145+0000 7ff717c12800 20 remove_watcher() i=2 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.145+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94731585535536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a810980 con 0x7ff708098070 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.146+0000 7ff7139ef640 1 -- 172.21.15.131:0/2342696837 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94731585535536] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70c040040 con 0x7ff708098070 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.146+0000 7ff717c12800 20 remove_watcher() i=3 2024-04-24T01:44:00.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.146+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94731585538944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a813e30 con 0x56286a806b60 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.147+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94731585538944] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x56286a806b60 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.147+0000 7ff717c12800 20 remove_watcher() i=4 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.147+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94731585542928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a810980 con 0x7ff70c031040 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.148+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94731585542928] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.148+0000 7ff717c12800 20 remove_watcher() i=5 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.148+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94731585537744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a813e30 con 0x7ff70c031040 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.149+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94731585537744] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.149+0000 7ff717c12800 20 remove_watcher() i=6 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.149+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94731585541216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56286a815b10 con 0x7ff70c031040 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94731585541216] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70402e070 con 0x7ff70c031040 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 20 remove_watcher() i=7 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff70c031040 msgr2=0x7ff70c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7ff70c031040 0x7ff70c032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a806b60 msgr2=0x56286a809020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a806b60 0x56286a809020 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff708098070 msgr2=0x7ff70808f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7ff708098070 0x7ff70808f070 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56286a80cdb0 msgr2=0x56286a80f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56286a80cdb0 0x56286a80f1a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5dc0368b0 msgr2=0x7ff5dc038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5dc0368b0 0x7ff5dc038d70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56286a7d2b00 tx=0x7ff70c01f000 comp rx=0 tx=0).stop 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 msgr2=0x56286a7fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 --2- 172.21.15.131:0/2342696837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7f39b0 0x56286a7fb050 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff708071c30 tx=0x7ff70808db00 comp rx=0 tx=0).stop 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 reap_dead start 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff7131ee640 1 -- 172.21.15.131:0/2342696837 reap_dead start 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 shutdown_connections 2024-04-24T01:44:00.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 >> 172.21.15.131:0/2342696837 conn(0x56286a7efd10 msgr2=0x56286a7ed370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 shutdown_connections 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.150+0000 7ff717c12800 1 -- 172.21.15.131:0/2342696837 wait complete. 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5ec036900 msgr2=0x7ff5ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5ec036900 0x7ff5ec038dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x56286a7d6810 tx=0x7ff70c005840 comp rx=0 tx=0).stop 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7e6780 msgr2=0x56286a7e6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7e6780 0x56286a7e6ba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff708000c00 tx=0x7ff708002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 shutdown_connections 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5ec036900 0x7ff5ec038dc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/588694364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a7e6780 0x56286a7e6ba0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 >> 172.21.15.131:0/588694364 conn(0x56286a7da820 msgr2=0x56286a7dac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 shutdown_connections 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/588694364 wait complete. 2024-04-24T01:44:00.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a6d3450 msgr2=0x56286a7d55e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a6d3450 0x56286a7d55e0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5f8036900 msgr2=0x7ff5f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5f8036900 0x7ff5f8038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff708054000 tx=0x7ff70804e000 comp rx=0 tx=0).stop 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 msgr2=0x56286a7ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a7ce3a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff704001ed0 tx=0x7ff704000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 shutdown_connections 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56286a6d3450 0x56286a7d55e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff5f8036900 0x7ff5f8038dc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 --2- 172.21.15.131:0/3114052316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56286a6cf940 0x56286a7ce3a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 >> 172.21.15.131:0/3114052316 conn(0x56286a6c9370 msgr2=0x56286a6ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 shutdown_connections 2024-04-24T01:44:00.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.151+0000 7ff717c12800 1 -- 172.21.15.131:0/3114052316 wait complete. 2024-04-24T01:44:00.163 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-24T01:44:00.137431Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:00.137419Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:00.180 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:44:00.184 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-24T01:44:00.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-24T01:44:00.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-24T01:44:00.185 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-24T01:44:00.229 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:00.229 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.229+0000 7f4ef8146800 1 Processor -- start 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.229+0000 7f4ef8146800 1 -- start start 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef8146800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ee8e0f2d40 0x55ee8e0f3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef8146800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee8dfb2d40 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef8146800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55ee8df854d0 con 0x55ee8e0f2d40 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef5c4c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ee8e0f2d40 0x55ee8e0f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef5c4c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ee8e0f2d40 0x55ee8e0f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42432/0 (socket says 172.21.15.131:42432) 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/4109624942 learned_addr learned my addr 172.21.15.131:0/4109624942 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4eed44b640 1 --1- 172.21.15.131:0/4109624942 >> v1:172.21.15.107:6789/0 conn(0x55ee8e0f3fa0 0x55ee8e0f4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:55672/0 (socket says 172.21.15.131:55672) 2024-04-24T01:44:00.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/4109624942 >> v1:172.21.15.107:6789/0 conn(0x55ee8e0f3fa0 legacy=0x55ee8e0f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.230+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/4109624942 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8dfb1590 con 0x55ee8e0f2d40 2024-04-24T01:44:00.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.232+0000 7f4ef5c4c640 1 --2- 172.21.15.131:0/4109624942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e0f3160 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800a520 tx=0x7f4ee801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23c9f27eafaf21d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.232+0000 7f4ef544b640 1 -- 172.21.15.131:0/4109624942 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee8057070 con 0x55ee8e0f2d40 2024-04-24T01:44:00.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.232+0000 7f4ef544b640 1 -- 172.21.15.131:0/4109624942 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8052570 con 0x55ee8e0f2d40 2024-04-24T01:44:00.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.232+0000 7f4ef544b640 1 -- 172.21.15.131:0/4109624942 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee804ae60 con 0x55ee8e0f2d40 2024-04-24T01:44:00.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.233+0000 7f4ef8146800 1 -- 172.21.15.131:0/4109624942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 msgr2=0x55ee8e0f3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.233+0000 7f4ef8146800 1 --2- 172.21.15.131:0/4109624942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e0f3160 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800a520 tx=0x7f4ee801d010 comp rx=0 tx=0).stop 2024-04-24T01:44:00.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.233+0000 7f4ef8146800 1 -- 172.21.15.131:0/4109624942 shutdown_connections 2024-04-24T01:44:00.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.233+0000 7f4ef8146800 1 --2- 172.21.15.131:0/4109624942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e0f3160 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.233+0000 7f4ef8146800 1 -- 172.21.15.131:0/4109624942 >> 172.21.15.131:0/4109624942 conn(0x55ee8e0ee3a0 msgr2=0x55ee8e0f07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.233+0000 7f4ef8146800 1 -- 172.21.15.131:0/4109624942 shutdown_connections 2024-04-24T01:44:00.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.233+0000 7f4ef8146800 1 -- 172.21.15.131:0/4109624942 wait complete. 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef8146800 1 Processor -- start 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef8146800 1 -- start start 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef8146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e1e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef8146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e03f3b0 con 0x55ee8e0f2d40 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef5c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e1e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef5c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e1e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42444/0 (socket says 172.21.15.131:42444) 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/2959733807 learned_addr learned my addr 172.21.15.131:0/2959733807 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.245+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/2959733807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e1e4a30 con 0x55ee8e0f2d40 2024-04-24T01:44:00.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4ef5c4c640 1 --2- 172.21.15.131:0/2959733807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e1e4460 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8055040 tx=0x7f4ee804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f602d5c51039686d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4de3e07640 1 -- 172.21.15.131:0/2959733807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee8057040 con 0x55ee8e0f2d40 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4de3e07640 1 -- 172.21.15.131:0/2959733807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8052720 con 0x55ee8e0f2d40 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4de3e07640 1 -- 172.21.15.131:0/2959733807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee8052a40 con 0x55ee8e0f2d40 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4ef8146800 1 -- 172.21.15.131:0/2959733807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 msgr2=0x55ee8e1e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4ef8146800 1 --2- 172.21.15.131:0/2959733807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e1e4460 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8055040 tx=0x7f4ee804c000 comp rx=0 tx=0).stop 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4ef8146800 1 -- 172.21.15.131:0/2959733807 shutdown_connections 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4ef8146800 1 --2- 172.21.15.131:0/2959733807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f2d40 0x55ee8e1e4460 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.246+0000 7f4ef8146800 1 -- 172.21.15.131:0/2959733807 >> 172.21.15.131:0/2959733807 conn(0x55ee8e0ee3a0 msgr2=0x55ee8e1dfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef8146800 1 -- 172.21.15.131:0/2959733807 shutdown_connections 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef8146800 1 -- 172.21.15.131:0/2959733807 wait complete. 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef8146800 1 Processor -- start 2024-04-24T01:44:00.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef8146800 1 -- start start 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef8146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f3fa0 0x55ee8e1efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef8146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e0fc410 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef5c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f3fa0 0x55ee8e1efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef5c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f3fa0 0x55ee8e1efdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42452/0 (socket says 172.21.15.131:42452) 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.247+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/3303063382 learned_addr learned my addr 172.21.15.131:0/3303063382 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.248+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e0670d0 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.248+0000 7f4ef5c4c640 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f3fa0 0x55ee8e1efdd0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8052540 tx=0x7f4ee8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.248+0000 7f4de2604640 1 -- 172.21.15.131:0/3303063382 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee8073070 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.248+0000 7f4de2604640 1 -- 172.21.15.131:0/3303063382 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8052bf0 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.248+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8e067360 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.248+0000 7f4de2604640 1 -- 172.21.15.131:0/3303063382 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee8057070 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.248+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8e1f0520 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.249+0000 7f4de2604640 1 -- 172.21.15.131:0/3303063382 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ee8076070 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.249+0000 7f4de2604640 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4ddc036900 0x7f4ddc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.249+0000 7f4de2604640 1 -- 172.21.15.131:0/3303063382 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4ee808d990 con 0x55ee8e0f3fa0 2024-04-24T01:44:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.249+0000 7f4eed44b640 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4ddc036900 0x7f4ddc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.249+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e1f2330 0x55ee8e1f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.249+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e1f4d10 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.249+0000 7f4ef644d640 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e1f2330 0x55ee8e1f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.250+0000 7f4eed44b640 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4ddc036900 0x7f4ddc038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000f60 tx=0x7f4ee0001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.250+0000 7f4ef644d640 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e1f2330 0x55ee8e1f4740 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.250+0000 7f4ef644d640 1 -- 172.21.15.131:0/3303063382 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ef000a4a0 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.250+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e1f1910 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.250+0000 7f4ef644d640 1 -- 172.21.15.131:0/3303063382 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ef000a4a0 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.250+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e1f6b50 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.251+0000 7f4ef644d640 1 -- 172.21.15.131:0/3303063382 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ef000a4a0 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.251+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e1f5e90 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.251+0000 7f4ef644d640 1 -- 172.21.15.131:0/3303063382 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ef000a4a0 con 0x55ee8e1f2330 2024-04-24T01:44:00.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.251+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e1f62e0 con 0x55ee8e1f2330 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.251+0000 7f4ef644d640 1 -- 172.21.15.131:0/3303063382 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ef000a4a0 con 0x55ee8e1f2330 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.251+0000 7f4ef8146800 1 Processor -- start 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4ef8146800 1 -- start start 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4ef8146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e205920 0x55ee8e205d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4ef8146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ee8dfe56b0 con 0x55ee8e205920 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4eed44b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e205920 0x55ee8e205d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4eed44b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e205920 0x55ee8e205d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42454/0 (socket says 172.21.15.131:42454) 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4eed44b640 1 -- 172.21.15.131:0/3693478933 learned_addr learned my addr 172.21.15.131:0/3693478933 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4eed44b640 1 -- 172.21.15.131:0/3693478933 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e206280 con 0x55ee8e205920 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.252+0000 7f4eed44b640 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e205920 0x55ee8e205d40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0001ed0 tx=0x7f4ee000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.253+0000 7f4ddb7fe640 1 -- 172.21.15.131:0/3693478933 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee0022070 con 0x55ee8e205920 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.253+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8e206cf0 con 0x55ee8e205920 2024-04-24T01:44:00.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.253+0000 7f4ddb7fe640 1 -- 172.21.15.131:0/3693478933 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee000d520 con 0x55ee8e205920 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.253+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8e2071f0 con 0x55ee8e205920 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.253+0000 7f4ddb7fe640 1 -- 172.21.15.131:0/3693478933 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee000d6d0 con 0x55ee8e205920 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.253+0000 7f4ddb7fe640 1 -- 172.21.15.131:0/3693478933 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ee0025070 con 0x55ee8e205920 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ddb7fe640 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dd0036900 0x7f4dd0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ddb7fe640 1 -- 172.21.15.131:0/3693478933 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4ee004dd70 con 0x55ee8e205920 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ef644d640 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dd0036900 0x7f4dd0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ef8146800 1 Processor -- start 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ef644d640 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dd0036900 0x7f4dd0038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55ee8e1f59b0 tx=0x7f4ef0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ef8146800 1 -- start start 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ef8146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e213080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4ef8146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e1e4cf0 con 0x55ee8e212c60 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4eed44b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e213080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4eed44b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e213080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42458/0 (socket says 172.21.15.131:42458) 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.254+0000 7f4eed44b640 1 -- 172.21.15.131:0/1838144455 learned_addr learned my addr 172.21.15.131:0/1838144455 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4eed44b640 1 -- 172.21.15.131:0/1838144455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e213650 con 0x55ee8e212c60 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4eed44b640 1 --2- 172.21.15.131:0/1838144455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e213080 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0027030 tx=0x7f4ee0025520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7868ca9d6dfaedc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4dd97fa640 1 -- 172.21.15.131:0/1838144455 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee00263b0 con 0x55ee8e212c60 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4dd97fa640 1 -- 172.21.15.131:0/1838144455 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee000dba0 con 0x55ee8e212c60 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4dd97fa640 1 -- 172.21.15.131:0/1838144455 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee0026550 con 0x55ee8e212c60 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4ef8146800 1 -- 172.21.15.131:0/1838144455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 msgr2=0x55ee8e213080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1838144455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e213080 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0027030 tx=0x7f4ee0025520 comp rx=0 tx=0).stop 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4ef8146800 1 -- 172.21.15.131:0/1838144455 shutdown_connections 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1838144455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e213080 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4ef8146800 1 -- 172.21.15.131:0/1838144455 >> 172.21.15.131:0/1838144455 conn(0x55ee8e20efc0 msgr2=0x55ee8e20d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4ef8146800 1 -- 172.21.15.131:0/1838144455 shutdown_connections 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.255+0000 7f4ef8146800 1 -- 172.21.15.131:0/1838144455 wait complete. 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4ef8146800 1 Processor -- start 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4ef8146800 1 -- start start 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4ef8146800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e21a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4ef8146800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e213dc0 con 0x55ee8e212c60 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4eed44b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e21a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4eed44b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e21a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:42468/0 (socket says 172.21.15.131:42468) 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 learned_addr learned my addr 172.21.15.131:0/1299733423 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e21a850 con 0x55ee8e212c60 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.256+0000 7f4eed44b640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e21a310 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0024a70 tx=0x7f4ee000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.257+0000 7f4dc77fe640 1 -- 172.21.15.131:0/1299733423 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee001a8c0 con 0x55ee8e212c60 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.257+0000 7f4dc77fe640 1 -- 172.21.15.131:0/1299733423 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee0024ae0 con 0x55ee8e212c60 2024-04-24T01:44:00.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.257+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8e21a850 con 0x55ee8e212c60 2024-04-24T01:44:00.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.257+0000 7f4dc77fe640 1 -- 172.21.15.131:0/1299733423 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ee0024dc0 con 0x55ee8e212c60 2024-04-24T01:44:00.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.257+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8e21a850 con 0x55ee8e212c60 2024-04-24T01:44:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.257+0000 7f4dc77fe640 1 -- 172.21.15.131:0/1299733423 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ee0025a40 con 0x55ee8e212c60 2024-04-24T01:44:00.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4dc77fe640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dc0036900 0x7f4dc0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4dc77fe640 1 -- 172.21.15.131:0/1299733423 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4ee0028070 con 0x55ee8e212c60 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4ef644d640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dc0036900 0x7f4dc0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4ef644d640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dc0036900 0x7f4dc0038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55ee8e1f1860 tx=0x7f4ef001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e225a00 0x55ee8e227ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e228610 con 0x55ee8e225a00 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4ef5c4c640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e225a00 0x55ee8e227ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.258+0000 7f4ef5c4c640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e225a00 0x55ee8e227ec0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 realm 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e228a20 con 0x55ee8e225a00 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2292f0 con 0x55ee8e225a00 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e229690 con 0x55ee8e225a00 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:00.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.259+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e229ee0 con 0x55ee8e225a00 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4ef8146800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4ef8146800 20 searching for the correct realm 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ee8e22bc50 0x55ee8e22e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4eed44b640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ee8e22bc50 0x55ee8e22e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4eed44b640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ee8e22bc50 0x55ee8e22e040 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4eed44b640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4ee0027060 0x7f4ee0035440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ee0027060 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.260+0000 7f4ef644d640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4ee0027060 0x7f4ee0035440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.261+0000 7f4ef644d640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4ee0027060 0x7f4ee0035440 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.261+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef001f070 con 0x7f4ee0027060 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.261+0000 7f4ef644d640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4ef0031040 0x7f4ef0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.261+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.261+0000 7f4ef5c4c640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4ef0031040 0x7f4ef0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.262+0000 7f4ef5c4c640 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4ef0031040 0x7f4ef0032940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.262+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.262+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.262+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.262+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.262+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.262+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ee0027060 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef001f070 con 0x7f4ee0027060 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.263+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.264+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.264+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.264+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.264+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ee0027060 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.264+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ef001f070 con 0x7f4ee0027060 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.264+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.264+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.265+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.266+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.266+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.266+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.266+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.266+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.266+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ee0027060 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef001f070 con 0x7f4ee0027060 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ee0027060 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef001f070 con 0x7f4ee0027060 2024-04-24T01:44:00.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.267+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.268+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.268+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ee0027060 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.268+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef001f070 con 0x7f4ee0027060 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.268+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e22bc50 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.268+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.268+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ef0031040 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x55ee8e225a00 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22e620 con 0x7f4ee0027060 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22a860 con 0x55ee8e225a00 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.269+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22b100 con 0x55ee8e225a00 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22b100 con 0x55ee8e225a00 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 zone default found 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 4 Realm: () 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 zonegroup default 2024-04-24T01:44:00.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22eaa0 con 0x7f4ee0027060 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.270+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e22aeb0 con 0x55ee8e22bc50 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4ef8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e230e20 con 0x55ee8e22bc50 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4ef8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4ef8146800 20 started sync module instance, tier type = 2024-04-24T01:44:00.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4ef8146800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.271+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e230160 con 0x7f4ee0027060 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.272+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.272+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483075237472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e230160 con 0x7f4ee0027060 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.272+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2318a0 con 0x55ee8e225a00 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.273+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.273+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483075237472] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.273+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483075235536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2318a0 con 0x55ee8e225a00 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.273+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2322b0 con 0x55ee8e22bc50 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.274+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483075235536] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.274+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.274+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483075243520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e232650 con 0x55ee8e22bc50 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.274+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e233150 con 0x7f4ee0027060 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.275+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483075243520] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.275+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.275+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483075247168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e233540 con 0x7f4ee0027060 2024-04-24T01:44:00.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.276+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e233fa0 con 0x55ee8e225a00 2024-04-24T01:44:00.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.277+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483075247168] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.277+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.277+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483075240944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e233fa0 con 0x55ee8e225a00 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.277+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2349f0 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.278+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483075240944] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.278+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.278+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483075250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2349b0 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.278+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e235400 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.279+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.279+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483075256144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e235820 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.279+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2362e0 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.279+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483075250816] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483075256144] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483075259824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e235370 con 0x7f4ef0031040 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 20 add_watcher() i=0 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 20 add_watcher() i=1 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 20 add_watcher() i=2 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 20 add_watcher() i=3 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 20 add_watcher() i=4 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 20 add_watcher() i=5 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.280+0000 7f4ef8146800 20 add_watcher() i=6 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.281+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483075259824] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.281+0000 7f4ef8146800 20 add_watcher() i=7 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.281+0000 7f4ef8146800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.281+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2393e0 con 0x55ee8e225a00 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.281+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.281+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483075253504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e236860 con 0x55ee8e225a00 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.282+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483075253504] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.282+0000 7f4da77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.282+0000 7f4ef8146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.282+0000 7f4ef8146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.282+0000 7f4ef8146800 5 note: GC not initialized 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.283+0000 7f4da67fc640 20 reqs_thread_entry: start 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.283+0000 7f4ef8146800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.283+0000 7f4ef8146800 20 Filter name: none 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.283+0000 7f4d17fff640 20 reqs_thread_entry: start 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.283+0000 7f4ef8146800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.283+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.283+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26c550 con 0x7f4ef0031040 2024-04-24T01:44:00.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.284+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.284+0000 7f4ef8146800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.284+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.284+0000 7f4ef8146800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.284+0000 7f4ef8146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.284+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2708d0 con 0x7f4ee0027060 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef8146800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef8146800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94483075498944 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e271540 con 0x7f4ef0031040 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== watch-notify(notify (1) cookie 94483075250816 notify 146028888095 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f4ee8095080 con 0x7f4ef0031040 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4dd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94483075250816 notifier 4730 bl.length()=382 2024-04-24T01:44:00.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4dd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4dd97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(64 notify.5 [notify cookie 94483075498944 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4dd97fa640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4db8003ea0 con 0x7f4ef0031040 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.285+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.286+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== watch-notify(notify_complete (2) cookie 94483075498944 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee8e1f0520 con 0x7f4ef0031040 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.286+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2703c0 con 0x55ee8e225a00 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.286+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.286+0000 7f4ef8146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 : miss 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.286+0000 7f4ef8146800 20 rados->read ofs=0 len=0 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.286+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 8.14 8:2f2a0974:root::.bucket.meta.myfoo6%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26e6f0 con 0x55ee8e22bc50 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4ef8146800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:44:00.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 info.flags=0x17 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4ef8146800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 to cache LRU end 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4ef8146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4ef8146800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4ef8146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.287+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 8.14 8:2f2a0974:root::.bucket.meta.myfoo6%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2789e0 con 0x55ee8e22bc50 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 info.flags=0x17 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 to cache LRU end 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9, ofs0, ns] 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94483075495968 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e2749a0 con 0x7f4ee0027060 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== watch-notify(notify (1) cookie 94483075237472 notify 146028888086 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f4ef0044430 con 0x7f4ee0027060 2024-04-24T01:44:00.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4dd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94483075237472 notifier 4730 bl.length()=748 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4dd8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 info.flags=0x17 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(69 notify.0 [notify cookie 94483075495968 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4dd8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 to cache LRU end 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4dd8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4dd8ff9640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4d20003530 con 0x7f4ee0027060 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== watch-notify(notify_complete (2) cookie 94483075495968 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4ef0024750 con 0x7f4ee0027060 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): orig_sources= new_sources= 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): potential sources added=[] removed=[] 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): orig_dests= new_dests= 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): potential dests added=[] removed=[] 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.288+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e225a00 2024-04-24T01:44:00.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.289+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(71 bud.buckets [call] v34'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.289+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e225a00 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.290+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(72 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.290+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e225a00 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef8146800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef8146800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94483075493232 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e274ba0 con 0x7f4ee0027060 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== watch-notify(notify (1) cookie 94483075247168 notify 146028888087 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7f4ef00249f0 con 0x7f4ee0027060 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4dd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94483075247168 notifier 4730 bl.length()=316 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4dd8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4dd8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T01:44:00.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(74 notify.3 [notify cookie 94483075493232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4dd8ff9640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4d20003560 con 0x7f4ee0027060 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== watch-notify(notify_complete (2) cookie 94483075493232 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4ef0024bc0 con 0x7f4ee0027060 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef8146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 : hit (requested=0x17, cached=0x17) 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef8146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.292+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:76 8.14 8:2f2a0974:root::.bucket.meta.myfoo6%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278110 con 0x55ee8e22bc50 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.293+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(76 .bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.293+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 info.flags=0x17 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.293+0000 7f4ef8146800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 to cache LRU end 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.293+0000 7f4ef8146800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.293+0000 7f4ef8146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9, ofs0, ns] 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.293+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94483075495968 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e275050 con 0x7f4ee0027060 2024-04-24T01:44:00.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== watch-notify(notify (1) cookie 94483075237472 notify 146028888088 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f4ef0024bc0 con 0x7f4ee0027060 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4dd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94483075237472 notifier 4730 bl.length()=748 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(77 notify.0 [notify cookie 94483075495968 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4dd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 info.flags=0x17 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4dd97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 to cache LRU end 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4dd97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4dd97fa640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4db8003ea0 con 0x7f4ee0027060 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== watch-notify(notify_complete (2) cookie 94483075495968 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4ef0044980 con 0x7f4ee0027060 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): orig_sources= new_sources= 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): potential sources added=[] removed=[] 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): orig_dests= new_dests= 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef8146800 20 handle_bi_update(): bucket=:myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]): potential dests added=[] removed=[] 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:79 4.3d 4:bd8fe768:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x7f4ee0027060 2024-04-24T01:44:00.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(79 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.294+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:80 4.1b 4:d99cd558:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x7f4ee0027060 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.295+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(80 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.295+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:81 4.6 4:62a798b5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e22bc50 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.295+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(81 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.295+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:82 4.35 4:ae924c50:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e225a00 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.295+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(82 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.295+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:83 4.9 4:92145eba:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e225a00 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.296+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(83 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ee8075030 con 0x55ee8e225a00 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.296+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:84 4.1a 4:59b6e54d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x7f4ee0027060 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.296+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(84 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.296+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 4.25 4:a4056974:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e22bc50 2024-04-24T01:44:00.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.296+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(85 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.296+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:86 4.2d 4:b7f2f868:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x7f4ef0031040 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.297+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(86 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.297+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:87 4.17 4:e81411c7:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x7f4ef0031040 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.297+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(87 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ee8075030 con 0x7f4ef0031040 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.297+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x7f4ef0031040 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.298+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(88 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [call out=377b] v0'0 uv3 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.298+0000 7f4ef8146800 10 cls_bucket_list_unordered: got thirteen 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.298+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:89 4.3f 4:fcc5bc61:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x7f4ee0027060 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.298+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(89 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.298+0000 7f4ef8146800 20 get_obj_state: octx=0x7f4ef000a220 obj=myfoo6:thirteen state=0x55ee8e271b58 s->prefetch_data=0 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.298+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:90 3.8s0 3:10dd7976:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e26f820 con 0x55ee8e22bc50 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(90 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 10 manifest: total_size = 8 2024-04-24T01:44:00.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.6511988609234216462 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.acl 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.etag 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 get_obj_state: octx=0x7f4ef000a220 obj=myfoo6:thirteen state=0x55ee8e271b58 s->prefetch_data=0 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 : hit (requested=0x17, cached=0x17) 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 2024-04-24T01:44:00.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.299+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:91 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278050 con 0x7f4ef0031040 2024-04-24T01:44:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.300+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(91 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.300+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:92 3.8s0 3:10dd7976:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e27a040 con 0x55ee8e22bc50 2024-04-24T01:44:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.301+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(92 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.301+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:93 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:1 objects processed in :myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9]). Next marker thirteen 2024-04-24T01:44:00.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.301+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ee0027060 2024-04-24T01:44:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:44:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef8146800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:44:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef8146800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T01:44:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94483075514080 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(93 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4dd97fa640 20 handle_completion(): completion ok for obj=thirteen 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== watch-notify(notify (1) cookie 94483075250816 notify 146028888096 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55ee8e26f2a0 con 0x7f4ef0031040 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4dd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94483075250816 notifier 4730 bl.length()=556 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(95 notify.5 [notify cookie 94483075514080 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4dd8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4dd8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4dd8ff9640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4d20003090 con 0x7f4ef0031040 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.304+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.305+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== watch-notify(notify_complete (2) cookie 94483075514080 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4ee80ae040 con 0x7f4ef0031040 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.305+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x55ee8e225a00 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x55ee8e225a00 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef8146800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef8146800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef8146800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T01:44:00.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94483075514080 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== watch-notify(notify (1) cookie 94483075250816 notify 146028888097 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f4ee80ae040 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4dd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94483075250816 notifier 4730 bl.length()=177 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4dd8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4dd8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(98 notify.5 [notify cookie 94483075514080 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4dd8ff9640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4d20003090 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== watch-notify(notify_complete (2) cookie 94483075514080 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee8e1f0520 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef8146800 10 removing user index: bar 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.306+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.307+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(100 bar [delete] v34'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.307+0000 7f4ef8146800 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-24T01:44:00.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.307+0000 7f4ef8146800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.307+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94483075514080 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.308+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== watch-notify(notify (1) cookie 94483075259824 notify 146028888098 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ee8e1f0520 con 0x7f4ef0031040 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.308+0000 7f4dd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94483075259824 notifier 4730 bl.length()=152 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.308+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(101 notify.7 [notify cookie 94483075514080 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.308+0000 7f4dd8ff9640 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4d20003090 con 0x7f4ef0031040 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.308+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== watch-notify(notify_complete (2) cookie 94483075514080 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee8e067360 con 0x7f4ef0031040 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.308+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-24T01:44:00.137431Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:00.137419Z","tags":[],"group_ids":[]} 2024-04-24T01:44:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.309+0000 7f4da77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.309+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483075253504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x55ee8e225a00 2024-04-24T01:44:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.310+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94483075253504] v34'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x55ee8e225a00 2024-04-24T01:44:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.310+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483075237472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ee0027060 2024-04-24T01:44:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.311+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94483075237472] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.311+0000 7f4ef8146800 20 remove_watcher() i=0 2024-04-24T01:44:00.329 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.311+0000 7f4ef8146800 2 removed watcher, disabling cache 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.311+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483075235536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x55ee8e225a00 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.312+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94483075235536] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x55ee8e225a00 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.312+0000 7f4ef8146800 20 remove_watcher() i=1 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.312+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483075243520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x55ee8e22bc50 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.313+0000 7f4eed44b640 1 -- 172.21.15.131:0/1299733423 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94483075243520] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee0052020 con 0x55ee8e22bc50 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.313+0000 7f4ef8146800 20 remove_watcher() i=2 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.313+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483075247168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ee0027060 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.314+0000 7f4ef644d640 1 -- 172.21.15.131:0/1299733423 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94483075247168] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef0040040 con 0x7f4ee0027060 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.314+0000 7f4ef8146800 20 remove_watcher() i=3 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.314+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483075240944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x55ee8e225a00 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.315+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94483075240944] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x55ee8e225a00 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.315+0000 7f4ef8146800 20 remove_watcher() i=4 2024-04-24T01:44:00.330 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.315+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483075250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.316+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94483075250816] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.316+0000 7f4ef8146800 20 remove_watcher() i=5 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.316+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483075256144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.317+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94483075256144] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.317+0000 7f4ef8146800 20 remove_watcher() i=6 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.317+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483075259824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee8e278140 con 0x7f4ef0031040 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94483075259824] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ee80b8040 con 0x7f4ef0031040 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 20 remove_watcher() i=7 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4ef0031040 msgr2=0x7f4ef0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f4ef0031040 0x7f4ef0032940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e225a00 msgr2=0x55ee8e227ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e225a00 0x55ee8e227ec0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4ee0027060 msgr2=0x7f4ee0035440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f4ee0027060 0x7f4ee0035440 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ee8e22bc50 msgr2=0x55ee8e22e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55ee8e22bc50 0x55ee8e22e040 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dc0036900 msgr2=0x7f4dc0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dc0036900 0x7f4dc0038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55ee8e1f1860 tx=0x7f4ef001f000 comp rx=0 tx=0).stop 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 msgr2=0x55ee8e21a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef8146800 1 --2- 172.21.15.131:0/1299733423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e212c60 0x55ee8e21a310 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0024a70 tx=0x7f4ee000ef90 comp rx=0 tx=0).stop 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.318+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 reap_dead start 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef5c4c640 1 -- 172.21.15.131:0/1299733423 reap_dead start 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 shutdown_connections 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 >> 172.21.15.131:0/1299733423 conn(0x55ee8e20efc0 msgr2=0x55ee8e20c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 shutdown_connections 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/1299733423 wait complete. 2024-04-24T01:44:00.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dd0036900 msgr2=0x7f4dd0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dd0036900 0x7f4dd0038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55ee8e1f59b0 tx=0x7f4ef0005840 comp rx=0 tx=0).stop 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e205920 msgr2=0x55ee8e205d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e205920 0x55ee8e205d40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0001ed0 tx=0x7f4ee000ea00 comp rx=0 tx=0).stop 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 shutdown_connections 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4dd0036900 0x7f4dd0038dc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3693478933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e205920 0x55ee8e205d40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 >> 172.21.15.131:0/3693478933 conn(0x55ee8e1f99c0 msgr2=0x55ee8e1f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 shutdown_connections 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3693478933 wait complete. 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e1f2330 msgr2=0x55ee8e1f4740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e1f2330 0x55ee8e1f4740 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4ddc036900 msgr2=0x7f4ddc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4ddc036900 0x7f4ddc038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000f60 tx=0x7f4ee0001370 comp rx=0 tx=0).stop 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f3fa0 msgr2=0x55ee8e1efdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f3fa0 0x55ee8e1efdd0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8052540 tx=0x7f4ee8003020 comp rx=0 tx=0).stop 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 shutdown_connections 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55ee8e1f2330 0x55ee8e1f4740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4ddc036900 0x7f4ddc038dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 --2- 172.21.15.131:0/3303063382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee8e0f3fa0 0x55ee8e1efdd0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 >> 172.21.15.131:0/3303063382 conn(0x55ee8e0ee3a0 msgr2=0x55ee8e1de600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.319+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 shutdown_connections 2024-04-24T01:44:00.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:00.320+0000 7f4ef8146800 1 -- 172.21.15.131:0/3303063382 wait complete. 2024-04-24T01:44:00.334 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-24T01:44:00.137431Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:00.137419Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:05.342 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:44:05.342 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-24T01:44:05.342 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-24T01:44:05.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-24T01:44:05.343 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-24T01:44:05.400 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:05.400 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:05.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.400+0000 7fb5cdb2d800 1 Processor -- start 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.400+0000 7fb5cdb2d800 1 -- start start 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.400+0000 7fb5cdb2d800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cd121b39a0 0x55cd121b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.400+0000 7fb5cdb2d800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd12071d40 con 0x55cd121b62d0 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.400+0000 7fb5cdb2d800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55cd120444d0 con 0x55cd121b39a0 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.401+0000 7fb5c9778640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cd121b39a0 0x55cd121b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.401+0000 7fb5c9778640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cd121b39a0 0x55cd121b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37218/0 (socket says 172.21.15.131:37218) 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.401+0000 7fb5c9778640 1 -- 172.21.15.131:0/2479907467 learned_addr learned my addr 172.21.15.131:0/2479907467 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.401+0000 7fb5c8f77640 1 --1- 172.21.15.131:0/2479907467 >> v1:172.21.15.107:6789/0 conn(0x55cd121b62d0 0x55cd121b86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:34780/0 (socket says 172.21.15.131:34780) 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.401+0000 7fb5c9778640 1 -- 172.21.15.131:0/2479907467 >> v1:172.21.15.107:6789/0 conn(0x55cd121b62d0 legacy=0x55cd121b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.401+0000 7fb5c9778640 1 -- 172.21.15.131:0/2479907467 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd12070590 con 0x55cd121b39a0 2024-04-24T01:44:05.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.403+0000 7fb5c9778640 1 --2- 172.21.15.131:0/2479907467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b5d90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc005fd0 tx=0x7fb5bc01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca205932fb07629 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.403+0000 7fb5bbfff640 1 -- 172.21.15.131:0/2479907467 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc052540 con 0x55cd121b39a0 2024-04-24T01:44:05.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.403+0000 7fb5bbfff640 1 -- 172.21.15.131:0/2479907467 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc04e070 con 0x55cd121b39a0 2024-04-24T01:44:05.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.403+0000 7fb5bbfff640 1 -- 172.21.15.131:0/2479907467 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc052890 con 0x55cd121b39a0 2024-04-24T01:44:05.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.404+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2479907467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 msgr2=0x55cd121b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.404+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2479907467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b5d90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc005fd0 tx=0x7fb5bc01cd80 comp rx=0 tx=0).stop 2024-04-24T01:44:05.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.404+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2479907467 shutdown_connections 2024-04-24T01:44:05.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.404+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2479907467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b5d90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.404+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2479907467 >> 172.21.15.131:0/2479907467 conn(0x55cd121ad3d0 msgr2=0x55cd121af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.404+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2479907467 shutdown_connections 2024-04-24T01:44:05.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.404+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2479907467 wait complete. 2024-04-24T01:44:05.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.417+0000 7fb5cdb2d800 1 Processor -- start 2024-04-24T01:44:05.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.417+0000 7fb5cdb2d800 1 -- start start 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.417+0000 7fb5cdb2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.417+0000 7fb5cdb2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd120fe3e0 con 0x55cd121b39a0 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb5c9778640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb5c9778640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37226/0 (socket says 172.21.15.131:37226) 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb5c9778640 1 -- 172.21.15.131:0/74725530 learned_addr learned my addr 172.21.15.131:0/74725530 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb5c9778640 1 -- 172.21.15.131:0/74725530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd121b18a0 con 0x55cd121b39a0 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb5c9778640 1 --2- 172.21.15.131:0/74725530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b32e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc007000 tx=0x7fb5bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f115d5dfdcdd158 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb4b7606640 1 -- 172.21.15.131:0/74725530 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc052860 con 0x55cd121b39a0 2024-04-24T01:44:05.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb4b7606640 1 -- 172.21.15.131:0/74725530 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc058040 con 0x55cd121b39a0 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.418+0000 7fb4b7606640 1 -- 172.21.15.131:0/74725530 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc052b50 con 0x55cd121b39a0 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/74725530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 msgr2=0x55cd121b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/74725530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b32e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc007000 tx=0x7fb5bc04c000 comp rx=0 tx=0).stop 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/74725530 shutdown_connections 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/74725530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd121b32e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/74725530 >> 172.21.15.131:0/74725530 conn(0x55cd121ad3d0 msgr2=0x55cd1229fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/74725530 shutdown_connections 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/74725530 wait complete. 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.419+0000 7fb5cdb2d800 1 Processor -- start 2024-04-24T01:44:05.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5cdb2d800 1 -- start start 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5cdb2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd122adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5cdb2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd121bc0f0 con 0x55cd121b39a0 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5c9778640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd122adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5c9778640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd122adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37232/0 (socket says 172.21.15.131:37232) 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5c9778640 1 -- 172.21.15.131:0/797568387 learned_addr learned my addr 172.21.15.131:0/797568387 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5c9778640 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd122ae3f0 con 0x55cd121b39a0 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.420+0000 7fb5c9778640 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd122adeb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc05f040 tx=0x7fb5bc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.421+0000 7fb4b5e03640 1 -- 172.21.15.131:0/797568387 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc05d630 con 0x55cd121b39a0 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.421+0000 7fb4b5e03640 1 -- 172.21.15.131:0/797568387 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5bc05d7d0 con 0x55cd121b39a0 2024-04-24T01:44:05.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.421+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd122ae680 con 0x55cd121b39a0 2024-04-24T01:44:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.421+0000 7fb4b5e03640 1 -- 172.21.15.131:0/797568387 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5bc05dad0 con 0x55cd121b39a0 2024-04-24T01:44:05.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.421+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd122b1330 con 0x55cd121b39a0 2024-04-24T01:44:05.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.421+0000 7fb4b5e03640 1 -- 172.21.15.131:0/797568387 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5bc050070 con 0x55cd121b39a0 2024-04-24T01:44:05.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb4b5e03640 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4b0036950 0x7fb4b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb4b5e03640 1 -- 172.21.15.131:0/797568387 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb5bc062070 con 0x55cd121b39a0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4b0036950 0x7fb4b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd121b62d0 0x55cd122b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122b5670 con 0x55cd121b62d0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd121b62d0 0x55cd122b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4b0036950 0x7fb4b0038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0000f60 tx=0x7fb5c0001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.422+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd121b62d0 0x55cd122b50f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.423+0000 7fb5c9f79640 1 -- 172.21.15.131:0/797568387 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5c40083e0 con 0x55cd121b62d0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.423+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122b2680 con 0x55cd121b62d0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.423+0000 7fb5c9f79640 1 -- 172.21.15.131:0/797568387 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5c40083e0 con 0x55cd121b62d0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.423+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122b74c0 con 0x55cd121b62d0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.423+0000 7fb5c9f79640 1 -- 172.21.15.131:0/797568387 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5c40083e0 con 0x55cd121b62d0 2024-04-24T01:44:05.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.423+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122b6740 con 0x55cd121b62d0 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.424+0000 7fb5c9f79640 1 -- 172.21.15.131:0/797568387 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5c40083e0 con 0x55cd121b62d0 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.424+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122b6b30 con 0x55cd121b62d0 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.424+0000 7fb5c9f79640 1 -- 172.21.15.131:0/797568387 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb5c40083e0 con 0x55cd121b62d0 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.424+0000 7fb5cdb2d800 1 Processor -- start 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.424+0000 7fb5cdb2d800 1 -- start start 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.424+0000 7fb5cdb2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122c62c0 0x55cd122c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.424+0000 7fb5cdb2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd120a46b0 con 0x55cd122c62c0 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb5c8f77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122c62c0 0x55cd122c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb5c8f77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122c62c0 0x55cd122c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37236/0 (socket says 172.21.15.131:37236) 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2740409532 learned_addr learned my addr 172.21.15.131:0/2740409532 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2740409532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd122c6c20 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122c62c0 0x55cd122c66e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0001ed0 tx=0x7fb5c000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb4aeffd640 1 -- 172.21.15.131:0/2740409532 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0022070 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb4aeffd640 1 -- 172.21.15.131:0/2740409532 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c000d520 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd122c7690 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb4aeffd640 1 -- 172.21.15.131:0/2740409532 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c000d800 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.425+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd122c7b90 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.426+0000 7fb4aeffd640 1 -- 172.21.15.131:0/2740409532 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5c0025070 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.426+0000 7fb4aeffd640 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4a0036900 0x7fb4a0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.426+0000 7fb4aeffd640 1 -- 172.21.15.131:0/2740409532 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb5c004de50 con 0x55cd122c62c0 2024-04-24T01:44:05.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4a0036900 0x7fb4a0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5cdb2d800 1 Processor -- start 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4a0036900 0x7fb4a0038dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55cd122b6260 tx=0x7fb5c4000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5cdb2d800 1 -- start start 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5cdb2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5cdb2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd121b1b60 con 0x55cd122d3600 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5c8f77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5c8f77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37244/0 (socket says 172.21.15.131:37244) 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5c8f77640 1 -- 172.21.15.131:0/1802959170 learned_addr learned my addr 172.21.15.131:0/1802959170 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.427+0000 7fb5c8f77640 1 -- 172.21.15.131:0/1802959170 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd122d3ff0 con 0x55cd122d3600 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/1802959170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122d3a20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb5c004c120 tx=0x7fb5c0024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5721064e15c71c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb4acff9640 1 -- 172.21.15.131:0/1802959170 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c004a030 con 0x55cd122d3600 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb4acff9640 1 -- 172.21.15.131:0/1802959170 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c0025990 con 0x55cd122d3600 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb4acff9640 1 -- 172.21.15.131:0/1802959170 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0026730 con 0x55cd122d3600 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/1802959170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 msgr2=0x55cd122d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/1802959170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122d3a20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb5c004c120 tx=0x7fb5c0024740 comp rx=0 tx=0).stop 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/1802959170 shutdown_connections 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/1802959170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122d3a20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/1802959170 >> 172.21.15.131:0/1802959170 conn(0x55cd122cf960 msgr2=0x55cd122cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/1802959170 shutdown_connections 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.428+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/1802959170 wait complete. 2024-04-24T01:44:05.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5cdb2d800 1 Processor -- start 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5cdb2d800 1 -- start start 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5cdb2d800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122dac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5cdb2d800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cd122d4760 con 0x55cd122d3600 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5c8f77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5c8f77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122dac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37256/0 (socket says 172.21.15.131:37256) 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 learned_addr learned my addr 172.21.15.131:0/2187658254 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.429+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd122db1a0 con 0x55cd122d3600 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.430+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122dac60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0024a50 tx=0x7fb5c004c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.430+0000 7fb49effd640 1 -- 172.21.15.131:0/2187658254 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c0025570 con 0x55cd122d3600 2024-04-24T01:44:05.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.430+0000 7fb49effd640 1 -- 172.21.15.131:0/2187658254 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c000d9a0 con 0x55cd122d3600 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.430+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd122db1a0 con 0x55cd122d3600 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.430+0000 7fb49effd640 1 -- 172.21.15.131:0/2187658254 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c000dca0 con 0x55cd122d3600 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.430+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd122db1a0 con 0x55cd122d3600 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb49effd640 1 -- 172.21.15.131:0/2187658254 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5c001a320 con 0x55cd122d3600 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb49effd640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb494036900 0x7fb494038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb49effd640 1 -- 172.21.15.131:0/2187658254 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb5c0045070 con 0x55cd122d3600 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb494036900 0x7fb494038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb494036900 0x7fb494038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400f010 tx=0x7fb5c400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd122e63d0 0x55cd122e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.431+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122e8fe0 con 0x55cd122e63d0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5c9778640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd122e63d0 0x55cd122e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5c9778640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd122e63d0 0x55cd122e8890 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 20 realm 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122e93f0 con 0x55cd122e63d0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:05.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122e9cc0 con 0x55cd122e63d0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.432+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ea060 con 0x55cd122e63d0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5cdb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ea8b0 con 0x55cd122e63d0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5cdb2d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5cdb2d800 20 searching for the correct realm 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cd122ec620 0x55cd122eea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cd122ec620 0x55cd122eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.433+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cd122ec620 0x55cd122eea10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c8f77640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb5c001ac20 0x7fb5c00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c001ac20 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb5c001ac20 0x7fb5c00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb5c001ac20 0x7fb5c00039f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c9f79640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb5c4019040 0x7fb5c4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.434+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.435+0000 7fb5c9778640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb5c4019040 0x7fb5c4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.435+0000 7fb5c9778640 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb5c4019040 0x7fb5c4019930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.435+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4019040 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.435+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.436+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.436+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.436+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.436+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.436+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4019040 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.436+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4019040 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c001ac20 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.437+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.438+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4019040 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.438+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.438+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.438+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c001ac20 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.438+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.438+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4019040 2024-04-24T01:44:05.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.439+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.440+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.440+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.440+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.440+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.440+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.440+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x7fb5c4019040 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c001ac20 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc078070 con 0x55cd122e63d0 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.441+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c001ac20 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.442+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.442+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.442+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.442+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.442+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.442+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c001ac20 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122ec620 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c4019040 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x55cd122e63d0 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.443+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef020 con 0x7fb5c001ac20 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:05.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122eb230 con 0x55cd122e63d0 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ebad0 con 0x55cd122e63d0 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ebad0 con 0x55cd122e63d0 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 zone default found 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 4 Realm: () 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:05.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 zonegroup default 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.444+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122ef4a0 con 0x7fb5c001ac20 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f0eb0 con 0x55cd122ec620 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f1420 con 0x55cd122ec620 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 20 started sync module instance, tier type = 2024-04-24T01:44:05.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:05.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.445+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f0320 con 0x7fb5c001ac20 2024-04-24T01:44:05.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.446+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.446+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94339261728832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f0320 con 0x7fb5c001ac20 2024-04-24T01:44:05.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.447+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f1ee0 con 0x55cd122e63d0 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.448+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94339261728832] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.448+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.448+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94339261733360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f0320 con 0x55cd122e63d0 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.448+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f2980 con 0x55cd122ec620 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.449+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.449+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94339261736048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f3220 con 0x55cd122ec620 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.449+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f3d00 con 0x7fb5c001ac20 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.449+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94339261733360] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.450+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94339261736048] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.451+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.451+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94339261738352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122efe70 con 0x7fb5c001ac20 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.451+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f4710 con 0x55cd122e63d0 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.452+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94339261738352] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.452+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.452+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94339261741072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f4710 con 0x55cd122e63d0 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.452+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f50d0 con 0x7fb5c4019040 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.453+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.453+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94339261746208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f54f0 con 0x7fb5c4019040 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.453+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f5fe0 con 0x7fb5c4019040 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.453+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94339261741072] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.454+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94339261746208] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.454+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.454+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94339261743712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f54f0 con 0x7fb5c4019040 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.454+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f6450 con 0x7fb5c4019040 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94339261743712] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94339261747264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f6630 con 0x7fb5c4019040 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 20 add_watcher() i=0 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 20 add_watcher() i=1 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 20 add_watcher() i=2 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 20 add_watcher() i=3 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 20 add_watcher() i=4 2024-04-24T01:44:05.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 20 add_watcher() i=5 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.456+0000 7fb5cdb2d800 20 add_watcher() i=6 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.457+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94339261747264] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.457+0000 7fb5cdb2d800 20 add_watcher() i=7 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.457+0000 7fb5cdb2d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.457+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f9800 con 0x55cd122e63d0 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.458+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.458+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94339261764048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f65a0 con 0x55cd122e63d0 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94339261764048] v34'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb47f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb5cdb2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb5cdb2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:05.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb5cdb2d800 5 note: GC not initialized 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb47e7e4640 20 reqs_thread_entry: start 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb5cdb2d800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb5cdb2d800 20 Filter name: none 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.459+0000 7fb3effff640 20 reqs_thread_entry: start 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd1232cc60 con 0x7fb5c4019040 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:44:05.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd1232b400 con 0x7fb5c4019040 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:44:05.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.460+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd1232bca0 con 0x7fb5c4019040 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5cdb2d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5cdb2d800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5cdb2d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94339261970416 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd12330700 con 0x7fb5c4019040 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== watch-notify(notify (1) cookie 94339261746208 notify 146028888099 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55cd1232c040 con 0x7fb5c4019040 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(65 notify.5 [notify cookie 94339261970416 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb4acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94339261746208 notifier 4737 bl.length()=556 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb4acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:44:05.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb4acff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb4acff9640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb48c003ea0 con 0x7fb5c4019040 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== watch-notify(notify_complete (2) cookie 94339261970416 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd1232c6b0 con 0x7fb5c4019040 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.462+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd1232e230 con 0x7fb5c4019040 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb5cdb2d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb5cdb2d800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb5cdb2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:44:05.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94339261970304 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cd12330700 con 0x55cd122ec620 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== watch-notify(notify (1) cookie 94339261736048 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55cd122d3ff0 con 0x55cd122ec620 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb4acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94339261736048 notifier 4737 bl.length()=177 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb4acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb4acff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb4acff9640 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb48c003ea0 con 0x55cd122ec620 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.464+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 notify.2 [notify cookie 94339261970304 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.465+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== watch-notify(notify_complete (2) cookie 94339261970304 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd122c7b90 con 0x55cd122ec620 2024-04-24T01:44:05.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.465+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.485 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:44:05.461582Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:05.461569Z","tags":[],"group_ids":[]} 2024-04-24T01:44:05.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.465+0000 7fb47f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:05.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.465+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94339261764048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f89b0 con 0x55cd122e63d0 2024-04-24T01:44:05.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.466+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94339261764048] v34'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.466+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94339261728832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f91a0 con 0x7fb5c001ac20 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.467+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94339261728832] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.467+0000 7fb5cdb2d800 20 remove_watcher() i=0 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.467+0000 7fb5cdb2d800 2 removed watcher, disabling cache 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.467+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94339261733360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f0820 con 0x55cd122e63d0 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.469+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94339261733360] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.469+0000 7fb5cdb2d800 20 remove_watcher() i=1 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.469+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94339261736048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f19f0 con 0x55cd122ec620 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.470+0000 7fb5c8f77640 1 -- 172.21.15.131:0/2187658254 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94339261736048] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c0024030 con 0x55cd122ec620 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.470+0000 7fb5cdb2d800 20 remove_watcher() i=2 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.470+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94339261738352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f0820 con 0x7fb5c001ac20 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.471+0000 7fb5c9f79640 1 -- 172.21.15.131:0/2187658254 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94339261738352] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5c402f040 con 0x7fb5c001ac20 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.471+0000 7fb5cdb2d800 20 remove_watcher() i=3 2024-04-24T01:44:05.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.471+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94339261741072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f2d70 con 0x55cd122e63d0 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.472+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94339261741072] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x55cd122e63d0 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.472+0000 7fb5cdb2d800 20 remove_watcher() i=4 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.472+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94339261746208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f3810 con 0x7fb5c4019040 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.473+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94339261746208] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.473+0000 7fb5cdb2d800 20 remove_watcher() i=5 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.473+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94339261743712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f4c20 con 0x7fb5c4019040 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.474+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94339261743712] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.474+0000 7fb5cdb2d800 20 remove_watcher() i=6 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.474+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94339261747264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cd122f4c20 con 0x7fb5c4019040 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94339261747264] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5bc09e040 con 0x7fb5c4019040 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 20 remove_watcher() i=7 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb5c4019040 msgr2=0x7fb5c4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb5c4019040 0x7fb5c4019930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd122e63d0 msgr2=0x55cd122e8890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd122e63d0 0x55cd122e8890 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb5c001ac20 msgr2=0x7fb5c00039f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb5c001ac20 0x7fb5c00039f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cd122ec620 msgr2=0x55cd122eea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cd122ec620 0x55cd122eea10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb494036900 msgr2=0x7fb494038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb494036900 0x7fb494038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400f010 tx=0x7fb5c400c040 comp rx=0 tx=0).stop 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 msgr2=0x55cd122dac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122dac60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0024a50 tx=0x7fb5c004c080 comp rx=0 tx=0).stop 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.475+0000 7fb5c9778640 1 -- 172.21.15.131:0/2187658254 reap_dead start 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 shutdown_connections 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2187658254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122d3600 0x55cd122dac60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 >> 172.21.15.131:0/2187658254 conn(0x55cd122cf960 msgr2=0x55cd122ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 shutdown_connections 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2187658254 wait complete. 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4a0036900 msgr2=0x7fb4a0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4a0036900 0x7fb4a0038dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55cd122b6260 tx=0x7fb5c4000f90 comp rx=0 tx=0).stop 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122c62c0 msgr2=0x55cd122c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122c62c0 0x55cd122c66e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0001ed0 tx=0x7fb5c000ea00 comp rx=0 tx=0).stop 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 shutdown_connections 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4a0036900 0x7fb4a0038dc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/2740409532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd122c62c0 0x55cd122c66e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 >> 172.21.15.131:0/2740409532 conn(0x55cd122ba360 msgr2=0x55cd122ba760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 shutdown_connections 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/2740409532 wait complete. 2024-04-24T01:44:05.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd121b62d0 msgr2=0x55cd122b50f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd121b62d0 0x55cd122b50f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4b0036950 msgr2=0x7fb4b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4b0036950 0x7fb4b0038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0000f60 tx=0x7fb5c0001370 comp rx=0 tx=0).stop 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 msgr2=0x55cd122adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd122adeb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc05f040 tx=0x7fb5bc003330 comp rx=0 tx=0).stop 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 shutdown_connections 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cd121b62d0 0x55cd122b50f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb4b0036950 0x7fb4b0038e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 --2- 172.21.15.131:0/797568387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cd121b39a0 0x55cd122adeb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.476+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 >> 172.21.15.131:0/797568387 conn(0x55cd121ad3d0 msgr2=0x55cd121b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.477+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 shutdown_connections 2024-04-24T01:44:05.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.477+0000 7fb5cdb2d800 1 -- 172.21.15.131:0/797568387 wait complete. 2024-04-24T01:44:05.496 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:44:05.461582Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:05.461569Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:05.510 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:44:05.515 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-24T01:44:05.515 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-24T01:44:05.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-24T01:44:05.515 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-24T01:44:05.559 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:05.560 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c6e414800 1 Processor -- start 2024-04-24T01:44:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c6e414800 1 -- start start 2024-04-24T01:44:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c6e414800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e6d18fe7a0 0x55e6d18febc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c6e414800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e6d17bed40 con 0x55e6d18ff100 2024-04-24T01:44:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c6e414800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55e6d17914d0 con 0x55e6d18fe7a0 2024-04-24T01:44:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c69b5c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e6d18fe7a0 0x55e6d18febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c69b5c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e6d18fe7a0 0x55e6d18febc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37270/0 (socket says 172.21.15.131:37270) 2024-04-24T01:44:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c69b5c640 1 -- 172.21.15.131:0/3947654103 learned_addr learned my addr 172.21.15.131:0/3947654103 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.560+0000 7f7c6935b640 1 --1- 172.21.15.131:0/3947654103 >> v1:172.21.15.107:6789/0 conn(0x55e6d18ff100 0x55e6d18ff5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:34782/0 (socket says 172.21.15.131:34782) 2024-04-24T01:44:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.561+0000 7f7c69b5c640 1 -- 172.21.15.131:0/3947654103 >> v1:172.21.15.107:6789/0 conn(0x55e6d18ff100 legacy=0x55e6d18ff5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.561+0000 7f7c69b5c640 1 -- 172.21.15.131:0/3947654103 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d17bd590 con 0x55e6d18fe7a0 2024-04-24T01:44:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.562+0000 7f7c69b5c640 1 --2- 172.21.15.131:0/3947654103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d18febc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00a520 tx=0x7f7c5c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6207205bfd6b64 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c68b5a640 1 -- 172.21.15.131:0/3947654103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c057070 con 0x55e6d18fe7a0 2024-04-24T01:44:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c68b5a640 1 -- 172.21.15.131:0/3947654103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c052570 con 0x55e6d18fe7a0 2024-04-24T01:44:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c68b5a640 1 -- 172.21.15.131:0/3947654103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c052870 con 0x55e6d18fe7a0 2024-04-24T01:44:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c6e414800 1 -- 172.21.15.131:0/3947654103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 msgr2=0x55e6d18febc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3947654103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d18febc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00a520 tx=0x7f7c5c01d010 comp rx=0 tx=0).stop 2024-04-24T01:44:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c6e414800 1 -- 172.21.15.131:0/3947654103 shutdown_connections 2024-04-24T01:44:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3947654103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d18febc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c6e414800 1 -- 172.21.15.131:0/3947654103 >> 172.21.15.131:0/3947654103 conn(0x55e6d18fa3a0 msgr2=0x55e6d18fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c6e414800 1 -- 172.21.15.131:0/3947654103 shutdown_connections 2024-04-24T01:44:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.563+0000 7f7c6e414800 1 -- 172.21.15.131:0/3947654103 wait complete. 2024-04-24T01:44:05.575 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.575+0000 7f7c6e414800 1 Processor -- start 2024-04-24T01:44:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.575+0000 7f7c6e414800 1 -- start start 2024-04-24T01:44:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.575+0000 7f7c6e414800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19f3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.575+0000 7f7c6e414800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e6d184b3b0 con 0x55e6d18fe7a0 2024-04-24T01:44:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.575+0000 7f7c69b5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.575+0000 7f7c69b5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37276/0 (socket says 172.21.15.131:37276) 2024-04-24T01:44:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.575+0000 7f7c69b5c640 1 -- 172.21.15.131:0/740014331 learned_addr learned my addr 172.21.15.131:0/740014331 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.578 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.576+0000 7f7c69b5c640 1 -- 172.21.15.131:0/740014331 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d19f39d0 con 0x55e6d18fe7a0 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.576+0000 7f7c69b5c640 1 --2- 172.21.15.131:0/740014331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19f3400 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c055040 tx=0x7f7c5c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dec9e053b4947b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.576+0000 7f7b57e07640 1 -- 172.21.15.131:0/740014331 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c057040 con 0x55e6d18fe7a0 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.576+0000 7f7b57e07640 1 -- 172.21.15.131:0/740014331 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c052870 con 0x55e6d18fe7a0 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.576+0000 7f7b57e07640 1 -- 172.21.15.131:0/740014331 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c052b90 con 0x55e6d18fe7a0 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 -- 172.21.15.131:0/740014331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 msgr2=0x55e6d19f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 --2- 172.21.15.131:0/740014331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19f3400 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c055040 tx=0x7f7c5c04c000 comp rx=0 tx=0).stop 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 -- 172.21.15.131:0/740014331 shutdown_connections 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 --2- 172.21.15.131:0/740014331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19f3400 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 -- 172.21.15.131:0/740014331 >> 172.21.15.131:0/740014331 conn(0x55e6d18fa3a0 msgr2=0x55e6d19eed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 -- 172.21.15.131:0/740014331 shutdown_connections 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 -- 172.21.15.131:0/740014331 wait complete. 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 Processor -- start 2024-04-24T01:44:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 -- start start 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19faea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c6e414800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e6d18fff00 con 0x55e6d18fe7a0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c69b5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c69b5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37292/0 (socket says 172.21.15.131:37292) 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.577+0000 7f7c69b5c640 1 -- 172.21.15.131:0/3824187389 learned_addr learned my addr 172.21.15.131:0/3824187389 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.578+0000 7f7c69b5c640 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d19fb3e0 con 0x55e6d18fe7a0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.578+0000 7f7c69b5c640 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19faea0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c052540 tx=0x7f7c5c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.578+0000 7f7b56604640 1 -- 172.21.15.131:0/3824187389 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c073070 con 0x55e6d18fe7a0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.578+0000 7f7b56604640 1 -- 172.21.15.131:0/3824187389 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c05d570 con 0x55e6d18fe7a0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.578+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6d19fb670 con 0x55e6d18fe7a0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.578+0000 7f7b56604640 1 -- 172.21.15.131:0/3824187389 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c057070 con 0x55e6d18fe7a0 2024-04-24T01:44:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.578+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d19fe320 con 0x55e6d18fe7a0 2024-04-24T01:44:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.579+0000 7f7b56604640 1 -- 172.21.15.131:0/3824187389 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7c5c076070 con 0x55e6d18fe7a0 2024-04-24T01:44:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.579+0000 7f7b56604640 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b50036950 0x7f7b50038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.579+0000 7f7b56604640 1 -- 172.21.15.131:0/3824187389 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f7c5c08de10 con 0x55e6d18fe7a0 2024-04-24T01:44:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.579+0000 7f7c6935b640 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b50036950 0x7f7b50038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.579+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d18ff100 0x55e6d1a020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.579+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a02620 con 0x55e6d18ff100 2024-04-24T01:44:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.579+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d18ff100 0x55e6d1a020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.580+0000 7f7c6935b640 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b50036950 0x7f7b50038e10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c60000f60 tx=0x7f7c60001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.580+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d18ff100 0x55e6d1a020e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.580+0000 7f7c6a35d640 1 -- 172.21.15.131:0/3824187389 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c6400a4a0 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.580+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d19ff6b0 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.580+0000 7f7c6a35d640 1 -- 172.21.15.131:0/3824187389 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c6400a4a0 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.580+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a04470 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.580+0000 7f7c6a35d640 1 -- 172.21.15.131:0/3824187389 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7c6400a4a0 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a037b0 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6a35d640 1 -- 172.21.15.131:0/3824187389 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c6400a4a0 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a03c00 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6a35d640 1 -- 172.21.15.131:0/3824187389 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c6400a4a0 con 0x55e6d18ff100 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6e414800 1 Processor -- start 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6e414800 1 -- start start 2024-04-24T01:44:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6e414800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a13240 0x55e6d1a13660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.581+0000 7f7c6e414800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e6d17f16b0 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7c6935b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a13240 0x55e6d1a13660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7c6935b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a13240 0x55e6d1a13660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37302/0 (socket says 172.21.15.131:37302) 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7c6935b640 1 -- 172.21.15.131:0/2275711477 learned_addr learned my addr 172.21.15.131:0/2275711477 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7c6935b640 1 -- 172.21.15.131:0/2275711477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d1a13ba0 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7c6935b640 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a13240 0x55e6d1a13660 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7c60001ed0 tx=0x7f7c6000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7b4f7fe640 1 -- 172.21.15.131:0/2275711477 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c60022070 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7b4f7fe640 1 -- 172.21.15.131:0/2275711477 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6000d520 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6d1a14610 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7b4f7fe640 1 -- 172.21.15.131:0/2275711477 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c6000d800 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.582+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d1a14b10 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.583+0000 7f7b4f7fe640 1 -- 172.21.15.131:0/2275711477 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7c60025070 con 0x55e6d1a13240 2024-04-24T01:44:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.583+0000 7f7b4f7fe640 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b44036900 0x7f7b44038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.583+0000 7f7b4f7fe640 1 -- 172.21.15.131:0/2275711477 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f7c6004de50 con 0x55e6d1a13240 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.583+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b44036900 0x7f7b44038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6e414800 1 Processor -- start 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b44036900 0x7f7b44038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55e6d1a032d0 tx=0x7f7c64005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6e414800 1 -- start start 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6e414800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a209a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6e414800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e6d19f3c90 con 0x55e6d1a20580 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6935b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6935b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a209a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37304/0 (socket says 172.21.15.131:37304) 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6935b640 1 -- 172.21.15.131:0/2626470081 learned_addr learned my addr 172.21.15.131:0/2626470081 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.584+0000 7f7c6935b640 1 -- 172.21.15.131:0/2626470081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d1a20f70 con 0x55e6d1a20580 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6935b640 1 --2- 172.21.15.131:0/2626470081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a209a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c6004c120 tx=0x7f7c60024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df43d8e641b8022 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7b4d7fa640 1 -- 172.21.15.131:0/2626470081 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c6004a030 con 0x55e6d1a20580 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7b4d7fa640 1 -- 172.21.15.131:0/2626470081 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c60025990 con 0x55e6d1a20580 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7b4d7fa640 1 -- 172.21.15.131:0/2626470081 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c60026730 con 0x55e6d1a20580 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 -- 172.21.15.131:0/2626470081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 msgr2=0x55e6d1a209a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2626470081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a209a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c6004c120 tx=0x7f7c60024740 comp rx=0 tx=0).stop 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 -- 172.21.15.131:0/2626470081 shutdown_connections 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2626470081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a209a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 -- 172.21.15.131:0/2626470081 >> 172.21.15.131:0/2626470081 conn(0x55e6d1a1c8e0 msgr2=0x55e6d1a1a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 -- 172.21.15.131:0/2626470081 shutdown_connections 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 -- 172.21.15.131:0/2626470081 wait complete. 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.585+0000 7f7c6e414800 1 Processor -- start 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6e414800 1 -- start start 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6e414800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a27be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6e414800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e6d1a216e0 con 0x55e6d1a20580 2024-04-24T01:44:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6935b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a27be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6935b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a27be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37320/0 (socket says 172.21.15.131:37320) 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 learned_addr learned my addr 172.21.15.131:0/2697213880 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d1a28120 con 0x55e6d1a20580 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7c6935b640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a27be0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7c60024a50 tx=0x7f7c6004c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.586+0000 7f7b3b7fe640 1 -- 172.21.15.131:0/2697213880 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c60025570 con 0x55e6d1a20580 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.587+0000 7f7b3b7fe640 1 -- 172.21.15.131:0/2697213880 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6000d9a0 con 0x55e6d1a20580 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.587+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6d1a28120 con 0x55e6d1a20580 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.587+0000 7f7b3b7fe640 1 -- 172.21.15.131:0/2697213880 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c6000dca0 con 0x55e6d1a20580 2024-04-24T01:44:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.587+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d1a28120 con 0x55e6d1a20580 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.587+0000 7f7b3b7fe640 1 -- 172.21.15.131:0/2697213880 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7c6001a320 con 0x55e6d1a20580 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.587+0000 7f7b3b7fe640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b34036900 0x7f7b34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.587+0000 7f7b3b7fe640 1 -- 172.21.15.131:0/2697213880 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f7c60045070 con 0x55e6d1a20580 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.588+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b34036900 0x7f7b34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.588+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b34036900 0x7f7b34038dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55e6d19ff600 tx=0x7f7c6401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.588+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.588+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d1a33380 0x55e6d1a35840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.588+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a35f90 con 0x55e6d1a33380 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.588+0000 7f7c69b5c640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d1a33380 0x55e6d1a35840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c69b5c640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d1a33380 0x55e6d1a35840 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x55e6d1a33380 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 realm 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a363a0 con 0x55e6d1a33380 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x55e6d1a33380 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a36c70 con 0x55e6d1a33380 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x55e6d1a33380 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a37010 con 0x55e6d1a33380 2024-04-24T01:44:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c5c075030 con 0x55e6d1a33380 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.589+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a37860 con 0x55e6d1a33380 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c5c075030 con 0x55e6d1a33380 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6e414800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6e414800 20 searching for the correct realm 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e6d1a395d0 0x55e6d1a3b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6935b640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e6d1a395d0 0x55e6d1a3b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6935b640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e6d1a395d0 0x55e6d1a3b9c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6935b640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7c6001ac20 0x7f7c6001c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.590+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c6001ac20 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.591+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7c6001ac20 0x7f7c6001c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.591+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7c6001ac20 0x7f7c6001c420 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.591+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6401f070 con 0x7f7c6001ac20 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.591+0000 7f7c6a35d640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7c64031040 0x7f7c64032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.591+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.591+0000 7f7c69b5c640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7c64031040 0x7f7c64032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.592+0000 7f7c69b5c640 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7c64031040 0x7f7c64032430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.592+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.592+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.592+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.592+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.592+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.592+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c6001ac20 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6401f070 con 0x7f7c6001ac20 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.593+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c6001ac20 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c6401f070 con 0x7f7c6001ac20 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.594+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.595+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.596+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c6001ac20 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6401f070 con 0x7f7c6001ac20 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c6001ac20 2024-04-24T01:44:05.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6401f070 con 0x7f7c6001ac20 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.597+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.598+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.598+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.598+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.598+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c6001ac20 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.598+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6401f070 con 0x7f7c6001ac20 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.598+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a395d0 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c64031040 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x55e6d1a33380 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3bfa0 con 0x7f7c6001ac20 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6e414800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6e414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6e414800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6e414800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6e414800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6e414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.599+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a381b0 con 0x55e6d1a33380 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a38a50 con 0x55e6d1a33380 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3c420 con 0x55e6d1a33380 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 zone default found 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 4 Realm: () 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 zonegroup default 2024-04-24T01:44:05.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3c4b0 con 0x7f7c6001ac20 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.600+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3e780 con 0x55e6d1a395d0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3eb50 con 0x55e6d1a395d0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6e414800 20 started sync module instance, tier type = 2024-04-24T01:44:05.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6e414800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.601+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3dc10 con 0x7f7c6001ac20 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.602+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.602+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94449848017168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3dc10 con 0x7f7c6001ac20 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.602+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3f610 con 0x55e6d1a33380 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.603+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94449848017168] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.603+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.603+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94449848021280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3dc10 con 0x55e6d1a33380 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.603+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a40090 con 0x55e6d1a395d0 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.605+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94449848021280] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.605+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.605+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94449848014688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a40430 con 0x55e6d1a395d0 2024-04-24T01:44:05.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.605+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a40ee0 con 0x7f7c6001ac20 2024-04-24T01:44:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.606+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94449848014688] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.606+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.606+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94449848023968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a412d0 con 0x7f7c6001ac20 2024-04-24T01:44:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.606+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a41d30 con 0x55e6d1a33380 2024-04-24T01:44:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.607+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.607+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94449848031200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a41cf0 con 0x55e6d1a33380 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.607+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a42ce0 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.607+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94449848023968] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.608+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.608+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94449848035312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a42ce0 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.608+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a43720 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.608+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94449848031200] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.610+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94449848035312] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.610+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.610+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94449848027584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a43270 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.610+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a43c30 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94449848027584] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94449848033568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a43c30 con 0x7f7c64031040 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 20 add_watcher() i=0 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 20 add_watcher() i=1 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 20 add_watcher() i=2 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 20 add_watcher() i=3 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 20 add_watcher() i=4 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 20 add_watcher() i=5 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.611+0000 7f7c6e414800 20 add_watcher() i=6 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.614+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94449848033568] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.614+0000 7f7c6e414800 20 add_watcher() i=7 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.614+0000 7f7c6e414800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.614+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a46f60 con 0x55e6d1a33380 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.614+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.614+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94449848039664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a441c0 con 0x55e6d1a33380 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.615+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94449848039664] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.615+0000 7f7b1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.615+0000 7f7c6e414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.615+0000 7f7c6e414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.615+0000 7f7c6e414800 5 note: GC not initialized 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7b1a7fc640 20 reqs_thread_entry: start 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 20 Filter name: none 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7a8bfff640 20 reqs_thread_entry: start 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a7a2b0 con 0x7f7c6001ac20 2024-04-24T01:44:05.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.616+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a7e620 con 0x7f7c64031040 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.617+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.618+0000 7f7b1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.618+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94449848039664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a460f0 con 0x55e6d1a33380 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.619+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94449848039664] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.619+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94449848017168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a438f0 con 0x7f7c6001ac20 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.620+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94449848017168] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.620+0000 7f7c6e414800 20 remove_watcher() i=0 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.620+0000 7f7c6e414800 2 removed watcher, disabling cache 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.620+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94449848021280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a438f0 con 0x55e6d1a33380 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.621+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94449848021280] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.621+0000 7f7c6e414800 20 remove_watcher() i=1 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.622+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94449848014688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3f120 con 0x55e6d1a395d0 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.623+0000 7f7c6935b640 1 -- 172.21.15.131:0/2697213880 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94449848014688] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c60052020 con 0x55e6d1a395d0 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.623+0000 7f7c6e414800 20 remove_watcher() i=2 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.623+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94449848023968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a438f0 con 0x7f7c6001ac20 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.624+0000 7f7c6a35d640 1 -- 172.21.15.131:0/2697213880 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94449848023968] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c64040040 con 0x7f7c6001ac20 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.624+0000 7f7c6e414800 20 remove_watcher() i=3 2024-04-24T01:44:05.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.624+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94449848031200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3d760 con 0x55e6d1a33380 2024-04-24T01:44:05.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.627+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94449848031200] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x55e6d1a33380 2024-04-24T01:44:05.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.627+0000 7f7c6e414800 20 remove_watcher() i=4 2024-04-24T01:44:05.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.627+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94449848035312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3fba0 con 0x7f7c64031040 2024-04-24T01:44:05.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.628+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94449848035312] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.628+0000 7f7c6e414800 20 remove_watcher() i=5 2024-04-24T01:44:05.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.628+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94449848027584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a438f0 con 0x7f7c64031040 2024-04-24T01:44:05.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.629+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94449848027584] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.629+0000 7f7c6e414800 20 remove_watcher() i=6 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.629+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94449848033568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6d1a3d760 con 0x7f7c64031040 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94449848033568] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c086040 con 0x7f7c64031040 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 20 remove_watcher() i=7 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7c64031040 msgr2=0x7f7c64032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f7c64031040 0x7f7c64032430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d1a33380 msgr2=0x55e6d1a35840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d1a33380 0x55e6d1a35840 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7c6001ac20 msgr2=0x7f7c6001c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f7c6001ac20 0x7f7c6001c420 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e6d1a395d0 msgr2=0x55e6d1a3b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e6d1a395d0 0x55e6d1a3b9c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b34036900 msgr2=0x7f7b34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b34036900 0x7f7b34038dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55e6d19ff600 tx=0x7f7c6401f000 comp rx=0 tx=0).stop 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 msgr2=0x55e6d1a27be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c69b5c640 1 -- 172.21.15.131:0/2697213880 reap_dead start 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a27be0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7c60024a50 tx=0x7f7c6004c080 comp rx=0 tx=0).stop 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 shutdown_connections 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2697213880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a20580 0x55e6d1a27be0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.630+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 >> 172.21.15.131:0/2697213880 conn(0x55e6d1a1c8e0 msgr2=0x55e6d1a19f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 shutdown_connections 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2697213880 wait complete. 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b44036900 msgr2=0x7f7b44038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b44036900 0x7f7b44038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55e6d1a032d0 tx=0x7f7c64005840 comp rx=0 tx=0).stop 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a13240 msgr2=0x55e6d1a13660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a13240 0x55e6d1a13660 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7c60001ed0 tx=0x7f7c6000ea00 comp rx=0 tx=0).stop 2024-04-24T01:44:05.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 shutdown_connections 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b44036900 0x7f7b44038dc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/2275711477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d1a13240 0x55e6d1a13660 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 >> 172.21.15.131:0/2275711477 conn(0x55e6d1a072e0 msgr2=0x55e6d1a076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 shutdown_connections 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/2275711477 wait complete. 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d18ff100 msgr2=0x55e6d1a020e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d18ff100 0x55e6d1a020e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b50036950 msgr2=0x7f7b50038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b50036950 0x7f7b50038e10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c60000f60 tx=0x7f7c60001370 comp rx=0 tx=0).stop 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 msgr2=0x55e6d19faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19faea0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c052540 tx=0x7f7c5c003020 comp rx=0 tx=0).stop 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 shutdown_connections 2024-04-24T01:44:05.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e6d18ff100 0x55e6d1a020e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7b50036950 0x7f7b50038e10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 --2- 172.21.15.131:0/3824187389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6d18fe7a0 0x55e6d19faea0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 >> 172.21.15.131:0/3824187389 conn(0x55e6d18fa3a0 msgr2=0x55e6d19ed5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 shutdown_connections 2024-04-24T01:44:05.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.631+0000 7f7c6e414800 1 -- 172.21.15.131:0/3824187389 wait complete. 2024-04-24T01:44:05.639 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:44:05.644 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:44:05.644 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-24T01:44:05.650 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:44:05.651 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-24T01:44:05.651 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-24T01:44:05.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-24T01:44:05.651 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-24T01:44:05.694 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:05.695 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:05.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce6b50c800 1 Processor -- start 2024-04-24T01:44:05.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce6b50c800 1 -- start start 2024-04-24T01:44:05.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce6b50c800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560df90c19b0 0x560df90c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce6b50c800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560df8f7fd40 con 0x560df90c42e0 2024-04-24T01:44:05.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce6b50c800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x560df8f524d0 con 0x560df90c19b0 2024-04-24T01:44:05.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce69012640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560df90c19b0 0x560df90c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce68811640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x560df90c42e0 0x560df90c66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:34796/0 (socket says 172.21.15.131:34796) 2024-04-24T01:44:05.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce68811640 1 -- 172.21.15.131:0/2530567268 learned_addr learned my addr 172.21.15.131:0/2530567268 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:05.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.695+0000 7fce69012640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560df90c19b0 0x560df90c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37324/0 (socket says 172.21.15.131:37324) 2024-04-24T01:44:05.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.696+0000 7fce69012640 1 -- 172.21.15.131:0/2530567268 >> v1:172.21.15.107:6789/0 conn(0x560df90c42e0 legacy=0x560df90c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.696+0000 7fce69012640 1 -- 172.21.15.131:0/2530567268 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df8f7e590 con 0x560df90c19b0 2024-04-24T01:44:05.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.697+0000 7fce69012640 1 --2- 172.21.15.131:0/2530567268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c3da0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00a470 tx=0x7fce5c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd9392d150fef98 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce5bfff640 1 -- 172.21.15.131:0/2530567268 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5c057070 con 0x560df90c19b0 2024-04-24T01:44:05.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce5bfff640 1 -- 172.21.15.131:0/2530567268 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c052570 con 0x560df90c19b0 2024-04-24T01:44:05.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce5bfff640 1 -- 172.21.15.131:0/2530567268 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5c052870 con 0x560df90c19b0 2024-04-24T01:44:05.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce6b50c800 1 -- 172.21.15.131:0/2530567268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 msgr2=0x560df90c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce6b50c800 1 --2- 172.21.15.131:0/2530567268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c3da0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00a470 tx=0x7fce5c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:05.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce6b50c800 1 -- 172.21.15.131:0/2530567268 shutdown_connections 2024-04-24T01:44:05.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce6b50c800 1 --2- 172.21.15.131:0/2530567268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c3da0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce6b50c800 1 -- 172.21.15.131:0/2530567268 >> 172.21.15.131:0/2530567268 conn(0x560df90bb340 msgr2=0x560df90bd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce6b50c800 1 -- 172.21.15.131:0/2530567268 shutdown_connections 2024-04-24T01:44:05.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.698+0000 7fce6b50c800 1 -- 172.21.15.131:0/2530567268 wait complete. 2024-04-24T01:44:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce6b50c800 1 Processor -- start 2024-04-24T01:44:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce6b50c800 1 -- start start 2024-04-24T01:44:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce6b50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df91b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce6b50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560df900c3b0 con 0x560df90c19b0 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce69012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df91b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce69012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df91b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37330/0 (socket says 172.21.15.131:37330) 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce69012640 1 -- 172.21.15.131:0/681378911 learned_addr learned my addr 172.21.15.131:0/681378911 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.710+0000 7fce69012640 1 -- 172.21.15.131:0/681378911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df91b2710 con 0x560df90c19b0 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.711+0000 7fce69012640 1 --2- 172.21.15.131:0/681378911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df91b2140 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce5c055040 tx=0x7fce5c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a63691a5f9ea0b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.711+0000 7fcd57606640 1 -- 172.21.15.131:0/681378911 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5c057070 con 0x560df90c19b0 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.711+0000 7fcd57606640 1 -- 172.21.15.131:0/681378911 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c063070 con 0x560df90c19b0 2024-04-24T01:44:05.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.711+0000 7fcd57606640 1 -- 172.21.15.131:0/681378911 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5c052720 con 0x560df90c19b0 2024-04-24T01:44:05.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 -- 172.21.15.131:0/681378911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 msgr2=0x560df91b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 --2- 172.21.15.131:0/681378911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df91b2140 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce5c055040 tx=0x7fce5c04c000 comp rx=0 tx=0).stop 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 -- 172.21.15.131:0/681378911 shutdown_connections 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 --2- 172.21.15.131:0/681378911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df91b2140 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 -- 172.21.15.131:0/681378911 >> 172.21.15.131:0/681378911 conn(0x560df90bb340 msgr2=0x560df91ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 -- 172.21.15.131:0/681378911 shutdown_connections 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 -- 172.21.15.131:0/681378911 wait complete. 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 Processor -- start 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 -- start start 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce6b50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560df90ca100 con 0x560df90c19b0 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce69012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce69012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37340/0 (socket says 172.21.15.131:37340) 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.712+0000 7fce69012640 1 -- 172.21.15.131:0/1632488481 learned_addr learned my addr 172.21.15.131:0/1632488481 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.713+0000 7fce69012640 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df90c1790 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.713+0000 7fce69012640 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c1250 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce5c060040 tx=0x7fce5c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.713+0000 7fcd55e03640 1 -- 172.21.15.131:0/1632488481 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5c052e30 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.713+0000 7fcd55e03640 1 -- 172.21.15.131:0/1632488481 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c06c070 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.713+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560df90bf9e0 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.713+0000 7fcd55e03640 1 -- 172.21.15.131:0/1632488481 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5c05e5d0 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.713+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df90bff60 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.714+0000 7fcd55e03640 1 -- 172.21.15.131:0/1632488481 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce5c05e770 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.714+0000 7fcd55e03640 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd500369a0 0x7fcd50038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.714+0000 7fcd55e03640 1 -- 172.21.15.131:0/1632488481 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fce5c08e960 con 0x560df90c19b0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.714+0000 7fce68811640 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd500369a0 0x7fcd50038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.714+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df90c42e0 0x560df91c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.714+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91c3530 con 0x560df90c42e0 2024-04-24T01:44:05.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.714+0000 7fce69813640 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df90c42e0 0x560df91c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.715+0000 7fce68811640 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd500369a0 0x7fcd50038e60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fce60001d90 tx=0x7fce600012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.715+0000 7fce69813640 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df90c42e0 0x560df91c2ff0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.715+0000 7fce69813640 1 -- 172.21.15.131:0/1632488481 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce6400a4a0 con 0x560df90c42e0 2024-04-24T01:44:05.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.715+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91c3d80 con 0x560df90c42e0 2024-04-24T01:44:05.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.715+0000 7fce69813640 1 -- 172.21.15.131:0/1632488481 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce6400a4a0 con 0x560df90c42e0 2024-04-24T01:44:05.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.715+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91c5130 con 0x560df90c42e0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.716+0000 7fce69813640 1 -- 172.21.15.131:0/1632488481 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce6400a4a0 con 0x560df90c42e0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.716+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91c45d0 con 0x560df90c42e0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.716+0000 7fce69813640 1 -- 172.21.15.131:0/1632488481 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce6400a4a0 con 0x560df90c42e0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.716+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91c4a20 con 0x560df90c42e0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.716+0000 7fce69813640 1 -- 172.21.15.131:0/1632488481 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce6400a4a0 con 0x560df90c42e0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.716+0000 7fce6b50c800 1 Processor -- start 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce6b50c800 1 -- start start 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce6b50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91d40e0 0x560df91d4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce6b50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560df8fb26b0 con 0x560df91d40e0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce68811640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91d40e0 0x560df91d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce68811640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91d40e0 0x560df91d4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37342/0 (socket says 172.21.15.131:37342) 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce68811640 1 -- 172.21.15.131:0/1440568931 learned_addr learned my addr 172.21.15.131:0/1440568931 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce68811640 1 -- 172.21.15.131:0/1440568931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df91d4a40 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.717+0000 7fce68811640 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91d40e0 0x560df91d4500 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fce6000efd0 tx=0x7fce6000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.718+0000 7fcd4effd640 1 -- 172.21.15.131:0/1440568931 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6001b550 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.718+0000 7fcd4effd640 1 -- 172.21.15.131:0/1440568931 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6001b6f0 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.718+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560df91d54b0 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.718+0000 7fcd4effd640 1 -- 172.21.15.131:0/1440568931 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6001b9f0 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.718+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df91d59b0 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.718+0000 7fcd4effd640 1 -- 172.21.15.131:0/1440568931 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce60023020 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fcd4effd640 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd40036900 0x7fcd40038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fcd4effd640 1 -- 172.21.15.131:0/1440568931 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fce60021020 con 0x560df91d40e0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce69813640 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd40036900 0x7fcd40038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce6b50c800 1 Processor -- start 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce69813640 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd40036900 0x7fcd40038dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560df91c3d10 tx=0x7fce64005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce6b50c800 1 -- start start 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce6b50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce6b50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560df91b29d0 con 0x560df91e1420 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce68811640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce68811640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37358/0 (socket says 172.21.15.131:37358) 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.719+0000 7fce68811640 1 -- 172.21.15.131:0/2020247496 learned_addr learned my addr 172.21.15.131:0/2020247496 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce68811640 1 -- 172.21.15.131:0/2020247496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df91e1e10 con 0x560df91e1420 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce68811640 1 --2- 172.21.15.131:0/2020247496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e1840 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fce60041200 tx=0x7fce60041230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7278caafe6a4648a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fcd4cff9640 1 -- 172.21.15.131:0/2020247496 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60024cc0 con 0x560df91e1420 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fcd4cff9640 1 -- 172.21.15.131:0/2020247496 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6004a070 con 0x560df91e1420 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fcd4cff9640 1 -- 172.21.15.131:0/2020247496 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60025410 con 0x560df91e1420 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce6b50c800 1 -- 172.21.15.131:0/2020247496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 msgr2=0x560df91e1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce6b50c800 1 --2- 172.21.15.131:0/2020247496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e1840 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fce60041200 tx=0x7fce60041230 comp rx=0 tx=0).stop 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce6b50c800 1 -- 172.21.15.131:0/2020247496 shutdown_connections 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce6b50c800 1 --2- 172.21.15.131:0/2020247496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e1840 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce6b50c800 1 -- 172.21.15.131:0/2020247496 >> 172.21.15.131:0/2020247496 conn(0x560df91dd780 msgr2=0x560df91db7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce6b50c800 1 -- 172.21.15.131:0/2020247496 shutdown_connections 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.720+0000 7fce6b50c800 1 -- 172.21.15.131:0/2020247496 wait complete. 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce6b50c800 1 Processor -- start 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce6b50c800 1 -- start start 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce6b50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce6b50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560df91e2580 con 0x560df91e1420 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce68811640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce68811640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37366/0 (socket says 172.21.15.131:37366) 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 learned_addr learned my addr 172.21.15.131:0/1229940944 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df91e8fa0 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.721+0000 7fce68811640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e8a60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fce6001bbb0 tx=0x7fce6004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.722+0000 7fcd3effd640 1 -- 172.21.15.131:0/1229940944 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60034070 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.722+0000 7fcd3effd640 1 -- 172.21.15.131:0/1229940944 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60024cc0 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.722+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560df91e9230 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.722+0000 7fcd3effd640 1 -- 172.21.15.131:0/1229940944 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60025410 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.722+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df91e9230 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.722+0000 7fcd3effd640 1 -- 172.21.15.131:0/1229940944 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce60037070 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.722+0000 7fcd3effd640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd34036900 0x7fcd34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.723+0000 7fcd3effd640 1 -- 172.21.15.131:0/1229940944 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fce6003ad40 con 0x560df91e1420 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.723+0000 7fce69813640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd34036900 0x7fcd34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.723+0000 7fce69813640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd34036900 0x7fcd34038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x560df90c0330 tx=0x7fce6401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.723+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.723+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df91f4430 0x560df91f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.723+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f7040 con 0x560df91f4430 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.723+0000 7fce69012640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df91f4430 0x560df91f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce69012640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df91f4430 0x560df91f68f0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 20 realm 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f7450 con 0x560df91f4430 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f7d20 con 0x560df91f4430 2024-04-24T01:44:05.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.724+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f80c0 con 0x560df91f4430 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce6b50c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce6b50c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce6b50c800 20 searching for the correct realm 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560df91fa680 0x560df91fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91fd080 con 0x560df91fa680 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce68811640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560df91fa680 0x560df91fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce68811640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560df91fa680 0x560df91fca70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.725+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce68811640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fce60039070 0x7fce6004b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91fd080 con 0x7fce60039070 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce69813640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fce60039070 0x7fce6004b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce69813640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fce60039070 0x7fce6004b4d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce69813640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fce64031040 0x7fce64032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91fd080 con 0x7fce64031040 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.726+0000 7fce69012640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fce64031040 0x7fce64032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.727+0000 7fce69012640 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fce64031040 0x7fce64032940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.727+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.727+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.727+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.727+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.727+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.727+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce64031040 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce64031040 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce60039070 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.728+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.729+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.729+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce64031040 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.729+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.729+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.729+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.729+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce60039070 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.729+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.730+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.730+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.730+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.730+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.730+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce64031040 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.730+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.730+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.731+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce64031040 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce60039070 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce60039070 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.732+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.733+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.733+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.733+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce64031040 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.733+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.733+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce60039070 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.733+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.733+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91fa680 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce64031040 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x560df91f4430 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560df91f8910 con 0x7fce60039070 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:05.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.734+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f9160 con 0x560df91f4430 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f9550 con 0x560df91f4430 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91f9550 con 0x560df91f4430 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 zone default found 2024-04-24T01:44:05.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 4 Realm: () 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 zonegroup default 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91fd4e0 con 0x7fce60039070 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.735+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91ff260 con 0x560df91fa680 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df91ff600 con 0x560df91fa680 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 20 started sync module instance, tier type = 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.736+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df91fe700 con 0x7fce60039070 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.737+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.737+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94618014182432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df91fe700 con 0x7fce60039070 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.737+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df91fffc0 con 0x560df91f4430 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.738+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94618014182432] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.738+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.738+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94618014186736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df91fe700 con 0x560df91f4430 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.738+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9200a10 con 0x560df91fa680 2024-04-24T01:44:05.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.739+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.740+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94618014188832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92012e0 con 0x560df91fa680 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.740+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9201db0 con 0x7fce60039070 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.740+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94618014186736] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.741+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.741+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94618014179920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92021a0 con 0x7fce60039070 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.741+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9202be0 con 0x560df91f4430 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.741+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94618014188832] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.742+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.742+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94618014197424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9202ba0 con 0x560df91f4430 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.742+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9202ba0 con 0x7fce64031040 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.742+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94618014179920] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.743+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.743+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94618014193776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92035f0 con 0x7fce64031040 2024-04-24T01:44:05.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.743+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9203ff0 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.743+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94618014197424] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.744+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94618014193776] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.744+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.744+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94618014191152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9203140 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.744+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9204680 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94618014191152] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94618014202624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9204680 con 0x7fce64031040 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 20 add_watcher() i=0 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 20 add_watcher() i=1 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 20 add_watcher() i=2 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 20 add_watcher() i=3 2024-04-24T01:44:05.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 20 add_watcher() i=4 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 20 add_watcher() i=5 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.746+0000 7fce6b50c800 20 add_watcher() i=6 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.747+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94618014202624] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.747+0000 7fce6b50c800 20 add_watcher() i=7 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.747+0000 7fce6b50c800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.747+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9207820 con 0x560df91f4430 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.747+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.747+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94618014216752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9204680 con 0x560df91f4430 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.748+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94618014216752] v34'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.748+0000 7fcd1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.748+0000 7fce6b50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.748+0000 7fce6b50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.748+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9206bf0 con 0x560df91f4430 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.749+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.749+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92108e0 con 0x7fce64031040 2024-04-24T01:44:05.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.750+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.750+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92108e0 con 0x560df91fa680 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.751+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.751+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9210c80 con 0x560df91f4430 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.752+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'225 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.752+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9210cc0 con 0x7fce60039070 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.753+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.753+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9211330 con 0x560df91fa680 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.754+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'57 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.754+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9211330 con 0x560df91f4430 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.755+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.755+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9211330 con 0x7fce64031040 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.756+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.756+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9211330 con 0x7fce60039070 2024-04-24T01:44:05.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.757+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.757+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92119a0 con 0x560df91fa680 2024-04-24T01:44:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.758+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.758+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92119a0 con 0x7fce60039070 2024-04-24T01:44:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.759+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'76 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.759+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9211f30 con 0x7fce64031040 2024-04-24T01:44:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.760+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.760+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9211f30 con 0x7fce60039070 2024-04-24T01:44:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.761+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.761+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x7fce64031040 2024-04-24T01:44:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.762+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'65 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.762+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91f4430 2024-04-24T01:44:05.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.763+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'226 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.763+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.764+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.764+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x7fce60039070 2024-04-24T01:44:05.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.765+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'77 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.765+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.766+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.766+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91f4430 2024-04-24T01:44:05.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.767+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.767+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91f4430 2024-04-24T01:44:05.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.768+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'227 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.768+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.770+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.770+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x7fce60039070 2024-04-24T01:44:05.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.771+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.771+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.772+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'35 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.772+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.772+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'46 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.773+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.773+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.773+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.774+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'58 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.774+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x7fce64031040 2024-04-24T01:44:05.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.775+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.775+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.776+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.776+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x7fce64031040 2024-04-24T01:44:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.777+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.778+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x560df91fa680 2024-04-24T01:44:05.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.779+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.779+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x7fce64031040 2024-04-24T01:44:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.780+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'66 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.780+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92123e0 con 0x7fce60039070 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.781+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fcd1e7e4640 20 reqs_thread_entry: start 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 20 Filter name: none 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fcc8ffff640 20 reqs_thread_entry: start 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df923d2a0 con 0x7fce60039070 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.782+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df923fd10 con 0x560df91f4430 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 : miss 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:96 8.14 8:2f2a0974:root::.bucket.meta.myfoo6%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df923fbb0 con 0x560df91fa680 2024-04-24T01:44:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(96 .bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:44:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 info.flags=0x17 2024-04-24T01:44:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 to cache LRU end 2024-04-24T01:44:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:05.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.783+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:97 4.3d 4:bd8fe768:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd0a0 con 0x7fce60039070 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.784+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(97 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.784+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:98 4.1b 4:d99cd558:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd0e0 con 0x7fce60039070 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.784+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(98 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.784+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:99 4.6 4:62a798b5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd0e0 con 0x560df91fa680 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.784+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(99 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.784+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:100 4.35 4:ae924c50:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x560df91f4430 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.785+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(100 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.785+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:101 4.9 4:92145eba:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x560df91f4430 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.785+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(101 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.785+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:102 4.1a 4:59b6e54d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x7fce60039070 2024-04-24T01:44:05.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.785+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(102 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.785+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:103 4.25 4:a4056974:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x560df91fa680 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.785+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(103 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.786+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:104 4.2d 4:b7f2f868:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x7fce64031040 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.786+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(104 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.786+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:105 4.17 4:e81411c7:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x7fce64031040 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.786+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(105 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.786+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:106 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x7fce64031040 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(106 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [call out=289b] v0'0 uv5 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 10 cls_bucket_list_unordered: got thirteen 2024-04-24T01:44:05.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:107 4.3f 4:fcc5bc61:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bd6c0 con 0x7fce60039070 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(107 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 20 get_obj_state: octx=0x7fce5c08a040 obj=myfoo6:thirteen state=0x560df92bb168 s->prefetch_data=0 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:108 3.8s0 3:10dd7976:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bc130 con 0x560df91fa680 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(108 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 10 manifest: total_size = 8 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 20 get_obj_state: setting s->obj_tag to _qtrvrI1mNT-snROomMR7sWuHT3h3zaJ 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 20 get_obj_state: octx=0x7fce5c08a040 obj=myfoo6:thirteen state=0x560df92bb168 s->prefetch_data=0 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 20 prepare_atomic_modification: state is not atomic. state=0x560df92bb168 2024-04-24T01:44:05.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.787+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:109 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92bc9f0 con 0x7fce64031040 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.789+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(109 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.789+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:110 3.8s0 3:10dd7976:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92bc9f0 con 0x560df91fa680 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(110 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92bca90 con 0x7fce64031040 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:112 4.3d 4:bd8fe768:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bca90 con 0x7fce60039070 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:113 4.1b 4:d99cd558:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9248620 con 0x7fce60039070 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:114 4.6 4:62a798b5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df92bca90 con 0x560df91fa680 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:115 4.35 4:ae924c50:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924d490 con 0x560df91f4430 2024-04-24T01:44:05.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:116 4.9 4:92145eba:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9250210 con 0x560df91f4430 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.790+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:117 4.1a 4:59b6e54d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9253060 con 0x7fce60039070 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(115 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:118 4.25 4:a4056974:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9250210 con 0x560df91fa680 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(116 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:119 4.2d 4:b7f2f868:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924dec0 con 0x7fce64031040 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:120 4.17 4:e81411c7:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9253060 con 0x7fce64031040 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(113 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(114 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:121 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9253060 con 0x7fce64031040 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(112 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:122 4.3f 4:fcc5bc61:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9253060 con 0x7fce60039070 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(119 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(120 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(117 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(118 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(111 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fcd3ffff640 20 handle_completion(): completion ok for obj=thirteen 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(122 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(121 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.791+0000 7fce6b50c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9])"; uploads.size()=0; is_truncated=0 2024-04-24T01:44:05.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:123 4.3d 4:bd8fe768:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924d4f0 con 0x7fce60039070 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:124 4.1b 4:d99cd558:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9250210 con 0x7fce60039070 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:125 4.6 4:62a798b5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924ddb0 con 0x560df91fa680 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:126 4.35 4:ae924c50:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924d4f0 con 0x560df91f4430 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:127 4.9 4:92145eba:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9250210 con 0x560df91f4430 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:128 4.1a 4:59b6e54d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9252ec0 con 0x7fce60039070 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:129 4.25 4:a4056974:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924d4f0 con 0x560df91fa680 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:130 4.2d 4:b7f2f868:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9250210 con 0x7fce64031040 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:131 4.17 4:e81411c7:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9252ec0 con 0x7fce64031040 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:132 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9258940 con 0x7fce64031040 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:133 4.3f 4:fcc5bc61:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df925b360 con 0x7fce60039070 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(126 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(125 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce60036030 con 0x560df91fa680 2024-04-24T01:44:05.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(123 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(124 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(127 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== osd_op_reply(129 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce60079060 con 0x560df91fa680 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(130 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(131 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(132 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== osd_op_reply(128 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(133 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.792+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df924f340 con 0x560df91f4430 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.793+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(134 bud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.793+0000 7fce6b50c800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-24T01:44:05.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.793+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.793+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924f340 con 0x560df91f4430 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.794+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.794+0000 7fce6b50c800 20 rados_obj.operate() r=0 bl.length=166 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.794+0000 7fce6b50c800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.794+0000 7fce6b50c800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.794+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9252900 con 0x560df91f4430 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce6b50c800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce6b50c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-24T01:44:05.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94618014525696 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924d8e0 con 0x7fce60039070 2024-04-24T01:44:05.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== watch-notify(notify (1) cookie 94618014179920 notify 146028888090 ret 0) ==== 192+0+0 (crc 0 0 0) 0x560df9206b10 con 0x7fce60039070 2024-04-24T01:44:05.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fcd4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94618014179920 notifier 4751 bl.length()=150 2024-04-24T01:44:05.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fcd4cff9640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcd2c003d60 con 0x7fce60039070 2024-04-24T01:44:05.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(137 notify.3 [notify cookie 94618014525696 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 36 ==== watch-notify(notify_complete (2) cookie 94618014525696 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560df9211d40 con 0x7fce60039070 2024-04-24T01:44:05.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.795+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:139 8.14 8:2f2a0974:root::.bucket.meta.myfoo6%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9252fa0 con 0x560df91fa680 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.796+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(139 .bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fce60079060 con 0x560df91fa680 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.796+0000 7fce6b50c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 from cache 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.796+0000 7fce6b50c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9, ofs0, ns] 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.796+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94618014448416 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df9252fa0 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 37 ==== watch-notify(notify (1) cookie 94618014182432 notify 146028888091 ret 0) ==== 249+0+0 (crc 0 0 0) 0x560df9211d40 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fcd3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94618014182432 notifier 4751 bl.length()=207 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 38 ==== osd_op_reply(140 notify.0 [notify cookie 94618014448416 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fcd3ffff640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcc9c0032c0 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 39 ==== watch-notify(notify_complete (2) cookie 94618014448416 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560df9210c80 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 40 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:142 4.3d 4:bd8fe768:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9252fa0 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:143 4.1b 4:d99cd558:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df924d8e0 con 0x7fce60039070 2024-04-24T01:44:05.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:144 4.6 4:62a798b5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df923def0 con 0x560df91fa680 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:145 4.35 4:ae924c50:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df923e810 con 0x560df91f4430 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:146 4.9 4:92145eba:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9252fa0 con 0x560df91f4430 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:147 4.1a 4:59b6e54d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df924d8e0 con 0x7fce60039070 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:148 4.25 4:a4056974:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df923ebf0 con 0x560df91fa680 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:149 4.2d 4:b7f2f868:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9250680 con 0x7fce64031040 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:150 4.17 4:e81411c7:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df924d8e0 con 0x7fce64031040 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:151 4.37 4:edc4d6ec:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df92514a0 con 0x7fce64031040 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.797+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:152 4.3f 4:fcc5bc61:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9251e50 con 0x7fce60039070 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.798+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(145 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.3 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 41 ==== osd_op_reply(147 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(146 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.4 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 36 ==== osd_op_reply(144 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.2 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce60079060 con 0x560df91fa680 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 42 ==== osd_op_reply(143 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.1 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 43 ==== osd_op_reply(152 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.10 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 37 ==== osd_op_reply(148 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.6 [delete] v34'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce60079060 con 0x560df91fa680 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 44 ==== osd_op_reply(142 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.0 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(151 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.9 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(150 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.8 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(149 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce6b50c800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 : miss 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce6b50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.799+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:153 6.11 6:8af26a5f:::pubsub..bucket.myfoo6%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df924d8e0 con 0x560df91fa680 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.800+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 38 ==== osd_op_reply(153 pubsub..bucket.myfoo6/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fce60079060 con 0x560df91fa680 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.800+0000 7fce6b50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.800+0000 7fce6b50c800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 info.flags=0x0 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.800+0000 7fce6b50c800 10 adding default.rgw.log++pubsub..bucket.myfoo6/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 to cache LRU end 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.800+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:154 6.11 6:8af26a5f:::pubsub..bucket.myfoo6%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df924d8e0 con 0x560df91fa680 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.801+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 39 ==== osd_op_reply(154 pubsub..bucket.myfoo6/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.9 [delete] v34'36 uv30 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fce60079060 con 0x560df91fa680 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.801+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df924d8e0 con 0x560df91f4430 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.802+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(155 bud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.802+0000 7fce6b50c800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.802+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9250680 con 0x560df91f4430 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.802+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.802+0000 7fce6b50c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94618014527216 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df923e850 con 0x7fce64031040 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== watch-notify(notify (1) cookie 94618014193776 notify 146028888100 ret 0) ==== 212+0+0 (crc 0 0 0) 0x560df9206ce0 con 0x7fce64031040 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fcd4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94618014193776 notifier 4751 bl.length()=170 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(157 notify.5 [notify cookie 94618014527216 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fcd4cff9640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcd2c003d60 con 0x7fce64031040 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== watch-notify(notify_complete (2) cookie 94618014527216 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560df9206480 con 0x7fce64031040 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce6b50c800 10 removing email index: 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce6b50c800 10 removing user buckets index 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.803+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df9250680 con 0x560df91f4430 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.804+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(159 bud.buckets [delete] v34'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.804+0000 7fce6b50c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.804+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94618014527216 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df923e850 con 0x7fce64031040 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== watch-notify(notify (1) cookie 94618014191152 notify 146028888101 ret 0) ==== 202+0+0 (crc 0 0 0) 0x560df9206480 con 0x7fce64031040 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fcd4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94618014191152 notifier 4751 bl.length()=160 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== osd_op_reply(160 notify.6 [notify cookie 94618014527216 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fcd4cff9640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcd2c003d60 con 0x7fce64031040 2024-04-24T01:44:05.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== watch-notify(notify_complete (2) cookie 94618014527216 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560df90bff60 con 0x7fce64031040 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fce6b50c800 10 removing user index: bud 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.805+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df923e850 con 0x7fce60039070 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 45 ==== osd_op_reply(162 bud [call,call,delete] v34'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fce6b50c800 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fce6b50c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94618014524048 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560df923e850 con 0x7fce64031040 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== watch-notify(notify (1) cookie 94618014193776 notify 146028888102 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560df90bff60 con 0x7fce64031040 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fcd4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94618014193776 notifier 4751 bl.length()=152 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(163 notify.5 [notify cookie 94618014524048 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.806+0000 7fcd4cff9640 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcd2c003d60 con 0x7fce64031040 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.807+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 46 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.807+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 47 ==== watch-notify(notify_complete (2) cookie 94618014524048 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560df90bf9e0 con 0x7fce64031040 2024-04-24T01:44:05.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.807+0000 7fcd1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:05.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.807+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94618014216752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x560df91f4430 2024-04-24T01:44:05.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.809+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94618014216752] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.809+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94618014182432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x7fce60039070 2024-04-24T01:44:05.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.810+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 46 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94618014182432] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.810+0000 7fce6b50c800 20 remove_watcher() i=0 2024-04-24T01:44:05.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.810+0000 7fce6b50c800 2 removed watcher, disabling cache 2024-04-24T01:44:05.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.810+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94618014186736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x560df91f4430 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.811+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94618014186736] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.811+0000 7fce6b50c800 20 remove_watcher() i=1 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.811+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94618014188832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x560df91fa680 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.812+0000 7fce68811640 1 -- 172.21.15.131:0/1229940944 <== osd.3 v2:172.21.15.131:6800/3849831825 40 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94618014188832] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60079060 con 0x560df91fa680 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.812+0000 7fce6b50c800 20 remove_watcher() i=2 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.812+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94618014179920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x7fce60039070 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.813+0000 7fce69813640 1 -- 172.21.15.131:0/1229940944 <== osd.2 v2:172.21.15.131:6809/3673094383 47 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94618014179920] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6401f070 con 0x7fce60039070 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.813+0000 7fce6b50c800 20 remove_watcher() i=3 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.813+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94618014197424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x560df91f4430 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.814+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94618014197424] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x560df91f4430 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.814+0000 7fce6b50c800 20 remove_watcher() i=4 2024-04-24T01:44:05.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.814+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94618014193776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x7fce64031040 2024-04-24T01:44:05.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.815+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 48 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94618014193776] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.815+0000 7fce6b50c800 20 remove_watcher() i=5 2024-04-24T01:44:05.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.815+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94618014191152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x7fce64031040 2024-04-24T01:44:05.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.816+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 49 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94618014191152] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.816+0000 7fce6b50c800 20 remove_watcher() i=6 2024-04-24T01:44:05.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.816+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94618014202624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560df920cc70 con 0x7fce64031040 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.817+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 <== osd.0 v2:172.21.15.107:6800/2413654117 50 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94618014202624] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce5c009d10 con 0x7fce64031040 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.817+0000 7fce6b50c800 20 remove_watcher() i=7 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fce64031040 msgr2=0x7fce64032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fce64031040 0x7fce64032940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df91f4430 msgr2=0x560df91f68f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df91f4430 0x560df91f68f0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fce60039070 msgr2=0x7fce6004b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fce60039070 0x7fce6004b4d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560df91fa680 msgr2=0x560df91fca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560df91fa680 0x560df91fca70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd34036900 msgr2=0x7fcd34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd34036900 0x7fcd34038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x560df90c0330 tx=0x7fce6401f000 comp rx=0 tx=0).stop 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 msgr2=0x560df91e8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce69012640 1 -- 172.21.15.131:0/1229940944 reap_dead start 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e8a60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fce6001bbb0 tx=0x7fce6004cd90 comp rx=0 tx=0).stop 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 shutdown_connections 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1229940944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91e1420 0x560df91e8a60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 >> 172.21.15.131:0/1229940944 conn(0x560df91dd780 msgr2=0x560df91dade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 shutdown_connections 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1229940944 wait complete. 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd40036900 msgr2=0x7fcd40038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd40036900 0x7fcd40038dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560df91c3d10 tx=0x7fce64005840 comp rx=0 tx=0).stop 2024-04-24T01:44:05.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91d40e0 msgr2=0x560df91d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91d40e0 0x560df91d4500 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fce6000efd0 tx=0x7fce6000d7a0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 shutdown_connections 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd40036900 0x7fcd40038dc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1440568931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df91d40e0 0x560df91d4500 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 >> 172.21.15.131:0/1440568931 conn(0x560df91c8180 msgr2=0x560df91c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 shutdown_connections 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.818+0000 7fce6b50c800 1 -- 172.21.15.131:0/1440568931 wait complete. 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df90c42e0 msgr2=0x560df91c2ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df90c42e0 0x560df91c2ff0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd500369a0 msgr2=0x7fcd50038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd500369a0 0x7fcd50038e60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fce60001d90 tx=0x7fce600012f0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 msgr2=0x560df90c1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c1250 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce5c060040 tx=0x7fce5c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 shutdown_connections 2024-04-24T01:44:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560df90c42e0 0x560df91c2ff0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fcd500369a0 0x7fcd50038e60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 --2- 172.21.15.131:0/1632488481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560df90c19b0 0x560df90c1250 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 >> 172.21.15.131:0/1632488481 conn(0x560df90bb340 msgr2=0x560df91ac260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 shutdown_connections 2024-04-24T01:44:05.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.819+0000 7fce6b50c800 1 -- 172.21.15.131:0/1632488481 wait complete. 2024-04-24T01:44:05.827 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-24T01:44:05.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-24T01:44:05.828 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-24T01:44:05.911 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:05.911 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:05.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.911+0000 7f9b9280f800 1 Processor -- start 2024-04-24T01:44:05.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.911+0000 7f9b9280f800 1 -- start start 2024-04-24T01:44:05.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.911+0000 7f9b9280f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561f892801d0 0x561f892825c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.911+0000 7f9b9280f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f8913bd40 con 0x561f8927bd40 2024-04-24T01:44:05.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.911+0000 7f9b9280f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x561f8910e4d0 con 0x561f892801d0 2024-04-24T01:44:05.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.912+0000 7f9b85620640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561f892801d0 0x561f892825c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.912+0000 7f9b85620640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561f892801d0 0x561f892825c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37368/0 (socket says 172.21.15.131:37368) 2024-04-24T01:44:05.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.912+0000 7f9b8de21640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x561f8927bd40 0x561f8927c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:34808/0 (socket says 172.21.15.131:34808) 2024-04-24T01:44:05.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.912+0000 7f9b85620640 1 -- 172.21.15.131:0/3503203699 learned_addr learned my addr 172.21.15.131:0/3503203699 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.912+0000 7f9b85620640 1 -- 172.21.15.131:0/3503203699 >> v1:172.21.15.107:6789/0 conn(0x561f8927bd40 legacy=0x561f8927c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.912+0000 7f9b8d620640 1 -- 172.21.15.131:0/3503203699 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781480665 0 0) 0x561f8913bd40 con 0x561f8927bd40 2024-04-24T01:44:05.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.912+0000 7f9b85620640 1 -- 172.21.15.131:0/3503203699 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8913a590 con 0x561f892801d0 2024-04-24T01:44:05.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.914+0000 7f9b85620640 1 --2- 172.21.15.131:0/3503203699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f892801d0 0x561f892825c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800a520 tx=0x7f9b7801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944041503c017662 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.914+0000 7f9b8d620640 1 -- 172.21.15.131:0/3503203699 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b78057070 con 0x561f892801d0 2024-04-24T01:44:05.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.914+0000 7f9b8d620640 1 -- 172.21.15.131:0/3503203699 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b78052570 con 0x561f892801d0 2024-04-24T01:44:05.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.914+0000 7f9b8d620640 1 -- 172.21.15.131:0/3503203699 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7804ae60 con 0x561f892801d0 2024-04-24T01:44:05.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.915+0000 7f9b9280f800 1 -- 172.21.15.131:0/3503203699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f892801d0 msgr2=0x561f892825c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.915+0000 7f9b9280f800 1 --2- 172.21.15.131:0/3503203699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f892801d0 0x561f892825c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800a520 tx=0x7f9b7801d010 comp rx=0 tx=0).stop 2024-04-24T01:44:05.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.915+0000 7f9b9280f800 1 -- 172.21.15.131:0/3503203699 shutdown_connections 2024-04-24T01:44:05.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.915+0000 7f9b9280f800 1 --2- 172.21.15.131:0/3503203699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f892801d0 0x561f892825c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.915+0000 7f9b9280f800 1 -- 172.21.15.131:0/3503203699 >> 172.21.15.131:0/3503203699 conn(0x561f892773a0 msgr2=0x561f892797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.915+0000 7f9b9280f800 1 -- 172.21.15.131:0/3503203699 shutdown_connections 2024-04-24T01:44:05.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.915+0000 7f9b9280f800 1 -- 172.21.15.131:0/3503203699 wait complete. 2024-04-24T01:44:05.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.926+0000 7f9b9280f800 1 Processor -- start 2024-04-24T01:44:05.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.926+0000 7f9b9280f800 1 -- start start 2024-04-24T01:44:05.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.926+0000 7f9b9280f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f8936ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.927+0000 7f9b9280f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561f891c83b0 con 0x561f8927bd40 2024-04-24T01:44:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.927+0000 7f9b8de21640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f8936ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.927+0000 7f9b8de21640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f8936ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37374/0 (socket says 172.21.15.131:37374) 2024-04-24T01:44:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.927+0000 7f9b8de21640 1 -- 172.21.15.131:0/1353909708 learned_addr learned my addr 172.21.15.131:0/1353909708 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.927+0000 7f9b8de21640 1 -- 172.21.15.131:0/1353909708 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8936d3f0 con 0x561f8927bd40 2024-04-24T01:44:05.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.927+0000 7f9b8de21640 1 --2- 172.21.15.131:0/1353909708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f8936ce20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000b240 tx=0x7f9b8000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581c1899d8b74b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9a7be07640 1 -- 172.21.15.131:0/1353909708 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80008070 con 0x561f8927bd40 2024-04-24T01:44:05.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9a7be07640 1 -- 172.21.15.131:0/1353909708 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8000d500 con 0x561f8927bd40 2024-04-24T01:44:05.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9a7be07640 1 -- 172.21.15.131:0/1353909708 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8000d860 con 0x561f8927bd40 2024-04-24T01:44:05.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9b9280f800 1 -- 172.21.15.131:0/1353909708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 msgr2=0x561f8936ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1353909708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f8936ce20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000b240 tx=0x7f9b8000b700 comp rx=0 tx=0).stop 2024-04-24T01:44:05.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9b9280f800 1 -- 172.21.15.131:0/1353909708 shutdown_connections 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1353909708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f8936ce20 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9b9280f800 1 -- 172.21.15.131:0/1353909708 >> 172.21.15.131:0/1353909708 conn(0x561f892773a0 msgr2=0x561f89368740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9b9280f800 1 -- 172.21.15.131:0/1353909708 shutdown_connections 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.928+0000 7f9b9280f800 1 -- 172.21.15.131:0/1353909708 wait complete. 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b9280f800 1 Processor -- start 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b9280f800 1 -- start start 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b9280f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f891f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b9280f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561f89282e90 con 0x561f8927bd40 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b8de21640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f891f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b8de21640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f891f0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37388/0 (socket says 172.21.15.131:37388) 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b8de21640 1 -- 172.21.15.131:0/1819103550 learned_addr learned my addr 172.21.15.131:0/1819103550 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b8de21640 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f89376510 con 0x561f8927bd40 2024-04-24T01:44:05.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9b8de21640 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f891f0050 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x561f8936dbb0 tx=0x7f9b80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.929+0000 7f9a7a604640 1 -- 172.21.15.131:0/1819103550 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80019870 con 0x561f8927bd40 2024-04-24T01:44:05.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.930+0000 7f9a7a604640 1 -- 172.21.15.131:0/1819103550 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b80019a10 con 0x561f8927bd40 2024-04-24T01:44:05.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.930+0000 7f9a7a604640 1 -- 172.21.15.131:0/1819103550 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80019d30 con 0x561f8927bd40 2024-04-24T01:44:05.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.930+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f8937ab20 con 0x561f8927bd40 2024-04-24T01:44:05.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.930+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8937b040 con 0x561f8927bd40 2024-04-24T01:44:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.930+0000 7f9a7a604640 1 -- 172.21.15.131:0/1819103550 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9b80017040 con 0x561f8927bd40 2024-04-24T01:44:05.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.930+0000 7f9a7a604640 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a740369a0 0x7f9a74038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9a7a604640 1 -- 172.21.15.131:0/1819103550 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9b80015020 con 0x561f8927bd40 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b85620640 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a740369a0 0x7f9a74038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f892801d0 0x561f8937eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8937f490 con 0x561f892801d0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b8e622640 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f892801d0 0x561f8937eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b85620640 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a740369a0 0x7f9a74038e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b78054000 tx=0x7f9b7804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b8e622640 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f892801d0 0x561f8937eea0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b8e622640 1 -- 172.21.15.131:0/1819103550 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8800a4a0 con 0x561f892801d0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.931+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8937c430 con 0x561f892801d0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.932+0000 7f9b8e622640 1 -- 172.21.15.131:0/1819103550 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b8800a4a0 con 0x561f892801d0 2024-04-24T01:44:05.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.932+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893812a0 con 0x561f892801d0 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.932+0000 7f9b8e622640 1 -- 172.21.15.131:0/1819103550 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b8800a4a0 con 0x561f892801d0 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.932+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893805e0 con 0x561f892801d0 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.932+0000 7f9b8e622640 1 -- 172.21.15.131:0/1819103550 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b8800a4a0 con 0x561f892801d0 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.932+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89380a30 con 0x561f892801d0 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b8e622640 1 -- 172.21.15.131:0/1819103550 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b8800a4a0 con 0x561f892801d0 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b9280f800 1 Processor -- start 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b9280f800 1 -- start start 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b9280f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f89390070 0x561f89390490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b9280f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561f8916e6b0 con 0x561f89390070 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b85620640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f89390070 0x561f89390490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b85620640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f89390070 0x561f89390490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37396/0 (socket says 172.21.15.131:37396) 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b85620640 1 -- 172.21.15.131:0/579970997 learned_addr learned my addr 172.21.15.131:0/579970997 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.933+0000 7f9b85620640 1 -- 172.21.15.131:0/579970997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f893909d0 con 0x561f89390070 2024-04-24T01:44:05.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.934+0000 7f9b85620640 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f89390070 0x561f89390490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9b78005930 tx=0x7f9b78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.934+0000 7f9a737fe640 1 -- 172.21.15.131:0/579970997 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b78057040 con 0x561f89390070 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.934+0000 7f9a737fe640 1 -- 172.21.15.131:0/579970997 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7805d650 con 0x561f89390070 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.934+0000 7f9a737fe640 1 -- 172.21.15.131:0/579970997 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7805d950 con 0x561f89390070 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.934+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f89391440 con 0x561f89390070 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.934+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f893918e0 con 0x561f89390070 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9a737fe640 1 -- 172.21.15.131:0/579970997 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9b78067070 con 0x561f89390070 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9a737fe640 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a68036900 0x7f9a68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9a737fe640 1 -- 172.21.15.131:0/579970997 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9b7808f6e0 con 0x561f89390070 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9b8e622640 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a68036900 0x7f9a68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9b9280f800 1 Processor -- start 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9b8e622640 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a68036900 0x7f9a68038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561f89380100 tx=0x7f9b88005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9b9280f800 1 -- start start 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9b9280f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f8939d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.935+0000 7f9b9280f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561f8936d770 con 0x561f8939d2b0 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9b85620640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f8939d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9b85620640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f8939d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37408/0 (socket says 172.21.15.131:37408) 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9b85620640 1 -- 172.21.15.131:0/2783899720 learned_addr learned my addr 172.21.15.131:0/2783899720 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9b85620640 1 -- 172.21.15.131:0/2783899720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8939dca0 con 0x561f8939d2b0 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9b85620640 1 --2- 172.21.15.131:0/2783899720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f8939d6d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9b7808da40 tx=0x7f9b7805df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8405992b073ee46 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9a717fa640 1 -- 172.21.15.131:0/2783899720 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b78082070 con 0x561f8939d2b0 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9a717fa640 1 -- 172.21.15.131:0/2783899720 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b78067360 con 0x561f8939d2b0 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.936+0000 7f9a717fa640 1 -- 172.21.15.131:0/2783899720 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7808b070 con 0x561f8939d2b0 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 -- 172.21.15.131:0/2783899720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 msgr2=0x561f8939d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 --2- 172.21.15.131:0/2783899720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f8939d6d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9b7808da40 tx=0x7f9b7805df50 comp rx=0 tx=0).stop 2024-04-24T01:44:05.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 -- 172.21.15.131:0/2783899720 shutdown_connections 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 --2- 172.21.15.131:0/2783899720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f8939d6d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 -- 172.21.15.131:0/2783899720 >> 172.21.15.131:0/2783899720 conn(0x561f89399610 msgr2=0x561f89397670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 -- 172.21.15.131:0/2783899720 shutdown_connections 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 -- 172.21.15.131:0/2783899720 wait complete. 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 Processor -- start 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 -- start start 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f893a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b9280f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561f8939e410 con 0x561f8939d2b0 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b85620640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f893a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b85620640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f893a4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:37410/0 (socket says 172.21.15.131:37410) 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 learned_addr learned my addr 172.21.15.131:0/4276449427 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.937+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f893a4eb0 con 0x561f8939d2b0 2024-04-24T01:44:05.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.938+0000 7f9b85620640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f893a4970 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9b78067b80 tx=0x7f9b7808d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.938+0000 7f9a5f7fe640 1 -- 172.21.15.131:0/4276449427 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b78093070 con 0x561f8939d2b0 2024-04-24T01:44:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.938+0000 7f9a5f7fe640 1 -- 172.21.15.131:0/4276449427 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b78083040 con 0x561f8939d2b0 2024-04-24T01:44:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.938+0000 7f9a5f7fe640 1 -- 172.21.15.131:0/4276449427 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b78082070 con 0x561f8939d2b0 2024-04-24T01:44:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.938+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f893a5140 con 0x561f8939d2b0 2024-04-24T01:44:05.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.938+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f893a7df0 con 0x561f8939d2b0 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.938+0000 7f9a5f7fe640 1 -- 172.21.15.131:0/4276449427 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9b78096070 con 0x561f8939d2b0 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9a5f7fe640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a58036900 0x7f9a58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9a5f7fe640 1 -- 172.21.15.131:0/4276449427 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9b78099d40 con 0x561f8939d2b0 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9b8e622640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a58036900 0x7f9a58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9b8e622640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a58036900 0x7f9a58038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x561f8937c380 tx=0x7f9b8801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f893b0450 0x561f893b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b3060 con 0x561f893b0450 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.939+0000 7f9b8de21640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f893b0450 0x561f893b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b8de21640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f893b0450 0x561f893b2910 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 20 realm 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b3470 con 0x561f893b0450 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b3d40 con 0x561f893b0450 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.940+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b40e0 con 0x561f893b0450 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b9280f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b4930 con 0x561f893b0450 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b9280f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b9280f800 20 searching for the correct realm 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561f893b66a0 0x561f893b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x561f893b66a0 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b85620640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561f893b66a0 0x561f893b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.941+0000 7f9b85620640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561f893b66a0 0x561f893b8a90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b85620640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f9b78098070 0x7f9b78070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x7f9b78098070 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b8e622640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f9b78098070 0x7f9b78070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b8e622640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f9b78098070 0x7f9b78070580 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8801f070 con 0x7f9b78098070 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b8e622640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9b88031040 0x7f9b88032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x7f9b88031040 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.942+0000 7f9b8de21640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9b88031040 0x7f9b88032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.943+0000 7f9b8de21640 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9b88031040 0x7f9b88032940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.943+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.943+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x561f893b0450 2024-04-24T01:44:05.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.943+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.943+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x561f893b0450 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x7f9b88031040 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x7f9b88031040 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x7f9b78098070 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8801f070 con 0x7f9b78098070 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.944+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x561f893b66a0 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x561f893b0450 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561f893b90a0 con 0x7f9b88031040 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b0450 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.945+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b78098070 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.946+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b8801f070 con 0x7f9b78098070 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.946+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b66a0 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.946+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.946+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b66a0 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.946+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.946+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b88031040 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b66a0 2024-04-24T01:44:05.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b66a0 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b0450 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b0450 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.947+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b88031040 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.948+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.948+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b66a0 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.948+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.948+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b78098070 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.948+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8801f070 con 0x7f9b78098070 2024-04-24T01:44:05.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.948+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b0450 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b78098070 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8801f070 con 0x7f9b78098070 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b66a0 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b88031040 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.949+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b78098070 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8801f070 con 0x7f9b78098070 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b66a0 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b88031040 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x561f893b0450 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.950+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9b8003c040 con 0x7f9b78098070 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b52e0 con 0x561f893b0450 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b5b80 con 0x561f893b0450 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b5b80 con 0x561f893b0450 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.951+0000 7f9b9280f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 zone default found 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 4 Realm: () 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:05.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 zonegroup default 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893b9520 con 0x7f9b78098070 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893bb750 con 0x561f893b66a0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893bbaf0 con 0x561f893b66a0 2024-04-24T01:44:05.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 started sync module instance, tier type = 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.952+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bab90 con 0x7f9b78098070 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.953+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.953+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94693446365104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bab90 con 0x7f9b78098070 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.953+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bc340 con 0x561f893b0450 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.954+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94693446365104] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.955+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.955+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94693446369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bab90 con 0x561f893b0450 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.955+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bcd50 con 0x561f893b66a0 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.956+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94693446369392] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.956+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.956+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94693446371488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bd0f0 con 0x561f893b66a0 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.956+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bdb20 con 0x7f9b78098070 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.957+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.957+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94693446374960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893be3f0 con 0x7f9b78098070 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.957+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893beee0 con 0x561f893b0450 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.957+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94693446371488] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.958+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94693446374960] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.958+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.958+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94693446379952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bdf40 con 0x561f893b0450 2024-04-24T01:44:05.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.958+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bf780 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.959+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.959+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94693446382032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bfaa0 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.959+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893c0330 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.959+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94693446379952] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.960+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94693446382032] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.960+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.960+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94693446362848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893bfaa0 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.960+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893c09c0 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94693446362848] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94693446383088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893c09c0 con 0x7f9b88031040 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 20 add_watcher() i=0 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 20 add_watcher() i=1 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 20 add_watcher() i=2 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 20 add_watcher() i=3 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 20 add_watcher() i=4 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 20 add_watcher() i=5 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.961+0000 7f9b9280f800 20 add_watcher() i=6 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.962+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94693446383088] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.962+0000 7f9b9280f800 20 add_watcher() i=7 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.962+0000 7f9b9280f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.962+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893c3b30 con 0x561f893b0450 2024-04-24T01:44:05.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.962+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.962+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94693446386960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893c0de0 con 0x561f893b0450 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.963+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94693446386960] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.964+0000 7f9a3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.964+0000 7f9b9280f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.964+0000 7f9b9280f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.964+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893cc510 con 0x561f893b0450 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.965+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.965+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ccb60 con 0x7f9b88031040 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.966+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.966+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ccb60 con 0x561f893b66a0 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.967+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.967+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ccfa0 con 0x561f893b0450 2024-04-24T01:44:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.968+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'230 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.968+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ccff0 con 0x7f9b78098070 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.969+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'78 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.969+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893cd640 con 0x561f893b66a0 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.970+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'59 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.970+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893cd9e0 con 0x561f893b0450 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.972+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.972+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893cdb10 con 0x7f9b88031040 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.973+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.973+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893cdb10 con 0x7f9b78098070 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.974+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.974+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ce180 con 0x561f893b66a0 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.975+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.975+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ce180 con 0x7f9b78098070 2024-04-24T01:44:05.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.976+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'79 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.976+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ce6f0 con 0x7f9b88031040 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.977+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.977+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ce6f0 con 0x7f9b78098070 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.978+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.978+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x7f9b88031040 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.979+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.979+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b0450 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.980+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'231 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.980+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.981+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.981+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x7f9b78098070 2024-04-24T01:44:05.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.982+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'80 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.982+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.983+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.983+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b0450 2024-04-24T01:44:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.984+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.984+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b0450 2024-04-24T01:44:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.985+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'232 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:05.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.985+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.986+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.986+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x7f9b78098070 2024-04-24T01:44:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.987+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.987+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.988+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'37 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.988+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.989+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'47 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.989+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.990+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.990+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.991+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'60 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.991+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x7f9b88031040 2024-04-24T01:44:05.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.992+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.992+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.993+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.993+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x7f9b88031040 2024-04-24T01:44:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.994+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.995+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x561f893b66a0 2024-04-24T01:44:05.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.995+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:05.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.995+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x7f9b88031040 2024-04-24T01:44:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.996+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'68 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:05.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.996+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f893ceba0 con 0x7f9b78098070 2024-04-24T01:44:05.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.997+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.998+0000 7f9a3e7fc640 20 reqs_thread_entry: start 2024-04-24T01:44:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.998+0000 7f9b9280f800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.998+0000 7f9b9280f800 20 Filter name: none 2024-04-24T01:44:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.998+0000 7f99affff640 20 reqs_thread_entry: start 2024-04-24T01:44:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.998+0000 7f9b9280f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:44:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.998+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:05.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.998+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893f99e0 con 0x7f9b88031040 2024-04-24T01:44:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:44:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:44:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:44:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:06.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893fc2a0 con 0x7f9b88031040 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 : miss 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:96 8.c 8:33b48d29:root::.bucket.meta.myfoo7%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f893fc120 con 0x561f893b0450 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:05.999+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(96 .bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 20 rados_obj.operate() r=0 bl.length=382 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 info.flags=0x17 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 to cache LRU end 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 2024-04-24T01:44:06.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:97 4.a 4:52070c16:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f894795c0 con 0x7f9b78098070 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(97 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 4.2f 4:f7f6149c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479600 con 0x561f893b0450 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(98 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.000+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 4.9 4:9068dd9a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479640 con 0x561f893b0450 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.001+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(99 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.001+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:100 4.6 4:604f0c39:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479640 con 0x561f893b66a0 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.001+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(100 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.001+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:101 4.15 4:aab2fcfd:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479640 con 0x561f893b66a0 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.001+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(101 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.001+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:102 4.11 4:881c69f5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479640 con 0x7f9b88031040 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.002+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(102 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5 [call out=377b] v0'0 uv15 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7f9b8002d070 con 0x7f9b88031040 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.002+0000 7f9b9280f800 10 cls_bucket_list_unordered: got fourteen 2024-04-24T01:44:06.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.002+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 4.2c 4:36063aca:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479c50 con 0x561f893b0450 2024-04-24T01:44:06.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.002+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(103 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:06.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.002+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 4.e 4:72b93eac:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479c50 con 0x7f9b78098070 2024-04-24T01:44:06.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.002+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(104 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:06.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 4.2c 4:3604e111:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479c50 con 0x561f893b0450 2024-04-24T01:44:06.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(105 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:06.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:106 4.2f 4:f4722be6:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479c50 con 0x561f893b0450 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(106 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:107 4.38 4:1e5cf064:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479c00 con 0x561f893b0450 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(107 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f9b8002d070 con 0x561f893b0450 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b9280f800 20 get_obj_state: octx=0x7f9b8000fd10 obj=myfoo7:fourteen state=0x561f89477858 s->prefetch_data=0 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.003+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:108 3.27s0 3:e7e81904:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89478830 con 0x7f9b88031040 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.004+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(108 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.004+0000 7f9b9280f800 10 manifest: total_size = 8 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.004+0000 7f9b9280f800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7287226628390158989 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.004+0000 7f9b9280f800 20 get_obj_state: octx=0x7f9b8000fd10 obj=myfoo7:fourteen state=0x561f89477858 s->prefetch_data=0 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.004+0000 7f9b9280f800 20 prepare_atomic_modification: state is not atomic. state=0x561f89477858 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.004+0000 7f9b9280f800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5 2024-04-24T01:44:06.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.004+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:109 4.11 4:881c69f5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f894790c0 con 0x7f9b88031040 2024-04-24T01:44:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.005+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(109 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5 [stat,call,call] v34'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.005+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:110 3.27s0 3:e7e81904:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f894790c0 con 0x7f9b88031040 2024-04-24T01:44:06.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(110 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 4.11 4:881c69f5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f89479030 con 0x7f9b88031040 2024-04-24T01:44:06.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:44:06.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:112 4.a 4:52070c16:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479030 con 0x7f9b78098070 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:113 4.2f 4:f7f6149c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89404bb0 con 0x561f893b0450 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:114 4.9 4:9068dd9a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479030 con 0x561f893b0450 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:115 4.6 4:604f0c39:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89479030 con 0x561f893b66a0 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:116 4.15 4:aab2fcfd:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c0c0 con 0x561f893b66a0 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:117 4.11 4:881c69f5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940eee0 con 0x7f9b88031040 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:118 4.2c 4:36063aca:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89411d30 con 0x561f893b0450 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:119 4.e 4:72b93eac:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89414b90 con 0x7f9b78098070 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:120 4.2c 4:3604e111:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89414b90 con 0x561f893b0450 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:121 4.2f 4:f4722be6:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89419f30 con 0x561f893b0450 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:122 4.38 4:1e5cf064:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8941cd60 con 0x561f893b0450 2024-04-24T01:44:06.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(115 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.007+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(116 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(112 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(113 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(114 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(118 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(121 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(119 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(120 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(122 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(111 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5 [stat,call,call] v34'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9a717fa640 20 handle_completion(): completion ok for obj=fourteen 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(117 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10])"; uploads.size()=0; is_truncated=0 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:123 4.a 4:52070c16:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c0c0 con 0x7f9b78098070 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:124 4.2f 4:f7f6149c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940eee0 con 0x561f893b0450 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:125 4.9 4:9068dd9a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89414b10 con 0x561f893b0450 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:126 4.6 4:604f0c39:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c0c0 con 0x561f893b66a0 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:127 4.15 4:aab2fcfd:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940eee0 con 0x561f893b66a0 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:128 4.11 4:881c69f5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89414b10 con 0x7f9b88031040 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:129 4.2c 4:36063aca:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c0c0 con 0x561f893b0450 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:130 4.e 4:72b93eac:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c0c0 con 0x7f9b78098070 2024-04-24T01:44:06.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.008+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(123 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0 [call out=85b] v0'0 uv15 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(128 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:131 4.2c 4:3604e111:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c0c0 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:132 4.2f 4:f4722be6:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c0c0 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:133 4.38 4:1e5cf064:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89414af0 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(126 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b7809f070 con 0x561f893b66a0 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(130 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b88040040 con 0x7f9b78098070 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(127 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b780be060 con 0x561f893b66a0 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(124 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(125 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(129 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(131 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(132 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 47 ==== osd_op_reply(133 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.009+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f89414ad0 con 0x7f9b88031040 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.010+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(134 fud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.010+0000 7f9b9280f800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.010+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.010+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89414ad0 con 0x7f9b78098070 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.011+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.011+0000 7f9b9280f800 20 rados_obj.operate() r=0 bl.length=168 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.011+0000 7f9b9280f800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.011+0000 7f9b9280f800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.011+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f89414380 con 0x7f9b78098070 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9b9280f800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9b9280f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-24T01:44:06.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94693446732000 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f89414380 con 0x7f9b78098070 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== watch-notify(notify (1) cookie 94693446374960 notify 146028888092 ret 0) ==== 192+0+0 (crc 0 0 0) 0x561f893cbe80 con 0x7f9b78098070 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9a717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94693446374960 notifier 4758 bl.length()=150 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(137 notify.3 [notify cookie 94693446732000 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9a717fa640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9a50003d60 con 0x7f9b78098070 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.012+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.013+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== watch-notify(notify_complete (2) cookie 94693446732000 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561f893ce520 con 0x7f9b78098070 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.013+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:139 8.c 8:33b48d29:root::.bucket.meta.myfoo7%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940e740 con 0x561f893b0450 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 48 ==== osd_op_reply(139 .bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 [call,call,delete] v34'5 uv5 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 from cache 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10, ofs0, ns] 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94693446631568 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940e740 con 0x561f893b0450 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 49 ==== watch-notify(notify (1) cookie 94693446369392 notify 146028888085 ret 0) ==== 250+0+0 (crc 0 0 0) 0x561f893fb640 con 0x561f893b0450 2024-04-24T01:44:06.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9a717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94693446369392 notifier 4758 bl.length()=208 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 50 ==== osd_op_reply(140 notify.1 [notify cookie 94693446631568 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9a717fa640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9a50003d60 con 0x561f893b0450 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 51 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 52 ==== watch-notify(notify_complete (2) cookie 94693446631568 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561f893caca0 con 0x561f893b0450 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:142 4.a 4:52070c16:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940e740 con 0x7f9b78098070 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:143 4.2f 4:f7f6149c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f89411500 con 0x561f893b0450 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:144 4.9 4:9068dd9a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c530 con 0x561f893b0450 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:145 4.6 4:604f0c39:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940ce40 con 0x561f893b66a0 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:146 4.15 4:aab2fcfd:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940e740 con 0x561f893b66a0 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:147 4.11 4:881c69f5:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f89411500 con 0x7f9b88031040 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:148 4.2c 4:36063aca:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c530 con 0x561f893b0450 2024-04-24T01:44:06.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:149 4.e 4:72b93eac:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940eae0 con 0x7f9b78098070 2024-04-24T01:44:06.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:150 4.2c 4:3604e111:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940eae0 con 0x561f893b0450 2024-04-24T01:44:06.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:151 4.2f 4:f4722be6:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x561f893b0450 2024-04-24T01:44:06.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.014+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:152 4.38 4:1e5cf064:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940dfa0 con 0x561f893b0450 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.016+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 53 ==== osd_op_reply(144 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.2 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.016+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(145 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.3 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b780be060 con 0x561f893b66a0 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.016+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 54 ==== osd_op_reply(148 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.6 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.016+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 55 ==== osd_op_reply(143 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.1 [delete] v34'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.016+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 56 ==== osd_op_reply(152 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.10 [delete] v34'4 uv4 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.016+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(142 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.0 [delete] v34'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.018+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 57 ==== osd_op_reply(150 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.8 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 58 ==== osd_op_reply(151 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.9 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== osd_op_reply(149 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.7 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(147 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.5 [delete] v34'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(146 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10.4 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b780be060 con 0x561f893b66a0 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b9280f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 : miss 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b9280f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:153 6.1 6:81aac69b:::pubsub..bucket.myfoo7%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c530 con 0x561f893b0450 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 59 ==== osd_op_reply(153 pubsub..bucket.myfoo7/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b9280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b9280f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 info.flags=0x0 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b9280f800 10 adding default.rgw.log++pubsub..bucket.myfoo7/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 to cache LRU end 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.019+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:154 6.1 6:81aac69b:::pubsub..bucket.myfoo7%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x561f893b0450 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.020+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 60 ==== osd_op_reply(154 pubsub..bucket.myfoo7/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.10 [delete] v34'22 uv20 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.020+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940c530 con 0x7f9b88031040 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.022+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(155 fud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.022+0000 7f9b9280f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.022+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b9280f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94693446631568 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x561f893b66a0 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== watch-notify(notify (1) cookie 94693446371488 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x561f893cdb60 con 0x561f893b66a0 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9a717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94693446371488 notifier 4758 bl.length()=170 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9a717fa640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9a50003d60 con 0x561f893b66a0 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(157 notify.2 [notify cookie 94693446631568 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b780be060 con 0x561f893b66a0 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 36 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b780be060 con 0x561f893b66a0 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 37 ==== watch-notify(notify_complete (2) cookie 94693446631568 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561f893a4eb0 con 0x561f893b66a0 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b9280f800 10 removing email index: 2024-04-24T01:44:06.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b9280f800 10 removing user buckets index 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.023+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.024+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(159 fud.buckets [delete] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.024+0000 7f9b9280f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.024+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94693446731904 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== watch-notify(notify (1) cookie 94693446362848 notify 146028888103 ret 0) ==== 202+0+0 (crc 0 0 0) 0x561f893caca0 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9a70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94693446362848 notifier 4758 bl.length()=160 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(160 notify.6 [notify cookie 94693446731904 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9a70ff9640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f99b80032c0 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== watch-notify(notify_complete (2) cookie 94693446731904 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9b80037040 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9b9280f800 10 removing user index: fud 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.025+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(162 fud [call,call,delete] v34'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9b9280f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9b9280f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94693446731904 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== watch-notify(notify (1) cookie 94693446382032 notify 146028888104 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b80037040 con 0x7f9b88031040 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9a70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94693446382032 notifier 4758 bl.length()=152 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== osd_op_reply(163 notify.5 [notify cookie 94693446731904 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.026+0000 7f9a70ff9640 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f99b80032a0 con 0x7f9b88031040 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.027+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== watch-notify(notify_complete (2) cookie 94693446731904 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561f8937b040 con 0x7f9b88031040 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.027+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.027+0000 7f9a3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:06.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.027+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94693446386960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x561f893b0450 2024-04-24T01:44:06.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.028+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 61 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94693446386960] v34'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.028+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94693446365104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b78098070 2024-04-24T01:44:06.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.029+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94693446365104] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.029+0000 7f9b9280f800 20 remove_watcher() i=0 2024-04-24T01:44:06.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.029+0000 7f9b9280f800 2 removed watcher, disabling cache 2024-04-24T01:44:06.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.029+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94693446369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x561f893b0450 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.030+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 62 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94693446369392] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.030+0000 7f9b9280f800 20 remove_watcher() i=1 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.030+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94693446371488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x561f893b66a0 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.031+0000 7f9b85620640 1 -- 172.21.15.131:0/4276449427 <== osd.3 v2:172.21.15.131:6800/3849831825 38 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94693446371488] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b780be060 con 0x561f893b66a0 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.032+0000 7f9b9280f800 20 remove_watcher() i=2 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.032+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94693446374960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b78098070 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.032+0000 7f9b8e622640 1 -- 172.21.15.131:0/4276449427 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94693446374960] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8804a040 con 0x7f9b78098070 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.032+0000 7f9b9280f800 20 remove_watcher() i=3 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.032+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94693446379952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x561f893b0450 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.034+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.1 v2:172.21.15.131:6808/2417718615 63 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94693446379952] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x561f893b0450 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.034+0000 7f9b9280f800 20 remove_watcher() i=4 2024-04-24T01:44:06.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.034+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94693446382032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.035+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94693446382032] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.035+0000 7f9b9280f800 20 remove_watcher() i=5 2024-04-24T01:44:06.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.035+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94693446362848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.036+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 46 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94693446362848] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.036+0000 7f9b9280f800 20 remove_watcher() i=6 2024-04-24T01:44:06.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.036+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94693446383088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561f8940d650 con 0x7f9b88031040 2024-04-24T01:44:06.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.036+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 <== osd.0 v2:172.21.15.107:6800/2413654117 47 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94693446383088] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b80068370 con 0x7f9b88031040 2024-04-24T01:44:06.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 20 remove_watcher() i=7 2024-04-24T01:44:06.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9b88031040 msgr2=0x7f9b88032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9b88031040 0x7f9b88032940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f893b0450 msgr2=0x561f893b2910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f893b0450 0x561f893b2910 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f9b78098070 msgr2=0x7f9b78070580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f9b78098070 0x7f9b78070580 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561f893b66a0 msgr2=0x561f893b8a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x561f893b66a0 0x561f893b8a90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a58036900 msgr2=0x7f9a58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a58036900 0x7f9a58038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x561f8937c380 tx=0x7f9b8801f000 comp rx=0 tx=0).stop 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b8de21640 1 -- 172.21.15.131:0/4276449427 reap_dead start 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 msgr2=0x561f893a4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f893a4970 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9b78067b80 tx=0x7f9b7808d9d0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 shutdown_connections 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/4276449427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8939d2b0 0x561f893a4970 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 >> 172.21.15.131:0/4276449427 conn(0x561f89399610 msgr2=0x561f89396c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:06.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 shutdown_connections 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/4276449427 wait complete. 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a68036900 msgr2=0x7f9a68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a68036900 0x7f9a68038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561f89380100 tx=0x7f9b88005840 comp rx=0 tx=0).stop 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f89390070 msgr2=0x561f89390490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f89390070 0x561f89390490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9b78005930 tx=0x7f9b78002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 shutdown_connections 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a68036900 0x7f9a68038dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 --2- 172.21.15.131:0/579970997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f89390070 0x561f89390490 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 >> 172.21.15.131:0/579970997 conn(0x561f89384110 msgr2=0x561f89384510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 shutdown_connections 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.037+0000 7f9b9280f800 1 -- 172.21.15.131:0/579970997 wait complete. 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f892801d0 msgr2=0x561f8937eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f892801d0 0x561f8937eea0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a740369a0 msgr2=0x7f9a74038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a740369a0 0x7f9a74038e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b78054000 tx=0x7f9b7804e000 comp rx=0 tx=0).stop 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 msgr2=0x561f891f0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f891f0050 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x561f8936dbb0 tx=0x7f9b80000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 shutdown_connections 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x561f892801d0 0x561f8937eea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9a740369a0 0x7f9a74038e60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 --2- 172.21.15.131:0/1819103550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f8927bd40 0x561f891f0050 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 >> 172.21.15.131:0/1819103550 conn(0x561f892773a0 msgr2=0x561f89367000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 shutdown_connections 2024-04-24T01:44:06.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:06.038+0000 7f9b9280f800 1 -- 172.21.15.131:0/1819103550 wait complete. 2024-04-24T01:44:46.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-24T01:44:46.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-24T01:44:46.049 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-24T01:44:46.099 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:46.100 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:46.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c6521800 1 Processor -- start 2024-04-24T01:44:46.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c6521800 1 -- start start 2024-04-24T01:44:46.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c6521800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562897ec37c0 0x562897ec3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c6521800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562897d83d40 con 0x562897ec4120 2024-04-24T01:44:46.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c6521800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x562897d564d0 con 0x562897ec37c0 2024-04-24T01:44:46.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c2259640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562897ec37c0 0x562897ec3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c2259640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562897ec37c0 0x562897ec3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51554/0 (socket says 172.21.15.131:51554) 2024-04-24T01:44:46.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c1a58640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x562897ec4120 0x562897ec45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:38962/0 (socket says 172.21.15.131:38962) 2024-04-24T01:44:46.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.100+0000 7fa6c2259640 1 -- 172.21.15.131:0/1793922741 learned_addr learned my addr 172.21.15.131:0/1793922741 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.101+0000 7fa6c2259640 1 -- 172.21.15.131:0/1793922741 >> v1:172.21.15.107:6789/0 conn(0x562897ec4120 legacy=0x562897ec45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.101+0000 7fa6c2259640 1 -- 172.21.15.131:0/1793922741 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897d82590 con 0x562897ec37c0 2024-04-24T01:44:46.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c2259640 1 --2- 172.21.15.131:0/1793922741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897ec3be0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a520 tx=0x7fa6b401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee8256a5a4310e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c1257640 1 -- 172.21.15.131:0/1793922741 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b4057070 con 0x562897ec37c0 2024-04-24T01:44:46.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c1257640 1 -- 172.21.15.131:0/1793922741 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4052570 con 0x562897ec37c0 2024-04-24T01:44:46.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c1257640 1 -- 172.21.15.131:0/1793922741 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b4052870 con 0x562897ec37c0 2024-04-24T01:44:46.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c6521800 1 -- 172.21.15.131:0/1793922741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 msgr2=0x562897ec3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1793922741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897ec3be0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a520 tx=0x7fa6b401d010 comp rx=0 tx=0).stop 2024-04-24T01:44:46.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c6521800 1 -- 172.21.15.131:0/1793922741 shutdown_connections 2024-04-24T01:44:46.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1793922741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897ec3be0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c6521800 1 -- 172.21.15.131:0/1793922741 >> 172.21.15.131:0/1793922741 conn(0x562897ebf320 msgr2=0x562897ec1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c6521800 1 -- 172.21.15.131:0/1793922741 shutdown_connections 2024-04-24T01:44:46.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.103+0000 7fa6c6521800 1 -- 172.21.15.131:0/1793922741 wait complete. 2024-04-24T01:44:46.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.117+0000 7fa6c6521800 1 Processor -- start 2024-04-24T01:44:46.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.117+0000 7fa6c6521800 1 -- start start 2024-04-24T01:44:46.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.118+0000 7fa6c6521800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897fb8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.118+0000 7fa6c6521800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562897e103c0 con 0x562897ec37c0 2024-04-24T01:44:46.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.118+0000 7fa6c2259640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897fb8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.118+0000 7fa6c2259640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897fb8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51564/0 (socket says 172.21.15.131:51564) 2024-04-24T01:44:46.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.118+0000 7fa6c2259640 1 -- 172.21.15.131:0/4044641486 learned_addr learned my addr 172.21.15.131:0/4044641486 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.118+0000 7fa6c2259640 1 -- 172.21.15.131:0/4044641486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897fb89d0 con 0x562897ec37c0 2024-04-24T01:44:46.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.118+0000 7fa6c2259640 1 --2- 172.21.15.131:0/4044641486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897fb8400 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4055040 tx=0x7fa6b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2207d559d89bf1e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa5b0608640 1 -- 172.21.15.131:0/4044641486 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b4057040 con 0x562897ec37c0 2024-04-24T01:44:46.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa5b0608640 1 -- 172.21.15.131:0/4044641486 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4052870 con 0x562897ec37c0 2024-04-24T01:44:46.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa5b0608640 1 -- 172.21.15.131:0/4044641486 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b4052b90 con 0x562897ec37c0 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa6c6521800 1 -- 172.21.15.131:0/4044641486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 msgr2=0x562897fb8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4044641486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897fb8400 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4055040 tx=0x7fa6b404c000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa6c6521800 1 -- 172.21.15.131:0/4044641486 shutdown_connections 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4044641486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec37c0 0x562897fb8400 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.119+0000 7fa6c6521800 1 -- 172.21.15.131:0/4044641486 >> 172.21.15.131:0/4044641486 conn(0x562897ebf320 msgr2=0x562897fb3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c6521800 1 -- 172.21.15.131:0/4044641486 shutdown_connections 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c6521800 1 -- 172.21.15.131:0/4044641486 wait complete. 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c6521800 1 Processor -- start 2024-04-24T01:44:46.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c6521800 1 -- start start 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c6521800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec4120 0x562897fc0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c6521800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562897ec4f20 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c2259640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec4120 0x562897fc0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c2259640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec4120 0x562897fc0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51574/0 (socket says 172.21.15.131:51574) 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.120+0000 7fa6c2259640 1 -- 172.21.15.131:0/1776747125 learned_addr learned my addr 172.21.15.131:0/1776747125 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.121+0000 7fa6c2259640 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897fc0660 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.121+0000 7fa6c2259640 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec4120 0x562897fc0120 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4052540 tx=0x7fa6b4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.121+0000 7fa5aee05640 1 -- 172.21.15.131:0/1776747125 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b4073070 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.121+0000 7fa5aee05640 1 -- 172.21.15.131:0/1776747125 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b405d570 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.121+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562897fc08f0 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.121+0000 7fa5aee05640 1 -- 172.21.15.131:0/1776747125 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b4057070 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.121+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562897fc3550 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.122+0000 7fa5aee05640 1 -- 172.21.15.131:0/1776747125 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa6b4076070 con 0x562897ec4120 2024-04-24T01:44:46.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.122+0000 7fa5aee05640 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa5a8036900 0x7fa5a8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.122+0000 7fa5aee05640 1 -- 172.21.15.131:0/1776747125 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fa6b408dc90 con 0x562897ec4120 2024-04-24T01:44:46.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.122+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa5a8036900 0x7fa5a8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.122+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897fc5300 0x562897fc76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.122+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897fc7c30 con 0x562897fc5300 2024-04-24T01:44:46.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.122+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897fc5300 0x562897fc76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.123+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa5a8036900 0x7fa5a8038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000f60 tx=0x7fa6b8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.123+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897fc5300 0x562897fc76f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.123+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/1776747125 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6bc00a4a0 con 0x562897fc5300 2024-04-24T01:44:46.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.123+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897fc48e0 con 0x562897fc5300 2024-04-24T01:44:46.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.123+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/1776747125 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6bc00a4a0 con 0x562897fc5300 2024-04-24T01:44:46.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.123+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897fc9a10 con 0x562897fc5300 2024-04-24T01:44:46.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.124+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/1776747125 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6bc00a4a0 con 0x562897fc5300 2024-04-24T01:44:46.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.124+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897fc8d50 con 0x562897fc5300 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.124+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/1776747125 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6bc00a4a0 con 0x562897fc5300 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.124+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897fc91a0 con 0x562897fc5300 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.124+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/1776747125 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa6bc00a4a0 con 0x562897fc5300 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.124+0000 7fa6c6521800 1 Processor -- start 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.125+0000 7fa6c6521800 1 -- start start 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.125+0000 7fa6c6521800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fd87e0 0x562897fd8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.125+0000 7fa6c6521800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562897db66b0 con 0x562897fd87e0 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.125+0000 7fa6c1a58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fd87e0 0x562897fd8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.125+0000 7fa6c1a58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fd87e0 0x562897fd8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51590/0 (socket says 172.21.15.131:51590) 2024-04-24T01:44:46.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.125+0000 7fa6c1a58640 1 -- 172.21.15.131:0/95082155 learned_addr learned my addr 172.21.15.131:0/95082155 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.125+0000 7fa6c1a58640 1 -- 172.21.15.131:0/95082155 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897fd9140 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.126+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fd87e0 0x562897fd8c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8001ed0 tx=0x7fa6b800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.126+0000 7fa5a7fff640 1 -- 172.21.15.131:0/95082155 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8022070 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.126+0000 7fa5a7fff640 1 -- 172.21.15.131:0/95082155 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b800d520 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.126+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562897fd9bb0 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.126+0000 7fa5a7fff640 1 -- 172.21.15.131:0/95082155 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b800d800 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.126+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562897fda0b0 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa5a7fff640 1 -- 172.21.15.131:0/95082155 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa6b8025070 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa5a7fff640 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa59c036900 0x7fa59c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa5a7fff640 1 -- 172.21.15.131:0/95082155 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fa6b804de50 con 0x562897fd87e0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa59c036900 0x7fa59c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa6c6521800 1 Processor -- start 2024-04-24T01:44:46.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa6c6521800 1 -- start start 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa59c036900 0x7fa59c038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x562897fc8870 tx=0x7fa6bc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa6c6521800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fe5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.127+0000 7fa6c6521800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562897fb8c90 con 0x562897fe5bb0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa6c1a58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fe5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa6c1a58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fe5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51602/0 (socket says 172.21.15.131:51602) 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa6c1a58640 1 -- 172.21.15.131:0/3930198212 learned_addr learned my addr 172.21.15.131:0/3930198212 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa6c1a58640 1 -- 172.21.15.131:0/3930198212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897fe6580 con 0x562897fe5bb0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/3930198212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fe5fb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa6b804c120 tx=0x7fa6b8024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6aab7b9a96118ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa5a5ffb640 1 -- 172.21.15.131:0/3930198212 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b804a030 con 0x562897fe5bb0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa5a5ffb640 1 -- 172.21.15.131:0/3930198212 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b8025990 con 0x562897fe5bb0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.128+0000 7fa5a5ffb640 1 -- 172.21.15.131:0/3930198212 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8026730 con 0x562897fe5bb0 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 -- 172.21.15.131:0/3930198212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 msgr2=0x562897fe5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 --2- 172.21.15.131:0/3930198212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fe5fb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa6b804c120 tx=0x7fa6b8024740 comp rx=0 tx=0).stop 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 -- 172.21.15.131:0/3930198212 shutdown_connections 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 --2- 172.21.15.131:0/3930198212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fe5fb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 -- 172.21.15.131:0/3930198212 >> 172.21.15.131:0/3930198212 conn(0x562897fe1e80 msgr2=0x562897fdfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 -- 172.21.15.131:0/3930198212 shutdown_connections 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 -- 172.21.15.131:0/3930198212 wait complete. 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 Processor -- start 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 -- start start 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.129+0000 7fa6c6521800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562897fe6d30 con 0x562897fe5bb0 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa6c1a58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa6c1a58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fed190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51614/0 (socket says 172.21.15.131:51614) 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 learned_addr learned my addr 172.21.15.131:0/4250656667 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897fed6d0 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fed190 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8024a50 tx=0x7fa6b804c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa593fff640 1 -- 172.21.15.131:0/4250656667 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8025570 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa593fff640 1 -- 172.21.15.131:0/4250656667 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b800d9a0 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562897fed6d0 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa593fff640 1 -- 172.21.15.131:0/4250656667 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b800dce0 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.130+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562897fed6d0 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.131+0000 7fa593fff640 1 -- 172.21.15.131:0/4250656667 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa6b801a320 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.131+0000 7fa593fff640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa58c036950 0x7fa58c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa593fff640 1 -- 172.21.15.131:0/4250656667 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fa6b8045070 con 0x562897fe5bb0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa58c036950 0x7fa58c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897ff88c0 0x562897ffad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffb4d0 con 0x562897ff88c0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa58c036950 0x7fa58c038e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x562897fc12f0 tx=0x7fa6bc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa6c2259640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897ff88c0 0x562897ffad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.132+0000 7fa6c2259640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897ff88c0 0x562897ffad80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 realm 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffb8e0 con 0x562897ff88c0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:46.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffc1b0 con 0x562897ff88c0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffc550 con 0x562897ff88c0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.133+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffcda0 con 0x562897ff88c0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.134+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.134+0000 7fa6c6521800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.134+0000 7fa6c6521800 20 searching for the correct realm 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.134+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562897ffeb10 0x562898000f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.134+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.134+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562897ffeb10 0x562898000f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.134+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562897ffeb10 0x562898000f00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c1a58640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa6b801ac20 0x7fa6b80030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6b801ac20 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa6b801ac20 0x7fa6b80030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa6b801ac20 0x7fa6b80030d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc01f070 con 0x7fa6b801ac20 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c2a5a640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa6bc031040 0x7fa6bc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.135+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.136+0000 7fa6c2259640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa6bc031040 0x7fa6bc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.136+0000 7fa6c2259640 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa6bc031040 0x7fa6bc032940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.136+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.136+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ff88c0 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ff88c0 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.137+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6b801ac20 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.138+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc01f070 con 0x7fa6b801ac20 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.138+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.138+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.138+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ff88c0 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.138+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.138+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ff88c0 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6b801ac20 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa6bc01f070 con 0x7fa6b801ac20 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.139+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.140+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.140+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.140+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.140+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.140+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.140+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ff88c0 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ff88c0 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.141+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.142+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.142+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6b801ac20 2024-04-24T01:44:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.142+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc01f070 con 0x7fa6b801ac20 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.142+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ff88c0 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.142+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.142+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6b801ac20 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.142+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc01f070 con 0x7fa6b801ac20 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.143+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.143+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.143+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6b801ac20 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc01f070 con 0x7fa6b801ac20 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x562897ffeb10 2024-04-24T01:44:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5628980014e0 con 0x7fa6bc031040 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.144+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa6b40a1040 con 0x562897ff88c0 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa6b40a1040 con 0x7fa6b801ac20 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffd5f0 con 0x562897ff88c0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.145+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffd9e0 con 0x562897ff88c0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562897ffd9e0 con 0x562897ff88c0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 zone default found 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 4 Realm: () 2024-04-24T01:44:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 zonegroup default 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562898001960 con 0x7fa6b801ac20 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5628980036e0 con 0x562897ffeb10 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.146+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562898003a80 con 0x562897ffeb10 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.147+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.147+0000 7fa6c6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.147+0000 7fa6c6521800 20 started sync module instance, tier type = 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.147+0000 7fa6c6521800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.147+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898002b80 con 0x7fa6b801ac20 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.148+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.148+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732348829856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898002b80 con 0x7fa6b801ac20 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.148+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898004440 con 0x562897ff88c0 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.149+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732348829856] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.149+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.149+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732348834192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898002b80 con 0x562897ff88c0 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.149+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898004ed0 con 0x562897ffeb10 2024-04-24T01:44:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.150+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732348834192] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.151+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.151+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732348827344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898002af0 con 0x562897ffeb10 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.151+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898005d90 con 0x7fa6b801ac20 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.152+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.152+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732348840672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898006630 con 0x7fa6b801ac20 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.152+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5628980070e0 con 0x562897ff88c0 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.153+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732348840672] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.154+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732348827344] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.154+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.154+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732348838592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898006180 con 0x562897ff88c0 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.154+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898007980 con 0x7fa6bc031040 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.155+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732348838592] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.155+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.155+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732348844992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898006180 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.155+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898007fa0 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.156+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732348844992] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.156+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.156+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732348848784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898007f60 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.156+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5628980089a0 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.157+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732348848784] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732348851312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898008960 con 0x7fa6bc031040 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 20 add_watcher() i=0 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 20 add_watcher() i=1 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 20 add_watcher() i=2 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 20 add_watcher() i=3 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 20 add_watcher() i=4 2024-04-24T01:44:46.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 20 add_watcher() i=5 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.158+0000 7fa6c6521800 20 add_watcher() i=6 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.159+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732348851312] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.159+0000 7fa6c6521800 20 add_watcher() i=7 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.159+0000 7fa6c6521800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.159+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56289800bdf0 con 0x562897ff88c0 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.159+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.159+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732348846912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5628980092e0 con 0x562897ff88c0 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.160+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732348846912] v34'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.160+0000 7fa578fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.160+0000 7fa6c6521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.160+0000 7fa6c6521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:46.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.160+0000 7fa6c6521800 5 note: GC not initialized 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa4f37fe640 20 reqs_thread_entry: start 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 20 Filter name: none 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa4f17fa640 20 reqs_thread_entry: start 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56289803f0b0 con 0x562897ff88c0 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.161+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56289803eb90 con 0x7fa6bc031040 2024-04-24T01:44:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.163+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 usage.10 [call] v34'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.163+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56289803eb90 con 0x7fa6bc031040 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.164+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(64 usage.10 [call] v34'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.165+0000 7fa578fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.165+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732348846912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56289803eb90 con 0x562897ff88c0 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.166+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94732348846912] v34'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.166+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732348829856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56289803eb90 con 0x7fa6b801ac20 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.167+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94732348829856] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.167+0000 7fa6c6521800 20 remove_watcher() i=0 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.167+0000 7fa6c6521800 2 removed watcher, disabling cache 2024-04-24T01:44:46.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.167+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732348834192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56289803eb90 con 0x562897ff88c0 2024-04-24T01:44:46.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.169+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94732348834192] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.169+0000 7fa6c6521800 20 remove_watcher() i=1 2024-04-24T01:44:46.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.169+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732348827344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56289803eb90 con 0x562897ffeb10 2024-04-24T01:44:46.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.170+0000 7fa6c1a58640 1 -- 172.21.15.131:0/4250656667 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94732348827344] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8024030 con 0x562897ffeb10 2024-04-24T01:44:46.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.170+0000 7fa6c6521800 20 remove_watcher() i=2 2024-04-24T01:44:46.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.170+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732348840672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5628980026d0 con 0x7fa6b801ac20 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.171+0000 7fa6c2a5a640 1 -- 172.21.15.131:0/4250656667 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94732348840672] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc040040 con 0x7fa6b801ac20 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.171+0000 7fa6c6521800 20 remove_watcher() i=3 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.171+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732348838592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898005ae0 con 0x562897ff88c0 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.172+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94732348838592] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x562897ff88c0 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.172+0000 7fa6c6521800 20 remove_watcher() i=4 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.172+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732348844992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5628980026d0 con 0x7fa6bc031040 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.173+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94732348844992] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.173+0000 7fa6c6521800 20 remove_watcher() i=5 2024-04-24T01:44:46.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.173+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732348848784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898005ae0 con 0x7fa6bc031040 2024-04-24T01:44:46.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.174+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94732348848784] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.174+0000 7fa6c6521800 20 remove_watcher() i=6 2024-04-24T01:44:46.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.174+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732348851312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562898007a90 con 0x7fa6bc031040 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94732348851312] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b4075030 con 0x7fa6bc031040 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 20 remove_watcher() i=7 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa6bc031040 msgr2=0x7fa6bc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fa6bc031040 0x7fa6bc032940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897ff88c0 msgr2=0x562897ffad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897ff88c0 0x562897ffad80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa6b801ac20 msgr2=0x7fa6b80030d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fa6b801ac20 0x7fa6b80030d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562897ffeb10 msgr2=0x562898000f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x562897ffeb10 0x562898000f00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa58c036950 msgr2=0x7fa58c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa58c036950 0x7fa58c038e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x562897fc12f0 tx=0x7fa6bc01f000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 msgr2=0x562897fed190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c2259640 1 -- 172.21.15.131:0/4250656667 reap_dead start 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.175+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fed190 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8024a50 tx=0x7fa6b804c080 comp rx=0 tx=0).stop 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 shutdown_connections 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/4250656667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fe5bb0 0x562897fed190 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 >> 172.21.15.131:0/4250656667 conn(0x562897fe1e80 msgr2=0x562897fdf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 shutdown_connections 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/4250656667 wait complete. 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa59c036900 msgr2=0x7fa59c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa59c036900 0x7fa59c038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x562897fc8870 tx=0x7fa6bc005840 comp rx=0 tx=0).stop 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fd87e0 msgr2=0x562897fd8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fd87e0 0x562897fd8c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8001ed0 tx=0x7fa6b800ea00 comp rx=0 tx=0).stop 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 shutdown_connections 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa59c036900 0x7fa59c038dc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/95082155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897fd87e0 0x562897fd8c00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 >> 172.21.15.131:0/95082155 conn(0x562897fcc880 msgr2=0x562897fccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 shutdown_connections 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/95082155 wait complete. 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897fc5300 msgr2=0x562897fc76f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897fc5300 0x562897fc76f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa5a8036900 msgr2=0x7fa5a8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa5a8036900 0x7fa5a8038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000f60 tx=0x7fa6b8001370 comp rx=0 tx=0).stop 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec4120 msgr2=0x562897fc0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec4120 0x562897fc0120 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4052540 tx=0x7fa6b4003020 comp rx=0 tx=0).stop 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 shutdown_connections 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x562897fc5300 0x562897fc76f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fa5a8036900 0x7fa5a8038dc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.176+0000 7fa6c6521800 1 --2- 172.21.15.131:0/1776747125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562897ec4120 0x562897fc0120 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.177+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 >> 172.21.15.131:0/1776747125 conn(0x562897ebf320 msgr2=0x562897fb2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.177+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 shutdown_connections 2024-04-24T01:44:46.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.177+0000 7fa6c6521800 1 -- 172.21.15.131:0/1776747125 wait complete. 2024-04-24T01:44:46.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-24T01:44:46.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-24T01:44:46.185 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-24T01:44:46.228 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:46.228 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.228+0000 7fb97d127800 1 Processor -- start 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.228+0000 7fb97d127800 1 -- start start 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb97d127800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fd178e6b00 0x55fd178e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb97d127800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd1782fd40 con 0x55fd178e55f0 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb97d127800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55fd178024d0 con 0x55fd178e6b00 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb978da7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fd178e6b00 0x55fd178e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb9705a6640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55fd178e55f0 0x55fd17978de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:38968/0 (socket says 172.21.15.131:38968) 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb978da7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fd178e6b00 0x55fd178e50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51620/0 (socket says 172.21.15.131:51620) 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb9705a6640 1 -- 172.21.15.131:0/468201202 learned_addr learned my addr 172.21.15.131:0/468201202 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb978da7640 1 -- 172.21.15.131:0/468201202 >> v1:172.21.15.107:6789/0 conn(0x55fd178e55f0 legacy=0x55fd17978de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.229+0000 7fb978da7640 1 -- 172.21.15.131:0/468201202 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd1782e590 con 0x55fd178e6b00 2024-04-24T01:44:46.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.231+0000 7fb978da7640 1 --2- 172.21.15.131:0/468201202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e6b00 0x55fd178e50b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb96800a470 tx=0x7fb96801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1be4abca143c9ae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.231+0000 7fb973fff640 1 -- 172.21.15.131:0/468201202 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb968057070 con 0x55fd178e6b00 2024-04-24T01:44:46.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.231+0000 7fb973fff640 1 -- 172.21.15.131:0/468201202 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb968052570 con 0x55fd178e6b00 2024-04-24T01:44:46.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.231+0000 7fb973fff640 1 -- 172.21.15.131:0/468201202 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb968052870 con 0x55fd178e6b00 2024-04-24T01:44:46.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.232+0000 7fb97d127800 1 -- 172.21.15.131:0/468201202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e6b00 msgr2=0x55fd178e50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.232+0000 7fb97d127800 1 --2- 172.21.15.131:0/468201202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e6b00 0x55fd178e50b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb96800a470 tx=0x7fb96801ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:46.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.232+0000 7fb97d127800 1 -- 172.21.15.131:0/468201202 shutdown_connections 2024-04-24T01:44:46.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.232+0000 7fb97d127800 1 --2- 172.21.15.131:0/468201202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e6b00 0x55fd178e50b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.232+0000 7fb97d127800 1 -- 172.21.15.131:0/468201202 >> 172.21.15.131:0/468201202 conn(0x55fd1796c530 msgr2=0x55fd1796e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.232+0000 7fb97d127800 1 -- 172.21.15.131:0/468201202 shutdown_connections 2024-04-24T01:44:46.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.232+0000 7fb97d127800 1 -- 172.21.15.131:0/468201202 wait complete. 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.243+0000 7fb97d127800 1 Processor -- start 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.243+0000 7fb97d127800 1 -- start start 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.244+0000 7fb97d127800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.244+0000 7fb97d127800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fd178bc3c0 con 0x55fd178e55f0 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.244+0000 7fb978da7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.244+0000 7fb978da7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51626/0 (socket says 172.21.15.131:51626) 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.244+0000 7fb978da7640 1 -- 172.21.15.131:0/3244498459 learned_addr learned my addr 172.21.15.131:0/3244498459 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.244+0000 7fb978da7640 1 -- 172.21.15.131:0/3244498459 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd17a64dc0 con 0x55fd178e55f0 2024-04-24T01:44:46.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.244+0000 7fb978da7640 1 --2- 172.21.15.131:0/3244498459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a647f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb96804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5038c8c5bf28b41f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb866e0d640 1 -- 172.21.15.131:0/3244498459 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb968057070 con 0x55fd178e55f0 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb866e0d640 1 -- 172.21.15.131:0/3244498459 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb968063070 con 0x55fd178e55f0 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb866e0d640 1 -- 172.21.15.131:0/3244498459 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb968052720 con 0x55fd178e55f0 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb97d127800 1 -- 172.21.15.131:0/3244498459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 msgr2=0x55fd17a647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb97d127800 1 --2- 172.21.15.131:0/3244498459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a647f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb96804c000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb97d127800 1 -- 172.21.15.131:0/3244498459 shutdown_connections 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb97d127800 1 --2- 172.21.15.131:0/3244498459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a647f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb97d127800 1 -- 172.21.15.131:0/3244498459 >> 172.21.15.131:0/3244498459 conn(0x55fd1796c530 msgr2=0x55fd17a60110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb97d127800 1 -- 172.21.15.131:0/3244498459 shutdown_connections 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.245+0000 7fb97d127800 1 -- 172.21.15.131:0/3244498459 wait complete. 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb97d127800 1 Processor -- start 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb97d127800 1 -- start start 2024-04-24T01:44:46.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb97d127800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a6c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb97d127800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fd1797c7b0 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb978da7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a6c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb978da7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a6c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51642/0 (socket says 172.21.15.131:51642) 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb978da7640 1 -- 172.21.15.131:0/2496074502 learned_addr learned my addr 172.21.15.131:0/2496074502 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb978da7640 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd17a6c7d0 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.246+0000 7fb978da7640 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a6c290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb968002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.247+0000 7fb86560a640 1 -- 172.21.15.131:0/2496074502 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb968052c70 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.247+0000 7fb86560a640 1 -- 172.21.15.131:0/2496074502 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96806c070 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.247+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd17a6ca60 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.247+0000 7fb86560a640 1 -- 172.21.15.131:0/2496074502 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb96805e480 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.247+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd17a6f710 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.247+0000 7fb86560a640 1 -- 172.21.15.131:0/2496074502 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb96806e030 con 0x55fd178e55f0 2024-04-24T01:44:46.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb86560a640 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb860036900 0x7fb860038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb86560a640 1 -- 172.21.15.131:0/2496074502 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb96808e380 con 0x55fd178e55f0 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb9705a6640 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb860036900 0x7fb860038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb97d127800 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd178e6b00 0x55fd17a734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17a73a60 con 0x55fd178e6b00 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb9795a8640 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd178e6b00 0x55fd17a734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb9705a6640 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb860036900 0x7fb860038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb960000f60 tx=0x7fb9600012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb9795a8640 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd178e6b00 0x55fd17a734d0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb9795a8640 1 -- 172.21.15.131:0/2496074502 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb97400a4a0 con 0x55fd178e6b00 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.248+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17a70aa0 con 0x55fd178e6b00 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.249+0000 7fb9795a8640 1 -- 172.21.15.131:0/2496074502 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb97400a4a0 con 0x55fd178e6b00 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.249+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17a75880 con 0x55fd178e6b00 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.249+0000 7fb9795a8640 1 -- 172.21.15.131:0/2496074502 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb97400a4a0 con 0x55fd178e6b00 2024-04-24T01:44:46.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.249+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17a74bc0 con 0x55fd178e6b00 2024-04-24T01:44:46.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.249+0000 7fb9795a8640 1 -- 172.21.15.131:0/2496074502 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb97400a4a0 con 0x55fd178e6b00 2024-04-24T01:44:46.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.249+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17a74fe0 con 0x55fd178e6b00 2024-04-24T01:44:46.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb9795a8640 1 -- 172.21.15.131:0/2496074502 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb97400a4a0 con 0x55fd178e6b00 2024-04-24T01:44:46.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb97d127800 1 Processor -- start 2024-04-24T01:44:46.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb97d127800 1 -- start start 2024-04-24T01:44:46.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb97d127800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a84690 0x55fd17a84ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb97d127800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fd178626b0 con 0x55fd17a84690 2024-04-24T01:44:46.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb9705a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a84690 0x55fd17a84ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb9705a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a84690 0x55fd17a84ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51652/0 (socket says 172.21.15.131:51652) 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.250+0000 7fb9705a6640 1 -- 172.21.15.131:0/465643087 learned_addr learned my addr 172.21.15.131:0/465643087 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.251+0000 7fb9705a6640 1 -- 172.21.15.131:0/465643087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd17a84ff0 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.251+0000 7fb9705a6640 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a84690 0x55fd17a84ab0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb960001ed0 tx=0x7fb96000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.251+0000 7fb85e7fc640 1 -- 172.21.15.131:0/465643087 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb96001b550 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.251+0000 7fb85e7fc640 1 -- 172.21.15.131:0/465643087 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96001b6f0 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.251+0000 7fb85e7fc640 1 -- 172.21.15.131:0/465643087 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb96001b9d0 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.251+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd17a85a60 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.251+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd17a85f60 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.252+0000 7fb85e7fc640 1 -- 172.21.15.131:0/465643087 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb960023020 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.252+0000 7fb85e7fc640 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb850036900 0x7fb850038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.252+0000 7fb85e7fc640 1 -- 172.21.15.131:0/465643087 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb960021020 con 0x55fd17a84690 2024-04-24T01:44:46.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.252+0000 7fb9795a8640 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb850036900 0x7fb850038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.252+0000 7fb97d127800 1 Processor -- start 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.252+0000 7fb9795a8640 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb850036900 0x7fb850038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55fd17a74f60 tx=0x7fb974005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.252+0000 7fb97d127800 1 -- start start 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.253+0000 7fb97d127800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a91df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.253+0000 7fb97d127800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fd17a65080 con 0x55fd17a919d0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.253+0000 7fb9705a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a91df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.253+0000 7fb9705a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a91df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51660/0 (socket says 172.21.15.131:51660) 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.253+0000 7fb9705a6640 1 -- 172.21.15.131:0/1006882815 learned_addr learned my addr 172.21.15.131:0/1006882815 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.253+0000 7fb9705a6640 1 -- 172.21.15.131:0/1006882815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd17a923c0 con 0x55fd17a919d0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb9705a6640 1 --2- 172.21.15.131:0/1006882815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a91df0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb96004ce90 tx=0x7fb9600468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c277306d343f1e78 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb84ffff640 1 -- 172.21.15.131:0/1006882815 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb96001be20 con 0x55fd17a919d0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb84ffff640 1 -- 172.21.15.131:0/1006882815 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96004a070 con 0x55fd17a919d0 2024-04-24T01:44:46.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb84ffff640 1 -- 172.21.15.131:0/1006882815 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb960024e10 con 0x55fd17a919d0 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 -- 172.21.15.131:0/1006882815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 msgr2=0x55fd17a91df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 --2- 172.21.15.131:0/1006882815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a91df0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb96004ce90 tx=0x7fb9600468f0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 -- 172.21.15.131:0/1006882815 shutdown_connections 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 --2- 172.21.15.131:0/1006882815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a91df0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 -- 172.21.15.131:0/1006882815 >> 172.21.15.131:0/1006882815 conn(0x55fd17a8dd30 msgr2=0x55fd17a8bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 -- 172.21.15.131:0/1006882815 shutdown_connections 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 -- 172.21.15.131:0/1006882815 wait complete. 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.254+0000 7fb97d127800 1 Processor -- start 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb97d127800 1 -- start start 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb97d127800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a99090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb97d127800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fd17a92b30 con 0x55fd17a919d0 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb9705a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a99090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb9705a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a99090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51666/0 (socket says 172.21.15.131:51666) 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 learned_addr learned my addr 172.21.15.131:0/2041039592 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd17a995d0 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb9705a6640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a99090 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb9600234d0 tx=0x7fb96004ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.255+0000 7fb84e7fc640 1 -- 172.21.15.131:0/2041039592 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb960034070 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.256+0000 7fb84e7fc640 1 -- 172.21.15.131:0/2041039592 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb960024e10 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.256+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd17a99860 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.256+0000 7fb84e7fc640 1 -- 172.21.15.131:0/2041039592 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb960025ad0 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.256+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd17a99860 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.256+0000 7fb84e7fc640 1 -- 172.21.15.131:0/2041039592 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb96004ed10 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb84e7fc640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8440368b0 0x7fb844038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb84e7fc640 1 -- 172.21.15.131:0/2041039592 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb96003ad40 con 0x55fd17a919d0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb9795a8640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8440368b0 0x7fb844038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd17aa49f0 0x55fd17aa6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa75e0 con 0x55fd17aa49f0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb978da7640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd17aa49f0 0x55fd17aa6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb9795a8640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8440368b0 0x7fb844038d70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55fd17a746e0 tx=0x7fb97401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.257+0000 7fb978da7640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd17aa49f0 0x55fd17aa6e90 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 realm 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa79f0 con 0x55fd17aa49f0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa82c0 con 0x55fd17aa49f0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa8660 con 0x55fd17aa49f0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa8ac0 con 0x55fd17aa49f0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.258+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb97d127800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:46.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb97d127800 20 searching for the correct realm 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fd17aaab10 0x55fd17aacf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb9705a6640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fd17aaab10 0x55fd17aacf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb9705a6640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fd17aaab10 0x55fd17aacf00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb9705a6640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb960039070 0x7fb960030440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb960039070 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.259+0000 7fb9795a8640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb960039070 0x7fb960030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.260+0000 7fb9795a8640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb960039070 0x7fb960030440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.260+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb97401f070 con 0x7fb960039070 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.260+0000 7fb9795a8640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb974031040 0x7fb974032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.260+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.260+0000 7fb978da7640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb974031040 0x7fb974032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.261+0000 7fb978da7640 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb974031040 0x7fb974032940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.261+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.261+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.261+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.261+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.261+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.262+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.262+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.262+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.262+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.262+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb960039070 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.262+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb97401f070 con 0x7fb960039070 2024-04-24T01:44:46.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.262+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.263+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb960039070 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb97401f070 con 0x7fb960039070 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.286 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.264+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.265+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.287 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb960039070 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb97401f070 con 0x7fb960039070 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb960039070 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb97401f070 con 0x7fb960039070 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.266+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.267+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.267+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.267+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.267+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb960039070 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.267+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb97401f070 con 0x7fb960039070 2024-04-24T01:44:46.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.268+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aaab10 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.268+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.268+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb974031040 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.268+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.268+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x55fd17aa49f0 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.268+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.268+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aad5b0 con 0x7fb960039070 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:46.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa9560 con 0x55fd17aa49f0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa9e00 con 0x55fd17aa49f0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aa91a0 con 0x55fd17aa49f0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.269+0000 7fb97d127800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:46.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 zone default found 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 4 Realm: () 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 zonegroup default 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aada10 con 0x7fb960039070 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aafc40 con 0x55fd17aaab10 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aaffe0 con 0x55fd17aaab10 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 started sync module instance, tier type = 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.270+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aaf080 con 0x7fb960039070 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.271+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.271+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94545512166832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aaf080 con 0x7fb960039070 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.271+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab09a0 con 0x55fd17aa49f0 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.272+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94545512166832] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.273+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.273+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94545512164784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab09a0 con 0x55fd17aa49f0 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.273+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab13a0 con 0x55fd17aaab10 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.274+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.274+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94545512173232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab1c40 con 0x55fd17aaab10 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.274+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab2720 con 0x7fb960039070 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.274+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94545512164784] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.275+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.275+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94545512178224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab2b10 con 0x7fb960039070 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.275+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab3530 con 0x55fd17aa49f0 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.276+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94545512173232] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.276+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.276+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94545512181792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab34f0 con 0x55fd17aa49f0 2024-04-24T01:44:46.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.276+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94545512178224] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.276+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab04f0 con 0x7fb974031040 2024-04-24T01:44:46.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.277+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.277+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94545512184512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab04f0 con 0x7fb974031040 2024-04-24T01:44:46.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.277+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab49b0 con 0x7fb974031040 2024-04-24T01:44:46.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.277+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94545512181792] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.278+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94545512184512] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.278+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.278+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94545512185568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab4500 con 0x7fb974031040 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.279+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab4ec0 con 0x7fb974031040 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.280+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94545512185568] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94545512175504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab4ec0 con 0x7fb974031040 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 20 add_watcher() i=0 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 20 add_watcher() i=1 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 20 add_watcher() i=2 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 20 add_watcher() i=3 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 20 add_watcher() i=4 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 20 add_watcher() i=5 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.281+0000 7fb97d127800 20 add_watcher() i=6 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.282+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94545512175504] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.282+0000 7fb97d127800 20 add_watcher() i=7 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.282+0000 7fb97d127800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.282+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab81a0 con 0x55fd17aa49f0 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.282+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.282+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94545512188800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab5450 con 0x55fd17aa49f0 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.283+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94545512188800] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.283+0000 7fb82efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.283+0000 7fb97d127800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.283+0000 7fb97d127800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb97d127800 5 note: GC not initialized 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb82dfe3640 20 reqs_thread_entry: start 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb97d127800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:46.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb97d127800 20 Filter name: none 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb79f7fe640 20 reqs_thread_entry: start 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb97d127800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aeb0a0 con 0x55fd17aa49f0 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb97d127800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.284+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aec5f0 con 0x7fb974031040 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.285+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.286+0000 7fb82efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.286+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94545512188800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab71c0 con 0x55fd17aa49f0 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.287+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94545512188800] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.287+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94545512166832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab4b80 con 0x7fb960039070 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.288+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94545512166832] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.288+0000 7fb97d127800 20 remove_watcher() i=0 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.288+0000 7fb97d127800 2 removed watcher, disabling cache 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.288+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94545512164784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab4b80 con 0x55fd17aa49f0 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.289+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94545512164784] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.289+0000 7fb97d127800 20 remove_watcher() i=1 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.289+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94545512173232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17aaedb0 con 0x55fd17aaab10 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.290+0000 7fb9705a6640 1 -- 172.21.15.131:0/2041039592 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94545512173232] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb960036030 con 0x55fd17aaab10 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.290+0000 7fb97d127800 20 remove_watcher() i=2 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.290+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94545512178224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab4b80 con 0x7fb960039070 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.291+0000 7fb9795a8640 1 -- 172.21.15.131:0/2041039592 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94545512178224] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb974040040 con 0x7fb960039070 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.291+0000 7fb97d127800 20 remove_watcher() i=3 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.291+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94545512181792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab2230 con 0x55fd17aa49f0 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.293+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94545512181792] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x55fd17aa49f0 2024-04-24T01:44:46.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.293+0000 7fb97d127800 20 remove_watcher() i=4 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.293+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94545512184512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab3020 con 0x7fb974031040 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.294+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94545512184512] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.294+0000 7fb97d127800 20 remove_watcher() i=5 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.294+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94545512185568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab3ac0 con 0x7fb974031040 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.295+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94545512185568] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.295+0000 7fb97d127800 20 remove_watcher() i=6 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.295+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94545512175504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd17ab4b80 con 0x7fb974031040 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94545512175504] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb968070410 con 0x7fb974031040 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 20 remove_watcher() i=7 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb974031040 msgr2=0x7fb974032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb974031040 0x7fb974032940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd17aa49f0 msgr2=0x55fd17aa6e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd17aa49f0 0x55fd17aa6e90 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb960039070 msgr2=0x7fb960030440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb960039070 0x7fb960030440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fd17aaab10 msgr2=0x55fd17aacf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55fd17aaab10 0x55fd17aacf00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8440368b0 msgr2=0x7fb844038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8440368b0 0x7fb844038d70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55fd17a746e0 tx=0x7fb97401f000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 msgr2=0x55fd17a99090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb978da7640 1 -- 172.21.15.131:0/2041039592 reap_dead start 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a99090 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb9600234d0 tx=0x7fb96004ce20 comp rx=0 tx=0).stop 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 shutdown_connections 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 --2- 172.21.15.131:0/2041039592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a919d0 0x55fd17a99090 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 >> 172.21.15.131:0/2041039592 conn(0x55fd17a8dd30 msgr2=0x55fd17a8b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 shutdown_connections 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.296+0000 7fb97d127800 1 -- 172.21.15.131:0/2041039592 wait complete. 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb850036900 msgr2=0x7fb850038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb850036900 0x7fb850038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55fd17a74f60 tx=0x7fb974005840 comp rx=0 tx=0).stop 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a84690 msgr2=0x55fd17a84ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a84690 0x55fd17a84ab0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb960001ed0 tx=0x7fb96000d7a0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 shutdown_connections 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb850036900 0x7fb850038dc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/465643087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd17a84690 0x55fd17a84ab0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 >> 172.21.15.131:0/465643087 conn(0x55fd17a78730 msgr2=0x55fd17a78b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 shutdown_connections 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/465643087 wait complete. 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd178e6b00 msgr2=0x55fd17a734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd178e6b00 0x55fd17a734d0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb860036900 msgr2=0x7fb860038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb860036900 0x7fb860038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb960000f60 tx=0x7fb9600012b0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 msgr2=0x55fd17a6c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a6c290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb968002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 shutdown_connections 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55fd178e6b00 0x55fd17a734d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb860036900 0x7fb860038dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 --2- 172.21.15.131:0/2496074502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fd178e55f0 0x55fd17a6c290 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 >> 172.21.15.131:0/2496074502 conn(0x55fd1796c530 msgr2=0x55fd17a5e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 shutdown_connections 2024-04-24T01:44:46.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.297+0000 7fb97d127800 1 -- 172.21.15.131:0/2496074502 wait complete. 2024-04-24T01:44:46.311 INFO:teuthology.orchestra.run.smithi131.stdout:{"entries":[],"summary":[]} 2024-04-24T01:44:46.312 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-24T01:44:46.312 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-24T01:44:46.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-24T01:44:46.312 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-24T01:44:46.396 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:46.397 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:46.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623ed2e800 1 Processor -- start 2024-04-24T01:44:46.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623ed2e800 1 -- start start 2024-04-24T01:44:46.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623ed2e800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c38393c4a0 0x55c38393e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623ed2e800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3837f6d40 con 0x55c383938990 2024-04-24T01:44:46.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623ed2e800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55c3837c94d0 con 0x55c38393c4a0 2024-04-24T01:44:46.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623a266640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c38393c4a0 0x55c38393e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623aa67640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55c383938990 0x55c38393ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:38980/0 (socket says 172.21.15.131:38980) 2024-04-24T01:44:46.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.397+0000 7f623aa67640 1 -- 172.21.15.131:0/4192189545 learned_addr learned my addr 172.21.15.131:0/4192189545 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:46.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.398+0000 7f623a266640 1 -- 172.21.15.131:0/4192189545 >> v1:172.21.15.107:6789/0 conn(0x55c383938990 legacy=0x55c38393ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.398+0000 7f623a266640 1 -- 172.21.15.131:0/4192189545 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3837f5590 con 0x55c38393c4a0 2024-04-24T01:44:46.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.399+0000 7f623a266640 1 --2- 172.21.15.131:0/4192189545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c38393c4a0 0x55c38393e890 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f623000a470 tx=0x7f623001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d31119f0c351ccc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f6239a65640 1 -- 172.21.15.131:0/4192189545 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6230057070 con 0x55c38393c4a0 2024-04-24T01:44:46.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f6239a65640 1 -- 172.21.15.131:0/4192189545 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6230052570 con 0x55c38393c4a0 2024-04-24T01:44:46.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f6239a65640 1 -- 172.21.15.131:0/4192189545 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6230052870 con 0x55c38393c4a0 2024-04-24T01:44:46.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f623ed2e800 1 -- 172.21.15.131:0/4192189545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c38393c4a0 msgr2=0x55c38393e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f623ed2e800 1 --2- 172.21.15.131:0/4192189545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c38393c4a0 0x55c38393e890 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f623000a470 tx=0x7f623001ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:46.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f623ed2e800 1 -- 172.21.15.131:0/4192189545 shutdown_connections 2024-04-24T01:44:46.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f623ed2e800 1 --2- 172.21.15.131:0/4192189545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c38393c4a0 0x55c38393e890 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f623ed2e800 1 -- 172.21.15.131:0/4192189545 >> 172.21.15.131:0/4192189545 conn(0x55c383932340 msgr2=0x55c383934760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f623ed2e800 1 -- 172.21.15.131:0/4192189545 shutdown_connections 2024-04-24T01:44:46.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.400+0000 7f623ed2e800 1 -- 172.21.15.131:0/4192189545 wait complete. 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.412+0000 7f623ed2e800 1 Processor -- start 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.412+0000 7f623ed2e800 1 -- start start 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.412+0000 7f623ed2e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a29140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.412+0000 7f623ed2e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c3838833b0 con 0x55c383938990 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.412+0000 7f623aa67640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a29140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.412+0000 7f623aa67640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a29140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51688/0 (socket says 172.21.15.131:51688) 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.412+0000 7f623aa67640 1 -- 172.21.15.131:0/3404961562 learned_addr learned my addr 172.21.15.131:0/3404961562 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.413+0000 7f623aa67640 1 -- 172.21.15.131:0/3404961562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383a29710 con 0x55c383938990 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.413+0000 7f623aa67640 1 --2- 172.21.15.131:0/3404961562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a29140 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f622c001de0 tx=0x7f622c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d00416de3cc501 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.413+0000 7f6128e09640 1 -- 172.21.15.131:0/3404961562 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c012020 con 0x55c383938990 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.413+0000 7f6128e09640 1 -- 172.21.15.131:0/3404961562 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c00e5a0 con 0x55c383938990 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.413+0000 7f6128e09640 1 -- 172.21.15.131:0/3404961562 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c00e8c0 con 0x55c383938990 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 -- 172.21.15.131:0/3404961562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 msgr2=0x55c383a29140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 --2- 172.21.15.131:0/3404961562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a29140 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f622c001de0 tx=0x7f622c00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 -- 172.21.15.131:0/3404961562 shutdown_connections 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 --2- 172.21.15.131:0/3404961562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a29140 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 -- 172.21.15.131:0/3404961562 >> 172.21.15.131:0/3404961562 conn(0x55c383932340 msgr2=0x55c383a24a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 -- 172.21.15.131:0/3404961562 shutdown_connections 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 -- 172.21.15.131:0/3404961562 wait complete. 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 Processor -- start 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 -- start start 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a30c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.414+0000 7f623ed2e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c3839410e0 con 0x55c383938990 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f623aa67640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a30c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f623aa67640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a30c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51692/0 (socket says 172.21.15.131:51692) 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f623aa67640 1 -- 172.21.15.131:0/106192508 learned_addr learned my addr 172.21.15.131:0/106192508 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f623aa67640 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383a311a0 con 0x55c383938990 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f623aa67640 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a30c60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f622c001de0 tx=0x7f622c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f6127606640 1 -- 172.21.15.131:0/106192508 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c012030 con 0x55c383938990 2024-04-24T01:44:46.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f6127606640 1 -- 172.21.15.131:0/106192508 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c01a7a0 con 0x55c383938990 2024-04-24T01:44:46.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f6127606640 1 -- 172.21.15.131:0/106192508 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c01aac0 con 0x55c383938990 2024-04-24T01:44:46.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c383a31430 con 0x55c383938990 2024-04-24T01:44:46.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.415+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c383a340e0 con 0x55c383938990 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.416+0000 7f6127606640 1 -- 172.21.15.131:0/106192508 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f622c015020 con 0x55c383938990 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.416+0000 7f6127606640 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6120036900 0x7f6120038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.416+0000 7f6127606640 1 -- 172.21.15.131:0/106192508 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f622c020070 con 0x55c383938990 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.416+0000 7f623a266640 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6120036900 0x7f6120038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.416+0000 7f623ed2e800 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c38393c4a0 0x55c383a37ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.416+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a383e0 con 0x55c38393c4a0 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.417+0000 7f623b268640 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c38393c4a0 0x55c383a37ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.417+0000 7f623a266640 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6120036900 0x7f6120038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6230054000 tx=0x7f623004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.417+0000 7f623b268640 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c38393c4a0 0x55c383a37ea0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.417+0000 7f623b268640 1 -- 172.21.15.131:0/106192508 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f623400a4a0 con 0x55c38393c4a0 2024-04-24T01:44:46.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.417+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a35470 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.417+0000 7f623b268640 1 -- 172.21.15.131:0/106192508 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f623400a4a0 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.417+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a3a220 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.418+0000 7f623b268640 1 -- 172.21.15.131:0/106192508 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f623400a4a0 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.418+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a39560 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.418+0000 7f623b268640 1 -- 172.21.15.131:0/106192508 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f623400a4a0 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.418+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a39900 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.418+0000 7f623b268640 1 -- 172.21.15.131:0/106192508 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f623400a4a0 con 0x55c38393c4a0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.418+0000 7f623ed2e800 1 Processor -- start 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.419+0000 7f623ed2e800 1 -- start start 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.419+0000 7f623ed2e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a49040 0x55c383a49460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.419+0000 7f623ed2e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c3838296b0 con 0x55c383a49040 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.419+0000 7f623a266640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a49040 0x55c383a49460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.419+0000 7f623a266640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a49040 0x55c383a49460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51706/0 (socket says 172.21.15.131:51706) 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.419+0000 7f623a266640 1 -- 172.21.15.131:0/1001657945 learned_addr learned my addr 172.21.15.131:0/1001657945 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.419+0000 7f623a266640 1 -- 172.21.15.131:0/1001657945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383a499a0 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.420+0000 7f623a266640 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a49040 0x55c383a49460 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6230044840 tx=0x7f6230002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.420+0000 7f6124e01640 1 -- 172.21.15.131:0/1001657945 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f623006f070 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.420+0000 7f6124e01640 1 -- 172.21.15.131:0/1001657945 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6230058040 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.420+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c383a4a410 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.420+0000 7f6124e01640 1 -- 172.21.15.131:0/1001657945 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6230057050 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.420+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c383a4a8b0 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f6124e01640 1 -- 172.21.15.131:0/1001657945 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6230072070 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f6124e01640 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6114036900 0x7f6114038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f6124e01640 1 -- 172.21.15.131:0/1001657945 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f623008fb30 con 0x55c383a49040 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f623b268640 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6114036900 0x7f6114038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f623ed2e800 1 Processor -- start 2024-04-24T01:44:46.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f623ed2e800 1 -- start start 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f623b268640 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6114036900 0x7f6114038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c383a39080 tx=0x7f6234005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f623ed2e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.421+0000 7f623ed2e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c383a29a90 con 0x55c383a562c0 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f623a266640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f623a266640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51710/0 (socket says 172.21.15.131:51710) 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f623a266640 1 -- 172.21.15.131:0/1990416791 learned_addr learned my addr 172.21.15.131:0/1990416791 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f623a266640 1 -- 172.21.15.131:0/1990416791 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383a56cb0 con 0x55c383a562c0 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f623a266640 1 --2- 172.21.15.131:0/1990416791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a566e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f623008ddd0 tx=0x7f623008df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2ee51078c771f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f611e7fc640 1 -- 172.21.15.131:0/1990416791 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f623005ead0 con 0x55c383a562c0 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f611e7fc640 1 -- 172.21.15.131:0/1990416791 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623005e480 con 0x55c383a562c0 2024-04-24T01:44:46.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.422+0000 7f611e7fc640 1 -- 172.21.15.131:0/1990416791 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6230073c00 con 0x55c383a562c0 2024-04-24T01:44:46.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 -- 172.21.15.131:0/1990416791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 msgr2=0x55c383a566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 --2- 172.21.15.131:0/1990416791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a566e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f623008ddd0 tx=0x7f623008df10 comp rx=0 tx=0).stop 2024-04-24T01:44:46.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 -- 172.21.15.131:0/1990416791 shutdown_connections 2024-04-24T01:44:46.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 --2- 172.21.15.131:0/1990416791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a566e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 -- 172.21.15.131:0/1990416791 >> 172.21.15.131:0/1990416791 conn(0x55c383a52620 msgr2=0x55c383a50680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 -- 172.21.15.131:0/1990416791 shutdown_connections 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 -- 172.21.15.131:0/1990416791 wait complete. 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 Processor -- start 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 -- start start 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a5d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623ed2e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c383a57420 con 0x55c383a562c0 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623a266640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a5d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623a266640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a5d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51720/0 (socket says 172.21.15.131:51720) 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.423+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 learned_addr learned my addr 172.21.15.131:0/712705334 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.424+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383a5dea0 con 0x55c383a562c0 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.424+0000 7f623a266640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a5d960 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6230052f20 tx=0x7f623008dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.424+0000 7f611cff9640 1 -- 172.21.15.131:0/712705334 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6230072490 con 0x55c383a562c0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.424+0000 7f611cff9640 1 -- 172.21.15.131:0/712705334 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6230093030 con 0x55c383a562c0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.424+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c383a5e130 con 0x55c383a562c0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.424+0000 7f611cff9640 1 -- 172.21.15.131:0/712705334 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f623005fae0 con 0x55c383a562c0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.424+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c383a60de0 con 0x55c383a562c0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.425+0000 7f611cff9640 1 -- 172.21.15.131:0/712705334 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6230086070 con 0x55c383a562c0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.425+0000 7f611cff9640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6104036900 0x7f6104038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.425+0000 7f611cff9640 1 -- 172.21.15.131:0/712705334 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6230099d10 con 0x55c383a562c0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.425+0000 7f623b268640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6104036900 0x7f6104038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.425+0000 7f623b268640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6104036900 0x7f6104038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c383a353c0 tx=0x7f623401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.425+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.425+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c383a69450 0x55c383a6b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a6c060 con 0x55c383a69450 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623aa67640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c383a69450 0x55c383a6b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623aa67640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c383a69450 0x55c383a6b910 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 20 realm 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a6c470 con 0x55c383a69450 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.426+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a6cd40 con 0x55c383a69450 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a6d0e0 con 0x55c383a69450 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a6d930 con 0x55c383a69450 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 20 searching for the correct realm 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c383a6f6a0 0x55c383a71a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.427+0000 7f623a266640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c383a6f6a0 0x55c383a71a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.428+0000 7f623a266640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c383a6f6a0 0x55c383a71a90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.428+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.428+0000 7f623a266640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6230074060 0x7f6230001f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.428+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6230074060 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.428+0000 7f623b268640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6230074060 0x7f6230001f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.428+0000 7f623b268640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6230074060 0x7f6230001f00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.429+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f623401f070 con 0x7f6230074060 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.429+0000 7f623b268640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6234031040 0x7f6234032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.429+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.429+0000 7f623aa67640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6234031040 0x7f6234032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.429+0000 7f623aa67640 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6234031040 0x7f6234032940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x7f6234031040 2024-04-24T01:44:46.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x7f6234031040 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x7f6234031040 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.430+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6230074060 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f623401f070 con 0x7f6230074060 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x7f6234031040 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.431+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6230074060 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f623401f070 con 0x7f6230074060 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.432+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x7f6234031040 2024-04-24T01:44:46.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.433+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x7f6234031040 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6230074060 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f623401f070 con 0x7f6230074060 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.434+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c024980 con 0x55c383a69450 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6230074060 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f623401f070 con 0x7f6230074060 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.435+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6230074060 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.436+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f623401f070 con 0x7f6230074060 2024-04-24T01:44:46.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.436+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a6f6a0 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.436+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.436+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6234031040 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.436+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.436+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x55c383a69450 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c383a720c0 con 0x7f6230074060 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:46.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a6e2e0 con 0x55c383a69450 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a6eb80 con 0x55c383a69450 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.437+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a72540 con 0x55c383a69450 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 zone default found 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 4 Realm: () 2024-04-24T01:44:46.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 zonegroup default 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a729f0 con 0x7f6230074060 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a74770 con 0x55c383a6f6a0 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a74c10 con 0x55c383a6f6a0 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 started sync module instance, tier type = 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.438+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a73c10 con 0x7f6230074060 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.440+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.440+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94298215760176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a73c10 con 0x7f6230074060 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.440+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a75690 con 0x55c383a69450 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.441+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94298215760176] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.441+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.441+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94298215764960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a73c10 con 0x55c383a69450 2024-04-24T01:44:46.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.441+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a76120 con 0x55c383a6f6a0 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.442+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94298215764960] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.442+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.442+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94298215757664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a73b80 con 0x55c383a6f6a0 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.442+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a76fe0 con 0x7f6230074060 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.443+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.443+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94298215771440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a77880 con 0x7f6230074060 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.443+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a78330 con 0x55c383a69450 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.443+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94298215757664] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.445+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94298215771440] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.445+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.445+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94298215769360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a773d0 con 0x55c383a69450 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.445+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a78bd0 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.446+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.446+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94298215777792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a78ed0 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.446+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79720 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.446+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94298215769360] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.447+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94298215777792] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.447+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.447+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94298215778848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a792f0 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.447+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79ba0 con 0x7f6234031040 2024-04-24T01:44:46.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94298215778848] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94298215779904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79d80 con 0x7f6234031040 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 20 add_watcher() i=0 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 20 add_watcher() i=1 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 20 add_watcher() i=2 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 20 add_watcher() i=3 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 20 add_watcher() i=4 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 20 add_watcher() i=5 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.448+0000 7f623ed2e800 20 add_watcher() i=6 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.449+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94298215779904] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.449+0000 7f623ed2e800 20 add_watcher() i=7 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.449+0000 7f623ed2e800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:46.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.449+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383a7d150 con 0x55c383a69450 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.449+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.449+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94298215783536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a7a540 con 0x55c383a69450 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.450+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94298215783536] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.450+0000 7f60f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.450+0000 7f623ed2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.450+0000 7f623ed2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.451+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a859e0 con 0x55c383a69450 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.452+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.452+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a86030 con 0x7f6234031040 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.453+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.453+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a86030 con 0x55c383a6f6a0 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.454+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.454+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a864e0 con 0x55c383a69450 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.455+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'239 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.455+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a864e0 con 0x7f6230074060 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.456+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'81 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.456+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a86ab0 con 0x55c383a6f6a0 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.457+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'61 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.457+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a86ee0 con 0x55c383a69450 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.458+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.458+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a86ee0 con 0x7f6234031040 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.459+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.459+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a86ee0 con 0x7f6230074060 2024-04-24T01:44:46.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.460+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.460+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87500 con 0x55c383a6f6a0 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.461+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.461+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87500 con 0x7f6230074060 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.462+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'82 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.462+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87a70 con 0x7f6234031040 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.463+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.463+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87a70 con 0x7f6230074060 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.464+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.464+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x7f6234031040 2024-04-24T01:44:46.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.466+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.466+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a69450 2024-04-24T01:44:46.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.467+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'240 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.467+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.468+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.468+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x7f6230074060 2024-04-24T01:44:46.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.469+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'83 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.469+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.470+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.470+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a69450 2024-04-24T01:44:46.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.472+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.472+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a69450 2024-04-24T01:44:46.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.472+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'241 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.473+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.474+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.474+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x7f6230074060 2024-04-24T01:44:46.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.475+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.475+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.476+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'38 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.476+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.476+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'48 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.476+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.477+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.477+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.478+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'62 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.478+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x7f6234031040 2024-04-24T01:44:46.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.480+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.480+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.480+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.480+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x7f6234031040 2024-04-24T01:44:46.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.482+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.482+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x55c383a6f6a0 2024-04-24T01:44:46.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.483+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.483+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x7f6234031040 2024-04-24T01:44:46.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.484+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'70 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.484+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a87f20 con 0x7f6230074060 2024-04-24T01:44:46.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.485+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f606bfff640 20 reqs_thread_entry: start 2024-04-24T01:44:46.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:46.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 20 Filter name: none 2024-04-24T01:44:46.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f6069ffb640 20 reqs_thread_entry: start 2024-04-24T01:44:46.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:44:46.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab2d70 con 0x55c383a69450 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.486+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab2d20 con 0x7f6230074060 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 : miss 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:96 8.15 8:a885cca5:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab57e0 con 0x55c383a6f6a0 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(96 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 info.flags=0x17 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 to cache LRU end 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.487+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 4.2 4:4143931c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32b40 con 0x55c383a69450 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.488+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(97 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.488+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 4.12 4:4b5208e9:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32b40 con 0x55c383a69450 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.488+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(98 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.488+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:99 4.32 4:4fff430f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32b60 con 0x55c383a69450 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.488+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(99 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.488+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 4.17 4:ea68103f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32b60 con 0x7f6234031040 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.489+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(100 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.489+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:101 4.1c 4:38a0638d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32b60 con 0x7f6234031040 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.489+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(101 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.489+0000 7f623ed2e800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.489+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:102 4.d 4:b098ff8e:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32ba0 con 0x55c383a6f6a0 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.490+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(102 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.490+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 4.22 4:46688efa:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32bc0 con 0x55c383a69450 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.490+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(103 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.490+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:104 4.39 4:9c1332b4:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32bc0 con 0x55c383a6f6a0 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.491+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(104 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.491+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:105 4.1b 4:d87ac046:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32bc0 con 0x7f6230074060 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.491+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(105 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.491+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:106 4.32 4:4c4e154a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32bc0 con 0x55c383a69450 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.491+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(106 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.491+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:107 4.28 4:15181442:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32bc0 con 0x55c383a69450 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(107 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 20 get_obj_state: octx=0x7f623400a220 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c383b30c08 s->prefetch_data=0 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:108 3.26s0 3:641623ec:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383b31a90 con 0x7f6230074060 2024-04-24T01:44:46.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(108 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 10 manifest: total_size = 6 2024-04-24T01:44:46.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 20 get_obj_state: setting s->obj_tag to 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.14755033063015923384 2024-04-24T01:44:46.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 20 get_obj_state: octx=0x7f623400a220 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c383b30c08 s->prefetch_data=0 2024-04-24T01:44:46.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 20 prepare_atomic_modification: state is not atomic. state=0x55c383b30c08 2024-04-24T01:44:46.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 20 bucket index object: :.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4 2024-04-24T01:44:46.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.492+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:109 4.1c 4:38a0638d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32430 con 0x7f6234031040 2024-04-24T01:44:46.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.493+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(109 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.494+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:110 3.26s0 3:641623ec:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383b32430 con 0x7f6230074060 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(110 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 4.1c 4:38a0638d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383aba240 con 0x7f6234031040 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:112 4.2 4:4143931c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383abbbc0 con 0x55c383a69450 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:113 4.12 4:4b5208e9:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383abe470 con 0x55c383a69450 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:114 4.32 4:4fff430f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac0e10 con 0x55c383a69450 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:115 4.17 4:ea68103f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac3870 con 0x7f6234031040 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:116 4.1c 4:38a0638d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac63d0 con 0x7f6234031040 2024-04-24T01:44:46.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:117 4.d 4:b098ff8e:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x55c383a6f6a0 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:118 4.22 4:46688efa:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acc030 con 0x55c383a69450 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:119 4.39 4:9c1332b4:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acee80 con 0x55c383a6f6a0 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:120 4.1b 4:d87ac046:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ad1cb0 con 0x7f6230074060 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:121 4.32 4:4c4e154a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acee80 con 0x55c383a69450 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.495+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:122 4.28 4:15181442:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ad6bb0 con 0x55c383a69450 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(112 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(117 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(119 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6230071030 con 0x55c383a6f6a0 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(120 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(115 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(113 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(122 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(114 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(118 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(121 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(111 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.496+0000 7f611dffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(116 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7])"; uploads.size()=0; is_truncated=0 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:123 4.2 4:4143931c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ad1d30 con 0x55c383a69450 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:124 4.12 4:4b5208e9:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acee80 con 0x55c383a69450 2024-04-24T01:44:46.504 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:125 4.32 4:4fff430f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ad6bb0 con 0x55c383a69450 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:126 4.17 4:ea68103f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac0e10 con 0x7f6234031040 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:127 4.1c 4:38a0638d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acbba0 con 0x7f6234031040 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:128 4.d 4:b098ff8e:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ad1d30 con 0x55c383a6f6a0 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:129 4.22 4:46688efa:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acee80 con 0x55c383a69450 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:130 4.39 4:9c1332b4:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383abe540 con 0x55c383a6f6a0 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:131 4.1b 4:d87ac046:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acbba0 con 0x7f6230074060 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:132 4.32 4:4c4e154a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acee80 con 0x55c383a69450 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(123 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:133 4.28 4:15181442:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383acbba0 con 0x55c383a69450 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(128 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f62300be060 con 0x55c383a6f6a0 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(131 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(130 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f62300be060 con 0x55c383a6f6a0 2024-04-24T01:44:46.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(126 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(127 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(124 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(133 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(125 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.497+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(129 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.498+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 47 ==== osd_op_reply(132 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.498+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383abe540 con 0x7f6230074060 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623ed2e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6230074060 2024-04-24T01:44:46.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623ed2e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623ed2e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623ed2e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.499+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6230074060 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.500+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.500+0000 7f623ed2e800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.500+0000 7f623ed2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.500+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94298216130336 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6234031040 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.501+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== watch-notify(notify (1) cookie 94298215778848 notify 146028888105 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c383a87500 con 0x7f6234031040 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.501+0000 7f611dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94298215778848 notifier 4779 bl.length()=149 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.501+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(137 notify.6 [notify cookie 94298216130336 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.501+0000 7f611dffb640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6070003320 con 0x7f6234031040 2024-04-24T01:44:46.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.501+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.501+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== watch-notify(notify_complete (2) cookie 94298216130336 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c383a841c0 con 0x7f6234031040 2024-04-24T01:44:46.508 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.501+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:139 8.15 8:a885cca5:root::.bucket.meta.myfoo%3a57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x55c383a6f6a0 2024-04-24T01:44:46.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(139 .bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f62300be060 con 0x55c383a6f6a0 2024-04-24T01:44:46.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f623ed2e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 from cache 2024-04-24T01:44:46.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f623ed2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7, ofs0, ns] 2024-04-24T01:44:46.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94298216130336 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== watch-notify(notify (1) cookie 94298215777792 notify 146028888106 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55c383a841c0 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f611dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94298215777792 notifier 4779 bl.length()=206 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f611dffb640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6070003320 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.502+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(140 notify.5 [notify cookie 94298216130336 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== watch-notify(notify_complete (2) cookie 94298216130336 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c383a340e0 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:142 4.2 4:4143931c:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x55c383a69450 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:143 4.12 4:4b5208e9:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab3920 con 0x55c383a69450 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:144 4.32 4:4fff430f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab4170 con 0x55c383a69450 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:145 4.17 4:ea68103f:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab4510 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:146 4.1c 4:38a0638d:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6234031040 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:147 4.d 4:b098ff8e:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab3920 con 0x55c383a6f6a0 2024-04-24T01:44:46.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:148 4.22 4:46688efa:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab4170 con 0x55c383a69450 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:149 4.39 4:9c1332b4:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab4510 con 0x55c383a6f6a0 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:150 4.1b 4:d87ac046:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6230074060 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:151 4.32 4:4c4e154a:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab4170 con 0x55c383a69450 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.503+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:152 4.28 4:15181442:::.dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab3920 con 0x55c383a69450 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.505+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(146 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.4 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.505+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(150 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.8 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.505+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 48 ==== osd_op_reply(152 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.10 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.505+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== osd_op_reply(145 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.3 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.505+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 49 ==== osd_op_reply(144 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.2 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.505+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== osd_op_reply(149 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f62300be060 con 0x55c383a6f6a0 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.505+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 50 ==== osd_op_reply(151 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.9 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 51 ==== osd_op_reply(142 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(147 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f62300be060 con 0x55c383a6f6a0 2024-04-24T01:44:46.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 52 ==== osd_op_reply(143 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 53 ==== osd_op_reply(148 .dir.57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623ed2e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 : miss 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623ed2e800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:153 6.18 6:187af25e:::pubsub..bucket.myfoo%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6234031040 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(153 pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623ed2e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 info.flags=0x0 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623ed2e800 10 adding default.rgw.log++pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 to cache LRU end 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.506+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:154 6.18 6:187af25e:::pubsub..bucket.myfoo%2f57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6234031040 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.507+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== osd_op_reply(154 pubsub..bucket.myfoo/57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.7 [delete] v34'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.507+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6230074060 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.508+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.508+0000 7f623ed2e800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.508+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6234031040 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.509+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.509+0000 7f623ed2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.509+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94298216108544 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab42d0 con 0x7f6230074060 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== watch-notify(notify (1) cookie 94298215771440 notify 146028888093 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c383a86f30 con 0x7f6230074060 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f611dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94298215771440 notifier 4779 bl.length()=170 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(157 notify.3 [notify cookie 94298216108544 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f611dffb640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6070003320 con 0x7f6230074060 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== watch-notify(notify_complete (2) cookie 94298216108544 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c383a878a0 con 0x7f6230074060 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f623ed2e800 10 removing email index: foo@foo.com 2024-04-24T01:44:46.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.510+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x55c383a69450 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.511+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 54 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.511+0000 7f623ed2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.511+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94298216108544 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab42d0 con 0x7f6230074060 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.511+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== watch-notify(notify (1) cookie 94298215771440 notify 146028888094 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55c383a878a0 con 0x7f6230074060 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.511+0000 7f611e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94298215771440 notifier 4779 bl.length()=162 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.511+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 36 ==== osd_op_reply(160 notify.3 [notify cookie 94298216108544 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.511+0000 7f611e7fc640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6100003d60 con 0x7f6230074060 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.512+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 37 ==== watch-notify(notify_complete (2) cookie 94298216108544 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c383a864e0 con 0x7f6230074060 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.512+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 38 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.512+0000 7f623ed2e800 10 removing user buckets index 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.512+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6230074060 2024-04-24T01:44:46.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.513+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 39 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.513+0000 7f623ed2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.513+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94298216108544 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab42d0 con 0x7f6234031040 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.513+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== watch-notify(notify (1) cookie 94298215777792 notify 146028888107 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c383a340e0 con 0x7f6234031040 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.513+0000 7f611dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94298215777792 notifier 4779 bl.length()=160 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.513+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== osd_op_reply(163 notify.5 [notify cookie 94298216108544 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.513+0000 7f611dffb640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f60700032c0 con 0x7f6234031040 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.514+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.514+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 46 ==== watch-notify(notify_complete (2) cookie 94298216108544 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c383a31430 con 0x7f6234031040 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.514+0000 7f623ed2e800 10 removing user index: foo 2024-04-24T01:44:46.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.514+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x55c383a69450 2024-04-24T01:44:46.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 55 ==== osd_op_reply(165 foo [call,call,delete] v34'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623ed2e800 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623ed2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94298216108544 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c383ab42d0 con 0x55c383a69450 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 56 ==== watch-notify(notify (1) cookie 94298215769360 notify 146028888086 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c383a31430 con 0x55c383a69450 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f611e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94298215769360 notifier 4779 bl.length()=152 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f611e7fc640 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6100003d60 con 0x55c383a69450 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 57 ==== osd_op_reply(166 notify.4 [notify cookie 94298216108544 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 58 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.515+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 59 ==== watch-notify(notify_complete (2) cookie 94298216108544 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c383a311a0 con 0x55c383a69450 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.516+0000 7f60f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.516+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94298215783536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x55c383a69450 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.517+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 60 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94298215783536] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.517+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94298215760176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383ac9200 con 0x7f6230074060 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.518+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 40 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94298215760176] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.518+0000 7f623ed2e800 20 remove_watcher() i=0 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.518+0000 7f623ed2e800 2 removed watcher, disabling cache 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.518+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94298215764960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79c70 con 0x55c383a69450 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.520+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 61 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94298215764960] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.520+0000 7f623ed2e800 20 remove_watcher() i=1 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.520+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94298215757664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79c70 con 0x55c383a6f6a0 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.521+0000 7f623a266640 1 -- 172.21.15.131:0/712705334 <== osd.3 v2:172.21.15.131:6800/3849831825 36 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94298215757664] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62300be060 con 0x55c383a6f6a0 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.521+0000 7f623ed2e800 20 remove_watcher() i=2 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.521+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94298215771440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79c70 con 0x7f6230074060 2024-04-24T01:44:46.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.522+0000 7f623b268640 1 -- 172.21.15.131:0/712705334 <== osd.2 v2:172.21.15.131:6809/3673094383 41 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94298215771440] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6234040040 con 0x7f6230074060 2024-04-24T01:44:46.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.522+0000 7f623ed2e800 20 remove_watcher() i=3 2024-04-24T01:44:46.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.522+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94298215769360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79c70 con 0x55c383a69450 2024-04-24T01:44:46.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.523+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.1 v2:172.21.15.131:6808/2417718615 62 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94298215769360] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x55c383a69450 2024-04-24T01:44:46.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.523+0000 7f623ed2e800 20 remove_watcher() i=4 2024-04-24T01:44:46.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.523+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94298215777792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a76510 con 0x7f6234031040 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.524+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 47 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94298215777792] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.524+0000 7f623ed2e800 20 remove_watcher() i=5 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.524+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94298215778848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79c70 con 0x7f6234031040 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.525+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 48 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94298215778848] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.525+0000 7f623ed2e800 20 remove_watcher() i=6 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.525+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94298215779904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c383a79c70 con 0x7f6234031040 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 <== osd.0 v2:172.21.15.107:6800/2413654117 49 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94298215779904] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c061040 con 0x7f6234031040 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 20 remove_watcher() i=7 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6234031040 msgr2=0x7f6234032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f6234031040 0x7f6234032940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c383a69450 msgr2=0x55c383a6b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c383a69450 0x55c383a6b910 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6230074060 msgr2=0x7f6230001f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f6230074060 0x7f6230001f00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c383a6f6a0 msgr2=0x55c383a71a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c383a6f6a0 0x55c383a71a90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6104036900 msgr2=0x7f6104038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6104036900 0x7f6104038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c383a353c0 tx=0x7f623401f000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 msgr2=0x55c383a5d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623aa67640 1 -- 172.21.15.131:0/712705334 reap_dead start 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a5d960 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6230052f20 tx=0x7f623008dd60 comp rx=0 tx=0).stop 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 shutdown_connections 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 --2- 172.21.15.131:0/712705334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a562c0 0x55c383a5d960 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 >> 172.21.15.131:0/712705334 conn(0x55c383a52620 msgr2=0x55c383a4fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 shutdown_connections 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.526+0000 7f623ed2e800 1 -- 172.21.15.131:0/712705334 wait complete. 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6114036900 msgr2=0x7f6114038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6114036900 0x7f6114038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c383a39080 tx=0x7f6234005840 comp rx=0 tx=0).stop 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a49040 msgr2=0x55c383a49460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a49040 0x55c383a49460 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6230044840 tx=0x7f6230002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 shutdown_connections 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6114036900 0x7f6114038dc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/1001657945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383a49040 0x55c383a49460 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 >> 172.21.15.131:0/1001657945 conn(0x55c383a3d0e0 msgr2=0x55c383a3d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 shutdown_connections 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/1001657945 wait complete. 2024-04-24T01:44:46.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c38393c4a0 msgr2=0x55c383a37ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c38393c4a0 0x55c383a37ea0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6120036900 msgr2=0x7f6120038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6120036900 0x7f6120038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6230054000 tx=0x7f623004e000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 msgr2=0x55c383a30c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a30c60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f622c001de0 tx=0x7f622c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 shutdown_connections 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c38393c4a0 0x55c383a37ea0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6120036900 0x7f6120038dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 --2- 172.21.15.131:0/106192508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c383938990 0x55c383a30c60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 >> 172.21.15.131:0/106192508 conn(0x55c383932340 msgr2=0x55c383a23260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 shutdown_connections 2024-04-24T01:44:46.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.527+0000 7f623ed2e800 1 -- 172.21.15.131:0/106192508 wait complete. 2024-04-24T01:44:46.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:44:46.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:44:46.536 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:44:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:46.578 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d9436800 1 Processor -- start 2024-04-24T01:44:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d9436800 1 -- start start 2024-04-24T01:44:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d9436800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558d1e9f9d20 0x558d1e9fa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d9436800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d1e8b9d40 con 0x558d1e9faf80 2024-04-24T01:44:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d9436800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x558d1e88c4d0 con 0x558d1e9f9d20 2024-04-24T01:44:46.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d6f35640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558d1e9f9d20 0x558d1e9fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d6734640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x558d1e9faf80 0x558d1e9fb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:38988/0 (socket says 172.21.15.131:38988) 2024-04-24T01:44:46.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d6f35640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558d1e9f9d20 0x558d1e9fa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51736/0 (socket says 172.21.15.131:51736) 2024-04-24T01:44:46.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d6734640 1 -- 172.21.15.131:0/3677512920 learned_addr learned my addr 172.21.15.131:0/3677512920 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:46.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d6f35640 1 -- 172.21.15.131:0/3677512920 >> v1:172.21.15.107:6789/0 conn(0x558d1e9faf80 legacy=0x558d1e9fb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.580 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.579+0000 7f71d6f35640 1 -- 172.21.15.131:0/3677512920 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1e8b8590 con 0x558d1e9f9d20 2024-04-24T01:44:46.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.581+0000 7f71d6f35640 1 --2- 172.21.15.131:0/3677512920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1e9fa140 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f71c800a470 tx=0x7f71c801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03d0c276ee12002 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.581+0000 7f71d5f33640 1 -- 172.21.15.131:0/3677512920 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c8057070 con 0x558d1e9f9d20 2024-04-24T01:44:46.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.581+0000 7f71d5f33640 1 -- 172.21.15.131:0/3677512920 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c8052570 con 0x558d1e9f9d20 2024-04-24T01:44:46.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.581+0000 7f71d5f33640 1 -- 172.21.15.131:0/3677512920 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c8052870 con 0x558d1e9f9d20 2024-04-24T01:44:46.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.582+0000 7f71d9436800 1 -- 172.21.15.131:0/3677512920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 msgr2=0x558d1e9fa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.582+0000 7f71d9436800 1 --2- 172.21.15.131:0/3677512920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1e9fa140 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f71c800a470 tx=0x7f71c801ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:46.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.582+0000 7f71d9436800 1 -- 172.21.15.131:0/3677512920 shutdown_connections 2024-04-24T01:44:46.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.582+0000 7f71d9436800 1 --2- 172.21.15.131:0/3677512920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1e9fa140 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.582+0000 7f71d9436800 1 -- 172.21.15.131:0/3677512920 >> 172.21.15.131:0/3677512920 conn(0x558d1e9f5380 msgr2=0x558d1e9f77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.582+0000 7f71d9436800 1 -- 172.21.15.131:0/3677512920 shutdown_connections 2024-04-24T01:44:46.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.582+0000 7f71d9436800 1 -- 172.21.15.131:0/3677512920 wait complete. 2024-04-24T01:44:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.593+0000 7f71d9436800 1 Processor -- start 2024-04-24T01:44:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.594+0000 7f71d9436800 1 -- start start 2024-04-24T01:44:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.594+0000 7f71d9436800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.594+0000 7f71d9436800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558d1e9463c0 con 0x558d1e9f9d20 2024-04-24T01:44:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.594+0000 7f71d6f35640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.594+0000 7f71d6f35640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaee760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51740/0 (socket says 172.21.15.131:51740) 2024-04-24T01:44:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.594+0000 7f71d6f35640 1 -- 172.21.15.131:0/1129966143 learned_addr learned my addr 172.21.15.131:0/1129966143 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.594+0000 7f71d6f35640 1 -- 172.21.15.131:0/1129966143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1eaeed30 con 0x558d1e9f9d20 2024-04-24T01:44:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d6f35640 1 --2- 172.21.15.131:0/1129966143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaee760 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f71c8055040 tx=0x7f71c804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62bc649ef21e708 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f70c4e09640 1 -- 172.21.15.131:0/1129966143 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c8057070 con 0x558d1e9f9d20 2024-04-24T01:44:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f70c4e09640 1 -- 172.21.15.131:0/1129966143 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c8063070 con 0x558d1e9f9d20 2024-04-24T01:44:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f70c4e09640 1 -- 172.21.15.131:0/1129966143 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c8052720 con 0x558d1e9f9d20 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d9436800 1 -- 172.21.15.131:0/1129966143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 msgr2=0x558d1eaee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d9436800 1 --2- 172.21.15.131:0/1129966143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaee760 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f71c8055040 tx=0x7f71c804c000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d9436800 1 -- 172.21.15.131:0/1129966143 shutdown_connections 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d9436800 1 --2- 172.21.15.131:0/1129966143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaee760 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d9436800 1 -- 172.21.15.131:0/1129966143 >> 172.21.15.131:0/1129966143 conn(0x558d1e9f5380 msgr2=0x558d1eae5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d9436800 1 -- 172.21.15.131:0/1129966143 shutdown_connections 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.595+0000 7f71d9436800 1 -- 172.21.15.131:0/1129966143 wait complete. 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d9436800 1 Processor -- start 2024-04-24T01:44:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d9436800 1 -- start start 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d9436800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaf6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d9436800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558d1e96d4b0 con 0x558d1e9f9d20 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d6f35640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaf6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d6f35640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaf6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51746/0 (socket says 172.21.15.131:51746) 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d6f35640 1 -- 172.21.15.131:0/2184768389 learned_addr learned my addr 172.21.15.131:0/2184768389 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.596+0000 7f71d6f35640 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1eaf67c0 con 0x558d1e9f9d20 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.597+0000 7f71d6f35640 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaf6280 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f71c8060040 tx=0x7f71c8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.597+0000 7f70c3606640 1 -- 172.21.15.131:0/2184768389 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c8052c70 con 0x558d1e9f9d20 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.597+0000 7f70c3606640 1 -- 172.21.15.131:0/2184768389 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c806c070 con 0x558d1e9f9d20 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.597+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d1eaf6a50 con 0x558d1e9f9d20 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.597+0000 7f70c3606640 1 -- 172.21.15.131:0/2184768389 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c805e480 con 0x558d1e9f9d20 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.597+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1eaf96b0 con 0x558d1e9f9d20 2024-04-24T01:44:46.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f70c3606640 1 -- 172.21.15.131:0/2184768389 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71c805e620 con 0x558d1e9f9d20 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f70c3606640 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70bc036900 0x7f70bc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f70c3606640 1 -- 172.21.15.131:0/2184768389 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f71c808e800 con 0x558d1e9f9d20 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f71d6734640 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70bc036900 0x7f70bc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f71d9436800 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1e9faf80 0x558d1eafd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eafda40 con 0x558d1e9faf80 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f71d7736640 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1e9faf80 0x558d1eafd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f71d6734640 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70bc036900 0x7f70bc038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f71cc000f60 tx=0x7f71cc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.598+0000 7f71d7736640 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1e9faf80 0x558d1eafd470 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.599+0000 7f71d7736640 1 -- 172.21.15.131:0/2184768389 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71d000a4a0 con 0x558d1e9faf80 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.599+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eafaa40 con 0x558d1e9faf80 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.599+0000 7f71d7736640 1 -- 172.21.15.131:0/2184768389 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71d000a4a0 con 0x558d1e9faf80 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.599+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eaff860 con 0x558d1e9faf80 2024-04-24T01:44:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.599+0000 7f71d7736640 1 -- 172.21.15.131:0/2184768389 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f71d000a4a0 con 0x558d1e9faf80 2024-04-24T01:44:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.599+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eafeba0 con 0x558d1e9faf80 2024-04-24T01:44:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.599+0000 7f71d7736640 1 -- 172.21.15.131:0/2184768389 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71d000a4a0 con 0x558d1e9faf80 2024-04-24T01:44:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eafeff0 con 0x558d1e9faf80 2024-04-24T01:44:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d7736640 1 -- 172.21.15.131:0/2184768389 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f71d000a4a0 con 0x558d1e9faf80 2024-04-24T01:44:46.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d9436800 1 Processor -- start 2024-04-24T01:44:46.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d9436800 1 -- start start 2024-04-24T01:44:46.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d9436800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb0e5d0 0x558d1eb0e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d9436800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558d1e8ec6b0 con 0x558d1eb0e5d0 2024-04-24T01:44:46.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d6734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb0e5d0 0x558d1eb0e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.600+0000 7f71d6734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb0e5d0 0x558d1eb0e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51762/0 (socket says 172.21.15.131:51762) 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f71d6734640 1 -- 172.21.15.131:0/2009648416 learned_addr learned my addr 172.21.15.131:0/2009648416 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f71d6734640 1 -- 172.21.15.131:0/2009648416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1eb0ef30 con 0x558d1eb0e5d0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f71d6734640 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb0e5d0 0x558d1eb0e9f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f71cc001ed0 tx=0x7f71cc00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f70c0e01640 1 -- 172.21.15.131:0/2009648416 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71cc01b550 con 0x558d1eb0e5d0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f70c0e01640 1 -- 172.21.15.131:0/2009648416 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71cc01b6f0 con 0x558d1eb0e5d0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d1eb0f9a0 con 0x558d1eb0e5d0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f70c0e01640 1 -- 172.21.15.131:0/2009648416 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71cc01b9d0 con 0x558d1eb0e5d0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.601+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1eb0fea0 con 0x558d1eb0e5d0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.602+0000 7f70c0e01640 1 -- 172.21.15.131:0/2009648416 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71cc023020 con 0x558d1eb0e5d0 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.602+0000 7f70c0e01640 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70b0036900 0x7f70b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.602+0000 7f70c0e01640 1 -- 172.21.15.131:0/2009648416 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f71cc021020 con 0x558d1eb0e5d0 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.602+0000 7f71d7736640 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70b0036900 0x7f70b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.602+0000 7f71d9436800 1 Processor -- start 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d9436800 1 -- start start 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d7736640 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70b0036900 0x7f70b0038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x558d1eafe6c0 tx=0x7f71d0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d9436800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb1bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d9436800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558d1eaeeff0 con 0x558d1eb1b910 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d6734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb1bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d6734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb1bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51770/0 (socket says 172.21.15.131:51770) 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d6734640 1 -- 172.21.15.131:0/273713212 learned_addr learned my addr 172.21.15.131:0/273713212 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d6734640 1 -- 172.21.15.131:0/273713212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1eb1c300 con 0x558d1eb1b910 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f71d6734640 1 --2- 172.21.15.131:0/273713212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb1bd30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f71cc04ce90 tx=0x7f71cc0468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0b590533d7f8b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f70ba7fc640 1 -- 172.21.15.131:0/273713212 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71cc01be20 con 0x558d1eb1b910 2024-04-24T01:44:46.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f70ba7fc640 1 -- 172.21.15.131:0/273713212 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71cc04a070 con 0x558d1eb1b910 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.603+0000 7f70ba7fc640 1 -- 172.21.15.131:0/273713212 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71cc024e10 con 0x558d1eb1b910 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 -- 172.21.15.131:0/273713212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 msgr2=0x558d1eb1bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 --2- 172.21.15.131:0/273713212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb1bd30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f71cc04ce90 tx=0x7f71cc0468f0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 -- 172.21.15.131:0/273713212 shutdown_connections 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 --2- 172.21.15.131:0/273713212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb1bd30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 -- 172.21.15.131:0/273713212 >> 172.21.15.131:0/273713212 conn(0x558d1eb17c70 msgr2=0x558d1eb15cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 -- 172.21.15.131:0/273713212 shutdown_connections 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 -- 172.21.15.131:0/273713212 wait complete. 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 Processor -- start 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 -- start start 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb22fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.604+0000 7f71d9436800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558d1eb1ca70 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f71d6734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb22fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f71d6734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb22fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51780/0 (socket says 172.21.15.131:51780) 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 learned_addr learned my addr 172.21.15.131:0/2643738766 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1eb23510 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f71d6734640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb22fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0234d0 tx=0x7f71cc04ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f70b8ff9640 1 -- 172.21.15.131:0/2643738766 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71cc034070 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f70b8ff9640 1 -- 172.21.15.131:0/2643738766 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71cc024e10 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f70b8ff9640 1 -- 172.21.15.131:0/2643738766 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71cc025ad0 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d1eb237a0 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.605+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1eb237a0 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.606+0000 7f70b8ff9640 1 -- 172.21.15.131:0/2643738766 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71cc037070 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.606+0000 7f70b8ff9640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a00368b0 0x7f70a0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.606+0000 7f70b8ff9640 1 -- 172.21.15.131:0/2643738766 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f71cc03ad40 con 0x558d1eb1b910 2024-04-24T01:44:46.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.606+0000 7f71d7736640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a00368b0 0x7f70a0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.606+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.606+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1eb2e900 0x558d1eb30dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.606+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb31510 con 0x558d1eb2e900 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d6f35640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1eb2e900 0x558d1eb30dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d7736640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a00368b0 0x7f70a0038d70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x558d1eafa990 tx=0x7f71d001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d6f35640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1eb2e900 0x558d1eb30dc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 20 realm 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb31920 con 0x558d1eb2e900 2024-04-24T01:44:46.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.607+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb321f0 con 0x558d1eb2e900 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb32590 con 0x558d1eb2e900 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb32a30 con 0x558d1eb2e900 2024-04-24T01:44:46.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 20 searching for the correct realm 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558d1eb349d0 0x558d1eb36e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d6734640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558d1eb349d0 0x558d1eb36e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.608+0000 7f71d6734640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558d1eb349d0 0x558d1eb36e20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.609+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.609+0000 7f71d6734640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f71cc039070 0x7f71cc030440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.609+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71cc039070 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.609+0000 7f71d7736640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f71cc039070 0x7f71cc030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.609+0000 7f71d7736640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f71cc039070 0x7f71cc030440 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.610+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71d001f070 con 0x7f71cc039070 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.610+0000 7f71d7736640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f71d0031040 0x7f71d0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.610+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.610+0000 7f71d6f35640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f71d0031040 0x7f71d0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.610+0000 7f71d6f35640 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f71d0031040 0x7f71d0032940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.611+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71cc039070 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71d001f070 con 0x7f71cc039070 2024-04-24T01:44:46.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.612+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71cc039070 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71d001f070 con 0x7f71cc039070 2024-04-24T01:44:46.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.613+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.614+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71cc039070 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71d001f070 con 0x7f71cc039070 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.615+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71cc039070 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71d001f070 con 0x7f71cc039070 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.616+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71cc039070 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71d001f070 con 0x7f71cc039070 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb349d0 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71d0031040 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x558d1eb2e900 2024-04-24T01:44:46.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.617+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb374f0 con 0x7f71cc039070 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb33470 con 0x558d1eb2e900 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb33d10 con 0x558d1eb2e900 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb330b0 con 0x558d1eb2e900 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 zone default found 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 4 Realm: () 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:46.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 zonegroup default 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.618+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb33d10 con 0x7f71cc039070 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb39800 con 0x558d1eb349d0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb39ba0 con 0x558d1eb349d0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 20 started sync module instance, tier type = 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.619+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb38c40 con 0x7f71cc039070 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.620+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.620+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94064593834304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb38c40 con 0x7f71cc039070 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.620+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3a560 con 0x558d1eb2e900 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.621+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94064593834304] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.622+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.622+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94064593838768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb38c40 con 0x558d1eb2e900 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.622+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3afe0 con 0x558d1eb349d0 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.623+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94064593838768] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.623+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.623+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94064593831824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb38bb0 con 0x558d1eb349d0 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.623+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3bea0 con 0x7f71cc039070 2024-04-24T01:44:46.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.624+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94064593831824] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.624+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.624+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94064593844720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3be10 con 0x7f71cc039070 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.624+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3cd60 con 0x558d1eb2e900 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.625+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94064593844720] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.625+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.625+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94064593846928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3cd60 con 0x558d1eb2e900 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.625+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3d7b0 con 0x7f71d0031040 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.626+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94064593846928] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.626+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.626+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94064593851072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3cd60 con 0x7f71d0031040 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.626+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3e1c0 con 0x7f71d0031040 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.627+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94064593851072] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.627+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94064593854192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3cd60 con 0x7f71d0031040 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3ebd0 con 0x7f71d0031040 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94064593854192] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94064593848768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3ebd0 con 0x7f71d0031040 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 20 add_watcher() i=0 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 20 add_watcher() i=1 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 20 add_watcher() i=2 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 20 add_watcher() i=3 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 20 add_watcher() i=4 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 20 add_watcher() i=5 2024-04-24T01:44:46.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.628+0000 7f71d9436800 20 add_watcher() i=6 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.629+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94064593848768] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.629+0000 7f71d9436800 20 add_watcher() i=7 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.629+0000 7f71d9436800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.629+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb41ef0 con 0x558d1eb2e900 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.630+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.630+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94064593856656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3f160 con 0x558d1eb2e900 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94064593856656] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f708d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d9436800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d9436800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d9436800 5 note: GC not initialized 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f7007fff640 20 reqs_thread_entry: start 2024-04-24T01:44:46.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d9436800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d9436800 20 Filter name: none 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f7005ffb640 20 reqs_thread_entry: start 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d9436800 20 rados->read ofs=0 len=0 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.631+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb74db0 con 0x558d1eb2e900 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.632+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.632+0000 7f71d9436800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:could not fetch user info: no user info saved 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.632+0000 7f708d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.632+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94064593856656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb74d70 con 0x558d1eb2e900 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.633+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94064593856656] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.633+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94064593834304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb74d70 con 0x7f71cc039070 2024-04-24T01:44:46.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.634+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94064593834304] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.634+0000 7f71d9436800 20 remove_watcher() i=0 2024-04-24T01:44:46.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.634+0000 7f71d9436800 2 removed watcher, disabling cache 2024-04-24T01:44:46.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.634+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94064593838768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb74d70 con 0x558d1eb2e900 2024-04-24T01:44:46.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.636+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94064593838768] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.636+0000 7f71d9436800 20 remove_watcher() i=1 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.636+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94064593831824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb74d70 con 0x558d1eb349d0 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.637+0000 7f71d6734640 1 -- 172.21.15.131:0/2643738766 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94064593831824] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71cc036030 con 0x558d1eb349d0 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.637+0000 7f71d9436800 20 remove_watcher() i=2 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.637+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94064593844720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb39140 con 0x7f71cc039070 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.638+0000 7f71d7736640 1 -- 172.21.15.131:0/2643738766 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94064593844720] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71d0040040 con 0x7f71cc039070 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.638+0000 7f71d9436800 20 remove_watcher() i=3 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.638+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94064593846928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb38790 con 0x558d1eb2e900 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.639+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94064593846928] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x558d1eb2e900 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.639+0000 7f71d9436800 20 remove_watcher() i=4 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.639+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94064593851072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb3b9f0 con 0x7f71d0031040 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.640+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94064593851072] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.640+0000 7f71d9436800 20 remove_watcher() i=5 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.640+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94064593854192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb39140 con 0x7f71d0031040 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.641+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94064593854192] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.641+0000 7f71d9436800 20 remove_watcher() i=6 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.641+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94064593848768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558d1eb38790 con 0x7f71d0031040 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94064593848768] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c8009d10 con 0x7f71d0031040 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 20 remove_watcher() i=7 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f71d0031040 msgr2=0x7f71d0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f71d0031040 0x7f71d0032940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1eb2e900 msgr2=0x558d1eb30dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1eb2e900 0x558d1eb30dc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f71cc039070 msgr2=0x7f71cc030440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f71cc039070 0x7f71cc030440 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558d1eb349d0 msgr2=0x558d1eb36e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x558d1eb349d0 0x558d1eb36e20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a00368b0 msgr2=0x7f70a0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a00368b0 0x7f70a0038d70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x558d1eafa990 tx=0x7f71d001f000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d6f35640 1 -- 172.21.15.131:0/2643738766 reap_dead start 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 msgr2=0x558d1eb22fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb22fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0234d0 tx=0x7f71cc04ce20 comp rx=0 tx=0).stop 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 shutdown_connections 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 --2- 172.21.15.131:0/2643738766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb1b910 0x558d1eb22fd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 >> 172.21.15.131:0/2643738766 conn(0x558d1eb17c70 msgr2=0x558d1eb152d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 shutdown_connections 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.642+0000 7f71d9436800 1 -- 172.21.15.131:0/2643738766 wait complete. 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70b0036900 msgr2=0x7f70b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70b0036900 0x7f70b0038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x558d1eafe6c0 tx=0x7f71d0005840 comp rx=0 tx=0).stop 2024-04-24T01:44:46.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb0e5d0 msgr2=0x558d1eb0e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb0e5d0 0x558d1eb0e9f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f71cc001ed0 tx=0x7f71cc00d7a0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 shutdown_connections 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70b0036900 0x7f70b0038dc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2009648416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1eb0e5d0 0x558d1eb0e9f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 >> 172.21.15.131:0/2009648416 conn(0x558d1eb02670 msgr2=0x558d1eb02a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 shutdown_connections 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2009648416 wait complete. 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1e9faf80 msgr2=0x558d1eafd470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1e9faf80 0x558d1eafd470 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70bc036900 msgr2=0x7f70bc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70bc036900 0x7f70bc038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f71cc000f60 tx=0x7f71cc0012b0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 msgr2=0x558d1eaf6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaf6280 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f71c8060040 tx=0x7f71c8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 shutdown_connections 2024-04-24T01:44:46.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558d1e9faf80 0x558d1eafd470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70bc036900 0x7f70bc038dc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 --2- 172.21.15.131:0/2184768389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d1e9f9d20 0x558d1eaf6280 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 >> 172.21.15.131:0/2184768389 conn(0x558d1e9f5380 msgr2=0x558d1eae44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 shutdown_connections 2024-04-24T01:44:46.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.643+0000 7f71d9436800 1 -- 172.21.15.131:0/2184768389 wait complete. 2024-04-24T01:44:46.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-24T01:44:46.655 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-24T01:44:46.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-24T01:44:46.655 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-24T01:44:46.737 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:46.737 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:46.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.737+0000 7f43abb19800 1 Processor -- start 2024-04-24T01:44:46.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.737+0000 7f43abb19800 1 -- start start 2024-04-24T01:44:46.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.737+0000 7f43abb19800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e7af07d9f0 0x55e7af07fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.737+0000 7f43abb19800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7aef3bd40 con 0x55e7af080320 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.737+0000 7f43abb19800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55e7aef0e4d0 con 0x55e7af07d9f0 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.738+0000 7f43a9618640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e7af07d9f0 0x55e7af07fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.738+0000 7f43a9618640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e7af07d9f0 0x55e7af07fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51784/0 (socket says 172.21.15.131:51784) 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.738+0000 7f43a9618640 1 -- 172.21.15.131:0/3109267147 learned_addr learned my addr 172.21.15.131:0/3109267147 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.738+0000 7f43a0e17640 1 --1- 172.21.15.131:0/3109267147 >> v1:172.21.15.107:6789/0 conn(0x55e7af080320 0x55e7af082710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:38990/0 (socket says 172.21.15.131:38990) 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.738+0000 7f43a9618640 1 -- 172.21.15.131:0/3109267147 >> v1:172.21.15.107:6789/0 conn(0x55e7af080320 legacy=0x55e7af082710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.738+0000 7f43a9618640 1 -- 172.21.15.131:0/3109267147 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7aef3a590 con 0x55e7af07d9f0 2024-04-24T01:44:46.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43a9618640 1 --2- 172.21.15.131:0/3109267147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af07fde0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f439c00a520 tx=0x7f439c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3029a1cb3d612d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43a8e17640 1 -- 172.21.15.131:0/3109267147 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c057070 con 0x55e7af07d9f0 2024-04-24T01:44:46.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43a8e17640 1 -- 172.21.15.131:0/3109267147 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c052570 con 0x55e7af07d9f0 2024-04-24T01:44:46.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43a8e17640 1 -- 172.21.15.131:0/3109267147 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c04ae60 con 0x55e7af07d9f0 2024-04-24T01:44:46.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43abb19800 1 -- 172.21.15.131:0/3109267147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 msgr2=0x55e7af07fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43abb19800 1 --2- 172.21.15.131:0/3109267147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af07fde0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f439c00a520 tx=0x7f439c01d010 comp rx=0 tx=0).stop 2024-04-24T01:44:46.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43abb19800 1 -- 172.21.15.131:0/3109267147 shutdown_connections 2024-04-24T01:44:46.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43abb19800 1 --2- 172.21.15.131:0/3109267147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af07fde0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43abb19800 1 -- 172.21.15.131:0/3109267147 >> 172.21.15.131:0/3109267147 conn(0x55e7af077420 msgr2=0x55e7af079840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43abb19800 1 -- 172.21.15.131:0/3109267147 shutdown_connections 2024-04-24T01:44:46.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.740+0000 7f43abb19800 1 -- 172.21.15.131:0/3109267147 wait complete. 2024-04-24T01:44:46.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.752+0000 7f43abb19800 1 Processor -- start 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.752+0000 7f43abb19800 1 -- start start 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.752+0000 7f43abb19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af16e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.752+0000 7f43abb19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7aefc83c0 con 0x55e7af07d9f0 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f43a9618640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af16e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f43a9618640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af16e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51800/0 (socket says 172.21.15.131:51800) 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f43a9618640 1 -- 172.21.15.131:0/2287686215 learned_addr learned my addr 172.21.15.131:0/2287686215 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f43a9618640 1 -- 172.21.15.131:0/2287686215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7af16e740 con 0x55e7af07d9f0 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f43a9618640 1 --2- 172.21.15.131:0/2287686215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af16e170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f439c01d050 tx=0x7f439c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3739142f2bd4e02d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f4297606640 1 -- 172.21.15.131:0/2287686215 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c057040 con 0x55e7af07d9f0 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f4297606640 1 -- 172.21.15.131:0/2287686215 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c052720 con 0x55e7af07d9f0 2024-04-24T01:44:46.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.753+0000 7f4297606640 1 -- 172.21.15.131:0/2287686215 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c052a40 con 0x55e7af07d9f0 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 -- 172.21.15.131:0/2287686215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 msgr2=0x55e7af16e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 --2- 172.21.15.131:0/2287686215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af16e170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f439c01d050 tx=0x7f439c04c000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 -- 172.21.15.131:0/2287686215 shutdown_connections 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 --2- 172.21.15.131:0/2287686215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af16e170 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 -- 172.21.15.131:0/2287686215 >> 172.21.15.131:0/2287686215 conn(0x55e7af077420 msgr2=0x55e7af169a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 -- 172.21.15.131:0/2287686215 shutdown_connections 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 -- 172.21.15.131:0/2287686215 wait complete. 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 Processor -- start 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 -- start start 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af175b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.754+0000 7f43abb19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7af086140 con 0x55e7af07d9f0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f43a9618640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af175b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f43a9618640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af175b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51814/0 (socket says 172.21.15.131:51814) 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f43a9618640 1 -- 172.21.15.131:0/642946066 learned_addr learned my addr 172.21.15.131:0/642946066 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f43a9618640 1 -- 172.21.15.131:0/642946066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7af1760c0 con 0x55e7af07d9f0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f43a9618640 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af175b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f439c01cfe0 tx=0x7f439c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f4295e03640 1 -- 172.21.15.131:0/642946066 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c073070 con 0x55e7af07d9f0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f4295e03640 1 -- 172.21.15.131:0/642946066 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c05d440 con 0x55e7af07d9f0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7af176350 con 0x55e7af07d9f0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f4295e03640 1 -- 172.21.15.131:0/642946066 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c057070 con 0x55e7af07d9f0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.755+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7af179000 con 0x55e7af07d9f0 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43abb19800 1 Processor -- start 2024-04-24T01:44:46.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43abb19800 1 -- start start 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43abb19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af183850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43abb19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7aef6e6b0 con 0x55e7af183430 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f4295e03640 1 -- 172.21.15.131:0/642946066 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f439c076070 con 0x55e7af07d9f0 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f4295e03640 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4290036950 0x7f4290038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43a9e19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af183850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f4295e03640 1 -- 172.21.15.131:0/642946066 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f439c08dcb0 con 0x55e7af07d9f0 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43a9e19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af183850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51826/0 (socket says 172.21.15.131:51826) 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43a9e19640 1 -- 172.21.15.131:0/3336139897 learned_addr learned my addr 172.21.15.131:0/3336139897 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.756+0000 7f43a9618640 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4290036950 0x7f4290038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43a9e19640 1 -- 172.21.15.131:0/3336139897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7af183d90 con 0x55e7af183430 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43a9618640 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4290036950 0x7f4290038e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f439c066fd0 tx=0x7f439c0529c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43a9e19640 1 --2- 172.21.15.131:0/3336139897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af183850 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f43a400a430 tx=0x7f43a400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebce193aa0a6f90 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f428f7fe640 1 -- 172.21.15.131:0/3336139897 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a4015070 con 0x55e7af183430 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f428f7fe640 1 -- 172.21.15.131:0/3336139897 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a4001670 con 0x55e7af183430 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f428f7fe640 1 -- 172.21.15.131:0/3336139897 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a4001990 con 0x55e7af183430 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43abb19800 1 -- 172.21.15.131:0/3336139897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 msgr2=0x55e7af183850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43abb19800 1 --2- 172.21.15.131:0/3336139897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af183850 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f43a400a430 tx=0x7f43a400a8f0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43abb19800 1 -- 172.21.15.131:0/3336139897 shutdown_connections 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43abb19800 1 --2- 172.21.15.131:0/3336139897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af183850 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43abb19800 1 -- 172.21.15.131:0/3336139897 >> 172.21.15.131:0/3336139897 conn(0x55e7af080320 msgr2=0x55e7af17fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43abb19800 1 -- 172.21.15.131:0/3336139897 shutdown_connections 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.757+0000 7f43abb19800 1 -- 172.21.15.131:0/3336139897 wait complete. 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43abb19800 1 Processor -- start 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43abb19800 1 -- start start 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43abb19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af07d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43abb19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7af184720 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43a9e19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af07d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43a9e19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af07d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51828/0 (socket says 172.21.15.131:51828) 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43a9e19640 1 -- 172.21.15.131:0/1059942091 learned_addr learned my addr 172.21.15.131:0/1059942091 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.758+0000 7f43a9e19640 1 -- 172.21.15.131:0/1059942091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7af07ba00 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.759+0000 7f43a9e19640 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af07d310 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f43a4013040 tx=0x7f43a4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.759+0000 7f428dffb640 1 -- 172.21.15.131:0/1059942091 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a4020020 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.759+0000 7f428dffb640 1 -- 172.21.15.131:0/1059942091 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a40108e0 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.759+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7af07bc90 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.759+0000 7f428dffb640 1 -- 172.21.15.131:0/1059942091 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a4015040 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.759+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7af07c130 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f428dffb640 1 -- 172.21.15.131:0/1059942091 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43a4023020 con 0x55e7af183430 2024-04-24T01:44:46.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f428dffb640 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4280036900 0x7f4280038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43abb19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43abb19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f428dffb640 1 -- 172.21.15.131:0/1059942091 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f43a404c0d0 con 0x55e7af183430 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43a0e17640 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4280036900 0x7f4280038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43abb19800 1 Processor -- start 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43abb19800 1 -- start start 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43abb19800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af1a71e0 0x55e7af1a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43a0e17640 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4280036900 0x7f4280038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4394000f60 tx=0x7f43940012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.760+0000 7f43abb19800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e7af16ea00 con 0x55e7af1a71e0 2024-04-24T01:44:46.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f43a9618640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af1a71e0 0x55e7af1a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f43a9618640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af1a71e0 0x55e7af1a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51832/0 (socket says 172.21.15.131:51832) 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f43a9618640 1 -- 172.21.15.131:0/1432203207 learned_addr learned my addr 172.21.15.131:0/1432203207 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f43a9618640 1 -- 172.21.15.131:0/1432203207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7af1a7b40 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f43a9618640 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af1a71e0 0x55e7af1a7600 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f439c005930 tx=0x7f439c076590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f426e7e4640 1 -- 172.21.15.131:0/1432203207 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c091070 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f426e7e4640 1 -- 172.21.15.131:0/1432203207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c08a040 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f426e7e4640 1 -- 172.21.15.131:0/1432203207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f439c0773b0 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.761+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7af1a85b0 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.762+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7af1a8ab0 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.762+0000 7f426e7e4640 1 -- 172.21.15.131:0/1432203207 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f439c094070 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.762+0000 7f426e7e4640 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41e0036950 0x7f41e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.762+0000 7f426e7e4640 1 -- 172.21.15.131:0/1432203207 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f439c097d40 con 0x55e7af1a71e0 2024-04-24T01:44:46.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.762+0000 7f43a0e17640 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41e0036950 0x7f41e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f4267fff640 20 reqs_thread_entry: start 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f43abb19800 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7af1b4c30 0x55e7af1b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f43a0e17640 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41e0036950 0x7f41e0038e10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4394001ed0 tx=0x7f439400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7af1b7790 con 0x55e7af1b4c30 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f43a9e19640 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7af1b4c30 0x55e7af1b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f43a9e19640 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7af1b4c30 0x55e7af1b70c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f43a9e19640 1 -- 172.21.15.131:0/642946066 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43a400e070 con 0x55e7af1b4c30 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.763+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e7af1b9050 con 0x55e7af1b4c30 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43a9e19640 1 -- 172.21.15.131:0/642946066 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43a400e070 con 0x55e7af1b4c30 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4280036900 msgr2=0x7f4280038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4280036900 0x7f4280038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4394000f60 tx=0x7f43940012f0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 msgr2=0x55e7af07d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af07d310 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f43a4013040 tx=0x7f43a4003370 comp rx=0 tx=0).stop 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 shutdown_connections 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4280036900 0x7f4280038dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 --2- 172.21.15.131:0/1059942091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af183430 0x55e7af07d310 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.764+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 >> 172.21.15.131:0/1059942091 conn(0x55e7af080320 msgr2=0x55e7af17d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 shutdown_connections 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1059942091 wait complete. 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41e0036950 msgr2=0x7f41e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41e0036950 0x7f41e0038e10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4394001ed0 tx=0x7f439400f000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af1a71e0 msgr2=0x55e7af1a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af1a71e0 0x55e7af1a7600 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f439c005930 tx=0x7f439c076590 comp rx=0 tx=0).stop 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 shutdown_connections 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f41e0036950 0x7f41e0038e10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/1432203207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af1a71e0 0x55e7af1a7600 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 >> 172.21.15.131:0/1432203207 conn(0x55e7af19bcb0 msgr2=0x55e7af19c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 shutdown_connections 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/1432203207 wait complete. 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7af1b4c30 msgr2=0x55e7af1b70c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7af1b4c30 0x55e7af1b70c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4290036950 msgr2=0x7f4290038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4290036950 0x7f4290038e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f439c066fd0 tx=0x7f439c0529c0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 msgr2=0x55e7af175b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af175b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f439c01cfe0 tx=0x7f439c003020 comp rx=0 tx=0).stop 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 shutdown_connections 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e7af1b4c30 0x55e7af1b70c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4290036950 0x7f4290038e10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 --2- 172.21.15.131:0/642946066 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7af07d9f0 0x55e7af175b80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 >> 172.21.15.131:0/642946066 conn(0x55e7af077420 msgr2=0x55e7af168290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 shutdown_connections 2024-04-24T01:44:46.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.765+0000 7f43abb19800 1 -- 172.21.15.131:0/642946066 wait complete. 2024-04-24T01:44:46.776 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T01:44:46.776 DEBUG:tasks.util.rgw: json result: {'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T01:44:46.776 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-24T01:44:46.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-24T01:44:46.776 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-24T01:44:46.856 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:46.857 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:46.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.857+0000 7f31b040e800 1 Processor -- start 2024-04-24T01:44:46.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.857+0000 7f31b040e800 1 -- start start 2024-04-24T01:44:46.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.857+0000 7f31b040e800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5635ce524d50 0x5635ce525170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.857+0000 7f31b040e800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635ce3e4d40 con 0x5635ce525fb0 2024-04-24T01:44:46.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.857+0000 7f31b040e800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5635ce3b74d0 con 0x5635ce524d50 2024-04-24T01:44:46.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.857+0000 7f31adf0d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5635ce524d50 0x5635ce525170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.858+0000 7f31adf0d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5635ce524d50 0x5635ce525170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51838/0 (socket says 172.21.15.131:51838) 2024-04-24T01:44:46.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.858+0000 7f31ad70c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5635ce525fb0 0x5635ce526430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39004/0 (socket says 172.21.15.131:39004) 2024-04-24T01:44:46.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.858+0000 7f31adf0d640 1 -- 172.21.15.131:0/419169570 learned_addr learned my addr 172.21.15.131:0/419169570 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.858+0000 7f31adf0d640 1 -- 172.21.15.131:0/419169570 >> v1:172.21.15.107:6789/0 conn(0x5635ce525fb0 legacy=0x5635ce526430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.858+0000 7f31adf0d640 1 -- 172.21.15.131:0/419169570 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ce3e3590 con 0x5635ce524d50 2024-04-24T01:44:46.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.860+0000 7f31adf0d640 1 --2- 172.21.15.131:0/419169570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce525170 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f31a000a520 tx=0x7f31a001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6c8cf86386a763 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.860+0000 7f31acf0b640 1 -- 172.21.15.131:0/419169570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0057070 con 0x5635ce524d50 2024-04-24T01:44:46.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.860+0000 7f31acf0b640 1 -- 172.21.15.131:0/419169570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a0052570 con 0x5635ce524d50 2024-04-24T01:44:46.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.860+0000 7f31acf0b640 1 -- 172.21.15.131:0/419169570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a004ae60 con 0x5635ce524d50 2024-04-24T01:44:46.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.861+0000 7f31b040e800 1 -- 172.21.15.131:0/419169570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 msgr2=0x5635ce525170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.861+0000 7f31b040e800 1 --2- 172.21.15.131:0/419169570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce525170 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f31a000a520 tx=0x7f31a001d010 comp rx=0 tx=0).stop 2024-04-24T01:44:46.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.861+0000 7f31b040e800 1 -- 172.21.15.131:0/419169570 shutdown_connections 2024-04-24T01:44:46.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.861+0000 7f31b040e800 1 --2- 172.21.15.131:0/419169570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce525170 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.861+0000 7f31b040e800 1 -- 172.21.15.131:0/419169570 >> 172.21.15.131:0/419169570 conn(0x5635ce520310 msgr2=0x5635ce522730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.861+0000 7f31b040e800 1 -- 172.21.15.131:0/419169570 shutdown_connections 2024-04-24T01:44:46.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.861+0000 7f31b040e800 1 -- 172.21.15.131:0/419169570 wait complete. 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.872+0000 7f31b040e800 1 Processor -- start 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.873+0000 7f31b040e800 1 -- start start 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.873+0000 7f31b040e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce499870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.873+0000 7f31b040e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5635ce4713b0 con 0x5635ce524d50 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.873+0000 7f31adf0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce499870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.873+0000 7f31adf0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce499870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51846/0 (socket says 172.21.15.131:51846) 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.873+0000 7f31adf0d640 1 -- 172.21.15.131:0/940920631 learned_addr learned my addr 172.21.15.131:0/940920631 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.873+0000 7f31adf0d640 1 -- 172.21.15.131:0/940920631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ce61a220 con 0x5635ce524d50 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.874+0000 7f31adf0d640 1 --2- 172.21.15.131:0/940920631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce499870 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f31a001d050 tx=0x7f31a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768924e4f1879b07 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.874+0000 7f309be07640 1 -- 172.21.15.131:0/940920631 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0057040 con 0x5635ce524d50 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.874+0000 7f309be07640 1 -- 172.21.15.131:0/940920631 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a0052720 con 0x5635ce524d50 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.874+0000 7f309be07640 1 -- 172.21.15.131:0/940920631 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0052a40 con 0x5635ce524d50 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.874+0000 7f31b040e800 1 -- 172.21.15.131:0/940920631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 msgr2=0x5635ce499870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.874+0000 7f31b040e800 1 --2- 172.21.15.131:0/940920631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce499870 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f31a001d050 tx=0x7f31a004c000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.874+0000 7f31b040e800 1 -- 172.21.15.131:0/940920631 shutdown_connections 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 --2- 172.21.15.131:0/940920631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce499870 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 -- 172.21.15.131:0/940920631 >> 172.21.15.131:0/940920631 conn(0x5635ce520310 msgr2=0x5635ce611d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 -- 172.21.15.131:0/940920631 shutdown_connections 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 -- 172.21.15.131:0/940920631 wait complete. 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 Processor -- start 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 -- start start 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce61f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31b040e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5635ce52e420 con 0x5635ce524d50 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31adf0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce61f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31adf0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce61f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51860/0 (socket says 172.21.15.131:51860) 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.875+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 learned_addr learned my addr 172.21.15.131:0/3846365803 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.876+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ce61f550 con 0x5635ce524d50 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.876+0000 7f31adf0d640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce61f010 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f31a001cfe0 tx=0x7f31a0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.876+0000 7f309a604640 1 -- 172.21.15.131:0/3846365803 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0073070 con 0x5635ce524d50 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.876+0000 7f309a604640 1 -- 172.21.15.131:0/3846365803 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a0052d50 con 0x5635ce524d50 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.876+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ce61f7e0 con 0x5635ce524d50 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.876+0000 7f309a604640 1 -- 172.21.15.131:0/3846365803 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0057070 con 0x5635ce524d50 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.876+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ce6223f0 con 0x5635ce524d50 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31b040e800 1 Processor -- start 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31b040e800 1 -- start start 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f309a604640 1 -- 172.21.15.131:0/3846365803 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f31a0076070 con 0x5635ce524d50 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31b040e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce6161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31b040e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5635ce4176b0 con 0x5635ce617ca0 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f309a604640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3094036950 0x7f3094038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31ae70e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce6161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f309a604640 1 -- 172.21.15.131:0/3846365803 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f31a008da80 con 0x5635ce524d50 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31ae70e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce6161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51870/0 (socket says 172.21.15.131:51870) 2024-04-24T01:44:46.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31ae70e640 1 -- 172.21.15.131:0/172894550 learned_addr learned my addr 172.21.15.131:0/172894550 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31adf0d640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3094036950 0x7f3094038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31ae70e640 1 -- 172.21.15.131:0/172894550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ce616730 con 0x5635ce617ca0 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.877+0000 7f31adf0d640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3094036950 0x7f3094038e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f31a0078030 tx=0x7f31a00529c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31ae70e640 1 --2- 172.21.15.131:0/172894550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce6161f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f31a800a430 tx=0x7f31a800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14b6890b650dde8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f3093fff640 1 -- 172.21.15.131:0/172894550 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a8015070 con 0x5635ce617ca0 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f3093fff640 1 -- 172.21.15.131:0/172894550 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a8001670 con 0x5635ce617ca0 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f3093fff640 1 -- 172.21.15.131:0/172894550 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a8001990 con 0x5635ce617ca0 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 -- 172.21.15.131:0/172894550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 msgr2=0x5635ce6161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 --2- 172.21.15.131:0/172894550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce6161f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f31a800a430 tx=0x7f31a800a8f0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 -- 172.21.15.131:0/172894550 shutdown_connections 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 --2- 172.21.15.131:0/172894550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce6161f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 -- 172.21.15.131:0/172894550 >> 172.21.15.131:0/172894550 conn(0x5635ce525fb0 msgr2=0x5635ce6292c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 -- 172.21.15.131:0/172894550 shutdown_connections 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 -- 172.21.15.131:0/172894550 wait complete. 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.878+0000 7f31b040e800 1 Processor -- start 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31b040e800 1 -- start start 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31b040e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce635ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31b040e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5635ce616a20 con 0x5635ce617ca0 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31ae70e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce635ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31ae70e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce635ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51886/0 (socket says 172.21.15.131:51886) 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31ae70e640 1 -- 172.21.15.131:0/768943863 learned_addr learned my addr 172.21.15.131:0/768943863 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31ae70e640 1 -- 172.21.15.131:0/768943863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ce636420 con 0x5635ce617ca0 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31ae70e640 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce635ee0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f31a8013040 tx=0x7f31a8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f30927fc640 1 -- 172.21.15.131:0/768943863 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a8020020 con 0x5635ce617ca0 2024-04-24T01:44:46.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ce6366b0 con 0x5635ce617ca0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.879+0000 7f30927fc640 1 -- 172.21.15.131:0/768943863 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a80108e0 con 0x5635ce617ca0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.880+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ce639360 con 0x5635ce617ca0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.880+0000 7f30927fc640 1 -- 172.21.15.131:0/768943863 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a8015040 con 0x5635ce617ca0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.880+0000 7f30927fc640 1 -- 172.21.15.131:0/768943863 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f31a8023020 con 0x5635ce617ca0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.880+0000 7f30927fc640 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3088036900 0x7f3088038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.880+0000 7f30927fc640 1 -- 172.21.15.131:0/768943863 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f31a804c1a0 con 0x5635ce617ca0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31ad70c640 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3088036900 0x7f3088038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31b040e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31b040e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31ad70c640 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3088036900 0x7f3088038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f31a4000f60 tx=0x7f31a40012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31b040e800 1 Processor -- start 2024-04-24T01:44:46.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31b040e800 1 -- start start 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31b040e800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce650580 0x5635ce6509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31b040e800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5635ce61a4b0 con 0x5635ce650580 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31adf0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce650580 0x5635ce6509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31adf0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce650580 0x5635ce6509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51902/0 (socket says 172.21.15.131:51902) 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.881+0000 7f31adf0d640 1 -- 172.21.15.131:0/38501497 learned_addr learned my addr 172.21.15.131:0/38501497 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.882+0000 7f31adf0d640 1 -- 172.21.15.131:0/38501497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ce650ee0 con 0x5635ce650580 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.882+0000 7f31adf0d640 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce650580 0x5635ce6509a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f31a0066f70 tx=0x7f31a0076eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.882+0000 7f30727e4640 1 -- 172.21.15.131:0/38501497 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0089050 con 0x5635ce650580 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.882+0000 7f30727e4640 1 -- 172.21.15.131:0/38501497 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a008a040 con 0x5635ce650580 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.882+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ce651970 con 0x5635ce650580 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.882+0000 7f30727e4640 1 -- 172.21.15.131:0/38501497 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0008170 con 0x5635ce650580 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.882+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ce651e70 con 0x5635ce650580 2024-04-24T01:44:46.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f30727e4640 1 -- 172.21.15.131:0/38501497 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f31a005d5b0 con 0x5635ce650580 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f30727e4640 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2ff0036950 0x7f2ff0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f30727e4640 1 -- 172.21.15.131:0/38501497 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f31a004b100 con 0x5635ce650580 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f31ad70c640 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2ff0036950 0x7f2ff0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f2fe3fff640 20 reqs_thread_entry: start 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5635ce65dfa0 0x5635ce660390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6609a0 con 0x5635ce65dfa0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f31ad70c640 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2ff0036950 0x7f2ff0038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f31a4001ed0 tx=0x7f31a400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.883+0000 7f31ae70e640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5635ce65dfa0 0x5635ce660390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.884+0000 7f31ae70e640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5635ce65dfa0 0x5635ce660390 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.884+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.884+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ce661280 con 0x5635ce65dfa0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.884+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.884+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ce662630 con 0x5635ce65dfa0 2024-04-24T01:44:46.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.885+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.885+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ce66f590 con 0x5635ce65dfa0 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.885+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:NOTICE: set zone's realm_id= 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.885+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5635ce6669f0 0x5635ce668d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.885+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.885+0000 7f31adf0d640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5635ce6669f0 0x5635ce668d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.885+0000 7f31adf0d640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5635ce6669f0 0x5635ce668d30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31adf0d640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f31a0083070 0x7f31a0055880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a0083070 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31ad70c640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f31a0083070 0x7f31a0055880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31ad70c640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f31a0083070 0x7f31a0055880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a401e6e0 con 0x7f31a0083070 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31ad70c640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f31a400f070 0x7f31a400e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.886+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.887+0000 7f31ae70e640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f31a400f070 0x7f31a400e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.887+0000 7f31ae70e640 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f31a400f070 0x7f31a400e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.887+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.887+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.887+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.887+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a0083070 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a401e6e0 con 0x7f31a0083070 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.888+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.889+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a0083070 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.890+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31a401e6e0 con 0x7f31a0083070 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.890+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.890+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.890+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.890+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.890+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(23 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.891+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a0083070 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a401e6e0 con 0x7f31a0083070 2024-04-24T01:44:46.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.892+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a0083070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.893+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a401e6e0 con 0x7f31a0083070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.893+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.893+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.893+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.893+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.893+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a0083070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.894+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a401e6e0 con 0x7f31a0083070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.894+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce6669f0 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.894+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a0075030 con 0x5635ce6669f0 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.894+0000 7f31adf0d640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a400f070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.894+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a800e070 con 0x7f31a400f070 2024-04-24T01:44:46.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.894+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ce6630e0 con 0x7f31a0083070 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31ad70c640 1 -- 172.21.15.131:0/3846365803 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31a401e6e0 con 0x7f31a0083070 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ce66d4a0 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ce66aa70 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.895+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ce667ff0 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.897+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.897+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ce66ee70 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.898+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.898+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ce66ee70 con 0x5635ce65dfa0 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.899+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f31a800e070 con 0x5635ce65dfa0 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3088036900 msgr2=0x7f3088038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3088036900 0x7f3088038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f31a4000f60 tx=0x7f31a40012f0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 msgr2=0x5635ce635ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce635ee0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f31a8013040 tx=0x7f31a8003370 comp rx=0 tx=0).stop 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 shutdown_connections 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3088036900 0x7f3088038dc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/768943863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce617ca0 0x5635ce635ee0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 >> 172.21.15.131:0/768943863 conn(0x5635ce525fb0 msgr2=0x5635ce626900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 shutdown_connections 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/768943863 wait complete. 2024-04-24T01:44:46.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2ff0036950 msgr2=0x7f2ff0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2ff0036950 0x7f2ff0038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f31a4001ed0 tx=0x7f31a400f000 comp rx=0 tx=0).stop 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce650580 msgr2=0x5635ce6509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce650580 0x5635ce6509a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f31a0066f70 tx=0x7f31a0076eb0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 shutdown_connections 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2ff0036950 0x7f2ff0038e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 --2- 172.21.15.131:0/38501497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce650580 0x5635ce6509a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 >> 172.21.15.131:0/38501497 conn(0x5635ce6450c0 msgr2=0x5635ce645ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 shutdown_connections 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.900+0000 7f31b040e800 1 -- 172.21.15.131:0/38501497 wait complete. 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f31a400f070 msgr2=0x7f31a400e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f31a400f070 0x7f31a400e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5635ce65dfa0 msgr2=0x5635ce660390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5635ce65dfa0 0x5635ce660390 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f31a0083070 msgr2=0x7f31a0055880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f31a0083070 0x7f31a0055880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5635ce6669f0 msgr2=0x5635ce668d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5635ce6669f0 0x5635ce668d30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3094036950 msgr2=0x7f3094038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3094036950 0x7f3094038e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f31a0078030 tx=0x7f31a00529c0 comp rx=0 tx=0).stop 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 msgr2=0x5635ce61f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 --2- 172.21.15.131:0/3846365803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5635ce524d50 0x5635ce61f010 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f31a001cfe0 tx=0x7f31a0003020 comp rx=0 tx=0).stop 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 reap_dead start 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31ae70e640 1 -- 172.21.15.131:0/3846365803 reap_dead start 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 shutdown_connections 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 >> 172.21.15.131:0/3846365803 conn(0x5635ce520310 msgr2=0x5635ce610510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 shutdown_connections 2024-04-24T01:44:46.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.901+0000 7f31b040e800 1 -- 172.21.15.131:0/3846365803 wait complete. 2024-04-24T01:44:46.914 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-24T01:44:46.915 DEBUG:tasks.util.rgw: json result: {'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-24T01:44:46.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-24T01:44:46.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-24T01:44:46.915 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:46.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.996+0000 7fae54523800 1 Processor -- start 2024-04-24T01:44:46.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.996+0000 7fae54523800 1 -- start start 2024-04-24T01:44:46.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.996+0000 7fae54523800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f1f87d3d10 0x55f1f87d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:46.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.996+0000 7fae54523800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1f8693d40 con 0x55f1f87d4f70 2024-04-24T01:44:46.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.996+0000 7fae54523800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55f1f86664d0 con 0x55f1f87d3d10 2024-04-24T01:44:46.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.997+0000 7fae502b7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f1f87d3d10 0x55f1f87d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:46.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.997+0000 7fae47ab6640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f1f87d4f70 0x55f1f87d53f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39008/0 (socket says 172.21.15.131:39008) 2024-04-24T01:44:46.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.997+0000 7fae502b7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f1f87d3d10 0x55f1f87d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51918/0 (socket says 172.21.15.131:51918) 2024-04-24T01:44:46.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.997+0000 7fae47ab6640 1 -- 172.21.15.131:0/1471607446 learned_addr learned my addr 172.21.15.131:0/1471607446 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:46.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.997+0000 7fae502b7640 1 -- 172.21.15.131:0/1471607446 >> v1:172.21.15.107:6789/0 conn(0x55f1f87d4f70 legacy=0x55f1f87d53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:46.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.997+0000 7fae502b7640 1 -- 172.21.15.131:0/1471607446 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f8692590 con 0x55f1f87d3d10 2024-04-24T01:44:47.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.999+0000 7fae502b7640 1 --2- 172.21.15.131:0/1471607446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f87d4130 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fae4000a470 tx=0x7fae4001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52726af462078c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.999+0000 7fae4fab6640 1 -- 172.21.15.131:0/1471607446 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae40057070 con 0x55f1f87d3d10 2024-04-24T01:44:47.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.999+0000 7fae4fab6640 1 -- 172.21.15.131:0/1471607446 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae40052570 con 0x55f1f87d3d10 2024-04-24T01:44:47.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:46.999+0000 7fae4fab6640 1 -- 172.21.15.131:0/1471607446 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae40052870 con 0x55f1f87d3d10 2024-04-24T01:44:47.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.000+0000 7fae54523800 1 -- 172.21.15.131:0/1471607446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 msgr2=0x55f1f87d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.000+0000 7fae54523800 1 --2- 172.21.15.131:0/1471607446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f87d4130 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fae4000a470 tx=0x7fae4001ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:47.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.000+0000 7fae54523800 1 -- 172.21.15.131:0/1471607446 shutdown_connections 2024-04-24T01:44:47.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.000+0000 7fae54523800 1 --2- 172.21.15.131:0/1471607446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f87d4130 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.000+0000 7fae54523800 1 -- 172.21.15.131:0/1471607446 >> 172.21.15.131:0/1471607446 conn(0x55f1f87cf370 msgr2=0x55f1f87d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.000+0000 7fae54523800 1 -- 172.21.15.131:0/1471607446 shutdown_connections 2024-04-24T01:44:47.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.000+0000 7fae54523800 1 -- 172.21.15.131:0/1471607446 wait complete. 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.011+0000 7fae54523800 1 Processor -- start 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.011+0000 7fae54523800 1 -- start start 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.011+0000 7fae54523800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f88c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.011+0000 7fae54523800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f1f87203b0 con 0x55f1f87d3d10 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fae502b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f88c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fae502b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f88c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51932/0 (socket says 172.21.15.131:51932) 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fae502b7640 1 -- 172.21.15.131:0/2389341841 learned_addr learned my addr 172.21.15.131:0/2389341841 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fae502b7640 1 -- 172.21.15.131:0/2389341841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f88c5a00 con 0x55f1f87d3d10 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fae502b7640 1 --2- 172.21.15.131:0/2389341841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f88c5430 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fae40055040 tx=0x7fae4004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f3c7f6d7cf00d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fad3e60c640 1 -- 172.21.15.131:0/2389341841 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae40057070 con 0x55f1f87d3d10 2024-04-24T01:44:47.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fad3e60c640 1 -- 172.21.15.131:0/2389341841 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae40063070 con 0x55f1f87d3d10 2024-04-24T01:44:47.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.012+0000 7fad3e60c640 1 -- 172.21.15.131:0/2389341841 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae40052720 con 0x55f1f87d3d10 2024-04-24T01:44:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 -- 172.21.15.131:0/2389341841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 msgr2=0x55f1f88c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 --2- 172.21.15.131:0/2389341841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f88c5430 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fae40055040 tx=0x7fae4004c000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 -- 172.21.15.131:0/2389341841 shutdown_connections 2024-04-24T01:44:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 --2- 172.21.15.131:0/2389341841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d3d10 0x55f1f88c5430 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 -- 172.21.15.131:0/2389341841 >> 172.21.15.131:0/2389341841 conn(0x55f1f87cf370 msgr2=0x55f1f88c0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 -- 172.21.15.131:0/2389341841 shutdown_connections 2024-04-24T01:44:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 -- 172.21.15.131:0/2389341841 wait complete. 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 Processor -- start 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.013+0000 7fae54523800 1 -- start start 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae54523800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d4f70 0x55f1f8748020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae54523800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f1f87dd3e0 con 0x55f1f87d4f70 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae502b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d4f70 0x55f1f8748020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae502b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d4f70 0x55f1f8748020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51948/0 (socket says 172.21.15.131:51948) 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae502b7640 1 -- 172.21.15.131:0/2434185218 learned_addr learned my addr 172.21.15.131:0/2434185218 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae502b7640 1 -- 172.21.15.131:0/2434185218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f88d0df0 con 0x55f1f87d4f70 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae502b7640 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d4f70 0x55f1f8748020 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fae40060040 tx=0x7fae40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fad3ce09640 1 -- 172.21.15.131:0/2434185218 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae40052b60 con 0x55f1f87d4f70 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fad3ce09640 1 -- 172.21.15.131:0/2434185218 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4006c070 con 0x55f1f87d4f70 2024-04-24T01:44:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1f88d0fc0 con 0x55f1f87d4f70 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fad3ce09640 1 -- 172.21.15.131:0/2434185218 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae40052e50 con 0x55f1f87d4f70 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.014+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f88d1540 con 0x55f1f87d4f70 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae54523800 1 Processor -- start 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae54523800 1 -- start start 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae54523800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae54523800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f1f86c66b0 con 0x55f1f88ce3b0 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fad3ce09640 1 -- 172.21.15.131:0/2434185218 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fae4005e480 con 0x55f1f87d4f70 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae50ab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fad3ce09640 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad38036af0 0x7fad38038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae50ab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51954/0 (socket says 172.21.15.131:51954) 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae50ab8640 1 -- 172.21.15.131:0/1374475309 learned_addr learned my addr 172.21.15.131:0/1374475309 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fad3ce09640 1 -- 172.21.15.131:0/2434185218 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fae4008e640 con 0x55f1f87d4f70 2024-04-24T01:44:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.015+0000 7fae502b7640 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad38036af0 0x7fad38038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae50ab8640 1 -- 172.21.15.131:0/1374475309 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f88ccbd0 con 0x55f1f88ce3b0 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae50ab8640 1 --2- 172.21.15.131:0/1374475309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88ce7d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fae4800a430 tx=0x7fae4800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6453a7ec4f1dfd5f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae502b7640 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad38036af0 0x7fad38038fb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fae400447c0 tx=0x7fae40079760 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fad367fc640 1 -- 172.21.15.131:0/1374475309 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae48015070 con 0x55f1f88ce3b0 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fad367fc640 1 -- 172.21.15.131:0/1374475309 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae48001670 con 0x55f1f88ce3b0 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fad367fc640 1 -- 172.21.15.131:0/1374475309 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae48001990 con 0x55f1f88ce3b0 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae54523800 1 -- 172.21.15.131:0/1374475309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 msgr2=0x55f1f88ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae54523800 1 --2- 172.21.15.131:0/1374475309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88ce7d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fae4800a430 tx=0x7fae4800a8f0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae54523800 1 -- 172.21.15.131:0/1374475309 shutdown_connections 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae54523800 1 --2- 172.21.15.131:0/1374475309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88ce7d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae54523800 1 -- 172.21.15.131:0/1374475309 >> 172.21.15.131:0/1374475309 conn(0x55f1f88d8560 msgr2=0x55f1f88d65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.016+0000 7fae54523800 1 -- 172.21.15.131:0/1374475309 shutdown_connections 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae54523800 1 -- 172.21.15.131:0/1374475309 wait complete. 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae54523800 1 Processor -- start 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae54523800 1 -- start start 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae54523800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88e5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae54523800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f1f88ccef0 con 0x55f1f88ce3b0 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae50ab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88e5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae50ab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88e5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51966/0 (socket says 172.21.15.131:51966) 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.017+0000 7fae50ab8640 1 -- 172.21.15.131:0/2517776236 learned_addr learned my addr 172.21.15.131:0/2517776236 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.018+0000 7fae50ab8640 1 -- 172.21.15.131:0/2517776236 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f88e5a40 con 0x55f1f88ce3b0 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.018+0000 7fae50ab8640 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88e5500 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fae48013040 tx=0x7fae48003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.018+0000 7fad34ff9640 1 -- 172.21.15.131:0/2517776236 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae48020020 con 0x55f1f88ce3b0 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.018+0000 7fad34ff9640 1 -- 172.21.15.131:0/2517776236 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae48010900 con 0x55f1f88ce3b0 2024-04-24T01:44:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.018+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1f88e5cd0 con 0x55f1f88ce3b0 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.018+0000 7fad34ff9640 1 -- 172.21.15.131:0/2517776236 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae48015040 con 0x55f1f88ce3b0 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.018+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f88e8980 con 0x55f1f88ce3b0 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fad34ff9640 1 -- 172.21.15.131:0/2517776236 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fae48023020 con 0x55f1f88ce3b0 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fae54523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fae54523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fad34ff9640 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad28036900 0x7fad28038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fad34ff9640 1 -- 172.21.15.131:0/2517776236 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fae4804c0b0 con 0x55f1f88ce3b0 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fae47ab6640 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad28036900 0x7fad28038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fae54523800 1 Processor -- start 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.019+0000 7fae54523800 1 -- start start 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae54523800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ffc10 0x55f1f8900030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae54523800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f1f88c5cc0 con 0x55f1f88ffc10 2024-04-24T01:44:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae47ab6640 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad28036900 0x7fad28038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae38000f60 tx=0x7fae38001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae502b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ffc10 0x55f1f8900030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae502b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ffc10 0x55f1f8900030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51982/0 (socket says 172.21.15.131:51982) 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae502b7640 1 -- 172.21.15.131:0/4236846600 learned_addr learned my addr 172.21.15.131:0/4236846600 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae502b7640 1 -- 172.21.15.131:0/4236846600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f8900570 con 0x55f1f88ffc10 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae502b7640 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ffc10 0x55f1f8900030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fae4005efd0 tx=0x7fae40009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fad14fe1640 1 -- 172.21.15.131:0/4236846600 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae40092020 con 0x55f1f88ffc10 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fad14fe1640 1 -- 172.21.15.131:0/4236846600 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae40058040 con 0x55f1f88ffc10 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fad14fe1640 1 -- 172.21.15.131:0/4236846600 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae4008e1a0 con 0x55f1f88ffc10 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1f8900fe0 con 0x55f1f88ffc10 2024-04-24T01:44:47.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.020+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f89014e0 con 0x55f1f88ffc10 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.021+0000 7fad14fe1640 1 -- 172.21.15.131:0/4236846600 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fae40095020 con 0x55f1f88ffc10 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.021+0000 7fad14fe1640 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fac90036900 0x7fac90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.021+0000 7fad14fe1640 1 -- 172.21.15.131:0/4236846600 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fae40098cf0 con 0x55f1f88ffc10 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.021+0000 7fae47ab6640 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fac90036900 0x7fac90038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7facb67fc640 20 reqs_thread_entry: start 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7fae47ab6640 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fac90036900 0x7fac90038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fae38001ed0 tx=0x7fae3800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7fae54523800 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f1f890d6d0 0x55f1f890fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1f8910190 con 0x55f1f890d6d0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7fae50ab8640 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f1f890d6d0 0x55f1f890fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7fae50ab8640 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f1f890d6d0 0x55f1f890fae0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7fae50ab8640 1 -- 172.21.15.131:0/2434185218 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae4800e070 con 0x55f1f890d6d0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.022+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1f8910a70 con 0x55f1f890d6d0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.023+0000 7fae50ab8640 1 -- 172.21.15.131:0/2434185218 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae4800e070 con 0x55f1f890d6d0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.023+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1f8911e20 con 0x55f1f890d6d0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.023+0000 7fae50ab8640 1 -- 172.21.15.131:0/2434185218 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fae4800e070 con 0x55f1f890d6d0 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad28036900 msgr2=0x7fad28038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad28036900 0x7fad28038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae38000f60 tx=0x7fae38001230 comp rx=0 tx=0).stop 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 msgr2=0x55f1f88e5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88e5500 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fae48013040 tx=0x7fae48003370 comp rx=0 tx=0).stop 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 shutdown_connections 2024-04-24T01:44:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad28036900 0x7fad28038dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/2517776236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ce3b0 0x55f1f88e5500 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 >> 172.21.15.131:0/2517776236 conn(0x55f1f88d8560 msgr2=0x55f1f88d5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 shutdown_connections 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2517776236 wait complete. 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fac90036900 msgr2=0x7fac90038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fac90036900 0x7fac90038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fae38001ed0 tx=0x7fae3800f000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ffc10 msgr2=0x55f1f8900030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ffc10 0x55f1f8900030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fae4005efd0 tx=0x7fae40009710 comp rx=0 tx=0).stop 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 shutdown_connections 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fac90036900 0x7fac90038dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/4236846600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f88ffc10 0x55f1f8900030 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 >> 172.21.15.131:0/4236846600 conn(0x55f1f88f4780 msgr2=0x55f1f88f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 shutdown_connections 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/4236846600 wait complete. 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f1f890d6d0 msgr2=0x55f1f890fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f1f890d6d0 0x55f1f890fae0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad38036af0 msgr2=0x7fad38038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.024+0000 7fae54523800 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad38036af0 0x7fad38038fb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fae400447c0 tx=0x7fae40079760 comp rx=0 tx=0).stop 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d4f70 msgr2=0x55f1f8748020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d4f70 0x55f1f8748020 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fae40060040 tx=0x7fae40002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 shutdown_connections 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f1f890d6d0 0x55f1f890fae0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fad38036af0 0x7fad38038fb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 --2- 172.21.15.131:0/2434185218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1f87d4f70 0x55f1f8748020 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 >> 172.21.15.131:0/2434185218 conn(0x55f1f87cf370 msgr2=0x55f1f88bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 shutdown_connections 2024-04-24T01:44:47.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.025+0000 7fae54523800 1 -- 172.21.15.131:0/2434185218 wait complete. 2024-04-24T01:44:47.035 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-24T01:44:47.036 DEBUG:tasks.util.rgw: json result: {'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-24T01:44:47.036 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:44:47.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:44:47.036 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-24T01:44:47.123 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:47.123 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b41119800 1 Processor -- start 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b41119800 1 -- start start 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b41119800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55796d9ec250 0x55796d9ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b41119800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55796d8a7d40 con 0x55796d9e7dc0 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b41119800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55796d87a4d0 con 0x55796d9ec250 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b37fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55796d9ec250 0x55796d9ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b37fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55796d9ec250 0x55796d9ee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:51992/0 (socket says 172.21.15.131:51992) 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b3ec18640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55796d9e7dc0 0x55796d9e81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39024/0 (socket says 172.21.15.131:39024) 2024-04-24T01:44:47.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b37fff640 1 -- 172.21.15.131:0/3965981022 learned_addr learned my addr 172.21.15.131:0/3965981022 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b37fff640 1 -- 172.21.15.131:0/3965981022 >> v1:172.21.15.107:6789/0 conn(0x55796d9e7dc0 legacy=0x55796d9e81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.124+0000 7f3b37fff640 1 -- 172.21.15.131:0/3965981022 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796d8a6590 con 0x55796d9ec250 2024-04-24T01:44:47.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.126+0000 7f3b37fff640 1 --2- 172.21.15.131:0/3965981022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9ec250 0x55796d9ee640 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800a6b0 tx=0x7f3b2801eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd4eb4c93f613d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.126+0000 7f3b3e417640 1 -- 172.21.15.131:0/3965981022 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b28059070 con 0x55796d9ec250 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.126+0000 7f3b3e417640 1 -- 172.21.15.131:0/3965981022 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b28050050 con 0x55796d9ec250 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.126+0000 7f3b3e417640 1 -- 172.21.15.131:0/3965981022 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b2800a350 con 0x55796d9ec250 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.127+0000 7f3b41119800 1 -- 172.21.15.131:0/3965981022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9ec250 msgr2=0x55796d9ee640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.127+0000 7f3b41119800 1 --2- 172.21.15.131:0/3965981022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9ec250 0x55796d9ee640 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800a6b0 tx=0x7f3b2801eed0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.127+0000 7f3b41119800 1 -- 172.21.15.131:0/3965981022 shutdown_connections 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.127+0000 7f3b41119800 1 --2- 172.21.15.131:0/3965981022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9ec250 0x55796d9ee640 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.127+0000 7f3b41119800 1 -- 172.21.15.131:0/3965981022 >> 172.21.15.131:0/3965981022 conn(0x55796d9e3440 msgr2=0x55796d9e5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.127+0000 7f3b41119800 1 -- 172.21.15.131:0/3965981022 shutdown_connections 2024-04-24T01:44:47.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.127+0000 7f3b41119800 1 -- 172.21.15.131:0/3965981022 wait complete. 2024-04-24T01:44:47.139 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.139+0000 7f3b41119800 1 Processor -- start 2024-04-24T01:44:47.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.139+0000 7f3b41119800 1 -- start start 2024-04-24T01:44:47.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.139+0000 7f3b41119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dadc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.139+0000 7f3b41119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55796d9343e0 con 0x55796d9e7dc0 2024-04-24T01:44:47.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.139+0000 7f3b3ec18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dadc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.139+0000 7f3b3ec18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dadc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52006/0 (socket says 172.21.15.131:52006) 2024-04-24T01:44:47.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.139+0000 7f3b3ec18640 1 -- 172.21.15.131:0/4086349106 learned_addr learned my addr 172.21.15.131:0/4086349106 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.140+0000 7f3b3ec18640 1 -- 172.21.15.131:0/4086349106 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796dadc9a0 con 0x55796d9e7dc0 2024-04-24T01:44:47.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.140+0000 7f3b3ec18640 1 --2- 172.21.15.131:0/4086349106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dadc3d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b230 tx=0x7f3b3000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf04b0fffe2b629 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.140+0000 7f3a2ce09640 1 -- 172.21.15.131:0/4086349106 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3000e5c0 con 0x55796d9e7dc0 2024-04-24T01:44:47.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.140+0000 7f3a2ce09640 1 -- 172.21.15.131:0/4086349106 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b30006070 con 0x55796d9e7dc0 2024-04-24T01:44:47.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.140+0000 7f3a2ce09640 1 -- 172.21.15.131:0/4086349106 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3000e890 con 0x55796d9e7dc0 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 -- 172.21.15.131:0/4086349106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 msgr2=0x55796dadc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 --2- 172.21.15.131:0/4086349106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dadc3d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b230 tx=0x7f3b3000b6f0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 -- 172.21.15.131:0/4086349106 shutdown_connections 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 --2- 172.21.15.131:0/4086349106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dadc3d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 -- 172.21.15.131:0/4086349106 >> 172.21.15.131:0/4086349106 conn(0x55796d9e3440 msgr2=0x55796dad38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 -- 172.21.15.131:0/4086349106 shutdown_connections 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 -- 172.21.15.131:0/4086349106 wait complete. 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 Processor -- start 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 -- start start 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dae3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b41119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55796d9eef10 con 0x55796d9e7dc0 2024-04-24T01:44:47.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b3ec18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dae3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b3ec18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dae3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52012/0 (socket says 172.21.15.131:52012) 2024-04-24T01:44:47.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.141+0000 7f3b3ec18640 1 -- 172.21.15.131:0/3904328638 learned_addr learned my addr 172.21.15.131:0/3904328638 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.142+0000 7f3b3ec18640 1 -- 172.21.15.131:0/3904328638 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796dae4500 con 0x55796d9e7dc0 2024-04-24T01:44:47.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.142+0000 7f3b3ec18640 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dae3fc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3b30000fd0 tx=0x7f3b30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.142+0000 7f3a2b606640 1 -- 172.21.15.131:0/3904328638 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3000f8d0 con 0x55796d9e7dc0 2024-04-24T01:44:47.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.142+0000 7f3a2b606640 1 -- 172.21.15.131:0/3904328638 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3000fa90 con 0x55796d9e7dc0 2024-04-24T01:44:47.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.142+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55796dae4790 con 0x55796d9e7dc0 2024-04-24T01:44:47.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.142+0000 7f3a2b606640 1 -- 172.21.15.131:0/3904328638 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3000fdb0 con 0x55796d9e7dc0 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.142+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796dae7440 con 0x55796d9e7dc0 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3b41119800 1 Processor -- start 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3b41119800 1 -- start start 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3b41119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3b41119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55796d8da6b0 con 0x55796daf1800 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3a2b606640 1 -- 172.21.15.131:0/3904328638 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3b30017070 con 0x55796d9e7dc0 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3b3f419640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3b3f419640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52018/0 (socket says 172.21.15.131:52018) 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3b3f419640 1 -- 172.21.15.131:0/915778668 learned_addr learned my addr 172.21.15.131:0/915778668 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3a2b606640 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a24036900 0x7f3a24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.143+0000 7f3a2b606640 1 -- 172.21.15.131:0/3904328638 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3b30015020 con 0x55796d9e7dc0 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b3ec18640 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a24036900 0x7f3a24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b3f419640 1 -- 172.21.15.131:0/915778668 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796daf2160 con 0x55796daf1800 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b3f419640 1 --2- 172.21.15.131:0/915778668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf1c20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800a430 tx=0x7f3b3800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85894d9d5c6a1ae6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b3ec18640 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a24036900 0x7f3a24038dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b3001d5c0 tx=0x7f3b30035040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3a29602640 1 -- 172.21.15.131:0/915778668 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38015070 con 0x55796daf1800 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3a29602640 1 -- 172.21.15.131:0/915778668 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b38001670 con 0x55796daf1800 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3a29602640 1 -- 172.21.15.131:0/915778668 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38001990 con 0x55796daf1800 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b41119800 1 -- 172.21.15.131:0/915778668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 msgr2=0x55796daf1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b41119800 1 --2- 172.21.15.131:0/915778668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf1c20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800a430 tx=0x7f3b3800a8f0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b41119800 1 -- 172.21.15.131:0/915778668 shutdown_connections 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b41119800 1 --2- 172.21.15.131:0/915778668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf1c20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b41119800 1 -- 172.21.15.131:0/915778668 >> 172.21.15.131:0/915778668 conn(0x55796d9ec250 msgr2=0x55796daee2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b41119800 1 -- 172.21.15.131:0/915778668 shutdown_connections 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.144+0000 7f3b41119800 1 -- 172.21.15.131:0/915778668 wait complete. 2024-04-24T01:44:47.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b41119800 1 Processor -- start 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b41119800 1 -- start start 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b41119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b41119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55796daf2af0 con 0x55796daf1800 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b3f419640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b3f419640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52032/0 (socket says 172.21.15.131:52032) 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b3f419640 1 -- 172.21.15.131:0/2109403869 learned_addr learned my addr 172.21.15.131:0/2109403869 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.145+0000 7f3b3f419640 1 -- 172.21.15.131:0/2109403869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796daf91a0 con 0x55796daf1800 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.146+0000 7f3b3f419640 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf8c60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3b38013040 tx=0x7f3b38003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.146+0000 7f3a237fe640 1 -- 172.21.15.131:0/2109403869 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38020020 con 0x55796daf1800 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.146+0000 7f3a237fe640 1 -- 172.21.15.131:0/2109403869 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b380108e0 con 0x55796daf1800 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.146+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55796daf9430 con 0x55796daf1800 2024-04-24T01:44:47.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.146+0000 7f3a237fe640 1 -- 172.21.15.131:0/2109403869 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38015040 con 0x55796daf1800 2024-04-24T01:44:47.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.146+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796dafc0e0 con 0x55796daf1800 2024-04-24T01:44:47.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3a237fe640 1 -- 172.21.15.131:0/2109403869 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3b38023020 con 0x55796daf1800 2024-04-24T01:44:47.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3b41119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:47.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3b41119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3a237fe640 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a18036900 0x7f3a18038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3a237fe640 1 -- 172.21.15.131:0/2109403869 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3b3804c190 con 0x55796daf1800 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3b37fff640 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a18036900 0x7f3a18038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3b41119800 1 Processor -- start 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3b41119800 1 -- start start 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3b41119800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796db13390 0x55796db137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.147+0000 7f3b41119800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55796dadcd20 con 0x55796db13390 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b37fff640 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a18036900 0x7f3a18038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3b28056000 tx=0x7f3b2800a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b3ec18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796db13390 0x55796db137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b3ec18640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796db13390 0x55796db137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52036/0 (socket says 172.21.15.131:52036) 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b3ec18640 1 -- 172.21.15.131:0/1211146461 learned_addr learned my addr 172.21.15.131:0/1211146461 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b3ec18640 1 -- 172.21.15.131:0/1211146461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796db13cf0 con 0x55796db13390 2024-04-24T01:44:47.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b3ec18640 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796db13390 0x55796db137b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000ff70 tx=0x7f3b3001d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3a037e6640 1 -- 172.21.15.131:0/1211146461 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3001ce60 con 0x55796db13390 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3a037e6640 1 -- 172.21.15.131:0/1211146461 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b30019dd0 con 0x55796db13390 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55796db14760 con 0x55796db13390 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3a037e6640 1 -- 172.21.15.131:0/1211146461 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3001cc80 con 0x55796db13390 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.148+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796db14c60 con 0x55796db13390 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.149+0000 7f3a037e6640 1 -- 172.21.15.131:0/1211146461 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3b3004b080 con 0x55796db13390 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.149+0000 7f3a037e6640 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3980036950 0x7f3980038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.149+0000 7f3b37fff640 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3980036950 0x7f3980038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.149+0000 7f3a037e6640 1 -- 172.21.15.131:0/1211146461 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3b3004acf0 con 0x55796db13390 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.150+0000 7f3b37fff640 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3980036950 0x7f3980038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3b2801ef10 tx=0x7f3b28005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.150+0000 7f3a017e2640 20 reqs_thread_entry: start 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.150+0000 7f3b41119800 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55796db20de0 0x55796db23270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.150+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55796db23940 con 0x55796db20de0 2024-04-24T01:44:47.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.150+0000 7f3b3f419640 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55796db20de0 0x55796db23270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.150+0000 7f3b3f419640 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55796db20de0 0x55796db23270 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.150+0000 7f3b3f419640 1 -- 172.21.15.131:0/3904328638 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b3800e070 con 0x55796db20de0 2024-04-24T01:44:47.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.151+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55796db25200 con 0x55796db20de0 2024-04-24T01:44:47.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.151+0000 7f3b3f419640 1 -- 172.21.15.131:0/3904328638 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f3b3800e070 con 0x55796db20de0 2024-04-24T01:44:47.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.151+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55796db24b70 con 0x55796db20de0 2024-04-24T01:44:47.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.152+0000 7f3b3f419640 1 -- 172.21.15.131:0/3904328638 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f3b3800e070 con 0x55796db20de0 2024-04-24T01:44:47.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a18036900 msgr2=0x7f3a18038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a18036900 0x7f3a18038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3b28056000 tx=0x7f3b2800a000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 msgr2=0x55796daf8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf8c60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3b38013040 tx=0x7f3b38003370 comp rx=0 tx=0).stop 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 shutdown_connections 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a18036900 0x7f3a18038dc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/2109403869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796daf1800 0x55796daf8c60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 >> 172.21.15.131:0/2109403869 conn(0x55796d9ec250 msgr2=0x55796daeb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 shutdown_connections 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/2109403869 wait complete. 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3980036950 msgr2=0x7f3980038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3980036950 0x7f3980038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3b2801ef10 tx=0x7f3b28005ac0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796db13390 msgr2=0x55796db137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796db13390 0x55796db137b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000ff70 tx=0x7f3b3001d450 comp rx=0 tx=0).stop 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 shutdown_connections 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3980036950 0x7f3980038e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 --2- 172.21.15.131:0/1211146461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796db13390 0x55796db137b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 >> 172.21.15.131:0/1211146461 conn(0x55796db07ee0 msgr2=0x55796db08900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 shutdown_connections 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.153+0000 7f3b41119800 1 -- 172.21.15.131:0/1211146461 wait complete. 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55796db20de0 msgr2=0x55796db23270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55796db20de0 0x55796db23270 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a24036900 msgr2=0x7f3a24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a24036900 0x7f3a24038dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b3001d5c0 tx=0x7f3b30035040 comp rx=0 tx=0).stop 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 msgr2=0x55796dae3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dae3fc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3b30000fd0 tx=0x7f3b30000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 shutdown_connections 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55796db20de0 0x55796db23270 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3a24036900 0x7f3a24038dc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 --2- 172.21.15.131:0/3904328638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55796d9e7dc0 0x55796dae3fc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 >> 172.21.15.131:0/3904328638 conn(0x55796d9e3440 msgr2=0x55796dad2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 shutdown_connections 2024-04-24T01:44:47.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.154+0000 7f3b41119800 1 -- 172.21.15.131:0/3904328638 wait complete. 2024-04-24T01:44:47.167 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T01:44:47.167 DEBUG:tasks.util.rgw: json result: {'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T01:44:47.167 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-24T01:44:47.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-24T01:44:47.167 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-24T01:44:47.208 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:47.208 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:47.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.208+0000 7f9d61525800 1 Processor -- start 2024-04-24T01:44:47.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.208+0000 7f9d61525800 1 -- start start 2024-04-24T01:44:47.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.208+0000 7f9d61525800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5573695cf200 0x5573695d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.208+0000 7f9d61525800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55736948ad40 con 0x5573695cb250 2024-04-24T01:44:47.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.208+0000 7f9d61525800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55736945d4d0 con 0x5573695cf200 2024-04-24T01:44:47.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.209+0000 7f9d5cab6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5573695cf200 0x5573695d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.209+0000 7f9d5cab6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5573695cf200 0x5573695d15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52048/0 (socket says 172.21.15.131:52048) 2024-04-24T01:44:47.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.209+0000 7f9d5d2b7640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5573695cb250 0x5573695cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39034/0 (socket says 172.21.15.131:39034) 2024-04-24T01:44:47.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.209+0000 7f9d5cab6640 1 -- 172.21.15.131:0/3228945682 learned_addr learned my addr 172.21.15.131:0/3228945682 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.209+0000 7f9d5cab6640 1 -- 172.21.15.131:0/3228945682 >> v1:172.21.15.107:6789/0 conn(0x5573695cb250 legacy=0x5573695cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.209+0000 7f9d5cab6640 1 -- 172.21.15.131:0/3228945682 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557369489590 con 0x5573695cf200 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d5cab6640 1 --2- 172.21.15.131:0/3228945682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cf200 0x5573695d15f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400a520 tx=0x7f9d5401d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4886d53af618250c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d4ffff640 1 -- 172.21.15.131:0/3228945682 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54057070 con 0x5573695cf200 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d4ffff640 1 -- 172.21.15.131:0/3228945682 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5404ae50 con 0x5573695cf200 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d4ffff640 1 -- 172.21.15.131:0/3228945682 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d540526c0 con 0x5573695cf200 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d61525800 1 -- 172.21.15.131:0/3228945682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cf200 msgr2=0x5573695d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d61525800 1 --2- 172.21.15.131:0/3228945682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cf200 0x5573695d15f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400a520 tx=0x7f9d5401d0a0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d61525800 1 -- 172.21.15.131:0/3228945682 shutdown_connections 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d61525800 1 --2- 172.21.15.131:0/3228945682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cf200 0x5573695d15f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d61525800 1 -- 172.21.15.131:0/3228945682 >> 172.21.15.131:0/3228945682 conn(0x5573695c5af0 msgr2=0x5573695c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d61525800 1 -- 172.21.15.131:0/3228945682 shutdown_connections 2024-04-24T01:44:47.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.211+0000 7f9d61525800 1 -- 172.21.15.131:0/3228945682 wait complete. 2024-04-24T01:44:47.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.223+0000 7f9d61525800 1 Processor -- start 2024-04-24T01:44:47.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.223+0000 7f9d61525800 1 -- start start 2024-04-24T01:44:47.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.223+0000 7f9d61525800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573695ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.223+0000 7f9d61525800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5573695173b0 con 0x5573695cb250 2024-04-24T01:44:47.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.223+0000 7f9d5d2b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573695ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.223+0000 7f9d5d2b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573695ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52050/0 (socket says 172.21.15.131:52050) 2024-04-24T01:44:47.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.223+0000 7f9d5d2b7640 1 -- 172.21.15.131:0/2920332555 learned_addr learned my addr 172.21.15.131:0/2920332555 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.224+0000 7f9d5d2b7640 1 -- 172.21.15.131:0/2920332555 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573696bfdc0 con 0x5573695cb250 2024-04-24T01:44:47.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.224+0000 7f9d5d2b7640 1 --2- 172.21.15.131:0/2920332555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573695ca950 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b230 tx=0x7f9d5000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac94fc342027624 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.224+0000 7f9c4b606640 1 -- 172.21.15.131:0/2920332555 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5000e5c0 con 0x5573695cb250 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.224+0000 7f9c4b606640 1 -- 172.21.15.131:0/2920332555 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d50006070 con 0x5573695cb250 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.224+0000 7f9c4b606640 1 -- 172.21.15.131:0/2920332555 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5000e890 con 0x5573695cb250 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 -- 172.21.15.131:0/2920332555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 msgr2=0x5573695ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 --2- 172.21.15.131:0/2920332555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573695ca950 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000b230 tx=0x7f9d5000b6f0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 -- 172.21.15.131:0/2920332555 shutdown_connections 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 --2- 172.21.15.131:0/2920332555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573695ca950 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 -- 172.21.15.131:0/2920332555 >> 172.21.15.131:0/2920332555 conn(0x5573695c5af0 msgr2=0x5573696b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 -- 172.21.15.131:0/2920332555 shutdown_connections 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 -- 172.21.15.131:0/2920332555 wait complete. 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 Processor -- start 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 -- start start 2024-04-24T01:44:47.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.225+0000 7f9d61525800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573696c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d61525800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5573695d1e30 con 0x5573695cb250 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d5d2b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573696c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d5d2b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573696c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52062/0 (socket says 172.21.15.131:52062) 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d5d2b7640 1 -- 172.21.15.131:0/2249992574 learned_addr learned my addr 172.21.15.131:0/2249992574 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d5d2b7640 1 -- 172.21.15.131:0/2249992574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573696c51c0 con 0x5573695cb250 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d5d2b7640 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573696c4c80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9d50000fd0 tx=0x7f9d50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9c49e03640 1 -- 172.21.15.131:0/2249992574 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5000f8d0 con 0x5573695cb250 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9c49e03640 1 -- 172.21.15.131:0/2249992574 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5000fa90 con 0x5573695cb250 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573696c5450 con 0x5573695cb250 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9c49e03640 1 -- 172.21.15.131:0/2249992574 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5000fdb0 con 0x5573695cb250 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.226+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573696c8100 con 0x5573695cb250 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9d61525800 1 Processor -- start 2024-04-24T01:44:47.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9d61525800 1 -- start start 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9d61525800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9d61525800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5573694bd6b0 con 0x5573696d24c0 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9c49e03640 1 -- 172.21.15.131:0/2249992574 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9d50017070 con 0x5573695cb250 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9d5dab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9c49e03640 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44036950 0x7f9c44038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.227+0000 7f9d5dab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52074/0 (socket says 172.21.15.131:52074) 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9d5dab8640 1 -- 172.21.15.131:0/3321912766 learned_addr learned my addr 172.21.15.131:0/3321912766 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9c49e03640 1 -- 172.21.15.131:0/2249992574 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9d50015020 con 0x5573695cb250 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9d5d2b7640 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44036950 0x7f9c44038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9d5dab8640 1 -- 172.21.15.131:0/3321912766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573696d2e20 con 0x5573696d24c0 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9d5d2b7640 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44036950 0x7f9c44038e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9d50017910 tx=0x7f9d500014c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9d5dab8640 1 --2- 172.21.15.131:0/3321912766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d28e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800a430 tx=0x7f9d5800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633bea54583c6650 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9c437fe640 1 -- 172.21.15.131:0/3321912766 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58015070 con 0x5573696d24c0 2024-04-24T01:44:47.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9c437fe640 1 -- 172.21.15.131:0/3321912766 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d58001670 con 0x5573696d24c0 2024-04-24T01:44:47.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.228+0000 7f9c437fe640 1 -- 172.21.15.131:0/3321912766 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58001990 con 0x5573696d24c0 2024-04-24T01:44:47.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 -- 172.21.15.131:0/3321912766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 msgr2=0x5573696d28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 --2- 172.21.15.131:0/3321912766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d28e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800a430 tx=0x7f9d5800a8f0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 -- 172.21.15.131:0/3321912766 shutdown_connections 2024-04-24T01:44:47.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 --2- 172.21.15.131:0/3321912766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d28e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 -- 172.21.15.131:0/3321912766 >> 172.21.15.131:0/3321912766 conn(0x5573695cf200 msgr2=0x5573696cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 -- 172.21.15.131:0/3321912766 shutdown_connections 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 -- 172.21.15.131:0/3321912766 wait complete. 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 Processor -- start 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 -- start start 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d61525800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5573696d37b0 con 0x5573696d24c0 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d5dab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d5dab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52078/0 (socket says 172.21.15.131:52078) 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.229+0000 7f9d5dab8640 1 -- 172.21.15.131:0/3415375296 learned_addr learned my addr 172.21.15.131:0/3415375296 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.230+0000 7f9d5dab8640 1 -- 172.21.15.131:0/3415375296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573696d9e30 con 0x5573696d24c0 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.230+0000 7f9d5dab8640 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d98f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9d58013040 tx=0x7f9d58003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.230+0000 7f9c41ffb640 1 -- 172.21.15.131:0/3415375296 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58020020 con 0x5573696d24c0 2024-04-24T01:44:47.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.230+0000 7f9c41ffb640 1 -- 172.21.15.131:0/3415375296 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d580108e0 con 0x5573696d24c0 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.230+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573696da0c0 con 0x5573696d24c0 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.230+0000 7f9c41ffb640 1 -- 172.21.15.131:0/3415375296 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58015040 con 0x5573696d24c0 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.230+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573696dcd70 con 0x5573696d24c0 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.231+0000 7f9c41ffb640 1 -- 172.21.15.131:0/3415375296 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9d58023020 con 0x5573696d24c0 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.231+0000 7f9d61525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.231+0000 7f9d61525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.231+0000 7f9c41ffb640 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c34036900 0x7f9c34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.231+0000 7f9c41ffb640 1 -- 172.21.15.131:0/3415375296 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9d5804c0d0 con 0x5573696d24c0 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.231+0000 7f9d5cab6640 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c34036900 0x7f9c34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.231+0000 7f9d61525800 1 Processor -- start 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d61525800 1 -- start start 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d61525800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696bd970 0x5573696bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d5cab6640 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c34036900 0x7f9c34038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9d54054000 tx=0x7f9d5404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d61525800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5573696c0110 con 0x5573696bd970 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d5d2b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696bd970 0x5573696bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d5d2b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696bd970 0x5573696bbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52092/0 (socket says 172.21.15.131:52092) 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d5d2b7640 1 -- 172.21.15.131:0/1373054741 learned_addr learned my addr 172.21.15.131:0/1373054741 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d5d2b7640 1 -- 172.21.15.131:0/1373054741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573696bc320 con 0x5573696bd970 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.232+0000 7f9d5d2b7640 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696bd970 0x5573696bbde0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9d5004b3c0 tx=0x7f9d5001af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9c227e4640 1 -- 172.21.15.131:0/1373054741 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5004b0c0 con 0x5573696bd970 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9c227e4640 1 -- 172.21.15.131:0/1373054741 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5001c800 con 0x5573696bd970 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573696bc5b0 con 0x5573696bd970 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9c227e4640 1 -- 172.21.15.131:0/1373054741 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5001cae0 con 0x5573696bd970 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573696bcab0 con 0x5573696bd970 2024-04-24T01:44:47.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9c227e4640 1 -- 172.21.15.131:0/1373054741 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9d5001cc80 con 0x5573696bd970 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9c227e4640 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b94036900 0x7f9b94038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.233+0000 7f9c227e4640 1 -- 172.21.15.131:0/1373054741 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9d50044030 con 0x5573696bd970 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d5cab6640 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b94036900 0x7f9b94038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9c1bfff640 20 reqs_thread_entry: start 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d61525800 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557369703c20 0x557369706050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573697066d0 con 0x557369703c20 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d5cab6640 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b94036900 0x7f9b94038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d54055040 tx=0x7f9d54005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d5dab8640 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557369703c20 0x557369706050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d5dab8640 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557369703c20 0x557369706050 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d5dab8640 1 -- 172.21.15.131:0/2249992574 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d5800e070 con 0x557369703c20 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.234+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557369706fb0 con 0x557369703c20 2024-04-24T01:44:47.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.235+0000 7f9d5dab8640 1 -- 172.21.15.131:0/2249992574 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d5800e070 con 0x557369703c20 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.235+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557369708360 con 0x557369703c20 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.235+0000 7f9d5dab8640 1 -- 172.21.15.131:0/2249992574 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d5800e070 con 0x557369703c20 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c34036900 msgr2=0x7f9c34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c34036900 0x7f9c34038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9d54054000 tx=0x7f9d5404e000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 msgr2=0x5573696d98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d98f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9d58013040 tx=0x7f9d58003370 comp rx=0 tx=0).stop 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 shutdown_connections 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c34036900 0x7f9c34038dc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/3415375296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696d24c0 0x5573696d98f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 >> 172.21.15.131:0/3415375296 conn(0x5573695cf200 msgr2=0x5573696cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 shutdown_connections 2024-04-24T01:44:47.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/3415375296 wait complete. 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b94036900 msgr2=0x7f9b94038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b94036900 0x7f9b94038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d54055040 tx=0x7f9d54005ac0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696bd970 msgr2=0x5573696bbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696bd970 0x5573696bbde0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9d5004b3c0 tx=0x7f9d5001af50 comp rx=0 tx=0).stop 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 shutdown_connections 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b94036900 0x7f9b94038dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 --2- 172.21.15.131:0/1373054741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573696bd970 0x5573696bbde0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 >> 172.21.15.131:0/1373054741 conn(0x5573696e8ad0 msgr2=0x5573696e9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 shutdown_connections 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.236+0000 7f9d61525800 1 -- 172.21.15.131:0/1373054741 wait complete. 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557369703c20 msgr2=0x557369706050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557369703c20 0x557369706050 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44036950 msgr2=0x7f9c44038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44036950 0x7f9c44038e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9d50017910 tx=0x7f9d500014c0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 msgr2=0x5573696c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573696c4c80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9d50000fd0 tx=0x7f9d50000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 shutdown_connections 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x557369703c20 0x557369706050 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44036950 0x7f9c44038e10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 --2- 172.21.15.131:0/2249992574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5573695cb250 0x5573696c4c80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 >> 172.21.15.131:0/2249992574 conn(0x5573695c5af0 msgr2=0x5573696b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 shutdown_connections 2024-04-24T01:44:47.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.237+0000 7f9d61525800 1 -- 172.21.15.131:0/2249992574 wait complete. 2024-04-24T01:44:47.247 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"e8007cb0-7095-49ae-9c09-cc804d4cc0c2","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"57339dfa-6744-4aa2-9c16-e58ce0599faf","zones":[{"id":"57339dfa-6744-4aa2-9c16-e58ce0599faf","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-24T01:44:47.248 DEBUG:tasks.util.rgw: json result: {'id': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '57339dfa-6744-4aa2-9c16-e58ce0599faf', 'zones': [{'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-04-24T01:44:47.250 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-24T01:44:47.269 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-24T01:44:47.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-24T01:44:47.269 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-24T01:44:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:47.341 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:47.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.341+0000 7fdaef50c800 1 Processor -- start 2024-04-24T01:44:47.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.341+0000 7fdaef50c800 1 -- start start 2024-04-24T01:44:47.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.341+0000 7fdaef50c800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55577ff6f150 0x55577ff71540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.341+0000 7fdaef50c800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55577fe2ad40 con 0x55577ff6acc0 2024-04-24T01:44:47.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.341+0000 7fdaef50c800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55577fdfd4d0 con 0x55577ff6f150 2024-04-24T01:44:47.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.341+0000 7fdae7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55577ff6f150 0x55577ff71540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.341+0000 7fdaed012640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55577ff6acc0 0x55577ff6b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39046/0 (socket says 172.21.15.131:39046) 2024-04-24T01:44:47.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.342+0000 7fdaed012640 1 -- 172.21.15.131:0/291469261 learned_addr learned my addr 172.21.15.131:0/291469261 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:47.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.342+0000 7fdae7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55577ff6f150 0x55577ff71540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52108/0 (socket says 172.21.15.131:52108) 2024-04-24T01:44:47.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.342+0000 7fdae7fff640 1 -- 172.21.15.131:0/291469261 >> v1:172.21.15.107:6789/0 conn(0x55577ff6acc0 legacy=0x55577ff6b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.342+0000 7fdae7fff640 1 -- 172.21.15.131:0/291469261 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577fe29590 con 0x55577ff6f150 2024-04-24T01:44:47.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdae7fff640 1 --2- 172.21.15.131:0/291469261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6f150 0x55577ff71540 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdad800a470 tx=0x7fdad801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76342ed3df0dc6c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaec811640 1 -- 172.21.15.131:0/291469261 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad8057070 con 0x55577ff6f150 2024-04-24T01:44:47.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaec811640 1 -- 172.21.15.131:0/291469261 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad8052570 con 0x55577ff6f150 2024-04-24T01:44:47.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaec811640 1 -- 172.21.15.131:0/291469261 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad8052870 con 0x55577ff6f150 2024-04-24T01:44:47.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaef50c800 1 -- 172.21.15.131:0/291469261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6f150 msgr2=0x55577ff71540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaef50c800 1 --2- 172.21.15.131:0/291469261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6f150 0x55577ff71540 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdad800a470 tx=0x7fdad801ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:47.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaef50c800 1 -- 172.21.15.131:0/291469261 shutdown_connections 2024-04-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaef50c800 1 --2- 172.21.15.131:0/291469261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6f150 0x55577ff71540 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaef50c800 1 -- 172.21.15.131:0/291469261 >> 172.21.15.131:0/291469261 conn(0x55577ff66320 msgr2=0x55577ff68740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaef50c800 1 -- 172.21.15.131:0/291469261 shutdown_connections 2024-04-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.344+0000 7fdaef50c800 1 -- 172.21.15.131:0/291469261 wait complete. 2024-04-24T01:44:47.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.356+0000 7fdaef50c800 1 Processor -- start 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.356+0000 7fdaef50c800 1 -- start start 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.356+0000 7fdaef50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x55577fedef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.356+0000 7fdaef50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55577feb7360 con 0x55577ff6acc0 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fdaed012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x55577fedef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fdaed012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x55577fedef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52112/0 (socket says 172.21.15.131:52112) 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fdaed012640 1 -- 172.21.15.131:0/2817069087 learned_addr learned my addr 172.21.15.131:0/2817069087 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fdaed012640 1 -- 172.21.15.131:0/2817069087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55578005dd10 con 0x55577ff6acc0 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fdaed012640 1 --2- 172.21.15.131:0/2817069087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x55577fedef90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdae0001e10 tx=0x7fdae000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf260c1c595588d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fd9db606640 1 -- 172.21.15.131:0/2817069087 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae0012020 con 0x55577ff6acc0 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fd9db606640 1 -- 172.21.15.131:0/2817069087 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae000e5a0 con 0x55577ff6acc0 2024-04-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.357+0000 7fd9db606640 1 -- 172.21.15.131:0/2817069087 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae000e8e0 con 0x55577ff6acc0 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 -- 172.21.15.131:0/2817069087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 msgr2=0x55577fedef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2817069087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x55577fedef90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdae0001e10 tx=0x7fdae000b780 comp rx=0 tx=0).stop 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 -- 172.21.15.131:0/2817069087 shutdown_connections 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2817069087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x55577fedef90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 -- 172.21.15.131:0/2817069087 >> 172.21.15.131:0/2817069087 conn(0x55577ff66320 msgr2=0x555780057a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 -- 172.21.15.131:0/2817069087 shutdown_connections 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 -- 172.21.15.131:0/2817069087 wait complete. 2024-04-24T01:44:47.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 Processor -- start 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.358+0000 7fdaef50c800 1 -- start start 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaef50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x555780066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaef50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55577ff71e10 con 0x55577ff6acc0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaed012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x555780066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaed012640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x555780066fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52122/0 (socket says 172.21.15.131:52122) 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaed012640 1 -- 172.21.15.131:0/2230415032 learned_addr learned my addr 172.21.15.131:0/2230415032 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaed012640 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555780067500 con 0x55577ff6acc0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaed012640 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x555780066fc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdae000b7c0 tx=0x7fdae0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fd9d9e03640 1 -- 172.21.15.131:0/2230415032 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae0012030 con 0x55577ff6acc0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fd9d9e03640 1 -- 172.21.15.131:0/2230415032 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae0001470 con 0x55577ff6acc0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.359+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555780067790 con 0x55577ff6acc0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.360+0000 7fd9d9e03640 1 -- 172.21.15.131:0/2230415032 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae001a8d0 con 0x55577ff6acc0 2024-04-24T01:44:47.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.360+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55578006a440 con 0x55577ff6acc0 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.360+0000 7fd9d9e03640 1 -- 172.21.15.131:0/2230415032 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdae0015020 con 0x55577ff6acc0 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.360+0000 7fd9d9e03640 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9d4036900 0x7fd9d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fd9d9e03640 1 -- 172.21.15.131:0/2230415032 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdae0020030 con 0x55577ff6acc0 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdae7fff640 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9d4036900 0x7fd9d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55577ff6f150 0x55578006e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55578006e780 con 0x55577ff6f150 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdaed813640 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55577ff6f150 0x55578006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdae7fff640 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9d4036900 0x7fd9d4038dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdad8054000 tx=0x7fdad804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdaed813640 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55577ff6f150 0x55578006e200 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdaed813640 1 -- 172.21.15.131:0/2230415032 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae800a4a0 con 0x55577ff6f150 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.361+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55578006b7d0 con 0x55577ff6f150 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.362+0000 7fdaed813640 1 -- 172.21.15.131:0/2230415032 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdae800a4a0 con 0x55577ff6f150 2024-04-24T01:44:47.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.362+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800705c0 con 0x55577ff6f150 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.362+0000 7fdaed813640 1 -- 172.21.15.131:0/2230415032 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdae800a4a0 con 0x55577ff6f150 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.362+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55578006f900 con 0x55577ff6f150 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.362+0000 7fdaed813640 1 -- 172.21.15.131:0/2230415032 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdae800a4a0 con 0x55577ff6f150 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.362+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55578006fd20 con 0x55577ff6f150 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdaed813640 1 -- 172.21.15.131:0/2230415032 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdae800a4a0 con 0x55577ff6f150 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdaef50c800 1 Processor -- start 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdaef50c800 1 -- start start 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdaef50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578007f370 0x55578007f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdaef50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55577fe5d6b0 con 0x55578007f370 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdae7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578007f370 0x55578007f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdae7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578007f370 0x55578007f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52138/0 (socket says 172.21.15.131:52138) 2024-04-24T01:44:47.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.363+0000 7fdae7fff640 1 -- 172.21.15.131:0/607551680 learned_addr learned my addr 172.21.15.131:0/607551680 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.364+0000 7fdae7fff640 1 -- 172.21.15.131:0/607551680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55578007fcd0 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.364+0000 7fdae7fff640 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578007f370 0x55578007f790 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdad8044840 tx=0x7fdad8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.364+0000 7fd9d2ffd640 1 -- 172.21.15.131:0/607551680 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad806f070 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.364+0000 7fd9d2ffd640 1 -- 172.21.15.131:0/607551680 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad8058040 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.364+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555780080740 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.364+0000 7fd9d2ffd640 1 -- 172.21.15.131:0/607551680 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad8057050 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.364+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555780080be0 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.365+0000 7fd9d2ffd640 1 -- 172.21.15.131:0/607551680 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdad8072070 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.365+0000 7fd9d2ffd640 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9c4036900 0x7fd9c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.365+0000 7fd9d2ffd640 1 -- 172.21.15.131:0/607551680 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdad808fa40 con 0x55578007f370 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.365+0000 7fdaed813640 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9c4036900 0x7fd9c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.365+0000 7fdaef50c800 1 Processor -- start 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdaed813640 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9c4036900 0x7fd9c4038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55578006fca0 tx=0x7fdae8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdaef50c800 1 -- start start 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdaef50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x55578008ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdaef50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5557800624a0 con 0x55578008c630 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdae7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x55578008ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdae7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x55578008ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52146/0 (socket says 172.21.15.131:52146) 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdae7fff640 1 -- 172.21.15.131:0/3448762166 learned_addr learned my addr 172.21.15.131:0/3448762166 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdae7fff640 1 -- 172.21.15.131:0/3448762166 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55578008d020 con 0x55578008c630 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fdae7fff640 1 --2- 172.21.15.131:0/3448762166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x55578008ca50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdad808dda0 tx=0x7fdad8069ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0f032bb4f6de97 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fd9d0ff9640 1 -- 172.21.15.131:0/3448762166 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad805e480 con 0x55578008c630 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fd9d0ff9640 1 -- 172.21.15.131:0/3448762166 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad8072360 con 0x55578008c630 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.366+0000 7fd9d0ff9640 1 -- 172.21.15.131:0/3448762166 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad805e620 con 0x55578008c630 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 -- 172.21.15.131:0/3448762166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 msgr2=0x55578008ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 --2- 172.21.15.131:0/3448762166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x55578008ca50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdad808dda0 tx=0x7fdad8069ad0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 -- 172.21.15.131:0/3448762166 shutdown_connections 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 --2- 172.21.15.131:0/3448762166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x55578008ca50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 -- 172.21.15.131:0/3448762166 >> 172.21.15.131:0/3448762166 conn(0x555780088990 msgr2=0x5557800869f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 -- 172.21.15.131:0/3448762166 shutdown_connections 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 -- 172.21.15.131:0/3448762166 wait complete. 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 Processor -- start 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 -- start start 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x555780093c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.367+0000 7fdaef50c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55578008d790 con 0x55578008c630 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fdae7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x555780093c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fdae7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x555780093c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52152/0 (socket says 172.21.15.131:52152) 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 learned_addr learned my addr 172.21.15.131:0/2744961079 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557800941a0 con 0x55578008c630 2024-04-24T01:44:47.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fdae7fff640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x555780093c60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdad8069b10 tx=0x7fdad808dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fd9c2ffd640 1 -- 172.21.15.131:0/2744961079 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad8093070 con 0x55578008c630 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fd9c2ffd640 1 -- 172.21.15.131:0/2744961079 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad805fb40 con 0x55578008c630 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fd9c2ffd640 1 -- 172.21.15.131:0/2744961079 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad805fe20 con 0x55578008c630 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555780094430 con 0x55578008c630 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.368+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557800970e0 con 0x55578008c630 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.369+0000 7fd9c2ffd640 1 -- 172.21.15.131:0/2744961079 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdad8096070 con 0x55578008c630 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.369+0000 7fd9c2ffd640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9b8036950 0x7fd9b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.369+0000 7fd9c2ffd640 1 -- 172.21.15.131:0/2744961079 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdad8099d40 con 0x55578008c630 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.369+0000 7fdaed813640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9b8036950 0x7fd9b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55578009f790 0x5557800a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a23a0 con 0x55578009f790 2024-04-24T01:44:47.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaed813640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9b8036950 0x7fd9b8038e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55578006f420 tx=0x7fdae801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaed012640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55578009f790 0x5557800a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaed012640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55578009f790 0x5557800a1c50 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaef50c800 20 realm 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.370+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a27b0 con 0x55578009f790 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a3080 con 0x55578009f790 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a3420 con 0x55578009f790 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a3c70 con 0x55578009f790 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 20 searching for the correct realm 2024-04-24T01:44:47.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5557800a59e0 0x5557800a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.371+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x5557800a59e0 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.372+0000 7fdae7fff640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5557800a59e0 0x5557800a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.372+0000 7fdae7fff640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5557800a59e0 0x5557800a7dd0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.372+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.372+0000 7fdae7fff640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdad8098070 0x7fdad805c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.372+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x7fdad8098070 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.372+0000 7fdaed813640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdad8098070 0x7fdad805c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.372+0000 7fdaed813640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdad8098070 0x7fdad805c5b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.373+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801f070 con 0x7fdad8098070 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.373+0000 7fdaed813640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdae8031040 0x7fdae8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.373+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x7fdae8031040 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.373+0000 7fdaed012640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdae8031040 0x7fdae8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.373+0000 7fdaed012640 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdae8031040 0x7fdae8032940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x55578009f790 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x55578009f790 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x7fdae8031040 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.374+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x7fdae8031040 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x7fdad8098070 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801f070 con 0x7fdad8098070 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x5557800a59e0 2024-04-24T01:44:47.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x55578009f790 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.375+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x7fdae8031040 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x55578009f790 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x7fdad8098070 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdae801f070 con 0x7fdad8098070 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x5557800a59e0 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.376+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557800a83b0 con 0x5557800a59e0 2024-04-24T01:44:47.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdad80ae040 con 0x7fdae8031040 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdad80ae040 con 0x5557800a59e0 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdad80ae040 con 0x5557800a59e0 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.377+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdad80ae040 con 0x55578009f790 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdad80ae040 con 0x55578009f790 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdad80ae040 con 0x7fdae8031040 2024-04-24T01:44:47.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x5557800a59e0 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.378+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x7fdad8098070 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801f070 con 0x7fdad8098070 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x55578009f790 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x7fdad8098070 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801f070 con 0x7fdad8098070 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x5557800a59e0 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.379+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x7fdae8031040 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x7fdad8098070 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801f070 con 0x7fdad8098070 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x5557800a59e0 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x7fdae8031040 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.380+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x55578009f790 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdae0055040 con 0x7fdad8098070 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:47.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a45f0 con 0x55578009f790 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.381+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a4e90 con 0x55578009f790 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a4e90 con 0x55578009f790 2024-04-24T01:44:47.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 zone default found 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 4 Realm: () 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 zonegroup default 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800a8830 con 0x7fdad8098070 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800aa630 con 0x5557800a59e0 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.382+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800aab40 con 0x5557800a59e0 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.383+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.383+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.383+0000 7fdaef50c800 20 started sync module instance, tier type = 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.383+0000 7fdaef50c800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.383+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800a9a50 con 0x7fdad8098070 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.384+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.384+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93834298695536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800a9a50 con 0x7fdad8098070 2024-04-24T01:44:47.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.384+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ab620 con 0x55578009f790 2024-04-24T01:44:47.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.385+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93834298695536] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.385+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.385+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93834298700048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800a9a50 con 0x55578009f790 2024-04-24T01:44:47.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.385+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ac0c0 con 0x5557800a59e0 2024-04-24T01:44:47.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.387+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93834298700048] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.387+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.387+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93834298693024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800a99c0 con 0x5557800a59e0 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.387+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800acf80 con 0x7fdad8098070 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.388+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.388+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93834298707152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ad820 con 0x7fdad8098070 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.388+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ae310 con 0x55578009f790 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.388+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93834298693024] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.389+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93834298707152] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.389+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.389+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93834298711520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ad370 con 0x55578009f790 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.389+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800aebb0 con 0x7fdae8031040 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.390+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93834298711520] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.390+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.390+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93834298705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ad370 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.390+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800af230 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.391+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.391+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93834298715392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800af6a0 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.391+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800b0190 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93834298705072] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93834298719328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800b0150 con 0x7fdae8031040 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaef50c800 20 add_watcher() i=0 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaef50c800 20 add_watcher() i=1 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaef50c800 20 add_watcher() i=2 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaef50c800 20 add_watcher() i=3 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaef50c800 20 add_watcher() i=4 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.392+0000 7fdaef50c800 20 add_watcher() i=5 2024-04-24T01:44:47.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.393+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93834298715392] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.393+0000 7fdaef50c800 20 add_watcher() i=6 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.393+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93834298719328] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.393+0000 7fdaef50c800 20 add_watcher() i=7 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.393+0000 7fdaef50c800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.393+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800af1f0 con 0x55578009f790 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.394+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.394+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93834298713520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800af1f0 con 0x55578009f790 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93834298713520] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fd9a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:47.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 5 note: GC not initialized 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fd9a27e4640 20 reqs_thread_entry: start 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 20 Filter name: none 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fd913fff640 20 reqs_thread_entry: start 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.395+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800e6430 con 0x7fdae8031040 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-24T01:44:47.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800e4bd0 con 0x55578009f790 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.396+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800e54e0 con 0x7fdae8031040 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.397+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.397+0000 7fdaef50c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.397+0000 7fdaef50c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.397+0000 7fdaef50c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.397+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93834298937328 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800e9ed0 con 0x55578009f790 2024-04-24T01:44:47.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== watch-notify(notify (1) cookie 93834298711520 notify 146028888087 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5557800e5880 con 0x55578009f790 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fd9d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 93834298711520 notifier 4828 bl.length()=649 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fd9d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fd9d0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fd9d0ff9640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd9b0003ea0 con 0x55578009f790 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify cookie 93834298937328 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== watch-notify(notify_complete (2) cookie 93834298937328 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5557800e5fe0 con 0x55578009f790 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.398+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800e4f70 con 0x55578009f790 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.399+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.399+0000 7fdaef50c800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.399+0000 7fdaef50c800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T01:44:47.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.399+0000 7fdaef50c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.399+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93834298937200 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557800ea2e0 con 0x5557800a59e0 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.399+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== watch-notify(notify (1) cookie 93834298693024 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555780094430 con 0x5557800a59e0 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.400+0000 7fd9c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 93834298693024 notifier 4828 bl.length()=177 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.400+0000 7fd9c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.400+0000 7fd9c3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.400+0000 7fd9c3fff640 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd920003400 con 0x5557800a59e0 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.400+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(68 notify.2 [notify cookie 93834298937200 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.400+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== watch-notify(notify_complete (2) cookie 93834298937200 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5557800941a0 con 0x5557800a59e0 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.400+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.418 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:47.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.401+0000 7fd9a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.401+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93834298713520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800e7960 con 0x55578009f790 2024-04-24T01:44:47.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.402+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93834298713520] v34'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.402+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93834298695536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ae5b0 con 0x7fdad8098070 2024-04-24T01:44:47.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.403+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93834298695536] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.403+0000 7fdaef50c800 20 remove_watcher() i=0 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.403+0000 7fdaef50c800 2 removed watcher, disabling cache 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.403+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93834298700048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ae5b0 con 0x55578009f790 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.404+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93834298700048] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.404+0000 7fdaef50c800 20 remove_watcher() i=1 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.404+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93834298693024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ae5b0 con 0x5557800a59e0 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.405+0000 7fdae7fff640 1 -- 172.21.15.131:0/2744961079 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93834298693024] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad809f070 con 0x5557800a59e0 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.405+0000 7fdaef50c800 20 remove_watcher() i=2 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.405+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93834298707152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800a95a0 con 0x7fdad8098070 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.406+0000 7fdaed813640 1 -- 172.21.15.131:0/2744961079 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93834298707152] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae8040040 con 0x7fdad8098070 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.406+0000 7fdaef50c800 20 remove_watcher() i=3 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.406+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93834298711520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ae5b0 con 0x55578009f790 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.407+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93834298711520] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x55578009f790 2024-04-24T01:44:47.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.407+0000 7fdaef50c800 20 remove_watcher() i=4 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.407+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93834298705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800a95a0 con 0x7fdae8031040 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.408+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93834298705072] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.408+0000 7fdaef50c800 20 remove_watcher() i=5 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.408+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93834298715392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800adde0 con 0x7fdae8031040 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.409+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93834298715392] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.409+0000 7fdaef50c800 20 remove_watcher() i=6 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.409+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93834298719328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557800ac4b0 con 0x7fdae8031040 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.410+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93834298719328] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0018950 con 0x7fdae8031040 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.410+0000 7fdaef50c800 20 remove_watcher() i=7 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.410+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdae8031040 msgr2=0x7fdae8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.410+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdae8031040 0x7fdae8032940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55578009f790 msgr2=0x5557800a1c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55578009f790 0x5557800a1c50 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdad8098070 msgr2=0x7fdad805c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdad8098070 0x7fdad805c5b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5557800a59e0 msgr2=0x5557800a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5557800a59e0 0x5557800a7dd0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9b8036950 msgr2=0x7fd9b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9b8036950 0x7fd9b8038e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55578006f420 tx=0x7fdae801f000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 msgr2=0x555780093c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaed012640 1 -- 172.21.15.131:0/2744961079 reap_dead start 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x555780093c60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdad8069b10 tx=0x7fdad808dd30 comp rx=0 tx=0).stop 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 shutdown_connections 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2744961079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578008c630 0x555780093c60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.427 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 >> 172.21.15.131:0/2744961079 conn(0x555780088990 msgr2=0x555780085ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 shutdown_connections 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2744961079 wait complete. 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9c4036900 msgr2=0x7fd9c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9c4036900 0x7fd9c4038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55578006fca0 tx=0x7fdae8005840 comp rx=0 tx=0).stop 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578007f370 msgr2=0x55578007f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578007f370 0x55578007f790 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdad8044840 tx=0x7fdad8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 shutdown_connections 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9c4036900 0x7fd9c4038dc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/607551680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55578007f370 0x55578007f790 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 >> 172.21.15.131:0/607551680 conn(0x555780073410 msgr2=0x555780073810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 shutdown_connections 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/607551680 wait complete. 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55577ff6f150 msgr2=0x55578006e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.411+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55577ff6f150 0x55578006e200 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9d4036900 msgr2=0x7fd9d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9d4036900 0x7fd9d4038dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdad8054000 tx=0x7fdad804e000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 msgr2=0x555780066fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x555780066fc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdae000b7c0 tx=0x7fdae0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 shutdown_connections 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55577ff6f150 0x55578006e200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd9d4036900 0x7fd9d4038dc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 --2- 172.21.15.131:0/2230415032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55577ff6acc0 0x555780066fc0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 >> 172.21.15.131:0/2230415032 conn(0x55577ff66320 msgr2=0x5557800562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 shutdown_connections 2024-04-24T01:44:47.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.412+0000 7fdaef50c800 1 -- 172.21.15.131:0/2230415032 wait complete. 2024-04-24T01:44:47.430 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:47.430 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:47.430 ERROR:root:0 2024-04-24T01:44:47.431 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:47.438 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000008c23e17e5ec5455b-006628640f-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:44:47.438 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-24T01:44:47.449 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:47.449 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-24T01:44:47.461 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-24T01:44:47.461 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-24T01:44:47.477 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-24T01:44:47.477 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-24T01:44:47.486 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-24T01:44:47.486 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:47.489 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:47.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-24T01:44:47.494 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:47.494 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:47.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:47.494 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-04-24T01:44:47.539 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:47.539 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.539+0000 7fdce632b800 1 Processor -- start 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.539+0000 7fdce632b800 1 -- start start 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdce632b800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563ddb89c8d0 0x563ddb89ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdce632b800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ddb75ad40 con 0x563ddb89f200 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdce632b800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x563ddb72d4d0 con 0x563ddb89c8d0 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdce20c2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563ddb89c8d0 0x563ddb89ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdcd98c1640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x563ddb89f200 0x563ddb8a15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39048/0 (socket says 172.21.15.131:39048) 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdcd98c1640 1 -- 172.21.15.131:0/2439311839 learned_addr learned my addr 172.21.15.131:0/2439311839 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdce20c2640 1 -- 172.21.15.131:0/2439311839 >> v1:172.21.15.107:6789/0 conn(0x563ddb89f200 legacy=0x563ddb8a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.540+0000 7fdce20c2640 1 -- 172.21.15.131:0/2439311839 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ddb759590 con 0x563ddb89c8d0 2024-04-24T01:44:47.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.542+0000 7fdce20c2640 1 --2- 172.21.15.131:0/2439311839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89ecc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400a470 tx=0x7fdcd401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5181add16b6fcd43 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.542+0000 7fdce18c1640 1 -- 172.21.15.131:0/2439311839 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd4057070 con 0x563ddb89c8d0 2024-04-24T01:44:47.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.542+0000 7fdce18c1640 1 -- 172.21.15.131:0/2439311839 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd4052570 con 0x563ddb89c8d0 2024-04-24T01:44:47.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.542+0000 7fdce18c1640 1 -- 172.21.15.131:0/2439311839 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd4052870 con 0x563ddb89c8d0 2024-04-24T01:44:47.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.543+0000 7fdce632b800 1 -- 172.21.15.131:0/2439311839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 msgr2=0x563ddb89ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.543+0000 7fdce632b800 1 --2- 172.21.15.131:0/2439311839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89ecc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400a470 tx=0x7fdcd401ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:47.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.543+0000 7fdce632b800 1 -- 172.21.15.131:0/2439311839 shutdown_connections 2024-04-24T01:44:47.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.543+0000 7fdce632b800 1 --2- 172.21.15.131:0/2439311839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89ecc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.543+0000 7fdce632b800 1 -- 172.21.15.131:0/2439311839 >> 172.21.15.131:0/2439311839 conn(0x563ddb8963a0 msgr2=0x563ddb8987c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.543+0000 7fdce632b800 1 -- 172.21.15.131:0/2439311839 shutdown_connections 2024-04-24T01:44:47.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.543+0000 7fdce632b800 1 -- 172.21.15.131:0/2439311839 wait complete. 2024-04-24T01:44:47.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.554+0000 7fdce632b800 1 Processor -- start 2024-04-24T01:44:47.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.555+0000 7fdce632b800 1 -- start start 2024-04-24T01:44:47.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.555+0000 7fdce632b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.555+0000 7fdce632b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563ddb7e73b0 con 0x563ddb89c8d0 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.555+0000 7fdce20c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.555+0000 7fdce20c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52172/0 (socket says 172.21.15.131:52172) 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.555+0000 7fdce20c2640 1 -- 172.21.15.131:0/3404392153 learned_addr learned my addr 172.21.15.131:0/3404392153 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.555+0000 7fdce20c2640 1 -- 172.21.15.131:0/3404392153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ddb89a7d0 con 0x563ddb89c8d0 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdce20c2640 1 --2- 172.21.15.131:0/3404392153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89c210 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4055040 tx=0x7fdcd404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704d607e0ec019dc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdbd0608640 1 -- 172.21.15.131:0/3404392153 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd4057070 con 0x563ddb89c8d0 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdbd0608640 1 -- 172.21.15.131:0/3404392153 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd4063070 con 0x563ddb89c8d0 2024-04-24T01:44:47.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdbd0608640 1 -- 172.21.15.131:0/3404392153 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd4052720 con 0x563ddb89c8d0 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdce632b800 1 -- 172.21.15.131:0/3404392153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 msgr2=0x563ddb89c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdce632b800 1 --2- 172.21.15.131:0/3404392153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89c210 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4055040 tx=0x7fdcd404c000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdce632b800 1 -- 172.21.15.131:0/3404392153 shutdown_connections 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdce632b800 1 --2- 172.21.15.131:0/3404392153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89c8d0 0x563ddb89c210 secure :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4055040 tx=0x7fdcd404c000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.556+0000 7fdce632b800 1 -- 172.21.15.131:0/3404392153 >> 172.21.15.131:0/3404392153 conn(0x563ddb8963a0 msgr2=0x563ddb988a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce632b800 1 -- 172.21.15.131:0/3404392153 shutdown_connections 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce632b800 1 -- 172.21.15.131:0/3404392153 wait complete. 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce632b800 1 Processor -- start 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce632b800 1 -- start start 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce632b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89f200 0x563ddb996ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce632b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563ddb8a2fb0 con 0x563ddb89f200 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce20c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89f200 0x563ddb996ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce20c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89f200 0x563ddb996ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52174/0 (socket says 172.21.15.131:52174) 2024-04-24T01:44:47.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.557+0000 7fdce20c2640 1 -- 172.21.15.131:0/2208193180 learned_addr learned my addr 172.21.15.131:0/2208193180 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.558+0000 7fdce20c2640 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ddb997410 con 0x563ddb89f200 2024-04-24T01:44:47.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.558+0000 7fdce20c2640 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89f200 0x563ddb996ed0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4055040 tx=0x7fdcd4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.558+0000 7fdbcee05640 1 -- 172.21.15.131:0/2208193180 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd4052e50 con 0x563ddb89f200 2024-04-24T01:44:47.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.558+0000 7fdbcee05640 1 -- 172.21.15.131:0/2208193180 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd406c070 con 0x563ddb89f200 2024-04-24T01:44:47.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.558+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ddb9976a0 con 0x563ddb89f200 2024-04-24T01:44:47.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.558+0000 7fdbcee05640 1 -- 172.21.15.131:0/2208193180 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd405e5d0 con 0x563ddb89f200 2024-04-24T01:44:47.565 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.558+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ddb99a350 con 0x563ddb89f200 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.559+0000 7fdbcee05640 1 -- 172.21.15.131:0/2208193180 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdcd405e770 con 0x563ddb89f200 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.559+0000 7fdbcee05640 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbc8036aa0 0x7fdbc8038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.559+0000 7fdbcee05640 1 -- 172.21.15.131:0/2208193180 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdcd408e9c0 con 0x563ddb89f200 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.559+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbc8036aa0 0x7fdbc8038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.559+0000 7fdce632b800 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb99c100 0x563ddb99e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.559+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb99ea70 con 0x563ddb99c100 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.559+0000 7fdce28c3640 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb99c100 0x563ddb99e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.560+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbc8036aa0 0x7fdbc8038f60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdccc000f60 tx=0x7fdccc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.560+0000 7fdce28c3640 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb99c100 0x563ddb99e4f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.560+0000 7fdce28c3640 1 -- 172.21.15.131:0/2208193180 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc00a4a0 con 0x563ddb99c100 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.560+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb99b6e0 con 0x563ddb99c100 2024-04-24T01:44:47.566 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.560+0000 7fdce28c3640 1 -- 172.21.15.131:0/2208193180 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcdc00a4a0 con 0x563ddb99c100 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.560+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9a0890 con 0x563ddb99c100 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.560+0000 7fdce28c3640 1 -- 172.21.15.131:0/2208193180 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdcdc00a4a0 con 0x563ddb99c100 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb99fbd0 con 0x563ddb99c100 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce28c3640 1 -- 172.21.15.131:0/2208193180 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcdc00a4a0 con 0x563ddb99c100 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9a0020 con 0x563ddb99c100 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce28c3640 1 -- 172.21.15.131:0/2208193180 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdcdc00a4a0 con 0x563ddb99c100 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce632b800 1 Processor -- start 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce632b800 1 -- start start 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce632b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9af680 0x563ddb9afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.561+0000 7fdce632b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563ddb78d6b0 con 0x563ddb9af680 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdcd98c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9af680 0x563ddb9afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.567 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdcd98c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9af680 0x563ddb9afaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52180/0 (socket says 172.21.15.131:52180) 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1951408019 learned_addr learned my addr 172.21.15.131:0/1951408019 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1951408019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ddb9affe0 con 0x563ddb9af680 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9af680 0x563ddb9afaa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fdccc001ed0 tx=0x7fdccc00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdbc7fff640 1 -- 172.21.15.131:0/1951408019 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdccc01b550 con 0x563ddb9af680 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdbc7fff640 1 -- 172.21.15.131:0/1951408019 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdccc01b6f0 con 0x563ddb9af680 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ddb9b0a50 con 0x563ddb9af680 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.562+0000 7fdbc7fff640 1 -- 172.21.15.131:0/1951408019 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdccc01b9d0 con 0x563ddb9af680 2024-04-24T01:44:47.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.563+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ddb9b0f50 con 0x563ddb9af680 2024-04-24T01:44:47.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.563+0000 7fdbc7fff640 1 -- 172.21.15.131:0/1951408019 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdccc023020 con 0x563ddb9af680 2024-04-24T01:44:47.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.563+0000 7fdbc7fff640 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbbc036900 0x7fdbbc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.563+0000 7fdbc7fff640 1 -- 172.21.15.131:0/1951408019 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdccc021020 con 0x563ddb9af680 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdce28c3640 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbbc036900 0x7fdbbc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdce632b800 1 Processor -- start 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdce28c3640 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbbc036900 0x7fdbbc038dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x563ddb99f6f0 tx=0x7fdcdc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdce632b800 1 -- start start 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdce632b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdce632b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563ddb89aa90 con 0x563ddb9bc9c0 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdcd98c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdcd98c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9bcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52184/0 (socket says 172.21.15.131:52184) 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1425178716 learned_addr learned my addr 172.21.15.131:0/1425178716 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.564+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1425178716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ddb9bd3b0 con 0x563ddb9bc9c0 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/1425178716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9bcde0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdccc04ce90 tx=0x7fdccc0468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50705d204023e601 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdbc5ffb640 1 -- 172.21.15.131:0/1425178716 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdccc01be20 con 0x563ddb9bc9c0 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdbc5ffb640 1 -- 172.21.15.131:0/1425178716 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdccc04a070 con 0x563ddb9bc9c0 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdbc5ffb640 1 -- 172.21.15.131:0/1425178716 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdccc024e10 con 0x563ddb9bc9c0 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 -- 172.21.15.131:0/1425178716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 msgr2=0x563ddb9bcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 --2- 172.21.15.131:0/1425178716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9bcde0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdccc04ce90 tx=0x7fdccc0468f0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 -- 172.21.15.131:0/1425178716 shutdown_connections 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 --2- 172.21.15.131:0/1425178716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9bcde0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 -- 172.21.15.131:0/1425178716 >> 172.21.15.131:0/1425178716 conn(0x563ddb9b8d20 msgr2=0x563ddb9b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 -- 172.21.15.131:0/1425178716 shutdown_connections 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 -- 172.21.15.131:0/1425178716 wait complete. 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.565+0000 7fdce632b800 1 Processor -- start 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdce632b800 1 -- start start 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdce632b800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdce632b800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563ddb9bdb20 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdcd98c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdcd98c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52188/0 (socket says 172.21.15.131:52188) 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 learned_addr learned my addr 172.21.15.131:0/1368344124 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ddb9c4560 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9c4020 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0234d0 tx=0x7fdccc04ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdbb3fff640 1 -- 172.21.15.131:0/1368344124 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdccc024e10 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdbb3fff640 1 -- 172.21.15.131:0/1368344124 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdccc025980 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ddb9c47f0 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdbb3fff640 1 -- 172.21.15.131:0/1368344124 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdccc0461c0 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.566+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ddb9c47f0 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.567+0000 7fdbb3fff640 1 -- 172.21.15.131:0/1368344124 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdccc025410 con 0x563ddb9bc9c0 2024-04-24T01:44:47.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.567+0000 7fdbb3fff640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbac036900 0x7fdbac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.567+0000 7fdbb3fff640 1 -- 172.21.15.131:0/1368344124 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdccc039cf0 con 0x563ddb9bc9c0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.567+0000 7fdce28c3640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbac036900 0x7fdbac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce28c3640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbac036900 0x7fdbac038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x563ddb99b630 tx=0x7fdcdc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb9cf970 0x563ddb9d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d2580 con 0x563ddb9cf970 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce20c2640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb9cf970 0x563ddb9d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce20c2640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb9cf970 0x563ddb9d1e30 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce632b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce632b800 20 realm 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.568+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d2990 con 0x563ddb9cf970 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d3260 con 0x563ddb9cf970 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d3600 con 0x563ddb9cf970 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d3e50 con 0x563ddb9cf970 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 20 searching for the correct realm 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563ddb9d5bc0 0x563ddb9d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.569+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.570+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563ddb9d5bc0 0x563ddb9d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.570+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563ddb9d5bc0 0x563ddb9d7fb0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.570+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.570+0000 7fdcd98c1640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdccc015660 0x7fdccc023540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.570+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdccc015660 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.570+0000 7fdce28c3640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdccc015660 0x7fdccc023540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.571+0000 7fdce28c3640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdccc015660 0x7fdccc023540 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.571+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc01f070 con 0x7fdccc015660 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.571+0000 7fdce28c3640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdcdc031040 0x7fdcdc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.571+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.571+0000 7fdce20c2640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdcdc031040 0x7fdcdc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.572+0000 7fdce20c2640 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdcdc031040 0x7fdcdc032940 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.572+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.572+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.572+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.572+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.572+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.572+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdccc015660 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc01f070 con 0x7fdccc015660 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.573+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdccc015660 2024-04-24T01:44:47.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdcdc01f070 con 0x7fdccc015660 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.574+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.575+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.576+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdccc015660 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc01f070 con 0x7fdccc015660 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdccc015660 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc01f070 con 0x7fdccc015660 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.577+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.578+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.578+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.578+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.578+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdccc015660 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.578+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc01f070 con 0x7fdccc015660 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.578+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9d5bc0 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.578+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdcdc031040 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x563ddb9cf970 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8590 con 0x7fdccc015660 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.579+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d47d0 con 0x563ddb9cf970 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d5070 con 0x563ddb9cf970 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d5070 con 0x563ddb9cf970 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 zone default found 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 4 Realm: () 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 zonegroup default 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d8a10 con 0x7fdccc015660 2024-04-24T01:44:47.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.580+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d4e20 con 0x563ddb9d5bc0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdce632b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9dadf0 con 0x563ddb9d5bc0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdce632b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdce632b800 20 started sync module instance, tier type = 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdce632b800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:47.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.581+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9c30 con 0x7fdccc015660 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.582+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.582+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94823677534512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9c30 con 0x7fdccc015660 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.582+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9db870 con 0x563ddb9cf970 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.583+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94823677534512] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.584+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.584+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94823677539776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9c30 con 0x563ddb9cf970 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.584+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9dc2e0 con 0x563ddb9d5bc0 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.585+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94823677539776] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.585+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.585+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94823677532032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9ba0 con 0x563ddb9d5bc0 2024-04-24T01:44:47.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.585+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9dd1a0 con 0x7fdccc015660 2024-04-24T01:44:47.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.586+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.586+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94823677546192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9dd9a0 con 0x7fdccc015660 2024-04-24T01:44:47.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.586+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9de4c0 con 0x563ddb9cf970 2024-04-24T01:44:47.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.586+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94823677532032] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.587+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94823677546192] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.587+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.587+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94823677550480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9de480 con 0x563ddb9cf970 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.587+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9ded60 con 0x7fdcdc031040 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.588+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94823677550480] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.589+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.589+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94823677544144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9de930 con 0x7fdcdc031040 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.589+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9df3f0 con 0x7fdcdc031040 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.590+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.590+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94823677554368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9df860 con 0x7fdcdc031040 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.590+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9e0340 con 0x7fdcdc031040 2024-04-24T01:44:47.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.590+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94823677544144] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94823677558352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9e0340 con 0x7fdcdc031040 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 20 add_watcher() i=0 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 20 add_watcher() i=1 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 20 add_watcher() i=2 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 20 add_watcher() i=3 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 20 add_watcher() i=4 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 20 add_watcher() i=5 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94823677554368] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.591+0000 7fdce632b800 20 add_watcher() i=6 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.592+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94823677558352] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.592+0000 7fdce632b800 20 add_watcher() i=7 2024-04-24T01:44:47.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.592+0000 7fdce632b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.592+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9df3b0 con 0x563ddb9cf970 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.592+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.592+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94823677555632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9e0aa0 con 0x563ddb9cf970 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.593+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94823677555632] v34'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcd4009d10 con 0x563ddb9cf970 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.593+0000 7fdb98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.593+0000 7fdce632b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.593+0000 7fdce632b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.593+0000 7fdce632b800 5 note: GC not initialized 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.593+0000 7fdb137fe640 20 reqs_thread_entry: start 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.594+0000 7fdce632b800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.594+0000 7fdce632b800 20 Filter name: none 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.594+0000 7fdb117fa640 20 reqs_thread_entry: start 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.594+0000 7fdce632b800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:47.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.594+0000 7fdce632b800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.594+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddba16570 con 0x7fdcdc031040 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.595+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fdcd4009d10 con 0x7fdcdc031040 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.595+0000 7fdce632b800 20 rados_obj.operate() r=0 bl.length=473 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.595+0000 7fdce632b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.595+0000 7fdce632b800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.595+0000 7fdce632b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.595+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddba1ce90 con 0x7fdcdc031040 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x7fdcdc031040 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce632b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce632b800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce632b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94823677806848 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563ddba18580 con 0x563ddb9cf970 2024-04-24T01:44:47.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94823677550480 notify 146028888089 ret 0) ==== 678+0+0 (crc 0 0 0) 0x563ddb99a350 con 0x563ddb9cf970 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdbc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94823677550480 notifier 4835 bl.length()=636 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdbc5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdbc5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 94823677806848 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdcd40a4040 con 0x563ddb9cf970 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdbc5ffb640 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdba8003ea0 con 0x563ddb9cf970 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.597+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x563ddb9cf970 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.598+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 94823677806848 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563ddb9976a0 con 0x563ddb9cf970 2024-04-24T01:44:47.610 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:47.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.598+0000 7fdb98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.598+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94823677555632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddba18990 con 0x563ddb9cf970 2024-04-24T01:44:47.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.599+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94823677555632] v34'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x563ddb9cf970 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.599+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94823677534512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9df3b0 con 0x7fdccc015660 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.600+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94823677534512] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.600+0000 7fdce632b800 20 remove_watcher() i=0 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.600+0000 7fdce632b800 2 removed watcher, disabling cache 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.600+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94823677539776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9da130 con 0x563ddb9cf970 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.602+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94823677539776] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x563ddb9cf970 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.602+0000 7fdce632b800 20 remove_watcher() i=1 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.602+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94823677532032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9da130 con 0x563ddb9d5bc0 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.603+0000 7fdcd98c1640 1 -- 172.21.15.131:0/1368344124 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94823677532032] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc040020 con 0x563ddb9d5bc0 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.603+0000 7fdce632b800 20 remove_watcher() i=2 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.603+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94823677546192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9780 con 0x7fdccc015660 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.604+0000 7fdce28c3640 1 -- 172.21.15.131:0/1368344124 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94823677546192] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc040040 con 0x7fdccc015660 2024-04-24T01:44:47.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.604+0000 7fdce632b800 20 remove_watcher() i=3 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.604+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94823677550480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9780 con 0x563ddb9cf970 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.605+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94823677550480] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x563ddb9cf970 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.605+0000 7fdce632b800 20 remove_watcher() i=4 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.605+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94823677544144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9780 con 0x7fdcdc031040 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.606+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94823677544144] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x7fdcdc031040 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.606+0000 7fdce632b800 20 remove_watcher() i=5 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.606+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94823677554368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9dc6d0 con 0x7fdcdc031040 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.607+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94823677554368] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x7fdcdc031040 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.607+0000 7fdce632b800 20 remove_watcher() i=6 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.607+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94823677558352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563ddb9d9780 con 0x7fdcdc031040 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94823677558352] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40a4040 con 0x7fdcdc031040 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 20 remove_watcher() i=7 2024-04-24T01:44:47.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdcdc031040 msgr2=0x7fdcdc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdcdc031040 0x7fdcdc032940 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb9cf970 msgr2=0x563ddb9d1e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb9cf970 0x563ddb9d1e30 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdccc015660 msgr2=0x7fdccc023540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdccc015660 0x7fdccc023540 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563ddb9d5bc0 msgr2=0x563ddb9d7fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.608+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x563ddb9d5bc0 0x563ddb9d7fb0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbac036900 msgr2=0x7fdbac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbac036900 0x7fdbac038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x563ddb99b630 tx=0x7fdcdc01f000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 msgr2=0x563ddb9c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9c4020 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0234d0 tx=0x7fdccc04ce20 comp rx=0 tx=0).stop 2024-04-24T01:44:47.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce20c2640 1 -- 172.21.15.131:0/1368344124 reap_dead start 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 shutdown_connections 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/1368344124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9bc9c0 0x563ddb9c4020 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 >> 172.21.15.131:0/1368344124 conn(0x563ddb9b8d20 msgr2=0x563ddb9b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 shutdown_connections 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1368344124 wait complete. 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbbc036900 msgr2=0x7fdbbc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbbc036900 0x7fdbbc038dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x563ddb99f6f0 tx=0x7fdcdc005840 comp rx=0 tx=0).stop 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9af680 msgr2=0x563ddb9afaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9af680 0x563ddb9afaa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fdccc001ed0 tx=0x7fdccc00d7a0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 shutdown_connections 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbbc036900 0x7fdbbc038dc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/1951408019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb9af680 0x563ddb9afaa0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 >> 172.21.15.131:0/1951408019 conn(0x563ddb9a3720 msgr2=0x563ddb9a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 shutdown_connections 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/1951408019 wait complete. 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb99c100 msgr2=0x563ddb99e4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb99c100 0x563ddb99e4f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbc8036aa0 msgr2=0x7fdbc8038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbc8036aa0 0x7fdbc8038f60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdccc000f60 tx=0x7fdccc0012b0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89f200 msgr2=0x563ddb996ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89f200 0x563ddb996ed0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4055040 tx=0x7fdcd4002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 shutdown_connections 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x563ddb99c100 0x563ddb99e4f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdbc8036aa0 0x7fdbc8038f60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 --2- 172.21.15.131:0/2208193180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563ddb89f200 0x563ddb996ed0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.609+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 >> 172.21.15.131:0/2208193180 conn(0x563ddb8963a0 msgr2=0x563ddb89b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.610+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 shutdown_connections 2024-04-24T01:44:47.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.610+0000 7fdce632b800 1 -- 172.21.15.131:0/2208193180 wait complete. 2024-04-24T01:44:47.621 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:47.622 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:47.622 ERROR:root:0 2024-04-24T01:44:47.622 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-24T01:44:47.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-24T01:44:47.622 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-04-24T01:44:47.674 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:47.674 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:47.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.674+0000 7f28cd928800 1 Processor -- start 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.674+0000 7f28cd928800 1 -- start start 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.674+0000 7f28cd928800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560729bb21b0 0x560729bb45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.674+0000 7f28cd928800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560729a6dd40 con 0x560729bae200 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.674+0000 7f28cd928800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x560729a404d0 con 0x560729bb21b0 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.675+0000 7f28c3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560729bb21b0 0x560729bb45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.675+0000 7f28c9660640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x560729bae200 0x560729bae620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39050/0 (socket says 172.21.15.131:39050) 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.675+0000 7f28c9660640 1 -- 172.21.15.131:0/668684520 learned_addr learned my addr 172.21.15.131:0/668684520 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.675+0000 7f28c3fff640 1 --2- 172.21.15.131:0/668684520 >> v2:172.21.15.107:3300/0 conn(0x560729bb21b0 0x560729bb45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52192/0 (socket says 172.21.15.131:52192) 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.675+0000 7f28c3fff640 1 -- 172.21.15.131:0/668684520 >> v1:172.21.15.107:6789/0 conn(0x560729bae200 legacy=0x560729bae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.675+0000 7f28c3fff640 1 -- 172.21.15.131:0/668684520 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560729a6c590 con 0x560729bb21b0 2024-04-24T01:44:47.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.677+0000 7f28c3fff640 1 --2- 172.21.15.131:0/668684520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729bb45a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f28b400a470 tx=0x7f28b401cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155b27bc51af498c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.677+0000 7f28c8e5f640 1 -- 172.21.15.131:0/668684520 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b4057070 con 0x560729bb21b0 2024-04-24T01:44:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.677+0000 7f28c8e5f640 1 -- 172.21.15.131:0/668684520 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b4052570 con 0x560729bb21b0 2024-04-24T01:44:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.677+0000 7f28c8e5f640 1 -- 172.21.15.131:0/668684520 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b4052870 con 0x560729bb21b0 2024-04-24T01:44:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.678+0000 7f28cd928800 1 -- 172.21.15.131:0/668684520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 msgr2=0x560729bb45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.678+0000 7f28cd928800 1 --2- 172.21.15.131:0/668684520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729bb45a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f28b400a470 tx=0x7f28b401cf20 comp rx=0 tx=0).stop 2024-04-24T01:44:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.678+0000 7f28cd928800 1 -- 172.21.15.131:0/668684520 shutdown_connections 2024-04-24T01:44:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.678+0000 7f28cd928800 1 --2- 172.21.15.131:0/668684520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729bb45a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.678+0000 7f28cd928800 1 -- 172.21.15.131:0/668684520 >> 172.21.15.131:0/668684520 conn(0x560729ba8aa0 msgr2=0x560729baaec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.678+0000 7f28cd928800 1 -- 172.21.15.131:0/668684520 shutdown_connections 2024-04-24T01:44:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.678+0000 7f28cd928800 1 -- 172.21.15.131:0/668684520 wait complete. 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.689+0000 7f28cd928800 1 Processor -- start 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.689+0000 7f28cd928800 1 -- start start 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.689+0000 7f28cd928800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bae200 0x560729c9efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.690+0000 7f28cd928800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560729afa360 con 0x560729bae200 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.690+0000 7f28c9660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bae200 0x560729c9efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.690+0000 7f28c9660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bae200 0x560729c9efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52194/0 (socket says 172.21.15.131:52194) 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.690+0000 7f28c9660640 1 -- 172.21.15.131:0/3967156734 learned_addr learned my addr 172.21.15.131:0/3967156734 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.690+0000 7f28c9660640 1 -- 172.21.15.131:0/3967156734 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560729c9f570 con 0x560729bae200 2024-04-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.690+0000 7f28c9660640 1 --2- 172.21.15.131:0/3967156734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bae200 0x560729c9efa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f28bc001e10 tx=0x7f28bc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a43c8d0c786f44 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f27b7606640 1 -- 172.21.15.131:0/3967156734 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28bc012020 con 0x560729bae200 2024-04-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f27b7606640 1 -- 172.21.15.131:0/3967156734 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28bc00e5a0 con 0x560729bae200 2024-04-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f27b7606640 1 -- 172.21.15.131:0/3967156734 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28bc00e8e0 con 0x560729bae200 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f28cd928800 1 -- 172.21.15.131:0/3967156734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bae200 msgr2=0x560729c9efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f28cd928800 1 --2- 172.21.15.131:0/3967156734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bae200 0x560729c9efa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f28bc001e10 tx=0x7f28bc00b780 comp rx=0 tx=0).stop 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f28cd928800 1 -- 172.21.15.131:0/3967156734 shutdown_connections 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f28cd928800 1 --2- 172.21.15.131:0/3967156734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bae200 0x560729c9efa0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f28cd928800 1 -- 172.21.15.131:0/3967156734 >> 172.21.15.131:0/3967156734 conn(0x560729ba8aa0 msgr2=0x560729c9a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f28cd928800 1 -- 172.21.15.131:0/3967156734 shutdown_connections 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.691+0000 7f28cd928800 1 -- 172.21.15.131:0/3967156734 wait complete. 2024-04-24T01:44:47.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28cd928800 1 Processor -- start 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28cd928800 1 -- start start 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28cd928800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729ca7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28cd928800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560729bb4de0 con 0x560729bb21b0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28c9660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729ca7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28c9660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729ca7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52208/0 (socket says 172.21.15.131:52208) 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28c9660640 1 -- 172.21.15.131:0/345867297 learned_addr learned my addr 172.21.15.131:0/345867297 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.692+0000 7f28c9660640 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560729ca8340 con 0x560729bb21b0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.693+0000 7f28c9660640 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729ca7e00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00b7c0 tx=0x7f28bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.693+0000 7f27b5e03640 1 -- 172.21.15.131:0/345867297 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28bc012030 con 0x560729bb21b0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.693+0000 7f27b5e03640 1 -- 172.21.15.131:0/345867297 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28bc001470 con 0x560729bb21b0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.693+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560729ca85d0 con 0x560729bb21b0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.693+0000 7f27b5e03640 1 -- 172.21.15.131:0/345867297 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28bc01a700 con 0x560729bb21b0 2024-04-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.693+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560729cab280 con 0x560729bb21b0 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f27b5e03640 1 -- 172.21.15.131:0/345867297 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f28bc015020 con 0x560729bb21b0 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f27b5e03640 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27b0036900 0x7f27b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f27b5e03640 1 -- 172.21.15.131:0/345867297 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f28bc020030 con 0x560729bb21b0 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f28c3fff640 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27b0036900 0x7f27b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f28cd928800 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729cad030 0x560729caf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729caf960 con 0x560729cad030 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f28c9e61640 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729cad030 0x560729caf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f28c3fff640 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27b0036900 0x7f27b0038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f28b4054000 tx=0x7f28b404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.694+0000 7f28c9e61640 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729cad030 0x560729caf420 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.695+0000 7f28c9e61640 1 -- 172.21.15.131:0/345867297 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28c400a4a0 con 0x560729cad030 2024-04-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.695+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729cac610 con 0x560729cad030 2024-04-24T01:44:47.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.695+0000 7f28c9e61640 1 -- 172.21.15.131:0/345867297 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28c400a4a0 con 0x560729cad030 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.695+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729cb17a0 con 0x560729cad030 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.696+0000 7f28c9e61640 1 -- 172.21.15.131:0/345867297 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f28c400a4a0 con 0x560729cad030 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.696+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729cb0ae0 con 0x560729cad030 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.696+0000 7f28c9e61640 1 -- 172.21.15.131:0/345867297 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28c400a4a0 con 0x560729cad030 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.696+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729cb0f30 con 0x560729cad030 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.696+0000 7f28c9e61640 1 -- 172.21.15.131:0/345867297 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f28c400a4a0 con 0x560729cad030 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.696+0000 7f28cd928800 1 Processor -- start 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.697+0000 7f28cd928800 1 -- start start 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.697+0000 7f28cd928800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729cc0570 0x560729cc0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.697+0000 7f28cd928800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560729aa06b0 con 0x560729cc0570 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.697+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729cc0570 0x560729cc0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.697+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729cc0570 0x560729cc0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52212/0 (socket says 172.21.15.131:52212) 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.697+0000 7f28c3fff640 1 -- 172.21.15.131:0/3978811151 learned_addr learned my addr 172.21.15.131:0/3978811151 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.697+0000 7f28c3fff640 1 -- 172.21.15.131:0/3978811151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560729cc0ed0 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.698+0000 7f28c3fff640 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729cc0570 0x560729cc0990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f28b4044830 tx=0x7f28b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.698+0000 7f27aeffd640 1 -- 172.21.15.131:0/3978811151 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b406f070 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.698+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560729cc1940 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.698+0000 7f27aeffd640 1 -- 172.21.15.131:0/3978811151 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b4058040 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.698+0000 7f27aeffd640 1 -- 172.21.15.131:0/3978811151 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b4057050 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.698+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560729cc1de0 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f27aeffd640 1 -- 172.21.15.131:0/3978811151 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f28b4072070 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f27aeffd640 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27a0036900 0x7f27a0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f27aeffd640 1 -- 172.21.15.131:0/3978811151 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f28b408fb00 con 0x560729cc0570 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f28c9e61640 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27a0036900 0x7f27a0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f28cd928800 1 Processor -- start 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f28c9e61640 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27a0036900 0x7f27a0038dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x560729cb0600 tx=0x7f28c4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f28cd928800 1 -- start start 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f28cd928800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729ccdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.699+0000 7f28cd928800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560729c9f8f0 con 0x560729ccd830 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729ccdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729ccdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52220/0 (socket says 172.21.15.131:52220) 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f28c3fff640 1 -- 172.21.15.131:0/1320403622 learned_addr learned my addr 172.21.15.131:0/1320403622 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f28c3fff640 1 -- 172.21.15.131:0/1320403622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560729cce220 con 0x560729ccd830 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f28c3fff640 1 --2- 172.21.15.131:0/1320403622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729ccdc50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f28b408dda0 tx=0x7f28b408e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a849599c2e2d26f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f27acff9640 1 -- 172.21.15.131:0/1320403622 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b4087070 con 0x560729ccd830 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f27acff9640 1 -- 172.21.15.131:0/1320403622 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b405e480 con 0x560729ccd830 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.700+0000 7f27acff9640 1 -- 172.21.15.131:0/1320403622 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b4072360 con 0x560729ccd830 2024-04-24T01:44:47.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 -- 172.21.15.131:0/1320403622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 msgr2=0x560729ccdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 --2- 172.21.15.131:0/1320403622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729ccdc50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f28b408dda0 tx=0x7f28b408e050 comp rx=0 tx=0).stop 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 -- 172.21.15.131:0/1320403622 shutdown_connections 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 --2- 172.21.15.131:0/1320403622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729ccdc50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 -- 172.21.15.131:0/1320403622 >> 172.21.15.131:0/1320403622 conn(0x560729cc9b90 msgr2=0x560729cc7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 -- 172.21.15.131:0/1320403622 shutdown_connections 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 -- 172.21.15.131:0/1320403622 wait complete. 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 Processor -- start 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 -- start start 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729cd4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28cd928800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560729cce990 con 0x560729ccd830 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729cd4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729cd4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52226/0 (socket says 172.21.15.131:52226) 2024-04-24T01:44:47.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.701+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 learned_addr learned my addr 172.21.15.131:0/3592193915 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.702+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560729cd53d0 con 0x560729ccd830 2024-04-24T01:44:47.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.702+0000 7f28c3fff640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729cd4e90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f28b408e090 tx=0x7f28b408dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.702+0000 7f279effd640 1 -- 172.21.15.131:0/3592193915 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b4087030 con 0x560729ccd830 2024-04-24T01:44:47.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.702+0000 7f279effd640 1 -- 172.21.15.131:0/3592193915 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b405fd50 con 0x560729ccd830 2024-04-24T01:44:47.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.702+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560729cd5660 con 0x560729ccd830 2024-04-24T01:44:47.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.702+0000 7f279effd640 1 -- 172.21.15.131:0/3592193915 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b40726e0 con 0x560729ccd830 2024-04-24T01:44:47.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.702+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560729cd8310 con 0x560729ccd830 2024-04-24T01:44:47.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f279effd640 1 -- 172.21.15.131:0/3592193915 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f28b4072880 con 0x560729ccd830 2024-04-24T01:44:47.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f279effd640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2794036950 0x7f2794038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f279effd640 1 -- 172.21.15.131:0/3592193915 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f28b4088070 con 0x560729ccd830 2024-04-24T01:44:47.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f28c9e61640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2794036950 0x7f2794038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729ce09c0 0x560729ce2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce35d0 con 0x560729ce09c0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f28c9e61640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2794036950 0x7f2794038e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x560729cac560 tx=0x7f28c401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.703+0000 7f28c9660640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729ce09c0 0x560729ce2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28c9660640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729ce09c0 0x560729ce2e80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 20 realm 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce39e0 con 0x560729ce09c0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce42b0 con 0x560729ce09c0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.704+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce4650 con 0x560729ce09c0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28cd928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce4ea0 con 0x560729ce09c0 2024-04-24T01:44:47.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28cd928800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28cd928800 20 searching for the correct realm 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560729ce6c10 0x560729ce9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28c3fff640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560729ce6c10 0x560729ce9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.705+0000 7f28c3fff640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560729ce6c10 0x560729ce9000 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c3fff640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f28b4082070 0x7f28b405d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28b4082070 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c9e61640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f28b4082070 0x7f28b405d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c9e61640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f28b4082070 0x7f28b405d720 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28c401f070 con 0x7f28b4082070 2024-04-24T01:44:47.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c9e61640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f28c4031040 0x7f28c4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.706+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.707+0000 7f28c9660640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f28c4031040 0x7f28c4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.707+0000 7f28c9660640 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f28c4031040 0x7f28c4032940 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.708+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28b4082070 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28c401f070 con 0x7f28b4082070 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.709+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28b4082070 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f28c401f070 con 0x7f28b4082070 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.710+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.711+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.711+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.711+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.711+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.711+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.711+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.712+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28b4082070 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28c401f070 con 0x7f28b4082070 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28b4082070 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28c401f070 con 0x7f28b4082070 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.713+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28b4082070 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28c401f070 con 0x7f28b4082070 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce6c10 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.714+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28c4031040 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x560729ce09c0 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560729ce95e0 con 0x7f28b4082070 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce5820 con 0x560729ce09c0 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.715+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce60c0 con 0x560729ce09c0 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce9a40 con 0x560729ce09c0 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 zone default found 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 4 Realm: () 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 zonegroup default 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729ce9a90 con 0x7f28b4082070 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.716+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729cebd60 con 0x560729ce6c10 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729cec100 con 0x560729ce6c10 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28cd928800 20 started sync module instance, tier type = 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28cd928800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.717+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ceb1f0 con 0x7f28b4082070 2024-04-24T01:44:47.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.718+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.718+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94588766172944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ceb1f0 con 0x7f28b4082070 2024-04-24T01:44:47.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.718+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cecba0 con 0x560729ce09c0 2024-04-24T01:44:47.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.719+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94588766172944] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.720+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.720+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94588766176944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ceb1f0 con 0x560729ce09c0 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.720+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ced650 con 0x560729ce6c10 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.721+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94588766176944] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.721+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.721+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94588766170432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ceb160 con 0x560729ce6c10 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.721+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cee540 con 0x7f28b4082070 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.722+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.722+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94588766170432] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.722+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94588766184048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ceed40 con 0x7f28b4082070 2024-04-24T01:44:47.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.722+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cedab0 con 0x560729ce09c0 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.723+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94588766184048] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.723+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.723+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94588766185360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ceed00 con 0x560729ce09c0 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.724+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cefdd0 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.725+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.725+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94588766189856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cf01f0 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.725+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cf0c60 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.725+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94588766185360] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.726+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.726+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94588766193456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cf0c20 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.726+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cf1670 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.726+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94588766189856] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94588766193456] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94588766188288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cf11c0 con 0x7f28c4031040 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 20 add_watcher() i=0 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 20 add_watcher() i=1 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 20 add_watcher() i=2 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 20 add_watcher() i=3 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 20 add_watcher() i=4 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 20 add_watcher() i=5 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.727+0000 7f28cd928800 20 add_watcher() i=6 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.728+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94588766188288] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.728+0000 7f28cd928800 20 add_watcher() i=7 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.728+0000 7f28cd928800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.728+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729cf46a0 con 0x560729ce09c0 2024-04-24T01:44:47.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.728+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.728+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94588766196160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cf1a90 con 0x560729ce09c0 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.729+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94588766196160] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.729+0000 7f277f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.729+0000 7f28cd928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.729+0000 7f28cd928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.729+0000 7f28cd928800 5 note: GC not initialized 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.729+0000 7f277e7e4640 20 reqs_thread_entry: start 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 20 Filter name: none 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f26effff640 20 reqs_thread_entry: start 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729d27840 con 0x7f28c4031040 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.730+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729d25fe0 con 0x560729ce6c10 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.731+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.731+0000 7f28cd928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.731+0000 7f28cd928800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.731+0000 7f28cd928800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.731+0000 7f28cd928800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-24T01:44:47.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.731+0000 7f28cd928800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.731+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729d26b00 con 0x7f28c4031040 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f28cd928800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f28cd928800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f28cd928800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94588766414064 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729d2b4f0 con 0x7f28b4082070 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== watch-notify(notify (1) cookie 94588766172944 notify 146028888097 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f28c4024680 con 0x7f28b4082070 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f27acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94588766172944 notifier 4842 bl.length()=533 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(65 notify.0 [notify cookie 94588766414064 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f27acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f27acff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.732+0000 7f27acff9640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f278c003ea0 con 0x7f28b4082070 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.733+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.733+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== watch-notify(notify_complete (2) cookie 94588766414064 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f28c4024850 con 0x7f28b4082070 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.733+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729d2b4b0 con 0x560729ce6c10 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28cd928800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28cd928800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28cd928800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94588766433280 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560729d2bdd0 con 0x560729ce09c0 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94588766176944 notify 146028888090 ret 0) ==== 218+0+0 (crc 0 0 0) 0x560729d2ae30 con 0x560729ce09c0 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f27acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94588766176944 notifier 4842 bl.length()=176 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f27acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f27acff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(68 notify.1 [notify cookie 94588766433280 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f27acff9640 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f278c003ea0 con 0x560729ce09c0 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.734+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 94588766433280 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560729d27570 con 0x560729ce09c0 2024-04-24T01:44:47.745 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-04-24T01:44:47.731904Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.731885Z","tags":[],"group_ids":[]} 2024-04-24T01:44:47.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.735+0000 7f277f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.735+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94588766196160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cdd830 con 0x560729ce09c0 2024-04-24T01:44:47.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.736+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94588766196160] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.736+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94588766172944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cdd830 con 0x7f28b4082070 2024-04-24T01:44:47.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.737+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94588766172944] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.737+0000 7f28cd928800 20 remove_watcher() i=0 2024-04-24T01:44:47.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.737+0000 7f28cd928800 2 removed watcher, disabling cache 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.737+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94588766176944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729ceb6f0 con 0x560729ce09c0 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.738+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94588766176944] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.738+0000 7f28cd928800 20 remove_watcher() i=1 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.738+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94588766170432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cec6b0 con 0x560729ce6c10 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.739+0000 7f28c3fff640 1 -- 172.21.15.131:0/3592193915 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94588766170432] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28b4071030 con 0x560729ce6c10 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.739+0000 7f28cd928800 20 remove_watcher() i=2 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.739+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94588766184048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cec6b0 con 0x7f28b4082070 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.740+0000 7f28c9e61640 1 -- 172.21.15.131:0/3592193915 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94588766184048] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28c4040040 con 0x7f28b4082070 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.740+0000 7f28cd928800 20 remove_watcher() i=3 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.740+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94588766185360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cec6b0 con 0x560729ce09c0 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.742+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94588766185360] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x560729ce09c0 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.742+0000 7f28cd928800 20 remove_watcher() i=4 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.742+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94588766189856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cec6b0 con 0x7f28c4031040 2024-04-24T01:44:47.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.743+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94588766189856] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.743+0000 7f28cd928800 20 remove_watcher() i=5 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.743+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94588766193456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cef920 con 0x7f28c4031040 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.744+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94588766193456] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.744+0000 7f28cd928800 20 remove_watcher() i=6 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.744+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94588766188288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560729cec6b0 con 0x7f28c4031040 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94588766188288] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28bc02dcf0 con 0x7f28c4031040 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 20 remove_watcher() i=7 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f28c4031040 msgr2=0x7f28c4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f28c4031040 0x7f28c4032940 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729ce09c0 msgr2=0x560729ce2e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729ce09c0 0x560729ce2e80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f28b4082070 msgr2=0x7f28b405d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f28b4082070 0x7f28b405d720 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560729ce6c10 msgr2=0x560729ce9000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x560729ce6c10 0x560729ce9000 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2794036950 msgr2=0x7f2794038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2794036950 0x7f2794038e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x560729cac560 tx=0x7f28c401f000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28c9660640 1 -- 172.21.15.131:0/3592193915 reap_dead start 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 msgr2=0x560729cd4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729cd4e90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f28b408e090 tx=0x7f28b408dd30 comp rx=0 tx=0).stop 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 shutdown_connections 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3592193915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729ccd830 0x560729cd4e90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 >> 172.21.15.131:0/3592193915 conn(0x560729cc9b90 msgr2=0x560729cc71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 shutdown_connections 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3592193915 wait complete. 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27a0036900 msgr2=0x7f27a0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27a0036900 0x7f27a0038dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x560729cb0600 tx=0x7f28c4005840 comp rx=0 tx=0).stop 2024-04-24T01:44:47.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729cc0570 msgr2=0x560729cc0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729cc0570 0x560729cc0990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f28b4044830 tx=0x7f28b4002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 shutdown_connections 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27a0036900 0x7f27a0038dc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 --2- 172.21.15.131:0/3978811151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729cc0570 0x560729cc0990 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 >> 172.21.15.131:0/3978811151 conn(0x560729cb4610 msgr2=0x560729cb4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 shutdown_connections 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.745+0000 7f28cd928800 1 -- 172.21.15.131:0/3978811151 wait complete. 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729cad030 msgr2=0x560729caf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729cad030 0x560729caf420 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27b0036900 msgr2=0x7f27b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27b0036900 0x7f27b0038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f28b4054000 tx=0x7f28b404e000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 msgr2=0x560729ca7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729ca7e00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00b7c0 tx=0x7f28bc000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 shutdown_connections 2024-04-24T01:44:47.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x560729cad030 0x560729caf420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f27b0036900 0x7f27b0038dc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 --2- 172.21.15.131:0/345867297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560729bb21b0 0x560729ca7e00 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 >> 172.21.15.131:0/345867297 conn(0x560729ba8aa0 msgr2=0x560729c9db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 shutdown_connections 2024-04-24T01:44:47.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.746+0000 7f28cd928800 1 -- 172.21.15.131:0/345867297 wait complete. 2024-04-24T01:44:47.756 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-24T01:44:47.731904Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.731885Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:47.756 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-24T01:44:47.731904Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.731885Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:47.756 ERROR:root:0 2024-04-24T01:44:47.757 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:47.761 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:47.761 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-04-24T01:44:47.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-04-24T01:44:47.762 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-04-24T01:44:47.804 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:47.804 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:47.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.804+0000 7fdda830c800 1 Processor -- start 2024-04-24T01:44:47.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.804+0000 7fdda830c800 1 -- start start 2024-04-24T01:44:47.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.804+0000 7fdda830c800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c07c0423c0 0x55c07c0447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.804+0000 7fdda830c800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c07befcd40 con 0x55c07c03e8b0 2024-04-24T01:44:47.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.804+0000 7fdda830c800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55c07becf4d0 con 0x55c07c0423c0 2024-04-24T01:44:47.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.805+0000 7fdd9d60a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c07c0423c0 0x55c07c0447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.805+0000 7fdda5e0b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55c07c03e8b0 0x55c07c040ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39052/0 (socket says 172.21.15.131:39052) 2024-04-24T01:44:47.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.805+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1184856371 learned_addr learned my addr 172.21.15.131:0/1184856371 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:47.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.805+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1184856371 >> v1:172.21.15.107:6789/0 conn(0x55c07c03e8b0 legacy=0x55c07c040ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.805+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1184856371 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07befb590 con 0x55c07c0423c0 2024-04-24T01:44:47.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.807+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/1184856371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c0423c0 0x55c07c0447b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000a470 tx=0x7fdd9001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11baeff148d24426 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.807+0000 7fdda560a640 1 -- 172.21.15.131:0/1184856371 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90057070 con 0x55c07c0423c0 2024-04-24T01:44:47.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.807+0000 7fdda560a640 1 -- 172.21.15.131:0/1184856371 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd90052570 con 0x55c07c0423c0 2024-04-24T01:44:47.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.807+0000 7fdda560a640 1 -- 172.21.15.131:0/1184856371 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90052870 con 0x55c07c0423c0 2024-04-24T01:44:47.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.808+0000 7fdda830c800 1 -- 172.21.15.131:0/1184856371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c0423c0 msgr2=0x55c07c0447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.808+0000 7fdda830c800 1 --2- 172.21.15.131:0/1184856371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c0423c0 0x55c07c0447b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000a470 tx=0x7fdd9001ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:47.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.808+0000 7fdda830c800 1 -- 172.21.15.131:0/1184856371 shutdown_connections 2024-04-24T01:44:47.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.808+0000 7fdda830c800 1 --2- 172.21.15.131:0/1184856371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c0423c0 0x55c07c0447b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.808+0000 7fdda830c800 1 -- 172.21.15.131:0/1184856371 >> 172.21.15.131:0/1184856371 conn(0x55c07c038380 msgr2=0x55c07c03a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.808+0000 7fdda830c800 1 -- 172.21.15.131:0/1184856371 shutdown_connections 2024-04-24T01:44:47.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.808+0000 7fdda830c800 1 -- 172.21.15.131:0/1184856371 wait complete. 2024-04-24T01:44:47.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.819+0000 7fdda830c800 1 Processor -- start 2024-04-24T01:44:47.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.819+0000 7fdda830c800 1 -- start start 2024-04-24T01:44:47.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.819+0000 7fdda830c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c03e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.819+0000 7fdda830c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c07bf893c0 con 0x55c07c03e8b0 2024-04-24T01:44:47.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.820+0000 7fdda5e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c03e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.820+0000 7fdda5e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c03e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52250/0 (socket says 172.21.15.131:52250) 2024-04-24T01:44:47.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.820+0000 7fdda5e0b640 1 -- 172.21.15.131:0/3597154444 learned_addr learned my addr 172.21.15.131:0/3597154444 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.820+0000 7fdda5e0b640 1 -- 172.21.15.131:0/3597154444 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07c03c7b0 con 0x55c07c03e8b0 2024-04-24T01:44:47.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdda5e0b640 1 --2- 172.21.15.131:0/3597154444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c03e1f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdd98001de0 tx=0x7fdd9800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca00cc65ccd66588 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdc93e07640 1 -- 172.21.15.131:0/3597154444 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd98012020 con 0x55c07c03e8b0 2024-04-24T01:44:47.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdc93e07640 1 -- 172.21.15.131:0/3597154444 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9800e5a0 con 0x55c07c03e8b0 2024-04-24T01:44:47.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdc93e07640 1 -- 172.21.15.131:0/3597154444 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9800e8c0 con 0x55c07c03e8b0 2024-04-24T01:44:47.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdda830c800 1 -- 172.21.15.131:0/3597154444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 msgr2=0x55c07c03e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdda830c800 1 --2- 172.21.15.131:0/3597154444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c03e1f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdd98001de0 tx=0x7fdd9800b6c0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdda830c800 1 -- 172.21.15.131:0/3597154444 shutdown_connections 2024-04-24T01:44:47.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdda830c800 1 --2- 172.21.15.131:0/3597154444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c03e1f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.821+0000 7fdda830c800 1 -- 172.21.15.131:0/3597154444 >> 172.21.15.131:0/3597154444 conn(0x55c07c038380 msgr2=0x55c07c12aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda830c800 1 -- 172.21.15.131:0/3597154444 shutdown_connections 2024-04-24T01:44:47.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda830c800 1 -- 172.21.15.131:0/3597154444 wait complete. 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda830c800 1 Processor -- start 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda830c800 1 -- start start 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda830c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda830c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c07c044ff0 con 0x55c07c03e8b0 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda5e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda5e0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c138e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52264/0 (socket says 172.21.15.131:52264) 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.822+0000 7fdda5e0b640 1 -- 172.21.15.131:0/2957298966 learned_addr learned my addr 172.21.15.131:0/2957298966 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.823+0000 7fdda5e0b640 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07c139380 con 0x55c07c03e8b0 2024-04-24T01:44:47.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.823+0000 7fdda5e0b640 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c138e40 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c010 tx=0x7fdd98000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.824+0000 7fdc92604640 1 -- 172.21.15.131:0/2957298966 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd98012070 con 0x55c07c03e8b0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.824+0000 7fdc92604640 1 -- 172.21.15.131:0/2957298966 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9801a7a0 con 0x55c07c03e8b0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.824+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c07c139610 con 0x55c07c03e8b0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.824+0000 7fdc92604640 1 -- 172.21.15.131:0/2957298966 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9801aa80 con 0x55c07c03e8b0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.824+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c07c13c2c0 con 0x55c07c03e8b0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdc92604640 1 -- 172.21.15.131:0/2957298966 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd98015020 con 0x55c07c03e8b0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdc92604640 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc8c036950 0x7fdc8c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdc92604640 1 -- 172.21.15.131:0/2957298966 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdd98020070 con 0x55c07c03e8b0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc8c036950 0x7fdc8c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdda830c800 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c0423c0 0x55c07c140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1405c0 con 0x55c07c0423c0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdda660c640 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c0423c0 0x55c07c140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.825+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc8c036950 0x7fdc8c038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd90054000 tx=0x7fdd9004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.826+0000 7fdda660c640 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c0423c0 0x55c07c140080 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.826+0000 7fdda660c640 1 -- 172.21.15.131:0/2957298966 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdda000a4a0 con 0x55c07c0423c0 2024-04-24T01:44:47.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.826+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c13d650 con 0x55c07c0423c0 2024-04-24T01:44:47.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.826+0000 7fdda660c640 1 -- 172.21.15.131:0/2957298966 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdda000a4a0 con 0x55c07c0423c0 2024-04-24T01:44:47.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.826+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1423e0 con 0x55c07c0423c0 2024-04-24T01:44:47.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.826+0000 7fdda660c640 1 -- 172.21.15.131:0/2957298966 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdda000a4a0 con 0x55c07c0423c0 2024-04-24T01:44:47.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.827+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c141720 con 0x55c07c0423c0 2024-04-24T01:44:47.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.827+0000 7fdda660c640 1 -- 172.21.15.131:0/2957298966 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdda000a4a0 con 0x55c07c0423c0 2024-04-24T01:44:47.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.827+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c141b70 con 0x55c07c0423c0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.827+0000 7fdda660c640 1 -- 172.21.15.131:0/2957298966 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdda000a4a0 con 0x55c07c0423c0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.827+0000 7fdda830c800 1 Processor -- start 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdda830c800 1 -- start start 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdda830c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c1511d0 0x55c07c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdda830c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c07bf2f6b0 con 0x55c07c1511d0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdd9d60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c1511d0 0x55c07c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdd9d60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c1511d0 0x55c07c1515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52278/0 (socket says 172.21.15.131:52278) 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdd9d60a640 1 -- 172.21.15.131:0/3216579791 learned_addr learned my addr 172.21.15.131:0/3216579791 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdd9d60a640 1 -- 172.21.15.131:0/3216579791 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07c151b30 con 0x55c07c1511d0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.828+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c1511d0 0x55c07c1515f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdd90044840 tx=0x7fdd90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.829+0000 7fdc8b7fe640 1 -- 172.21.15.131:0/3216579791 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9006f070 con 0x55c07c1511d0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.829+0000 7fdc8b7fe640 1 -- 172.21.15.131:0/3216579791 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd90058040 con 0x55c07c1511d0 2024-04-24T01:44:47.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.829+0000 7fdc8b7fe640 1 -- 172.21.15.131:0/3216579791 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90057050 con 0x55c07c1511d0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.829+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c07c1525a0 con 0x55c07c1511d0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.829+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c07c152a40 con 0x55c07c1511d0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.829+0000 7fdc8b7fe640 1 -- 172.21.15.131:0/3216579791 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd90072070 con 0x55c07c1511d0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdc8b7fe640 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc80036900 0x7fdc80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdc8b7fe640 1 -- 172.21.15.131:0/3216579791 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdd9008fb00 con 0x55c07c1511d0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdda660c640 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc80036900 0x7fdc80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdda830c800 1 Processor -- start 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdda830c800 1 -- start start 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdda660c640 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc80036900 0x7fdc80038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55c07c141240 tx=0x7fdda0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdda830c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdda830c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c07c03cb30 con 0x55c07c15e490 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdd9d60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdd9d60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c15e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52282/0 (socket says 172.21.15.131:52282) 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.830+0000 7fdd9d60a640 1 -- 172.21.15.131:0/2170049003 learned_addr learned my addr 172.21.15.131:0/2170049003 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdd9d60a640 1 -- 172.21.15.131:0/2170049003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07c15ee80 con 0x55c07c15e490 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/2170049003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c15e8b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdd9008dda0 tx=0x7fdd9008e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bb82f74a3ae20c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdc897fa640 1 -- 172.21.15.131:0/2170049003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90087070 con 0x55c07c15e490 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdc897fa640 1 -- 172.21.15.131:0/2170049003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9005e480 con 0x55c07c15e490 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdc897fa640 1 -- 172.21.15.131:0/2170049003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90072360 con 0x55c07c15e490 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdda830c800 1 -- 172.21.15.131:0/2170049003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 msgr2=0x55c07c15e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdda830c800 1 --2- 172.21.15.131:0/2170049003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c15e8b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdd9008dda0 tx=0x7fdd9008e050 comp rx=0 tx=0).stop 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdda830c800 1 -- 172.21.15.131:0/2170049003 shutdown_connections 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdda830c800 1 --2- 172.21.15.131:0/2170049003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c15e8b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdda830c800 1 -- 172.21.15.131:0/2170049003 >> 172.21.15.131:0/2170049003 conn(0x55c07c15a7f0 msgr2=0x55c07c158850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdda830c800 1 -- 172.21.15.131:0/2170049003 shutdown_connections 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.831+0000 7fdda830c800 1 -- 172.21.15.131:0/2170049003 wait complete. 2024-04-24T01:44:47.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdda830c800 1 Processor -- start 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdda830c800 1 -- start start 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdda830c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdda830c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c07c15f5f0 con 0x55c07c15e490 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdd9d60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdd9d60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c165af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52298/0 (socket says 172.21.15.131:52298) 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 learned_addr learned my addr 172.21.15.131:0/1100265652 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.832+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07c166030 con 0x55c07c15e490 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.833+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c165af0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdd9008e090 tx=0x7fdd9008dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.833+0000 7fdc777fe640 1 -- 172.21.15.131:0/1100265652 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90087030 con 0x55c07c15e490 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.833+0000 7fdc777fe640 1 -- 172.21.15.131:0/1100265652 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9005fd50 con 0x55c07c15e490 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.833+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c07c1662c0 con 0x55c07c15e490 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.833+0000 7fdc777fe640 1 -- 172.21.15.131:0/1100265652 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd900726e0 con 0x55c07c15e490 2024-04-24T01:44:47.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.833+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c07c168f70 con 0x55c07c15e490 2024-04-24T01:44:47.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.833+0000 7fdc777fe640 1 -- 172.21.15.131:0/1100265652 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd90072880 con 0x55c07c15e490 2024-04-24T01:44:47.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdc777fe640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc70036950 0x7fdc70038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdc777fe640 1 -- 172.21.15.131:0/1100265652 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdd90088070 con 0x55c07c15e490 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdda660c640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc70036950 0x7fdc70038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdda660c640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc70036950 0x7fdc70038e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55c07c13d5a0 tx=0x7fdda001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c171600 0x55c07c173ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c174210 con 0x55c07c171600 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdda5e0b640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c171600 0x55c07c173ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.834+0000 7fdda5e0b640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c171600 0x55c07c173ac0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 realm 2024-04-24T01:44:47.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c174620 con 0x55c07c171600 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c174ef0 con 0x55c07c171600 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c175290 con 0x55c07c171600 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.835+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c175ae0 con 0x55c07c171600 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdda830c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdda830c800 20 searching for the correct realm 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c07c177850 0x55c07c179c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c07c177850 0x55c07c179c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c07c177850 0x55c07c179c40 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdd9d60a640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdd90082070 0x7fdd9005d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.836+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdd90082070 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.837+0000 7fdda660c640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdd90082070 0x7fdd9005d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.837+0000 7fdda660c640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdd90082070 0x7fdd9005d720 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.837+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda001f070 con 0x7fdd90082070 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.837+0000 7fdda660c640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdda0031040 0x7fdda0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.837+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.837+0000 7fdda5e0b640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdda0031040 0x7fdda0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.838+0000 7fdda5e0b640 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdda0031040 0x7fdda0032940 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.838+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.838+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.838+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.838+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.838+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdd90082070 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda001f070 con 0x7fdd90082070 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.839+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdd90082070 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdda001f070 con 0x7fdd90082070 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.840+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.841+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.841+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.841+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.841+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.841+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.841+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.842+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdd90082070 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda001f070 con 0x7fdd90082070 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdd90082070 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda001f070 con 0x7fdd90082070 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.843+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.844+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.844+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.844+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.844+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdd90082070 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.845+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda001f070 con 0x7fdd90082070 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.845+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c177850 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.845+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.845+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdda0031040 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.845+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.845+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x55c07c171600 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a220 con 0x7fdd90082070 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c176490 con 0x55c07c171600 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c176d30 con 0x55c07c171600 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.846+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c176d30 con 0x55c07c171600 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 zone default found 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 4 Realm: () 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 zonegroup default 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17a6a0 con 0x7fdd90082070 2024-04-24T01:44:47.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17c8d0 con 0x55c07c177850 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17cc70 con 0x55c07c177850 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 started sync module instance, tier type = 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.847+0000 7fdda830c800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.848+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17bd10 con 0x7fdd90082070 2024-04-24T01:44:47.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.848+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.849+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94285204013360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17bd10 con 0x7fdd90082070 2024-04-24T01:44:47.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.849+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17d4c0 con 0x55c07c171600 2024-04-24T01:44:47.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.850+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94285204013360] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.850+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.850+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94285204017648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17bd10 con 0x55c07c171600 2024-04-24T01:44:47.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.850+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17df10 con 0x55c07c177850 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.851+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.851+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94285204019744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17e7b0 con 0x55c07c177850 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.851+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17f2a0 con 0x7fdd90082070 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.851+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94285204017648] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.852+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94285204019744] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.852+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.852+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94285204022016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17b860 con 0x7fdd90082070 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.852+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17fb80 con 0x55c07c171600 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.853+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94285204022016] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.853+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.853+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94285204024688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17fb40 con 0x55c07c171600 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.853+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c180590 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.854+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94285204024688] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.854+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.854+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94285204030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17fb40 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.854+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c180fd0 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.856+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.856+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94285204032288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1813f0 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.856+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c181ef0 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94285204030144] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94285204032288] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.868 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94285204036064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17f690 con 0x7fdda0031040 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 20 add_watcher() i=0 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 20 add_watcher() i=1 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 20 add_watcher() i=2 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 20 add_watcher() i=3 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 20 add_watcher() i=4 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 20 add_watcher() i=5 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.857+0000 7fdda830c800 20 add_watcher() i=6 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.858+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94285204036064] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.858+0000 7fdda830c800 20 add_watcher() i=7 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.858+0000 7fdda830c800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.858+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c184ee0 con 0x55c07c171600 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.859+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.859+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94285204033344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c182360 con 0x55c07c171600 2024-04-24T01:44:47.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.860+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94285204033344] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.860+0000 7fdc4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.860+0000 7fdda830c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.860+0000 7fdda830c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.860+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18d730 con 0x55c07c171600 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.861+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.861+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18de00 con 0x7fdda0031040 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.862+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.862+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18d8c0 con 0x55c07c177850 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.863+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.863+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18e1e0 con 0x55c07c171600 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.864+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'252 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.864+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18e2a0 con 0x7fdd90082070 2024-04-24T01:44:47.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.865+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'84 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.865+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18e9e0 con 0x55c07c177850 2024-04-24T01:44:47.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.866+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'63 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.866+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18ed80 con 0x55c07c171600 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.867+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.867+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18ed80 con 0x7fdda0031040 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.868+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.868+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18ed80 con 0x7fdd90082070 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.869+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.869+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18f2f0 con 0x55c07c177850 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.870+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.870+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18f690 con 0x7fdd90082070 2024-04-24T01:44:47.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.871+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'85 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.871+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18fc00 con 0x7fdda0031040 2024-04-24T01:44:47.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.873+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.873+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18fc00 con 0x7fdd90082070 2024-04-24T01:44:47.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.874+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.874+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x7fdda0031040 2024-04-24T01:44:47.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.875+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'71 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.875+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c171600 2024-04-24T01:44:47.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.876+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'253 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.876+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.878+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.878+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x7fdd90082070 2024-04-24T01:44:47.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.879+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'86 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.879+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.880+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.880+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c171600 2024-04-24T01:44:47.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.881+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.881+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c171600 2024-04-24T01:44:47.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.882+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'254 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.882+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.883+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.883+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x7fdd90082070 2024-04-24T01:44:47.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.884+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.884+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.885+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'39 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.885+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.886+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'49 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.886+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.887+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.887+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.888+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'64 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.888+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x7fdda0031040 2024-04-24T01:44:47.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.889+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.889+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.890+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.890+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x7fdda0031040 2024-04-24T01:44:47.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.891+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.891+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x55c07c177850 2024-04-24T01:44:47.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.892+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.892+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x7fdda0031040 2024-04-24T01:44:47.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.893+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'72 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.893+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1900b0 con 0x7fdd90082070 2024-04-24T01:44:47.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdc4e7fc640 20 reqs_thread_entry: start 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdda830c800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdda830c800 20 Filter name: none 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdbc7fff640 20 reqs_thread_entry: start 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdda830c800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdda830c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.895+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1bb050 con 0x7fdda0031040 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda830c800 20 rados_obj.operate() r=0 bl.length=349 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda830c800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda830c800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda830c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:47.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1bb010 con 0x7fdda0031040 2024-04-24T01:44:47.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda830c800 10 removing key index: system_akey 2024-04-24T01:44:47.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.896+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1bb010 con 0x55c07c177850 2024-04-24T01:44:47.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdda830c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-24T01:44:47.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94285204276576 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1bdf10 con 0x55c07c171600 2024-04-24T01:44:47.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== watch-notify(notify (1) cookie 94285204017648 notify 146028888091 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55c07c18f690 con 0x55c07c171600 2024-04-24T01:44:47.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdc897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94285204017648 notifier 4849 bl.length()=161 2024-04-24T01:44:47.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(97 notify.1 [notify cookie 94285204276576 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdc897fa640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdc68003d60 con 0x55c07c171600 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.897+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.898+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== watch-notify(notify_complete (2) cookie 94285204276576 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c07c18bf00 con 0x55c07c171600 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.898+0000 7fdda830c800 10 removing email index: 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.898+0000 7fdda830c800 10 removing user buckets index 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.898+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1bba00 con 0x7fdda0031040 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.899+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(99 system_user.buckets [delete] v34'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.899+0000 7fdda830c800 10 removing user index: system_user 2024-04-24T01:44:47.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.899+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1bd570 con 0x7fdda0031040 2024-04-24T01:44:47.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(100 system_user [call,call,delete] v34'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdda830c800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-04-24T01:44:47.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdda830c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-24T01:44:47.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94285204272464 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1bce30 con 0x7fdd90082070 2024-04-24T01:44:47.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== watch-notify(notify (1) cookie 94285204013360 notify 146028888098 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c07c18e270 con 0x7fdd90082070 2024-04-24T01:44:47.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdc88ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94285204013360 notifier 4849 bl.length()=160 2024-04-24T01:44:47.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(101 notify.0 [notify cookie 94285204272464 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.900+0000 7fdc88ff9640 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdbd00032c0 con 0x7fdd90082070 2024-04-24T01:44:47.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.901+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== watch-notify(notify_complete (2) cookie 94285204272464 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c07c18fa30 con 0x7fdd90082070 2024-04-24T01:44:47.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.901+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.901+0000 7fdc4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:47.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.901+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94285204033344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c18b150 con 0x55c07c171600 2024-04-24T01:44:47.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.902+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94285204033344] v34'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.903+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94285204013360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c180f40 con 0x7fdd90082070 2024-04-24T01:44:47.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.903+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94285204013360] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.903+0000 7fdda830c800 20 remove_watcher() i=0 2024-04-24T01:44:47.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.903+0000 7fdda830c800 2 removed watcher, disabling cache 2024-04-24T01:44:47.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.904+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94285204017648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c180f40 con 0x55c07c171600 2024-04-24T01:44:47.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.905+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94285204017648] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.905+0000 7fdda830c800 20 remove_watcher() i=1 2024-04-24T01:44:47.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.905+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94285204019744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17d1f0 con 0x55c07c177850 2024-04-24T01:44:47.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.906+0000 7fdd9d60a640 1 -- 172.21.15.131:0/1100265652 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94285204019744] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd90071030 con 0x55c07c177850 2024-04-24T01:44:47.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.906+0000 7fdda830c800 20 remove_watcher() i=2 2024-04-24T01:44:47.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.906+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94285204022016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c180f40 con 0x7fdd90082070 2024-04-24T01:44:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.907+0000 7fdda660c640 1 -- 172.21.15.131:0/1100265652 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94285204022016] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdda0040040 con 0x7fdd90082070 2024-04-24T01:44:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.907+0000 7fdda830c800 20 remove_watcher() i=3 2024-04-24T01:44:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.907+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94285204024688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17d1f0 con 0x55c07c171600 2024-04-24T01:44:47.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.908+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94285204024688] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x55c07c171600 2024-04-24T01:44:47.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.908+0000 7fdda830c800 20 remove_watcher() i=4 2024-04-24T01:44:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.908+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94285204030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c180f40 con 0x7fdda0031040 2024-04-24T01:44:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.909+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94285204030144] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.909+0000 7fdda830c800 20 remove_watcher() i=5 2024-04-24T01:44:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.909+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94285204032288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c17d1f0 con 0x7fdda0031040 2024-04-24T01:44:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.910+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94285204032288] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.910+0000 7fdda830c800 20 remove_watcher() i=6 2024-04-24T01:44:47.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.910+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94285204036064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c07c1802c0 con 0x7fdda0031040 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94285204036064] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9802b070 con 0x7fdda0031040 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 20 remove_watcher() i=7 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdda0031040 msgr2=0x7fdda0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fdda0031040 0x7fdda0032940 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c171600 msgr2=0x55c07c173ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c171600 0x55c07c173ac0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdd90082070 msgr2=0x7fdd9005d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fdd90082070 0x7fdd9005d720 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c07c177850 msgr2=0x55c07c179c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55c07c177850 0x55c07c179c40 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc70036950 msgr2=0x7fdc70038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc70036950 0x7fdc70038e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55c07c13d5a0 tx=0x7fdda001f000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 msgr2=0x55c07c165af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c165af0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdd9008e090 tx=0x7fdd9008dd30 comp rx=0 tx=0).stop 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.911+0000 7fdda5e0b640 1 -- 172.21.15.131:0/1100265652 reap_dead start 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 shutdown_connections 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/1100265652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c15e490 0x55c07c165af0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 >> 172.21.15.131:0/1100265652 conn(0x55c07c15a7f0 msgr2=0x55c07c157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 shutdown_connections 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/1100265652 wait complete. 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc80036900 msgr2=0x7fdc80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc80036900 0x7fdc80038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55c07c141240 tx=0x7fdda0005840 comp rx=0 tx=0).stop 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c1511d0 msgr2=0x55c07c1515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c1511d0 0x55c07c1515f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdd90044840 tx=0x7fdd90002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 shutdown_connections 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc80036900 0x7fdc80038dc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/3216579791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c1511d0 0x55c07c1515f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 >> 172.21.15.131:0/3216579791 conn(0x55c07c145270 msgr2=0x55c07c145670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 shutdown_connections 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/3216579791 wait complete. 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c0423c0 msgr2=0x55c07c140080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c0423c0 0x55c07c140080 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc8c036950 msgr2=0x7fdc8c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc8c036950 0x7fdc8c038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd90054000 tx=0x7fdd9004e000 comp rx=0 tx=0).stop 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 msgr2=0x55c07c138e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c138e40 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c010 tx=0x7fdd98000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 shutdown_connections 2024-04-24T01:44:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55c07c0423c0 0x55c07c140080 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fdc8c036950 0x7fdc8c038e10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 --2- 172.21.15.131:0/2957298966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c07c03e8b0 0x55c07c138e40 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:47.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.912+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 >> 172.21.15.131:0/2957298966 conn(0x55c07c038380 msgr2=0x55c07c03d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:47.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.913+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 shutdown_connections 2024-04-24T01:44:47.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:47.913+0000 7fdda830c800 1 -- 172.21.15.131:0/2957298966 wait complete. 2024-04-24T01:44:47.921 ERROR:root:None 2024-04-24T01:44:47.921 ERROR:root:0 2024-04-24T01:44:47.921 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-24T01:44:47.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-24T01:44:47.921 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-04-24T01:44:48.013 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:48.013 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:48.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.013+0000 7f6280937800 1 Processor -- start 2024-04-24T01:44:48.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.013+0000 7f6280937800 1 -- start start 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f6280937800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5621ae157f30 0x5621ae158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f6280937800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621ae016d40 con 0x5621ae1590a0 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f6280937800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5621adfe94d0 con 0x5621ae157f30 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f627c6f9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5621ae157f30 0x5621ae158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f627c6f9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5621ae157f30 0x5621ae158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52302/0 (socket says 172.21.15.131:52302) 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f627c6f9640 1 -- 172.21.15.131:0/262100281 learned_addr learned my addr 172.21.15.131:0/262100281 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f627c6f9640 1 -- 172.21.15.131:0/262100281 >> v1:172.21.15.107:6789/0 conn(0x5621ae1590a0 legacy=0x5621ae159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.014+0000 7f627c6f9640 1 -- 172.21.15.131:0/262100281 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ae015590 con 0x5621ae157f30 2024-04-24T01:44:48.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.016+0000 7f627c6f9640 1 --2- 172.21.15.131:0/262100281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae158350 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f627400a520 tx=0x7f627401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb862ec87edf9c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.016+0000 7f627b6f7640 1 -- 172.21.15.131:0/262100281 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6274057070 con 0x5621ae157f30 2024-04-24T01:44:48.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.016+0000 7f627b6f7640 1 -- 172.21.15.131:0/262100281 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274052570 con 0x5621ae157f30 2024-04-24T01:44:48.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.016+0000 7f627b6f7640 1 -- 172.21.15.131:0/262100281 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f627404ae60 con 0x5621ae157f30 2024-04-24T01:44:48.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.017+0000 7f6280937800 1 -- 172.21.15.131:0/262100281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 msgr2=0x5621ae158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.017+0000 7f6280937800 1 --2- 172.21.15.131:0/262100281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae158350 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f627400a520 tx=0x7f627401d010 comp rx=0 tx=0).stop 2024-04-24T01:44:48.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.017+0000 7f6280937800 1 -- 172.21.15.131:0/262100281 shutdown_connections 2024-04-24T01:44:48.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.017+0000 7f6280937800 1 --2- 172.21.15.131:0/262100281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae158350 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.017+0000 7f6280937800 1 -- 172.21.15.131:0/262100281 >> 172.21.15.131:0/262100281 conn(0x5621ae1534d0 msgr2=0x5621ae1558f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.017+0000 7f6280937800 1 -- 172.21.15.131:0/262100281 shutdown_connections 2024-04-24T01:44:48.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.017+0000 7f6280937800 1 -- 172.21.15.131:0/262100281 wait complete. 2024-04-24T01:44:48.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.028+0000 7f6280937800 1 Processor -- start 2024-04-24T01:44:48.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.028+0000 7f6280937800 1 -- start start 2024-04-24T01:44:48.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.028+0000 7f6280937800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae249580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.028+0000 7f6280937800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5621ae0a3360 con 0x5621ae157f30 2024-04-24T01:44:48.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f627c6f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae249580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f627c6f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae249580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52310/0 (socket says 172.21.15.131:52310) 2024-04-24T01:44:48.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f627c6f9640 1 -- 172.21.15.131:0/1219317153 learned_addr learned my addr 172.21.15.131:0/1219317153 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f627c6f9640 1 -- 172.21.15.131:0/1219317153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ae249b50 con 0x5621ae157f30 2024-04-24T01:44:48.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f627c6f9640 1 --2- 172.21.15.131:0/1219317153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae249580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6274055040 tx=0x7f627404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa4497445153cc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f616a60c640 1 -- 172.21.15.131:0/1219317153 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6274057040 con 0x5621ae157f30 2024-04-24T01:44:48.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f616a60c640 1 -- 172.21.15.131:0/1219317153 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274052720 con 0x5621ae157f30 2024-04-24T01:44:48.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.029+0000 7f616a60c640 1 -- 172.21.15.131:0/1219317153 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6274052a40 con 0x5621ae157f30 2024-04-24T01:44:48.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 -- 172.21.15.131:0/1219317153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 msgr2=0x5621ae249580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 --2- 172.21.15.131:0/1219317153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae249580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6274055040 tx=0x7f627404c000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 -- 172.21.15.131:0/1219317153 shutdown_connections 2024-04-24T01:44:48.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 --2- 172.21.15.131:0/1219317153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae249580 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 -- 172.21.15.131:0/1219317153 >> 172.21.15.131:0/1219317153 conn(0x5621ae1534d0 msgr2=0x5621ae244ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 -- 172.21.15.131:0/1219317153 shutdown_connections 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 -- 172.21.15.131:0/1219317153 wait complete. 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 Processor -- start 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.030+0000 7f6280937800 1 -- start start 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f6280937800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f6280937800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5621ae161510 con 0x5621ae157f30 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f627c6f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f627c6f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae0cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52320/0 (socket says 172.21.15.131:52320) 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f627c6f9640 1 -- 172.21.15.131:0/1491303712 learned_addr learned my addr 172.21.15.131:0/1491303712 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f627c6f9640 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ae0cc050 con 0x5621ae157f30 2024-04-24T01:44:48.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f627c6f9640 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae0cd960 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6274052540 tx=0x7f6274003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f6168e09640 1 -- 172.21.15.131:0/1491303712 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6274073070 con 0x5621ae157f30 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f6168e09640 1 -- 172.21.15.131:0/1491303712 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274052c90 con 0x5621ae157f30 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f6168e09640 1 -- 172.21.15.131:0/1491303712 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6274057070 con 0x5621ae157f30 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621ae0cc2e0 con 0x5621ae157f30 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.031+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ae0cc800 con 0x5621ae157f30 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.032+0000 7f6168e09640 1 -- 172.21.15.131:0/1491303712 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6274076070 con 0x5621ae157f30 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.032+0000 7f6168e09640 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6164036900 0x7f6164038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.032+0000 7f6168e09640 1 -- 172.21.15.131:0/1491303712 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f627408daf0 con 0x5621ae157f30 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.032+0000 7f627bef8640 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6164036900 0x7f6164038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.032+0000 7f6280937800 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae1590a0 0x5621ae25a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.032+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae25aaa0 con 0x5621ae1590a0 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.033+0000 7f627cefa640 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae1590a0 0x5621ae25a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.033+0000 7f627bef8640 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6164036900 0x7f6164038dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6264001e10 tx=0x7f6264001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.033+0000 7f627cefa640 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae1590a0 0x5621ae25a560 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.033+0000 7f627cefa640 1 -- 172.21.15.131:0/1491303712 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f626c00a4a0 con 0x5621ae1590a0 2024-04-24T01:44:48.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.033+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae25aef0 con 0x5621ae1590a0 2024-04-24T01:44:48.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.033+0000 7f627cefa640 1 -- 172.21.15.131:0/1491303712 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f626c00a4a0 con 0x5621ae1590a0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.033+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae25c7f0 con 0x5621ae1590a0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.034+0000 7f627cefa640 1 -- 172.21.15.131:0/1491303712 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f626c00a4a0 con 0x5621ae1590a0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.034+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae25bb30 con 0x5621ae1590a0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.034+0000 7f627cefa640 1 -- 172.21.15.131:0/1491303712 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f626c00a4a0 con 0x5621ae1590a0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.034+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae25bf80 con 0x5621ae1590a0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.034+0000 7f627cefa640 1 -- 172.21.15.131:0/1491303712 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f626c00a4a0 con 0x5621ae1590a0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f6280937800 1 Processor -- start 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f6280937800 1 -- start start 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f6280937800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae26b5e0 0x5621ae26ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f6280937800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5621ae0496b0 con 0x5621ae26b5e0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f627bef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae26b5e0 0x5621ae26ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f627bef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae26b5e0 0x5621ae26ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52322/0 (socket says 172.21.15.131:52322) 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f627bef8640 1 -- 172.21.15.131:0/1089143116 learned_addr learned my addr 172.21.15.131:0/1089143116 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.035+0000 7f627bef8640 1 -- 172.21.15.131:0/1089143116 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ae26bf40 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.036+0000 7f627bef8640 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae26b5e0 0x5621ae26ba00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6264001770 tx=0x7f626400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.036+0000 7f6161ffb640 1 -- 172.21.15.131:0/1089143116 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626401c410 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.036+0000 7f6161ffb640 1 -- 172.21.15.131:0/1089143116 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6264017050 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.036+0000 7f6161ffb640 1 -- 172.21.15.131:0/1089143116 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626401c6e0 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.036+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621ae26c9b0 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.036+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ae26ceb0 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.036+0000 7f6161ffb640 1 -- 172.21.15.131:0/1089143116 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f626400e070 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f6161ffb640 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6154036900 0x7f6154038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f6161ffb640 1 -- 172.21.15.131:0/1089143116 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f626404e0c0 con 0x5621ae26b5e0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f627cefa640 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6154036900 0x7f6154038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f6280937800 1 Processor -- start 2024-04-24T01:44:48.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f6280937800 1 -- start start 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f627cefa640 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6154036900 0x7f6154038dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5621ae25b650 tx=0x7f626c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f6280937800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae278e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f6280937800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5621ae249e10 con 0x5621ae278a10 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f627bef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae278e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f627bef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae278e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52332/0 (socket says 172.21.15.131:52332) 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f627bef8640 1 -- 172.21.15.131:0/3134252496 learned_addr learned my addr 172.21.15.131:0/3134252496 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.037+0000 7f627bef8640 1 -- 172.21.15.131:0/3134252496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ae2793e0 con 0x5621ae278a10 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f627bef8640 1 --2- 172.21.15.131:0/3134252496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae278e10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f626401afd0 tx=0x7f626401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3640e5d2e460303 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f61537fe640 1 -- 172.21.15.131:0/3134252496 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6264040070 con 0x5621ae278a10 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f61537fe640 1 -- 172.21.15.131:0/3134252496 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6264002e50 con 0x5621ae278a10 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f61537fe640 1 -- 172.21.15.131:0/3134252496 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6264024c10 con 0x5621ae278a10 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f6280937800 1 -- 172.21.15.131:0/3134252496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 msgr2=0x5621ae278e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f6280937800 1 --2- 172.21.15.131:0/3134252496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae278e10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f626401afd0 tx=0x7f626401ac60 comp rx=0 tx=0).stop 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f6280937800 1 -- 172.21.15.131:0/3134252496 shutdown_connections 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f6280937800 1 --2- 172.21.15.131:0/3134252496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae278e10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f6280937800 1 -- 172.21.15.131:0/3134252496 >> 172.21.15.131:0/3134252496 conn(0x5621ae274ce0 msgr2=0x5621ae272d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f6280937800 1 -- 172.21.15.131:0/3134252496 shutdown_connections 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.038+0000 7f6280937800 1 -- 172.21.15.131:0/3134252496 wait complete. 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f6280937800 1 Processor -- start 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f6280937800 1 -- start start 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f6280937800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae280050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f6280937800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5621ae279b90 con 0x5621ae278a10 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f627bef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae280050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f627bef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae280050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52346/0 (socket says 172.21.15.131:52346) 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 learned_addr learned my addr 172.21.15.131:0/76932567 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ae280590 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.039+0000 7f627bef8640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae280050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f626401afd0 tx=0x7f626404c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6151ffb640 1 -- 172.21.15.131:0/76932567 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6264046030 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6151ffb640 1 -- 172.21.15.131:0/76932567 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626401a310 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621ae280820 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6151ffb640 1 -- 172.21.15.131:0/76932567 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626400ec60 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ae2834d0 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6151ffb640 1 -- 172.21.15.131:0/76932567 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f626403b0c0 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6151ffb640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6144036900 0x7f6144038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.040+0000 7f6151ffb640 1 -- 172.21.15.131:0/76932567 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f626403ad30 con 0x5621ae278a10 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.041+0000 7f627cefa640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6144036900 0x7f6144038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.041+0000 7f627cefa640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6144036900 0x7f6144038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5621ae25ae40 tx=0x7f626c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.041+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.041+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae28bb30 0x5621ae28dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.041+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae28e740 con 0x5621ae28bb30 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.041+0000 7f627c6f9640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae28bb30 0x5621ae28dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.041+0000 7f627c6f9640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae28bb30 0x5621ae28dff0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 realm 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae28eb50 con 0x5621ae28bb30 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae28f420 con 0x5621ae28bb30 2024-04-24T01:44:48.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae28f7c0 con 0x5621ae28bb30 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.042+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae290010 con 0x5621ae28bb30 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f6280937800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f6280937800 20 searching for the correct realm 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5621ae291d80 0x5621ae294170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f627bef8640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5621ae291d80 0x5621ae294170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f627bef8640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5621ae291d80 0x5621ae294170 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f627bef8640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f626401c030 0x7f626403c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626401c030 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.043+0000 7f627cefa640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f626401c030 0x7f626403c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.044+0000 7f627cefa640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f626401c030 0x7f626403c050 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.044+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c01f070 con 0x7f626401c030 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.044+0000 7f627cefa640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f626c031040 0x7f626c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.044+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.044+0000 7f627c6f9640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f626c031040 0x7f626c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.045+0000 7f627c6f9640 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f626c031040 0x7f626c032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.045+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x7f626c031040 2024-04-24T01:44:48.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.045+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.045+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.045+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.045+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.045+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x7f626c031040 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x7f626c031040 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626401c030 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c01f070 con 0x7f626401c030 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.046+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x7f626c031040 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626401c030 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f626c01f070 con 0x7f626401c030 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.047+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6274075030 con 0x7f626c031040 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.048+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.049+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.049+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.049+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6274075030 con 0x5621ae28bb30 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.049+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.049+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.049+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.049+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626401c030 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c01f070 con 0x7f626401c030 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626401c030 2024-04-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c01f070 con 0x7f626401c030 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.050+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.051+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.051+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.051+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.051+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626401c030 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.051+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c01f070 con 0x7f626401c030 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.051+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae291d80 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626c031040 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x5621ae28bb30 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294750 con 0x7f626401c030 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.052+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae290990 con 0x5621ae28bb30 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae291230 con 0x5621ae28bb30 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae294bd0 con 0x5621ae28bb30 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 zone default found 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 4 Realm: () 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 zonegroup default 2024-04-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae290e90 con 0x7f626401c030 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.053+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae296f90 con 0x5621ae291d80 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae297330 con 0x5621ae291d80 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f6280937800 20 started sync module instance, tier type = 2024-04-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f6280937800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.054+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae296420 con 0x7f626401c030 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.055+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.055+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702655859056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae296420 con 0x7f626401c030 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.055+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae297d60 con 0x5621ae28bb30 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.056+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702655859056] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.056+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.056+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702655863472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae296420 con 0x5621ae28bb30 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.056+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2987e0 con 0x5621ae291d80 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.057+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702655863472] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.057+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.057+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702655856496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae296390 con 0x5621ae291d80 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.057+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2996d0 con 0x7f626401c030 2024-04-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.058+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.058+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702655856496] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.058+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702655869952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae299e90 con 0x7f626401c030 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.058+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae298c20 con 0x5621ae28bb30 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.060+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702655869952] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.060+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.060+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702655871200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae299e50 con 0x5621ae28bb30 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.060+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29af50 con 0x7f626c031040 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.061+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.061+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702655875744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29b370 con 0x7f626c031040 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.061+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29bdc0 con 0x7f626c031040 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.061+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702655871200] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.062+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702655875744] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.062+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.062+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702655874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29b370 con 0x7f626c031040 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.062+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29c230 con 0x7f626c031040 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702655874176] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702655876800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29c410 con 0x7f626c031040 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 20 add_watcher() i=0 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 20 add_watcher() i=1 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 20 add_watcher() i=2 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 20 add_watcher() i=3 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 20 add_watcher() i=4 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 20 add_watcher() i=5 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.063+0000 7f6280937800 20 add_watcher() i=6 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.064+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702655876800] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.064+0000 7f6280937800 20 add_watcher() i=7 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.064+0000 7f6280937800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.064+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29f5d0 con 0x5621ae28bb30 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.064+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.064+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702655893376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29c350 con 0x5621ae28bb30 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.065+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702655893376] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.065+0000 7f61327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.065+0000 7f6280937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.065+0000 7f6280937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.065+0000 7f6280937800 5 note: GC not initialized 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f61317e2640 20 reqs_thread_entry: start 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:48.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 20 Filter name: none 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f60a2ffd640 20 reqs_thread_entry: start 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2d29d0 con 0x5621ae291d80 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.066+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2d1620 con 0x5621ae291d80 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.067+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.067+0000 7f6280937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.067+0000 7f6280937800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-04-24T01:44:48.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.067+0000 7f6280937800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T01:44:48.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.067+0000 7f6280937800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-24T01:44:48.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.067+0000 7f6280937800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-24T01:44:48.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.067+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2d5fc0 con 0x5621ae291d80 2024-04-24T01:44:48.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'5 uv5 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f6280937800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-24T01:44:48.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f6280937800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:44:48.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f6280937800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-24T01:44:48.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94702656101024 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2d6a70 con 0x5621ae291d80 2024-04-24T01:44:48.082 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== watch-notify(notify (1) cookie 94702655856496 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5621ae2d13a0 con 0x5621ae291d80 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f61537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94702655856496 notifier 4856 bl.length()=542 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(65 notify.2 [notify cookie 94702656101024 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f61537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f61537fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f61537fe640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6140003ea0 con 0x5621ae291d80 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== watch-notify(notify_complete (2) cookie 94702656101024 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621ae280590 con 0x5621ae291d80 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.068+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2d1aa0 con 0x5621ae291d80 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.069+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.069+0000 7f6280937800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.069+0000 7f6280937800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.069+0000 7f6280937800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-24T01:44:48.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.069+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94702656101024 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5621ae2d6ea0 con 0x7f626c031040 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== watch-notify(notify (1) cookie 94702655875744 notify 146028888108 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f627408d040 con 0x7f626c031040 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f61537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94702655875744 notifier 4856 bl.length()=175 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(68 notify.5 [notify cookie 94702656101024 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f61537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f61537fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f61537fe640 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6140003ea0 con 0x7f626c031040 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== watch-notify(notify_complete (2) cookie 94702656101024 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621ae0cc800 con 0x7f626c031040 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.070+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.084 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-04-24T01:44:48.067889Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:48.067873Z","tags":[],"group_ids":[]} 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.071+0000 7f61327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.071+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702655893376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29e760 con 0x5621ae28bb30 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.072+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94702655893376] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.072+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702655859056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae29ef80 con 0x7f626401c030 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.073+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94702655859056] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.073+0000 7f6280937800 20 remove_watcher() i=0 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.073+0000 7f6280937800 2 removed watcher, disabling cache 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.073+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702655863472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae296950 con 0x5621ae28bb30 2024-04-24T01:44:48.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.074+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94702655863472] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.074+0000 7f6280937800 20 remove_watcher() i=1 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.074+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702655856496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae296950 con 0x5621ae291d80 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.075+0000 7f627bef8640 1 -- 172.21.15.131:0/76932567 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94702655856496] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62640246e0 con 0x5621ae291d80 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.075+0000 7f6280937800 20 remove_watcher() i=2 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.075+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702655869952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae295f70 con 0x7f626401c030 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.076+0000 7f627cefa640 1 -- 172.21.15.131:0/76932567 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94702655869952] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626c040040 con 0x7f626401c030 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.076+0000 7f6280937800 20 remove_watcher() i=3 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.076+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702655871200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae295f70 con 0x5621ae28bb30 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.077+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94702655871200] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x5621ae28bb30 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.077+0000 7f6280937800 20 remove_watcher() i=4 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.077+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702655875744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae295f70 con 0x7f626c031040 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.078+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94702655875744] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.078+0000 7f6280937800 20 remove_watcher() i=5 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.078+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702655874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae295f70 con 0x7f626c031040 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.079+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94702655874176] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.079+0000 7f6280937800 20 remove_watcher() i=6 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.079+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702655876800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5621ae295f70 con 0x7f626c031040 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94702655876800] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62740a5060 con 0x7f626c031040 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 20 remove_watcher() i=7 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f626c031040 msgr2=0x7f626c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f626c031040 0x7f626c032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae28bb30 msgr2=0x5621ae28dff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae28bb30 0x5621ae28dff0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f626401c030 msgr2=0x7f626403c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f626401c030 0x7f626403c050 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5621ae291d80 msgr2=0x5621ae294170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5621ae291d80 0x5621ae294170 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6144036900 msgr2=0x7f6144038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6144036900 0x7f6144038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5621ae25ae40 tx=0x7f626c01f000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f627c6f9640 1 -- 172.21.15.131:0/76932567 reap_dead start 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 msgr2=0x5621ae280050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae280050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f626401afd0 tx=0x7f626404c2f0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 shutdown_connections 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 --2- 172.21.15.131:0/76932567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae278a10 0x5621ae280050 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.080+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 >> 172.21.15.131:0/76932567 conn(0x5621ae274ce0 msgr2=0x5621ae272340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 shutdown_connections 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/76932567 wait complete. 2024-04-24T01:44:48.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6154036900 msgr2=0x7f6154038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6154036900 0x7f6154038dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5621ae25b650 tx=0x7f626c005840 comp rx=0 tx=0).stop 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae26b5e0 msgr2=0x5621ae26ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae26b5e0 0x5621ae26ba00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6264001770 tx=0x7f626400f790 comp rx=0 tx=0).stop 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 shutdown_connections 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6154036900 0x7f6154038dc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1089143116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae26b5e0 0x5621ae26ba00 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 >> 172.21.15.131:0/1089143116 conn(0x5621ae25f6d0 msgr2=0x5621ae25fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 shutdown_connections 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1089143116 wait complete. 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae1590a0 msgr2=0x5621ae25a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae1590a0 0x5621ae25a560 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6164036900 msgr2=0x7f6164038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.094 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6164036900 0x7f6164038dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6264001e10 tx=0x7f6264001390 comp rx=0 tx=0).stop 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 msgr2=0x5621ae0cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae0cd960 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6274052540 tx=0x7f6274003020 comp rx=0 tx=0).stop 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 shutdown_connections 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5621ae1590a0 0x5621ae25a560 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f6164036900 0x7f6164038dc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 --2- 172.21.15.131:0/1491303712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621ae157f30 0x5621ae0cd960 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 >> 172.21.15.131:0/1491303712 conn(0x5621ae1534d0 msgr2=0x5621ae2436a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.081+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 shutdown_connections 2024-04-24T01:44:48.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.082+0000 7f6280937800 1 -- 172.21.15.131:0/1491303712 wait complete. 2024-04-24T01:44:48.095 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-24T01:44:48.067889Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:48.067873Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.095 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-24T01:44:48.067889Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:48.067873Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.096 ERROR:root:0 2024-04-24T01:44:48.096 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:48.101 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:48.101 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-04-24T01:44:48.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-04-24T01:44:48.101 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-04-24T01:44:48.144 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:48.144 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:48.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f2825b36800 1 Processor -- start 2024-04-24T01:44:48.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f2825b36800 1 -- start start 2024-04-24T01:44:48.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f2825b36800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f9cb51a370 0x55f9cb51c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f2825b36800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9cb3d4d40 con 0x55f9cb514100 2024-04-24T01:44:48.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f2825b36800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55f9cb3a74d0 con 0x55f9cb51a370 2024-04-24T01:44:48.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f28210cb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f9cb51a370 0x55f9cb51c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.145 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f28210cb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f9cb51a370 0x55f9cb51c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52362/0 (socket says 172.21.15.131:52362) 2024-04-24T01:44:48.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.144+0000 7f28210cb640 1 -- 172.21.15.131:0/3806198391 learned_addr learned my addr 172.21.15.131:0/3806198391 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.145+0000 7f28210cb640 1 -- 172.21.15.131:0/3806198391 >> v1:172.21.15.107:6789/0 conn(0x55f9cb514100 legacy=0x55f9cb514520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.145+0000 7f28210cb640 1 -- 172.21.15.131:0/3806198391 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cb3d3590 con 0x55f9cb51a370 2024-04-24T01:44:48.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.146+0000 7f28210cb640 1 --2- 172.21.15.131:0/3806198391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb51a370 0x55f9cb51c760 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f281800a520 tx=0x7f281801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775e91be65ec5f41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.146+0000 7f28208ca640 1 -- 172.21.15.131:0/3806198391 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2818057070 con 0x55f9cb51a370 2024-04-24T01:44:48.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f28208ca640 1 -- 172.21.15.131:0/3806198391 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2818052570 con 0x55f9cb51a370 2024-04-24T01:44:48.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f28208ca640 1 -- 172.21.15.131:0/3806198391 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281804ae60 con 0x55f9cb51a370 2024-04-24T01:44:48.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f2825b36800 1 -- 172.21.15.131:0/3806198391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb51a370 msgr2=0x55f9cb51c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f2825b36800 1 --2- 172.21.15.131:0/3806198391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb51a370 0x55f9cb51c760 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f281800a520 tx=0x7f281801d010 comp rx=0 tx=0).stop 2024-04-24T01:44:48.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f2825b36800 1 -- 172.21.15.131:0/3806198391 shutdown_connections 2024-04-24T01:44:48.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f2825b36800 1 --2- 172.21.15.131:0/3806198391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb51a370 0x55f9cb51c760 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f2825b36800 1 -- 172.21.15.131:0/3806198391 >> 172.21.15.131:0/3806198391 conn(0x55f9cb50fb00 msgr2=0x55f9cb511f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f2825b36800 1 -- 172.21.15.131:0/3806198391 shutdown_connections 2024-04-24T01:44:48.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.147+0000 7f2825b36800 1 -- 172.21.15.131:0/3806198391 wait complete. 2024-04-24T01:44:48.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f2825b36800 1 Processor -- start 2024-04-24T01:44:48.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f2825b36800 1 -- start start 2024-04-24T01:44:48.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f2825b36800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb607090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f2825b36800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb4613c0 con 0x55f9cb514100 2024-04-24T01:44:48.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f28218cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb607090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f28218cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb607090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52368/0 (socket says 172.21.15.131:52368) 2024-04-24T01:44:48.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f28218cc640 1 -- 172.21.15.131:0/1079128124 learned_addr learned my addr 172.21.15.131:0/1079128124 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.159+0000 7f28218cc640 1 -- 172.21.15.131:0/1079128124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cb607660 con 0x55f9cb514100 2024-04-24T01:44:48.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.160+0000 7f28218cc640 1 --2- 172.21.15.131:0/1079128124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb607090 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f281c001d50 tx=0x7f281c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcf06cfa257de30 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.160+0000 7f270fe07640 1 -- 172.21.15.131:0/1079128124 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c00f400 con 0x55f9cb514100 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.160+0000 7f270fe07640 1 -- 172.21.15.131:0/1079128124 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c00f5a0 con 0x55f9cb514100 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.160+0000 7f270fe07640 1 -- 172.21.15.131:0/1079128124 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c00f7d0 con 0x55f9cb514100 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.160+0000 7f2825b36800 1 -- 172.21.15.131:0/1079128124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 msgr2=0x55f9cb607090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.160+0000 7f2825b36800 1 --2- 172.21.15.131:0/1079128124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb607090 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f281c001d50 tx=0x7f281c00b5b0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 -- 172.21.15.131:0/1079128124 shutdown_connections 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 --2- 172.21.15.131:0/1079128124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb607090 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 -- 172.21.15.131:0/1079128124 >> 172.21.15.131:0/1079128124 conn(0x55f9cb50fb00 msgr2=0x55f9cb6029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 -- 172.21.15.131:0/1079128124 shutdown_connections 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 -- 172.21.15.131:0/1079128124 wait complete. 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 Processor -- start 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 -- start start 2024-04-24T01:44:48.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb60ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f2825b36800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb51cfa0 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f28218cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb60ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f28218cc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb60ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52374/0 (socket says 172.21.15.131:52374) 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f28218cc640 1 -- 172.21.15.131:0/2295953038 learned_addr learned my addr 172.21.15.131:0/2295953038 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.161+0000 7f28218cc640 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cb60f1d0 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.162+0000 7f28218cc640 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb60ec90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f281c00b5f0 tx=0x7f281c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.162+0000 7f270e604640 1 -- 172.21.15.131:0/2295953038 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c01a7c0 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.162+0000 7f270e604640 1 -- 172.21.15.131:0/2295953038 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c01a960 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.162+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9cb60f460 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.162+0000 7f270e604640 1 -- 172.21.15.131:0/2295953038 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c01ac40 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.162+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cb612110 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f270e604640 1 -- 172.21.15.131:0/2295953038 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f281c017070 con 0x55f9cb514100 2024-04-24T01:44:48.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f270e604640 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2708036900 0x7f2708038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f270e604640 1 -- 172.21.15.131:0/2295953038 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f281c015020 con 0x55f9cb514100 2024-04-24T01:44:48.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f28210cb640 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2708036900 0x7f2708038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f2825b36800 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb51a370 0x55f9cb615ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb616450 con 0x55f9cb51a370 2024-04-24T01:44:48.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f28220cd640 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb51a370 0x55f9cb615ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f28210cb640 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2708036900 0x7f2708038dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2818054000 tx=0x7f281804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.163+0000 7f28220cd640 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb51a370 0x55f9cb615ed0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f28220cd640 1 -- 172.21.15.131:0/2295953038 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f281400a4a0 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6134a0 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f28220cd640 1 -- 172.21.15.131:0/2295953038 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f281400a4a0 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6182e0 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f28220cd640 1 -- 172.21.15.131:0/2295953038 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f281400a4a0 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb617620 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f28220cd640 1 -- 172.21.15.131:0/2295953038 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f281400a4a0 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.164+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb617a70 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.165+0000 7f28220cd640 1 -- 172.21.15.131:0/2295953038 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f281400a4a0 con 0x55f9cb51a370 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.165+0000 7f2825b36800 1 Processor -- start 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.165+0000 7f2825b36800 1 -- start start 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.165+0000 7f2825b36800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb516d00 0x55f9cb515170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.165+0000 7f2825b36800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb4076b0 con 0x55f9cb516d00 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.166+0000 7f28210cb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb516d00 0x55f9cb515170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.166+0000 7f28210cb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb516d00 0x55f9cb515170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52384/0 (socket says 172.21.15.131:52384) 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.166+0000 7f28210cb640 1 -- 172.21.15.131:0/1623152762 learned_addr learned my addr 172.21.15.131:0/1623152762 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.166+0000 7f28210cb640 1 -- 172.21.15.131:0/1623152762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cb5156b0 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.166+0000 7f28210cb640 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb516d00 0x55f9cb515170 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2818005930 tx=0x7f2818002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.167+0000 7f27077fe640 1 -- 172.21.15.131:0/1623152762 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2818057040 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.167+0000 7f27077fe640 1 -- 172.21.15.131:0/1623152762 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281805d650 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.167+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9cb5158e0 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.167+0000 7f27077fe640 1 -- 172.21.15.131:0/1623152762 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281805d950 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.167+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cb515d80 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.167+0000 7f27077fe640 1 -- 172.21.15.131:0/1623152762 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2818067070 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.167+0000 7f27077fe640 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26fc036900 0x7f26fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f27077fe640 1 -- 172.21.15.131:0/1623152762 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f281808f7a0 con 0x55f9cb516d00 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f28220cd640 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26fc036900 0x7f26fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f2825b36800 1 Processor -- start 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f2825b36800 1 -- start start 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f28220cd640 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26fc036900 0x7f26fc038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55f9cb617140 tx=0x7f2814005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f2825b36800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb636890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f2825b36800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb6079e0 con 0x55f9cb636470 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f28210cb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb636890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f28210cb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb636890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52390/0 (socket says 172.21.15.131:52390) 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f28210cb640 1 -- 172.21.15.131:0/839901354 learned_addr learned my addr 172.21.15.131:0/839901354 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.168+0000 7f28210cb640 1 -- 172.21.15.131:0/839901354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cb636e60 con 0x55f9cb636470 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f28210cb640 1 --2- 172.21.15.131:0/839901354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb636890 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f281808da40 tx=0x7f281805df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcbe80c60afd747 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f27057fa640 1 -- 172.21.15.131:0/839901354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2818082070 con 0x55f9cb636470 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f27057fa640 1 -- 172.21.15.131:0/839901354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281808de50 con 0x55f9cb636470 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f27057fa640 1 -- 172.21.15.131:0/839901354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281808b070 con 0x55f9cb636470 2024-04-24T01:44:48.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 -- 172.21.15.131:0/839901354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 msgr2=0x55f9cb636890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 --2- 172.21.15.131:0/839901354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb636890 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f281808da40 tx=0x7f281805df50 comp rx=0 tx=0).stop 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 -- 172.21.15.131:0/839901354 shutdown_connections 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 --2- 172.21.15.131:0/839901354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb636890 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 -- 172.21.15.131:0/839901354 >> 172.21.15.131:0/839901354 conn(0x55f9cb6327d0 msgr2=0x55f9cb630830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 -- 172.21.15.131:0/839901354 shutdown_connections 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 -- 172.21.15.131:0/839901354 wait complete. 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.169+0000 7f2825b36800 1 Processor -- start 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f2825b36800 1 -- start start 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f2825b36800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb63db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f2825b36800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb6375d0 con 0x55f9cb636470 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f28210cb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb63db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f28210cb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb63db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52396/0 (socket says 172.21.15.131:52396) 2024-04-24T01:44:48.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 learned_addr learned my addr 172.21.15.131:0/3532957291 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cb63e0a0 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f28210cb640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb63db60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2818080040 tx=0x7f281808d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f26f37fe640 1 -- 172.21.15.131:0/3532957291 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2818093070 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f26f37fe640 1 -- 172.21.15.131:0/3532957291 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2818083040 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f26f37fe640 1 -- 172.21.15.131:0/3532957291 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2818082070 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.170+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9cb63e330 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.171+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cb640fe0 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.171+0000 7f26f37fe640 1 -- 172.21.15.131:0/3532957291 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2818096070 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f26f37fe640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26ec0368b0 0x7f26ec038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f26f37fe640 1 -- 172.21.15.131:0/3532957291 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2818099d40 con 0x55f9cb636470 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f28220cd640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26ec0368b0 0x7f26ec038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb649650 0x55f9cb64bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f28220cd640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26ec0368b0 0x7f26ec038d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55f9cb60fab0 tx=0x7f281401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64c260 con 0x55f9cb649650 2024-04-24T01:44:48.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f28218cc640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb649650 0x55f9cb64bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.172+0000 7f28218cc640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb649650 0x55f9cb64bb10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 realm 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64c670 con 0x55f9cb649650 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:48.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64cf40 con 0x55f9cb649650 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64d2e0 con 0x55f9cb649650 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.173+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64db30 con 0x55f9cb649650 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f2825b36800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f2825b36800 20 searching for the correct realm 2024-04-24T01:44:48.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f9cb64f8a0 0x55f9cb651c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb64f8a0 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f28210cb640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f9cb64f8a0 0x55f9cb651c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f28210cb640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f9cb64f8a0 0x55f9cb651c90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f28210cb640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2818098070 0x7f281807c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x7f2818098070 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.174+0000 7f28220cd640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2818098070 0x7f281807c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.175+0000 7f28220cd640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2818098070 0x7f281807c860 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.175+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281401f070 con 0x7f2818098070 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.175+0000 7f28220cd640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2814031040 0x7f2814032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.175+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x7f2814031040 2024-04-24T01:44:48.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.175+0000 7f28218cc640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2814031040 0x7f2814032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.176+0000 7f28218cc640 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2814031040 0x7f2814032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.176+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.176+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb649650 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.176+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.176+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb649650 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.176+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.176+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x7f2814031040 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x7f2814031040 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x7f2818098070 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281401f070 con 0x7f2818098070 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb64f8a0 2024-04-24T01:44:48.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb649650 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.177+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x7f2814031040 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb649650 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x7f2818098070 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f281401f070 con 0x7f2818098070 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb64f8a0 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.178+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb652250 con 0x55f9cb64f8a0 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2814031040 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.179+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb649650 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb649650 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2814031040 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.180+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2818098070 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281401f070 con 0x7f2818098070 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb649650 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2818098070 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281401f070 con 0x7f2818098070 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.181+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2814031040 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.182+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.182+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2818098070 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.182+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281401f070 con 0x7f2818098070 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.182+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.182+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.182+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2814031040 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x55f9cb649650 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f28180af040 con 0x7f2818098070 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:48.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.183+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64e4b0 con 0x55f9cb649650 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64ed50 con 0x55f9cb649650 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6526d0 con 0x55f9cb649650 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 zone default found 2024-04-24T01:44:48.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 4 Realm: () 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 zonegroup default 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb64e9b0 con 0x7f2818098070 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.184+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb654a60 con 0x55f9cb64f8a0 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f2825b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb654e00 con 0x55f9cb64f8a0 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f2825b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f2825b36800 20 started sync module instance, tier type = 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f2825b36800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.185+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb653ef0 con 0x7f2818098070 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.186+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.186+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531347629120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb653ef0 con 0x7f2818098070 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.186+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb655810 con 0x55f9cb649650 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.187+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531347629120] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.187+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.187+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531347633504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb653ef0 con 0x55f9cb649650 2024-04-24T01:44:48.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.187+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb656260 con 0x55f9cb64f8a0 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.188+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531347633504] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.189+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.189+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531347626560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb653e60 con 0x55f9cb64f8a0 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.189+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb657120 con 0x7f2818098070 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.190+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531347626560] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.190+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.190+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531347639408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb657540 con 0x7f2818098070 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.190+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb657f00 con 0x55f9cb649650 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.191+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531347639408] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.191+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.191+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531347640944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb657f00 con 0x55f9cb649650 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.191+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6588c0 con 0x7f2814031040 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.192+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.192+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531347645456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb658830 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.192+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb659890 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.192+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531347640944] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.193+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531347645456] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.193+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.193+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531347647664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb657a50 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.193+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb659d00 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531347647664] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531347649408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb659d00 con 0x7f2814031040 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 20 add_watcher() i=0 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 20 add_watcher() i=1 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 20 add_watcher() i=2 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 20 add_watcher() i=3 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 20 add_watcher() i=4 2024-04-24T01:44:48.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 20 add_watcher() i=5 2024-04-24T01:44:48.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.194+0000 7f2825b36800 20 add_watcher() i=6 2024-04-24T01:44:48.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.195+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531347649408] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.195+0000 7f2825b36800 20 add_watcher() i=7 2024-04-24T01:44:48.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.195+0000 7f2825b36800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:48.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.195+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb65d080 con 0x55f9cb649650 2024-04-24T01:44:48.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.195+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.195+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531347663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb659e70 con 0x55f9cb649650 2024-04-24T01:44:48.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.196+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531347663456] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.196+0000 7f26d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.197+0000 7f2825b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:48.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.197+0000 7f2825b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:48.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.197+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb65c320 con 0x55f9cb649650 2024-04-24T01:44:48.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.198+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.198+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb666140 con 0x7f2814031040 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.199+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.199+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb666140 con 0x55f9cb64f8a0 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.200+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.200+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6664e0 con 0x55f9cb649650 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.201+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'259 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.201+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6664e0 con 0x7f2818098070 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.202+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'87 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.202+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb666a50 con 0x55f9cb64f8a0 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.203+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'65 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.203+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb666df0 con 0x55f9cb649650 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.204+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.204+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb666df0 con 0x7f2814031040 2024-04-24T01:44:48.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.206+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.206+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb666df0 con 0x7f2818098070 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.207+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.207+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667360 con 0x55f9cb64f8a0 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.208+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.208+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6673f0 con 0x7f2818098070 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.209+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'88 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.209+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667960 con 0x7f2814031040 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.210+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.210+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667960 con 0x7f2818098070 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.211+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.211+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x7f2814031040 2024-04-24T01:44:48.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.212+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.212+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb649650 2024-04-24T01:44:48.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.213+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'260 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.213+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.215+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.215+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x7f2818098070 2024-04-24T01:44:48.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.215+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'89 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.216+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.216+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.216+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb649650 2024-04-24T01:44:48.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.218+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.218+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb649650 2024-04-24T01:44:48.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.219+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'261 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.219+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.220+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.220+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x7f2818098070 2024-04-24T01:44:48.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.221+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.221+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.222+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'40 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.222+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.223+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'50 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.223+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.223+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.224+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.225+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'66 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.225+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x7f2814031040 2024-04-24T01:44:48.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.226+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.226+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.227+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.227+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x7f2814031040 2024-04-24T01:44:48.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.228+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.228+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x55f9cb64f8a0 2024-04-24T01:44:48.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.229+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.229+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x7f2814031040 2024-04-24T01:44:48.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.230+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'74 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.230+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb667e10 con 0x7f2818098070 2024-04-24T01:44:48.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.231+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f26d27fc640 20 reqs_thread_entry: start 2024-04-24T01:44:48.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:48.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 20 Filter name: none 2024-04-24T01:44:48.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2643fff640 20 reqs_thread_entry: start 2024-04-24T01:44:48.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-24T01:44:48.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb692ae0 con 0x55f9cb64f8a0 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 20 rados_obj.operate() r=0 bl.length=363 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.232+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb695500 con 0x55f9cb64f8a0 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.233+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f281809f070 con 0x55f9cb64f8a0 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.233+0000 7f2825b36800 10 removing key index: true_admin_akey 2024-04-24T01:44:48.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.233+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb6934e0 con 0x55f9cb64f8a0 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.233+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f28180bd040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.234+0000 7f2825b36800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.234+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94531347890160 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb695a10 con 0x7f2814031040 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.234+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== watch-notify(notify (1) cookie 94531347645456 notify 146028888109 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55f9cb65c390 con 0x7f2814031040 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.234+0000 7f27057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 94531347645456 notifier 4863 bl.length()=165 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.234+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(97 notify.5 [notify cookie 94531347890160 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.234+0000 7f27057fa640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f26e4003d60 con 0x7f2814031040 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.235+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.235+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== watch-notify(notify_complete (2) cookie 94531347890160 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f9cb612110 con 0x7f2814031040 2024-04-24T01:44:48.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.235+0000 7f2825b36800 10 removing email index: 2024-04-24T01:44:48.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.235+0000 7f2825b36800 10 removing user buckets index 2024-04-24T01:44:48.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.235+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb695970 con 0x55f9cb64f8a0 2024-04-24T01:44:48.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.236+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f28180bd040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.236+0000 7f2825b36800 10 removing user index: a_user 2024-04-24T01:44:48.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.236+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb695970 con 0x55f9cb64f8a0 2024-04-24T01:44:48.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.236+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'6 uv6 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f28180bd040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.236+0000 7f2825b36800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-04-24T01:44:48.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.236+0000 7f2825b36800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-24T01:44:48.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.237+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94531347896688 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb693ff0 con 0x55f9cb64f8a0 2024-04-24T01:44:48.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.237+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== watch-notify(notify (1) cookie 94531347626560 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55f9cb666e40 con 0x55f9cb64f8a0 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.237+0000 7f27057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94531347626560 notifier 4863 bl.length()=155 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.237+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(101 notify.2 [notify cookie 94531347896688 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28180bd040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.237+0000 7f27057fa640 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f26e4003d60 con 0x55f9cb64f8a0 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.237+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28180bd040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.237+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== watch-notify(notify_complete (2) cookie 94531347896688 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f9cb63e0a0 con 0x55f9cb64f8a0 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.238+0000 7f26d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.238+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531347663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb695970 con 0x55f9cb649650 2024-04-24T01:44:48.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.239+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94531347663456] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.239+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531347629120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb695970 con 0x7f2818098070 2024-04-24T01:44:48.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.240+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94531347629120] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.240+0000 7f2825b36800 20 remove_watcher() i=0 2024-04-24T01:44:48.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.240+0000 7f2825b36800 2 removed watcher, disabling cache 2024-04-24T01:44:48.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.240+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531347633504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb695970 con 0x55f9cb649650 2024-04-24T01:44:48.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.241+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94531347633504] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.241+0000 7f2825b36800 20 remove_watcher() i=1 2024-04-24T01:44:48.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.241+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531347626560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb655560 con 0x55f9cb64f8a0 2024-04-24T01:44:48.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.242+0000 7f28210cb640 1 -- 172.21.15.131:0/3532957291 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94531347626560] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28180bd040 con 0x55f9cb64f8a0 2024-04-24T01:44:48.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.242+0000 7f2825b36800 20 remove_watcher() i=2 2024-04-24T01:44:48.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.242+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531347639408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb653a40 con 0x7f2818098070 2024-04-24T01:44:48.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.243+0000 7f28220cd640 1 -- 172.21.15.131:0/3532957291 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94531347639408] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2814040040 con 0x7f2818098070 2024-04-24T01:44:48.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.243+0000 7f2825b36800 20 remove_watcher() i=3 2024-04-24T01:44:48.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.243+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531347640944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb656c70 con 0x55f9cb649650 2024-04-24T01:44:48.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.244+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94531347640944] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x55f9cb649650 2024-04-24T01:44:48.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.244+0000 7f2825b36800 20 remove_watcher() i=4 2024-04-24T01:44:48.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.244+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531347645456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb653a40 con 0x7f2814031040 2024-04-24T01:44:48.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.245+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94531347645456] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.245+0000 7f2825b36800 20 remove_watcher() i=5 2024-04-24T01:44:48.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.245+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531347647664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb656c70 con 0x7f2814031040 2024-04-24T01:44:48.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.246+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94531347647664] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.246+0000 7f2825b36800 20 remove_watcher() i=6 2024-04-24T01:44:48.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.246+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531347649408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9cb658410 con 0x7f2814031040 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94531347649408] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281c02e070 con 0x7f2814031040 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 20 remove_watcher() i=7 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2814031040 msgr2=0x7f2814032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f2814031040 0x7f2814032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb649650 msgr2=0x55f9cb64bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb649650 0x55f9cb64bb10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2818098070 msgr2=0x7f281807c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f2818098070 0x7f281807c860 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f9cb64f8a0 msgr2=0x55f9cb651c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.247+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55f9cb64f8a0 0x55f9cb651c90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26ec0368b0 msgr2=0x7f26ec038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26ec0368b0 0x7f26ec038d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55f9cb60fab0 tx=0x7f281401f000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 msgr2=0x55f9cb63db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb63db60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2818080040 tx=0x7f281808d9d0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f28218cc640 1 -- 172.21.15.131:0/3532957291 reap_dead start 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 shutdown_connections 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/3532957291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb636470 0x55f9cb63db60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 >> 172.21.15.131:0/3532957291 conn(0x55f9cb6327d0 msgr2=0x55f9cb62fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 shutdown_connections 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/3532957291 wait complete. 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26fc036900 msgr2=0x7f26fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26fc036900 0x7f26fc038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55f9cb617140 tx=0x7f2814005840 comp rx=0 tx=0).stop 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb516d00 msgr2=0x55f9cb515170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb516d00 0x55f9cb515170 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2818005930 tx=0x7f2818002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 shutdown_connections 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f26fc036900 0x7f26fc038dc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/1623152762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb516d00 0x55f9cb515170 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 >> 172.21.15.131:0/1623152762 conn(0x55f9cb61b0f0 msgr2=0x55f9cb61b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 shutdown_connections 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/1623152762 wait complete. 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb51a370 msgr2=0x55f9cb615ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.248+0000 7f2825b36800 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb51a370 0x55f9cb615ed0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2708036900 msgr2=0x7f2708038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2708036900 0x7f2708038dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2818054000 tx=0x7f281804e000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 msgr2=0x55f9cb60ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb60ec90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f281c00b5f0 tx=0x7f281c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 shutdown_connections 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55f9cb51a370 0x55f9cb615ed0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f2708036900 0x7f2708038dc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 --2- 172.21.15.131:0/2295953038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9cb514100 0x55f9cb60ec90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 >> 172.21.15.131:0/2295953038 conn(0x55f9cb50fb00 msgr2=0x55f9cb601290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 shutdown_connections 2024-04-24T01:44:48.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.249+0000 7f2825b36800 1 -- 172.21.15.131:0/2295953038 wait complete. 2024-04-24T01:44:48.257 ERROR:root:None 2024-04-24T01:44:48.257 ERROR:root:0 2024-04-24T01:44:48.257 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-24T01:44:48.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-24T01:44:48.257 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-04-24T01:44:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e78b46800 1 Processor -- start 2024-04-24T01:44:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e78b46800 1 -- start start 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e78b46800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e224bdb3e0 0x55e224bdd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e78b46800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e224a95d40 con 0x55e224bd78d0 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e78b46800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55e224a684d0 con 0x55e224bdb3e0 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e75e44640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e224bdb3e0 0x55e224bdd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e75e44640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e224bdb3e0 0x55e224bdd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52398/0 (socket says 172.21.15.131:52398) 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.342+0000 7f3e75e44640 1 -- 172.21.15.131:0/2453543734 learned_addr learned my addr 172.21.15.131:0/2453543734 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.343+0000 7f3e75e44640 1 -- 172.21.15.131:0/2453543734 >> v1:172.21.15.107:6789/0 conn(0x55e224bd78d0 legacy=0x55e224bd9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.343+0000 7f3e75e44640 1 -- 172.21.15.131:0/2453543734 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e224a94590 con 0x55e224bdb3e0 2024-04-24T01:44:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.344+0000 7f3e75e44640 1 --2- 172.21.15.131:0/2453543734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bdb3e0 0x55e224bdd7d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00a520 tx=0x7f3e6c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dbfdc95c77ea51 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e75643640 1 -- 172.21.15.131:0/2453543734 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c057070 con 0x55e224bdb3e0 2024-04-24T01:44:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e75643640 1 -- 172.21.15.131:0/2453543734 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c052570 con 0x55e224bdb3e0 2024-04-24T01:44:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e75643640 1 -- 172.21.15.131:0/2453543734 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c04ae60 con 0x55e224bdb3e0 2024-04-24T01:44:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e78b46800 1 -- 172.21.15.131:0/2453543734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bdb3e0 msgr2=0x55e224bdd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2453543734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bdb3e0 0x55e224bdd7d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00a520 tx=0x7f3e6c01d010 comp rx=0 tx=0).stop 2024-04-24T01:44:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e78b46800 1 -- 172.21.15.131:0/2453543734 shutdown_connections 2024-04-24T01:44:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2453543734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bdb3e0 0x55e224bdd7d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e78b46800 1 -- 172.21.15.131:0/2453543734 >> 172.21.15.131:0/2453543734 conn(0x55e224bd13a0 msgr2=0x55e224bd37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e78b46800 1 -- 172.21.15.131:0/2453543734 shutdown_connections 2024-04-24T01:44:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.345+0000 7f3e78b46800 1 -- 172.21.15.131:0/2453543734 wait complete. 2024-04-24T01:44:48.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e78b46800 1 Processor -- start 2024-04-24T01:44:48.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e78b46800 1 -- start start 2024-04-24T01:44:48.358 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e78b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224cc8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e78b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e224b223b0 con 0x55e224bd78d0 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e76645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224cc8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e76645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224cc8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52400/0 (socket says 172.21.15.131:52400) 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e76645640 1 -- 172.21.15.131:0/675587764 learned_addr learned my addr 172.21.15.131:0/675587764 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.357+0000 7f3e76645640 1 -- 172.21.15.131:0/675587764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e224cc8740 con 0x55e224bd78d0 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.358+0000 7f3e76645640 1 --2- 172.21.15.131:0/675587764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224cc8170 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3e68001d20 tx=0x7f3e6800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168f2628c5e85ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.358+0000 7f3d64608640 1 -- 172.21.15.131:0/675587764 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6800f400 con 0x55e224bd78d0 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.358+0000 7f3d64608640 1 -- 172.21.15.131:0/675587764 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6800f5a0 con 0x55e224bd78d0 2024-04-24T01:44:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.358+0000 7f3d64608640 1 -- 172.21.15.131:0/675587764 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6800f7d0 con 0x55e224bd78d0 2024-04-24T01:44:48.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.358+0000 7f3e78b46800 1 -- 172.21.15.131:0/675587764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 msgr2=0x55e224cc8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 --2- 172.21.15.131:0/675587764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224cc8170 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3e68001d20 tx=0x7f3e6800b5b0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 -- 172.21.15.131:0/675587764 shutdown_connections 2024-04-24T01:44:48.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 --2- 172.21.15.131:0/675587764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224cc8170 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 -- 172.21.15.131:0/675587764 >> 172.21.15.131:0/675587764 conn(0x55e224bd13a0 msgr2=0x55e224cc3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 -- 172.21.15.131:0/675587764 shutdown_connections 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 -- 172.21.15.131:0/675587764 wait complete. 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 Processor -- start 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 -- start start 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224ccfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e78b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e224bde010 con 0x55e224bd78d0 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e76645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224ccfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e76645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224ccfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52402/0 (socket says 172.21.15.131:52402) 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.359+0000 7f3e76645640 1 -- 172.21.15.131:0/2861815630 learned_addr learned my addr 172.21.15.131:0/2861815630 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.360+0000 7f3e76645640 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e224cd0260 con 0x55e224bd78d0 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.360+0000 7f3e76645640 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224ccfd20 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55e224cc8f00 tx=0x7f3e68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.360+0000 7f3d62e05640 1 -- 172.21.15.131:0/2861815630 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6801a690 con 0x55e224bd78d0 2024-04-24T01:44:48.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.360+0000 7f3d62e05640 1 -- 172.21.15.131:0/2861815630 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6801a830 con 0x55e224bd78d0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.360+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e224cd04f0 con 0x55e224bd78d0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.360+0000 7f3d62e05640 1 -- 172.21.15.131:0/2861815630 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6801ab30 con 0x55e224bd78d0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.360+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e224cd31a0 con 0x55e224bd78d0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3d62e05640 1 -- 172.21.15.131:0/2861815630 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3e68017070 con 0x55e224bd78d0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3d62e05640 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d5c036950 0x7f3d5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3d62e05640 1 -- 172.21.15.131:0/2861815630 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3e68015020 con 0x55e224bd78d0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3e75e44640 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d5c036950 0x7f3d5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224bdb3e0 0x55e224cd6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224cd74e0 con 0x55e224bdb3e0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3e76e46640 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224bdb3e0 0x55e224cd6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.361+0000 7f3e75e44640 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d5c036950 0x7f3d5c038e10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c054000 tx=0x7f3e6c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.362+0000 7f3e76e46640 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224bdb3e0 0x55e224cd6f60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.362+0000 7f3e76e46640 1 -- 172.21.15.131:0/2861815630 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e7000a4a0 con 0x55e224bdb3e0 2024-04-24T01:44:48.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.362+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224cd4530 con 0x55e224bdb3e0 2024-04-24T01:44:48.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.362+0000 7f3e76e46640 1 -- 172.21.15.131:0/2861815630 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e7000a4a0 con 0x55e224bdb3e0 2024-04-24T01:44:48.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.362+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224cd92e0 con 0x55e224bdb3e0 2024-04-24T01:44:48.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.362+0000 7f3e76e46640 1 -- 172.21.15.131:0/2861815630 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e7000a4a0 con 0x55e224bdb3e0 2024-04-24T01:44:48.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.363+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224cd8620 con 0x55e224bdb3e0 2024-04-24T01:44:48.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.363+0000 7f3e76e46640 1 -- 172.21.15.131:0/2861815630 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e7000a4a0 con 0x55e224bdb3e0 2024-04-24T01:44:48.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.363+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224cd8a70 con 0x55e224bdb3e0 2024-04-24T01:44:48.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.363+0000 7f3e76e46640 1 -- 172.21.15.131:0/2861815630 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e7000a4a0 con 0x55e224bdb3e0 2024-04-24T01:44:48.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.363+0000 7f3e78b46800 1 Processor -- start 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.363+0000 7f3e78b46800 1 -- start start 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3e78b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd7450 0x55e224bd58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3e78b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e224ac86b0 con 0x55e224bd7450 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3e75e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd7450 0x55e224bd58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3e75e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd7450 0x55e224bd58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52414/0 (socket says 172.21.15.131:52414) 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3e75e44640 1 -- 172.21.15.131:0/4036613729 learned_addr learned my addr 172.21.15.131:0/4036613729 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3e75e44640 1 -- 172.21.15.131:0/4036613729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e224bd5e00 con 0x55e224bd7450 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3e75e44640 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd7450 0x55e224bd58c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c000c00 tx=0x7f3e6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.364+0000 7f3d5bfff640 1 -- 172.21.15.131:0/4036613729 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c057040 con 0x55e224bd7450 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.365+0000 7f3d5bfff640 1 -- 172.21.15.131:0/4036613729 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c05d650 con 0x55e224bd7450 2024-04-24T01:44:48.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.365+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e224bd5fd0 con 0x55e224bd7450 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.365+0000 7f3d5bfff640 1 -- 172.21.15.131:0/4036613729 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c05d930 con 0x55e224bd7450 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.365+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e224bd6470 con 0x55e224bd7450 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.365+0000 7f3d5bfff640 1 -- 172.21.15.131:0/4036613729 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3e6c067070 con 0x55e224bd7450 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.365+0000 7f3d5bfff640 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d50036900 0x7f3d50038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.365+0000 7f3d5bfff640 1 -- 172.21.15.131:0/4036613729 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3e6c08f860 con 0x55e224bd7450 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e76e46640 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d50036900 0x7f3d50038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e78b46800 1 Processor -- start 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e78b46800 1 -- start start 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e76e46640 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d50036900 0x7f3d50038dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55e224cd8140 tx=0x7f3e70005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e78b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cf7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e78b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e224cc8ac0 con 0x55e224cf7470 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e75e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cf7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e75e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cf7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52422/0 (socket says 172.21.15.131:52422) 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e75e44640 1 -- 172.21.15.131:0/2648055566 learned_addr learned my addr 172.21.15.131:0/2648055566 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.366+0000 7f3e75e44640 1 -- 172.21.15.131:0/2648055566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e224cf7e60 con 0x55e224cf7470 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e75e44640 1 --2- 172.21.15.131:0/2648055566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cf7890 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c08db70 tx=0x7f3e6c08ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b6618d5aa76994 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3d59ffb640 1 -- 172.21.15.131:0/2648055566 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c000ed0 con 0x55e224cf7470 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3d59ffb640 1 -- 172.21.15.131:0/2648055566 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c068c50 con 0x55e224cf7470 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3d59ffb640 1 -- 172.21.15.131:0/2648055566 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c001070 con 0x55e224cf7470 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 -- 172.21.15.131:0/2648055566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 msgr2=0x55e224cf7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2648055566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cf7890 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c08db70 tx=0x7f3e6c08ddf0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 -- 172.21.15.131:0/2648055566 shutdown_connections 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2648055566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cf7890 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 -- 172.21.15.131:0/2648055566 >> 172.21.15.131:0/2648055566 conn(0x55e224cf37d0 msgr2=0x55e224cf1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 -- 172.21.15.131:0/2648055566 shutdown_connections 2024-04-24T01:44:48.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 -- 172.21.15.131:0/2648055566 wait complete. 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 Processor -- start 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.367+0000 7f3e78b46800 1 -- start start 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e78b46800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cfead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e78b46800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e224cf85d0 con 0x55e224cf7470 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e75e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cfead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e75e44640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cfead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52430/0 (socket says 172.21.15.131:52430) 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 learned_addr learned my addr 172.21.15.131:0/3894325091 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e224cff010 con 0x55e224cf7470 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e75e44640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cfead0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c08ca60 tx=0x7f3e6c08dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3d47fff640 1 -- 172.21.15.131:0/3894325091 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c08f610 con 0x55e224cf7470 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3d47fff640 1 -- 172.21.15.131:0/3894325091 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c093030 con 0x55e224cf7470 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e224cff2a0 con 0x55e224cf7470 2024-04-24T01:44:48.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3d47fff640 1 -- 172.21.15.131:0/3894325091 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c08fb30 con 0x55e224cf7470 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.368+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e224d01f50 con 0x55e224cf7470 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.369+0000 7f3d47fff640 1 -- 172.21.15.131:0/3894325091 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3e6c08fcd0 con 0x55e224cf7470 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.369+0000 7f3d47fff640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d40036900 0x7f3d40038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.369+0000 7f3d47fff640 1 -- 172.21.15.131:0/3894325091 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3e6c0890d0 con 0x55e224cf7470 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.369+0000 7f3e76e46640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d40036900 0x7f3d40038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e76e46640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d40036900 0x7f3d40038dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55e224cd4480 tx=0x7f3e7001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224d0a5d0 0x55e224d0ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0d1e0 con 0x55e224d0a5d0 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e76645640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224d0a5d0 0x55e224d0ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e76645640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224d0a5d0 0x55e224d0ca90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e78b46800 20 realm 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.370+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0d5f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0dec0 con 0x55e224d0a5d0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0e260 con 0x55e224d0a5d0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0eab0 con 0x55e224d0a5d0 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 20 searching for the correct realm 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e224d10820 0x55e224d12c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.371+0000 7f3e75e44640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e224d10820 0x55e224d12c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.372+0000 7f3e75e44640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e224d10820 0x55e224d12c10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.372+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.372+0000 7f3e75e44640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e6c086050 0x7f3e6c050340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.372+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e6c086050 2024-04-24T01:44:48.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.372+0000 7f3e76e46640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e6c086050 0x7f3e6c050340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.372+0000 7f3e76e46640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e6c086050 0x7f3e6c050340 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.373+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7001f070 con 0x7f3e6c086050 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.373+0000 7f3e76e46640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e70031040 0x7f3e70032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.373+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.373+0000 7f3e76645640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e70031040 0x7f3e70032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.373+0000 7f3e76645640 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e70031040 0x7f3e70032940 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.374+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e6c086050 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7001f070 con 0x7f3e6c086050 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.375+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e6c086050 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e7001f070 con 0x7f3e6c086050 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.376+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.377+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.378+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.378+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.378+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.378+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e6c086050 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.378+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7001f070 con 0x7f3e6c086050 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.378+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.379+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.379+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e6c086050 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.379+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7001f070 con 0x7f3e6c086050 2024-04-24T01:44:48.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.379+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.379+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.379+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.380+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.380+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e6c086050 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.380+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7001f070 con 0x7f3e6c086050 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.380+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d10820 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.380+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.380+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e70031040 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x55e224d0a5d0 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e224d131f0 con 0x7f3e6c086050 2024-04-24T01:44:48.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0f430 con 0x55e224d0a5d0 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.381+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0fcd0 con 0x55e224d0a5d0 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.401 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d13670 con 0x55e224d0a5d0 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 zone default found 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 4 Realm: () 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 zonegroup default 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d0f930 con 0x7f3e6c086050 2024-04-24T01:44:48.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.382+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d15a00 con 0x55e224d10820 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d15da0 con 0x55e224d10820 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e78b46800 20 started sync module instance, tier type = 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e78b46800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.383+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d14e90 con 0x7f3e6c086050 2024-04-24T01:44:48.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.384+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.384+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94429768668048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d14e90 con 0x7f3e6c086050 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.384+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d16800 con 0x55e224d0a5d0 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.385+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94429768668048] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.385+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.385+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94429768672592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d14e90 con 0x55e224d0a5d0 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.385+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d17250 con 0x55e224d10820 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.386+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.386+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94429768674656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d17af0 con 0x55e224d10820 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.386+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d18590 con 0x7f3e6c086050 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.387+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94429768672592] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.387+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94429768674656] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.388+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.388+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94429768676928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d149e0 con 0x7f3e6c086050 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.388+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d18ea0 con 0x55e224d0a5d0 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.388+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94429768676928] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.389+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.389+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94429768679552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d18e60 con 0x55e224d0a5d0 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.389+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d198f0 con 0x7f3e70031040 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.390+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94429768679552] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.390+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.390+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94429768684544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d18e60 con 0x7f3e70031040 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.390+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1a300 con 0x7f3e70031040 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.391+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94429768684544] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.391+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.391+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94429768681904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1a4e0 con 0x7f3e70031040 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.391+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1ad30 con 0x7f3e70031040 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94429768681904] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94429768688144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1ab80 con 0x7f3e70031040 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 20 add_watcher() i=0 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 20 add_watcher() i=1 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 20 add_watcher() i=2 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 20 add_watcher() i=3 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 20 add_watcher() i=4 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 20 add_watcher() i=5 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.392+0000 7f3e78b46800 20 add_watcher() i=6 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.393+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94429768688144] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.393+0000 7f3e78b46800 20 add_watcher() i=7 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.393+0000 7f3e78b46800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.393+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1e0c0 con 0x55e224d0a5d0 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.393+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.393+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94429768689200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1b5b0 con 0x55e224d0a5d0 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.394+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94429768689200] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.394+0000 7f3d2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 5 note: GC not initialized 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3ca77fe640 20 reqs_thread_entry: start 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 20 Filter name: none 2024-04-24T01:44:48.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3ca57fa640 20 reqs_thread_entry: start 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.395+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d51450 con 0x7f3e70031040 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.396+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.396+0000 7f3e78b46800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.396+0000 7f3e78b46800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.396+0000 7f3e78b46800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.396+0000 7f3e78b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.396+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d57a60 con 0x7f3e70031040 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3e78b46800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3e78b46800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3e78b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94429768938704 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e224d53170 con 0x55e224d0a5d0 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94429768679552 notify 146028888092 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f3e68052040 con 0x55e224d0a5d0 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3d59ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94429768679552 notifier 4870 bl.length()=666 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3d59ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3d59ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 94429768938704 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.397+0000 7f3d59ffb640 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3d3c003ea0 con 0x55e224d0a5d0 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.398+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.398+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 94429768938704 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e224cd31a0 con 0x55e224d0a5d0 2024-04-24T01:44:48.409 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.399+0000 7f3d2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.399+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94429768689200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1d7a0 con 0x55e224d0a5d0 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.400+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94429768689200] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.400+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94429768668048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1a630 con 0x7f3e6c086050 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.401+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94429768668048] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.401+0000 7f3e78b46800 20 remove_watcher() i=0 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.401+0000 7f3e78b46800 2 removed watcher, disabling cache 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.401+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94429768672592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d50830 con 0x55e224d0a5d0 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.402+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94429768672592] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.402+0000 7f3e78b46800 20 remove_watcher() i=1 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.402+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94429768674656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d50830 con 0x55e224d10820 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.403+0000 7f3e75e44640 1 -- 172.21.15.131:0/3894325091 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94429768674656] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c066030 con 0x55e224d10820 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.403+0000 7f3e78b46800 20 remove_watcher() i=2 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.403+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94429768676928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1a630 con 0x7f3e6c086050 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.404+0000 7f3e76e46640 1 -- 172.21.15.131:0/3894325091 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94429768676928] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e70040040 con 0x7f3e6c086050 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.404+0000 7f3e78b46800 20 remove_watcher() i=3 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.404+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94429768679552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1a630 con 0x55e224d0a5d0 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.405+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94429768679552] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x55e224d0a5d0 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.405+0000 7f3e78b46800 20 remove_watcher() i=4 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.405+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94429768684544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d1a630 con 0x7f3e70031040 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.406+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94429768684544] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.406+0000 7f3e78b46800 20 remove_watcher() i=5 2024-04-24T01:44:48.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.406+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94429768681904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d19400 con 0x7f3e70031040 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.407+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94429768681904] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.407+0000 7f3e78b46800 20 remove_watcher() i=6 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.407+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94429768688144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e224d189b0 con 0x7f3e70031040 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94429768688144] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6802e070 con 0x7f3e70031040 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 20 remove_watcher() i=7 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e70031040 msgr2=0x7f3e70032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f3e70031040 0x7f3e70032940 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224d0a5d0 msgr2=0x55e224d0ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224d0a5d0 0x55e224d0ca90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e6c086050 msgr2=0x7f3e6c050340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f3e6c086050 0x7f3e6c050340 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e224d10820 msgr2=0x55e224d12c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55e224d10820 0x55e224d12c10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d40036900 msgr2=0x7f3d40038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d40036900 0x7f3d40038dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55e224cd4480 tx=0x7f3e7001f000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 msgr2=0x55e224cfead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e76645640 1 -- 172.21.15.131:0/3894325091 reap_dead start 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cfead0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c08ca60 tx=0x7f3e6c08dad0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 shutdown_connections 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 --2- 172.21.15.131:0/3894325091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224cf7470 0x55e224cfead0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.408+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 >> 172.21.15.131:0/3894325091 conn(0x55e224cf37d0 msgr2=0x55e224cf0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 shutdown_connections 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/3894325091 wait complete. 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d50036900 msgr2=0x7f3d50038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d50036900 0x7f3d50038dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55e224cd8140 tx=0x7f3e70005840 comp rx=0 tx=0).stop 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd7450 msgr2=0x55e224bd58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd7450 0x55e224bd58c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c000c00 tx=0x7f3e6c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 shutdown_connections 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d50036900 0x7f3d50038dc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/4036613729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd7450 0x55e224bd58c0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 >> 172.21.15.131:0/4036613729 conn(0x55e224cdc0f0 msgr2=0x55e224cdc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 shutdown_connections 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/4036613729 wait complete. 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224bdb3e0 msgr2=0x55e224cd6f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224bdb3e0 0x55e224cd6f60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d5c036950 msgr2=0x7f3d5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d5c036950 0x7f3d5c038e10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c054000 tx=0x7f3e6c04e000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 msgr2=0x55e224ccfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224ccfd20 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55e224cc8f00 tx=0x7f3e68000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 shutdown_connections 2024-04-24T01:44:48.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55e224bdb3e0 0x55e224cd6f60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3d5c036950 0x7f3d5c038e10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 --2- 172.21.15.131:0/2861815630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e224bd78d0 0x55e224ccfd20 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 >> 172.21.15.131:0/2861815630 conn(0x55e224bd13a0 msgr2=0x55e224cc22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 shutdown_connections 2024-04-24T01:44:48.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.409+0000 7f3e78b46800 1 -- 172.21.15.131:0/2861815630 wait complete. 2024-04-24T01:44:48.421 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.421 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.421 ERROR:root:0 2024-04-24T01:44:48.421 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:48.426 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:48.426 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-24T01:44:48.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-24T01:44:48.427 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-04-24T01:44:48.471 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:48.471 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:48.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc8a1f800 1 Processor -- start 2024-04-24T01:44:48.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc8a1f800 1 -- start start 2024-04-24T01:44:48.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc8a1f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555ea35dd3e0 0x555ea35df7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc8a1f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555ea3497d40 con 0x555ea35d98d0 2024-04-24T01:44:48.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc8a1f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x555ea346a4d0 con 0x555ea35dd3e0 2024-04-24T01:44:48.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc5d1d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555ea35dd3e0 0x555ea35df7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc5d1d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555ea35dd3e0 0x555ea35df7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52432/0 (socket says 172.21.15.131:52432) 2024-04-24T01:44:48.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc651e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x555ea35d98d0 0x555ea35dbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39092/0 (socket says 172.21.15.131:39092) 2024-04-24T01:44:48.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.471+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1463308147 learned_addr learned my addr 172.21.15.131:0/1463308147 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.472+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1463308147 >> v1:172.21.15.107:6789/0 conn(0x555ea35d98d0 legacy=0x555ea35dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.472+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1463308147 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ea3496590 con 0x555ea35dd3e0 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.473+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/1463308147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35dd3e0 0x555ea35df7d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fafb000a520 tx=0x7fafb001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510efd5799fa5b89 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc551c640 1 -- 172.21.15.131:0/1463308147 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb0057070 con 0x555ea35dd3e0 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc551c640 1 -- 172.21.15.131:0/1463308147 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0052570 con 0x555ea35dd3e0 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc551c640 1 -- 172.21.15.131:0/1463308147 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb004ae60 con 0x555ea35dd3e0 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463308147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35dd3e0 msgr2=0x555ea35df7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463308147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35dd3e0 0x555ea35df7d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fafb000a520 tx=0x7fafb001d010 comp rx=0 tx=0).stop 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463308147 shutdown_connections 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463308147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35dd3e0 0x555ea35df7d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463308147 >> 172.21.15.131:0/1463308147 conn(0x555ea35d33a0 msgr2=0x555ea35d57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463308147 shutdown_connections 2024-04-24T01:44:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.474+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463308147 wait complete. 2024-04-24T01:44:48.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc8a1f800 1 Processor -- start 2024-04-24T01:44:48.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc8a1f800 1 -- start start 2024-04-24T01:44:48.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc8a1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc8a1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555ea35243b0 con 0x555ea35d98d0 2024-04-24T01:44:48.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc651e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc651e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52436/0 (socket says 172.21.15.131:52436) 2024-04-24T01:44:48.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc651e640 1 -- 172.21.15.131:0/3425912432 learned_addr learned my addr 172.21.15.131:0/3425912432 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.486+0000 7fafc651e640 1 -- 172.21.15.131:0/3425912432 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ea36ca740 con 0x555ea35d98d0 2024-04-24T01:44:48.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.487+0000 7fafc651e640 1 --2- 172.21.15.131:0/3425912432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36ca170 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fafc0001e90 tx=0x7fafc000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68746c0744f08269 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.487+0000 7faeb4608640 1 -- 172.21.15.131:0/3425912432 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc000e5c0 con 0x555ea35d98d0 2024-04-24T01:44:48.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.487+0000 7faeb4608640 1 -- 172.21.15.131:0/3425912432 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc0006070 con 0x555ea35d98d0 2024-04-24T01:44:48.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.487+0000 7faeb4608640 1 -- 172.21.15.131:0/3425912432 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc000e890 con 0x555ea35d98d0 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.487+0000 7fafc8a1f800 1 -- 172.21.15.131:0/3425912432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 msgr2=0x555ea36ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.487+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/3425912432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36ca170 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fafc0001e90 tx=0x7fafc000b6c0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 -- 172.21.15.131:0/3425912432 shutdown_connections 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/3425912432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36ca170 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 -- 172.21.15.131:0/3425912432 >> 172.21.15.131:0/3425912432 conn(0x555ea35d33a0 msgr2=0x555ea36c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 -- 172.21.15.131:0/3425912432 shutdown_connections 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 -- 172.21.15.131:0/3425912432 wait complete. 2024-04-24T01:44:48.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 Processor -- start 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 -- start start 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc8a1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555ea35e0010 con 0x555ea35d98d0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc651e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc651e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52450/0 (socket says 172.21.15.131:52450) 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc651e640 1 -- 172.21.15.131:0/1463878021 learned_addr learned my addr 172.21.15.131:0/1463878021 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.488+0000 7fafc651e640 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ea36d2260 con 0x555ea35d98d0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.489+0000 7fafc651e640 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36d1d20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafc0001ed0 tx=0x7fafc0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.489+0000 7faeb2e05640 1 -- 172.21.15.131:0/1463878021 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc001a880 con 0x555ea35d98d0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.489+0000 7faeb2e05640 1 -- 172.21.15.131:0/1463878021 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc001aa20 con 0x555ea35d98d0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.489+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ea36d24f0 con 0x555ea35d98d0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.489+0000 7faeb2e05640 1 -- 172.21.15.131:0/1463878021 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc001ad40 con 0x555ea35d98d0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.489+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ea36d51a0 con 0x555ea35d98d0 2024-04-24T01:44:48.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.489+0000 7faeb2e05640 1 -- 172.21.15.131:0/1463878021 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fafc0017070 con 0x555ea35d98d0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7faeb2e05640 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faeac036950 0x7faeac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7faeb2e05640 1 -- 172.21.15.131:0/1463878021 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fafc0015020 con 0x555ea35d98d0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faeac036950 0x7faeac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea35dd3e0 0x555ea36d8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea36d94f0 con 0x555ea35dd3e0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea35dd3e0 0x555ea36d8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faeac036950 0x7faeac038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fafb0054000 tx=0x7fafb004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.490+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea35dd3e0 0x555ea36d8f60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.491+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1463878021 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafb800a4a0 con 0x555ea35dd3e0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.491+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea36d6530 con 0x555ea35dd3e0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.491+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1463878021 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafb800a4a0 con 0x555ea35dd3e0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.491+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea36db330 con 0x555ea35dd3e0 2024-04-24T01:44:48.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.491+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1463878021 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafb800a4a0 con 0x555ea35dd3e0 2024-04-24T01:44:48.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.491+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea36da670 con 0x555ea35dd3e0 2024-04-24T01:44:48.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.491+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1463878021 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafb800a4a0 con 0x555ea35dd3e0 2024-04-24T01:44:48.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.492+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea36daac0 con 0x555ea35dd3e0 2024-04-24T01:44:48.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.492+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1463878021 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafb800a4a0 con 0x555ea35dd3e0 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.492+0000 7fafc8a1f800 1 Processor -- start 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.492+0000 7fafc8a1f800 1 -- start start 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.492+0000 7fafc8a1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36ea0a0 0x555ea36ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.492+0000 7fafc8a1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555ea34ca6b0 con 0x555ea36ea0a0 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7fafc5d1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36ea0a0 0x555ea36ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7fafc5d1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36ea0a0 0x555ea36ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52464/0 (socket says 172.21.15.131:52464) 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7fafc5d1d640 1 -- 172.21.15.131:0/286599109 learned_addr learned my addr 172.21.15.131:0/286599109 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7fafc5d1d640 1 -- 172.21.15.131:0/286599109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ea36eaa00 con 0x555ea36ea0a0 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36ea0a0 0x555ea36ea4c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafb0000c00 tx=0x7fafb0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7faeabfff640 1 -- 172.21.15.131:0/286599109 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb0057040 con 0x555ea36ea0a0 2024-04-24T01:44:48.509 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7faeabfff640 1 -- 172.21.15.131:0/286599109 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb005d650 con 0x555ea36ea0a0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7faeabfff640 1 -- 172.21.15.131:0/286599109 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb005d930 con 0x555ea36ea0a0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ea36eb470 con 0x555ea36ea0a0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.493+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ea36eb910 con 0x555ea36ea0a0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.494+0000 7faeabfff640 1 -- 172.21.15.131:0/286599109 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fafb0067070 con 0x555ea36ea0a0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.494+0000 7faeabfff640 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faea0036950 0x7faea0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.494+0000 7faeabfff640 1 -- 172.21.15.131:0/286599109 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fafb008f880 con 0x555ea36ea0a0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.494+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faea0036950 0x7faea0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.494+0000 7fafc8a1f800 1 Processor -- start 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc8a1f800 1 -- start start 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faea0036950 0x7faea0038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x555ea36da190 tx=0x7fafb8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc8a1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea36f7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc8a1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555ea36caac0 con 0x555ea36f72e0 2024-04-24T01:44:48.510 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc5d1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea36f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc5d1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea36f7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52472/0 (socket says 172.21.15.131:52472) 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc5d1d640 1 -- 172.21.15.131:0/2783797115 learned_addr learned my addr 172.21.15.131:0/2783797115 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc5d1d640 1 -- 172.21.15.131:0/2783797115 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ea36f7cd0 con 0x555ea36f72e0 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/2783797115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea36f7700 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fafb008db50 tx=0x7fafb0067cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb744f82345190b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7faea9ffb640 1 -- 172.21.15.131:0/2783797115 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb0071400 con 0x555ea36f72e0 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7faea9ffb640 1 -- 172.21.15.131:0/2783797115 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0067360 con 0x555ea36f72e0 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.495+0000 7faea9ffb640 1 -- 172.21.15.131:0/2783797115 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb00715a0 con 0x555ea36f72e0 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 -- 172.21.15.131:0/2783797115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 msgr2=0x555ea36f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/2783797115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea36f7700 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fafb008db50 tx=0x7fafb0067cf0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 -- 172.21.15.131:0/2783797115 shutdown_connections 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/2783797115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea36f7700 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 -- 172.21.15.131:0/2783797115 >> 172.21.15.131:0/2783797115 conn(0x555ea36f3640 msgr2=0x555ea36f16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 -- 172.21.15.131:0/2783797115 shutdown_connections 2024-04-24T01:44:48.511 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 -- 172.21.15.131:0/2783797115 wait complete. 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 Processor -- start 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 -- start start 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea35d9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc8a1f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555ea36f8440 con 0x555ea36f72e0 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc5d1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea35d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc5d1d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea35d9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52476/0 (socket says 172.21.15.131:52476) 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.496+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 learned_addr learned my addr 172.21.15.131:0/1617130041 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.497+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ea35d7900 con 0x555ea36f72e0 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.497+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea35d9210 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fafb008ca40 tx=0x7fafb008dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.497+0000 7fae97fff640 1 -- 172.21.15.131:0/1617130041 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb008fad0 con 0x555ea36f72e0 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.497+0000 7fae97fff640 1 -- 172.21.15.131:0/1617130041 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0093030 con 0x555ea36f72e0 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.497+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ea35d7b90 con 0x555ea36f72e0 2024-04-24T01:44:48.512 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.497+0000 7fae97fff640 1 -- 172.21.15.131:0/1617130041 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb008fe20 con 0x555ea36f72e0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.497+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ea35d8090 con 0x555ea36f72e0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fae97fff640 1 -- 172.21.15.131:0/1617130041 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fafb008f070 con 0x555ea36f72e0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fae97fff640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fae900368b0 0x7fae90038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fae97fff640 1 -- 172.21.15.131:0/1617130041 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fafb0099d10 con 0x555ea36f72e0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fae900368b0 0x7fae90038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fae900368b0 0x7fae90038d70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x555ea36d6480 tx=0x7fafb801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea370c610 0x555ea370ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.498+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea370f220 con 0x555ea370c610 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc651e640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea370c610 0x555ea370ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc651e640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea370c610 0x555ea370ead0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 20 realm 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea370f630 con 0x555ea370c610 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea370ff00 con 0x555ea370c610 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.499+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea37102a0 con 0x555ea370c610 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc8a1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea3710af0 con 0x555ea370c610 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc8a1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc8a1f800 20 searching for the correct realm 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555ea3712860 0x555ea3714c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea3712860 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555ea3712860 0x555ea3714c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.500+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555ea3712860 0x555ea3714c50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc5d1d640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fafb0086050 0x7fafb0007900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb0086050 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fafb0086050 0x7fafb0007900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fafb0086050 0x7fafb0007900 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb801f070 con 0x7fafb0086050 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc6d1f640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fafb8031040 0x7fafb8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.501+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb8031040 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.502+0000 7fafc651e640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fafb8031040 0x7fafb8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.502+0000 7fafc651e640 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fafb8031040 0x7fafb8032940 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.502+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x7fafb8031040 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.502+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea370c610 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.502+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.502+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea370c610 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb8031040 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x7fafb8031040 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb8031040 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x7fafb8031040 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb0086050 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb801f070 con 0x7fafb0086050 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.503+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea3712860 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea370c610 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb8031040 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x7fafb8031040 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea370c610 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.504+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb0086050 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafb801f070 con 0x7fafb0086050 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555ea3715260 con 0x7fafb8031040 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x7fafb8031040 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.505+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea370c610 2024-04-24T01:44:48.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea370c610 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.506+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x7fafb8031040 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x7fafb8031040 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea3712860 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x7fafb0086050 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb801f070 con 0x7fafb0086050 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea370c610 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc002e070 con 0x555ea370c610 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x7fafb0086050 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb801f070 con 0x7fafb0086050 2024-04-24T01:44:48.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.507+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea3712860 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x7fafb8031040 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x7fafb0086050 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb801f070 con 0x7fafb0086050 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea3712860 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.508+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x7fafb8031040 2024-04-24T01:44:48.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x555ea370c610 2024-04-24T01:44:48.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fafc0054040 con 0x7fafb0086050 2024-04-24T01:44:48.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea3711440 con 0x555ea370c610 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.509+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea3711ce0 con 0x555ea370c610 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea3711ce0 con 0x555ea370c610 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 zone default found 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 4 Realm: () 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 zonegroup default 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea37156e0 con 0x7fafb0086050 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea37174c0 con 0x555ea3712860 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.510+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc8a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea37179d0 con 0x555ea3712860 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc8a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc8a1f800 20 started sync module instance, tier type = 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc8a1f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.511+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716900 con 0x7fafb0086050 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.512+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.512+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93864957406720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716900 con 0x7fafb0086050 2024-04-24T01:44:48.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.512+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3718450 con 0x555ea370c610 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.513+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93864957406720] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.513+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.513+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93864957411712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716900 con 0x555ea370c610 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.513+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3718ea0 con 0x555ea3712860 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.514+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93864957411712] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.514+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.515+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93864957404240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716870 con 0x555ea3712860 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.515+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3719d60 con 0x7fafb0086050 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.516+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93864957404240] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.516+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.516+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93864957417648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3719cd0 con 0x7fafb0086050 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.516+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371ac20 con 0x555ea370c610 2024-04-24T01:44:48.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.517+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93864957417648] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.517+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.517+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93864957419856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371ac20 con 0x555ea370c610 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.517+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371b5e0 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.518+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.518+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93864957423920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371b550 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.518+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93864957419856] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.518+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371a770 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.519+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93864957423920] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.519+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.519+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93864957426176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371c050 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.519+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371ca10 con 0x7fafb8031040 2024-04-24T01:44:48.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93864957426176] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93864957421424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371ca10 con 0x7fafb8031040 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 20 add_watcher() i=0 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 20 add_watcher() i=1 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 20 add_watcher() i=2 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 20 add_watcher() i=3 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 20 add_watcher() i=4 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 20 add_watcher() i=5 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.520+0000 7fafc8a1f800 20 add_watcher() i=6 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.521+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93864957421424] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.521+0000 7fafc8a1f800 20 add_watcher() i=7 2024-04-24T01:44:48.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.521+0000 7fafc8a1f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.521+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea371fd60 con 0x555ea370c610 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.521+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.521+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93864957441904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371cb80 con 0x555ea370c610 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.522+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93864957441904] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.522+0000 7fae7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 5 note: GC not initialized 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fadf77fe640 20 reqs_thread_entry: start 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 20 Filter name: none 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fadf57fa640 20 reqs_thread_entry: start 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:48.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.523+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea3753130 con 0x7fafb8031040 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.524+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.524+0000 7fafc8a1f800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.524+0000 7fafc8a1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.524+0000 7fafc8a1f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.524+0000 7fafc8a1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.524+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3759aa0 con 0x7fafb8031040 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7fafc8a1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7fafc8a1f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7fafc8a1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93864957678864 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555ea3755170 con 0x555ea370c610 2024-04-24T01:44:48.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 93864957419856 notify 146028888093 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fafc0037080 con 0x555ea370c610 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7faea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 93864957419856 notifier 4877 bl.length()=666 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.526+0000 7faea9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.525+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 93864957678864 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.526+0000 7faea9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.526+0000 7faea9ffb640 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fae8c003ea0 con 0x555ea370c610 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.526+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.526+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 93864957678864 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ea36d51a0 con 0x555ea370c610 2024-04-24T01:44:48.538 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:48.543 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.527+0000 7fae7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.527+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93864957441904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3752100 con 0x555ea370c610 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.528+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93864957441904] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.528+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93864957406720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371f770 con 0x7fafb0086050 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.529+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93864957406720] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.529+0000 7fafc8a1f800 20 remove_watcher() i=0 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.529+0000 7fafc8a1f800 2 removed watcher, disabling cache 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.529+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93864957411712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716e00 con 0x555ea370c610 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.530+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93864957411712] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.530+0000 7fafc8a1f800 20 remove_watcher() i=1 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.530+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93864957404240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716e00 con 0x555ea3712860 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.531+0000 7fafc5d1d640 1 -- 172.21.15.131:0/1617130041 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93864957404240] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb009f070 con 0x555ea3712860 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.531+0000 7fafc8a1f800 20 remove_watcher() i=2 2024-04-24T01:44:48.544 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.531+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93864957417648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716450 con 0x7fafb0086050 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.532+0000 7fafc6d1f640 1 -- 172.21.15.131:0/1617130041 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93864957417648] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb8040040 con 0x7fafb0086050 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.532+0000 7fafc8a1f800 20 remove_watcher() i=3 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.532+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93864957419856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716450 con 0x555ea370c610 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.533+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93864957419856] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x555ea370c610 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.533+0000 7fafc8a1f800 20 remove_watcher() i=4 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.533+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93864957423920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371a150 con 0x7fafb8031040 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.534+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93864957423920] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.534+0000 7fafc8a1f800 20 remove_watcher() i=5 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.534+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93864957426176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea3716450 con 0x7fafb8031040 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.535+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93864957426176] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.535+0000 7fafc8a1f800 20 remove_watcher() i=6 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.535+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93864957421424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555ea371b130 con 0x7fafb8031040 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.536+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93864957421424] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc005d040 con 0x7fafb8031040 2024-04-24T01:44:48.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.536+0000 7fafc8a1f800 20 remove_watcher() i=7 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.536+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fafb8031040 msgr2=0x7fafb8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.536+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fafb8031040 0x7fafb8032940 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea370c610 msgr2=0x555ea370ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea370c610 0x555ea370ead0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fafb0086050 msgr2=0x7fafb0007900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fafb0086050 0x7fafb0007900 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555ea3712860 msgr2=0x555ea3714c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555ea3712860 0x555ea3714c50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fae900368b0 msgr2=0x7fae90038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fae900368b0 0x7fae90038d70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x555ea36d6480 tx=0x7fafb801f000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 msgr2=0x555ea35d9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1617130041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36f72e0 0x555ea35d9210 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fafb008ca40 tx=0x7fafb008dab0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 reap_dead start 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc651e640 1 -- 172.21.15.131:0/1617130041 reap_dead start 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 shutdown_connections 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 >> 172.21.15.131:0/1617130041 conn(0x555ea36f3640 msgr2=0x555ea36f0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 shutdown_connections 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1617130041 wait complete. 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faea0036950 msgr2=0x7faea0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faea0036950 0x7faea0038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x555ea36da190 tx=0x7fafb8005840 comp rx=0 tx=0).stop 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36ea0a0 msgr2=0x555ea36ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36ea0a0 0x555ea36ea4c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafb0000c00 tx=0x7fafb0002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 shutdown_connections 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faea0036950 0x7faea0038e10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/286599109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea36ea0a0 0x555ea36ea4c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 >> 172.21.15.131:0/286599109 conn(0x555ea36de140 msgr2=0x555ea36de540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 shutdown_connections 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/286599109 wait complete. 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea35dd3e0 msgr2=0x555ea36d8f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.537+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea35dd3e0 0x555ea36d8f60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faeac036950 msgr2=0x7faeac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faeac036950 0x7faeac038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fafb0054000 tx=0x7fafb004e000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 msgr2=0x555ea36d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36d1d20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafc0001ed0 tx=0x7fafc0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 shutdown_connections 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555ea35dd3e0 0x555ea36d8f60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7faeac036950 0x7faeac038e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 --2- 172.21.15.131:0/1463878021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555ea35d98d0 0x555ea36d1d20 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 >> 172.21.15.131:0/1463878021 conn(0x555ea35d33a0 msgr2=0x555ea36c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 shutdown_connections 2024-04-24T01:44:48.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.538+0000 7fafc8a1f800 1 -- 172.21.15.131:0/1463878021 wait complete. 2024-04-24T01:44:48.550 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.550 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.550 ERROR:root:0 2024-04-24T01:44:48.550 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:48.554 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:48.555 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:48.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:48.555 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T01:44:48.599 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:48.599 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:48.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.599+0000 7fd228f0c800 1 Processor -- start 2024-04-24T01:44:48.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.599+0000 7fd228f0c800 1 -- start start 2024-04-24T01:44:48.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.599+0000 7fd228f0c800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555f4ce8cfb0 0x555f4ce8d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.599+0000 7fd228f0c800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f4cd4bd40 con 0x555f4ce8e120 2024-04-24T01:44:48.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.599+0000 7fd228f0c800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x555f4cd1e4d0 con 0x555f4ce8cfb0 2024-04-24T01:44:48.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.600+0000 7fd226a0b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555f4ce8cfb0 0x555f4ce8d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.600+0000 7fd21ffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x555f4ce8e120 0x555f4ce8e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39100/0 (socket says 172.21.15.131:39100) 2024-04-24T01:44:48.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.600+0000 7fd21ffff640 1 -- 172.21.15.131:0/1214904581 learned_addr learned my addr 172.21.15.131:0/1214904581 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:48.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.600+0000 7fd226a0b640 1 -- 172.21.15.131:0/1214904581 >> v1:172.21.15.107:6789/0 conn(0x555f4ce8e120 legacy=0x555f4ce8e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.600+0000 7fd226a0b640 1 -- 172.21.15.131:0/1214904581 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4cd4a590 con 0x555f4ce8cfb0 2024-04-24T01:44:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd226a0b640 1 --2- 172.21.15.131:0/1214904581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4ce8d3d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd21800a470 tx=0x7fd21801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be27744627ea801f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd22620a640 1 -- 172.21.15.131:0/1214904581 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd218057070 con 0x555f4ce8cfb0 2024-04-24T01:44:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd22620a640 1 -- 172.21.15.131:0/1214904581 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd218052570 con 0x555f4ce8cfb0 2024-04-24T01:44:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd22620a640 1 -- 172.21.15.131:0/1214904581 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd218052870 con 0x555f4ce8cfb0 2024-04-24T01:44:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd228f0c800 1 -- 172.21.15.131:0/1214904581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 msgr2=0x555f4ce8d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd228f0c800 1 --2- 172.21.15.131:0/1214904581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4ce8d3d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd21800a470 tx=0x7fd21801ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd228f0c800 1 -- 172.21.15.131:0/1214904581 shutdown_connections 2024-04-24T01:44:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd228f0c800 1 --2- 172.21.15.131:0/1214904581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4ce8d3d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd228f0c800 1 -- 172.21.15.131:0/1214904581 >> 172.21.15.131:0/1214904581 conn(0x555f4ce88550 msgr2=0x555f4ce8a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd228f0c800 1 -- 172.21.15.131:0/1214904581 shutdown_connections 2024-04-24T01:44:48.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.602+0000 7fd228f0c800 1 -- 172.21.15.131:0/1214904581 wait complete. 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.614+0000 7fd228f0c800 1 Processor -- start 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.614+0000 7fd228f0c800 1 -- start start 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.614+0000 7fd228f0c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf7e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.614+0000 7fd228f0c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f4cdd83b0 con 0x555f4ce8cfb0 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd226a0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf7e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd226a0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf7e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52490/0 (socket says 172.21.15.131:52490) 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd226a0b640 1 -- 172.21.15.131:0/109668347 learned_addr learned my addr 172.21.15.131:0/109668347 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd226a0b640 1 -- 172.21.15.131:0/109668347 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4cf7ebd0 con 0x555f4ce8cfb0 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd226a0b640 1 --2- 172.21.15.131:0/109668347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf7e600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd218055040 tx=0x7fd21804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf743f76743b898 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd114e09640 1 -- 172.21.15.131:0/109668347 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd218057070 con 0x555f4ce8cfb0 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd114e09640 1 -- 172.21.15.131:0/109668347 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd218063070 con 0x555f4ce8cfb0 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.615+0000 7fd114e09640 1 -- 172.21.15.131:0/109668347 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd218052720 con 0x555f4ce8cfb0 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 -- 172.21.15.131:0/109668347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 msgr2=0x555f4cf7e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 --2- 172.21.15.131:0/109668347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf7e600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd218055040 tx=0x7fd21804c000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 -- 172.21.15.131:0/109668347 shutdown_connections 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 --2- 172.21.15.131:0/109668347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf7e600 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 -- 172.21.15.131:0/109668347 >> 172.21.15.131:0/109668347 conn(0x555f4ce88550 msgr2=0x555f4cf79f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 -- 172.21.15.131:0/109668347 shutdown_connections 2024-04-24T01:44:48.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 -- 172.21.15.131:0/109668347 wait complete. 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 Processor -- start 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 -- start start 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf86040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd228f0c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f4ce96590 con 0x555f4ce8cfb0 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.616+0000 7fd226a0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf86040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd226a0b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf86040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52500/0 (socket says 172.21.15.131:52500) 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd226a0b640 1 -- 172.21.15.131:0/2008062108 learned_addr learned my addr 172.21.15.131:0/2008062108 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd226a0b640 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4cf86580 con 0x555f4ce8cfb0 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd226a0b640 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf86040 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd218055040 tx=0x7fd218002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd113606640 1 -- 172.21.15.131:0/2008062108 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd218052cd0 con 0x555f4ce8cfb0 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd113606640 1 -- 172.21.15.131:0/2008062108 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21806c070 con 0x555f4ce8cfb0 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd113606640 1 -- 172.21.15.131:0/2008062108 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21805e480 con 0x555f4ce8cfb0 2024-04-24T01:44:48.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f4cf86810 con 0x555f4ce8cfb0 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.617+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4cf89420 con 0x555f4ce8cfb0 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd113606640 1 -- 172.21.15.131:0/2008062108 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd21805e620 con 0x555f4ce8cfb0 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd113606640 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd10c036950 0x7fd10c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd113606640 1 -- 172.21.15.131:0/2008062108 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd21808e830 con 0x555f4ce8cfb0 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd21ffff640 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd10c036950 0x7fd10c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4ce8e120 0x555f4cf8d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cf8d760 con 0x555f4ce8e120 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd22720c640 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4ce8e120 0x555f4cf8d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.618+0000 7fd21ffff640 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd10c036950 0x7fd10c038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd210000f60 tx=0x7fd2100012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.619+0000 7fd22720c640 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4ce8e120 0x555f4cf8d1e0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.619+0000 7fd22720c640 1 -- 172.21.15.131:0/2008062108 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd22000a4a0 con 0x555f4ce8e120 2024-04-24T01:44:48.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.619+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cf8a7b0 con 0x555f4ce8e120 2024-04-24T01:44:48.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.619+0000 7fd22720c640 1 -- 172.21.15.131:0/2008062108 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd22000a4a0 con 0x555f4ce8e120 2024-04-24T01:44:48.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.619+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cf8f580 con 0x555f4ce8e120 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.619+0000 7fd22720c640 1 -- 172.21.15.131:0/2008062108 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd22000a4a0 con 0x555f4ce8e120 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.619+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cf8e8c0 con 0x555f4ce8e120 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.620+0000 7fd22720c640 1 -- 172.21.15.131:0/2008062108 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd22000a4a0 con 0x555f4ce8e120 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.620+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cf8ed10 con 0x555f4ce8e120 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.620+0000 7fd22720c640 1 -- 172.21.15.131:0/2008062108 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd22000a4a0 con 0x555f4ce8e120 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.620+0000 7fd228f0c800 1 Processor -- start 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.620+0000 7fd228f0c800 1 -- start start 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.620+0000 7fd228f0c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cf9e350 0x555f4cf9e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.620+0000 7fd228f0c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f4cd7e6b0 con 0x555f4cf9e350 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cf9e350 0x555f4cf9e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cf9e350 0x555f4cf9e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52514/0 (socket says 172.21.15.131:52514) 2024-04-24T01:44:48.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd21ffff640 1 -- 172.21.15.131:0/1174511179 learned_addr learned my addr 172.21.15.131:0/1174511179 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd21ffff640 1 -- 172.21.15.131:0/1174511179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4cf9ecb0 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd21ffff640 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cf9e350 0x555f4cf9e770 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd210001ed0 tx=0x7fd21000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd110e01640 1 -- 172.21.15.131:0/1174511179 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21001b550 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd110e01640 1 -- 172.21.15.131:0/1174511179 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21001b6f0 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f4cf9f720 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd110e01640 1 -- 172.21.15.131:0/1174511179 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21001b9d0 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.621+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4cf9fc20 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.622+0000 7fd110e01640 1 -- 172.21.15.131:0/1174511179 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd210023020 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.622+0000 7fd110e01640 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd100036900 0x7fd100038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.622+0000 7fd110e01640 1 -- 172.21.15.131:0/1174511179 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd210021020 con 0x555f4cf9e350 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.622+0000 7fd22720c640 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd100036900 0x7fd100038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.622+0000 7fd228f0c800 1 Processor -- start 2024-04-24T01:44:48.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd22720c640 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd100036900 0x7fd100038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x555f4cf8e3e0 tx=0x7fd220005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd228f0c800 1 -- start start 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd228f0c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfabab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd228f0c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f4cf7ee90 con 0x555f4cfab690 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfabab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfabab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52530/0 (socket says 172.21.15.131:52530) 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd21ffff640 1 -- 172.21.15.131:0/2307166293 learned_addr learned my addr 172.21.15.131:0/2307166293 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd21ffff640 1 -- 172.21.15.131:0/2307166293 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4cfac080 con 0x555f4cfab690 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd21ffff640 1 --2- 172.21.15.131:0/2307166293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfabab0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd21004ce90 tx=0x7fd2100468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fad4669731f0b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd10a7fc640 1 -- 172.21.15.131:0/2307166293 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21001be20 con 0x555f4cfab690 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.623+0000 7fd10a7fc640 1 -- 172.21.15.131:0/2307166293 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21004a070 con 0x555f4cfab690 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd10a7fc640 1 -- 172.21.15.131:0/2307166293 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd210024e10 con 0x555f4cfab690 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 -- 172.21.15.131:0/2307166293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 msgr2=0x555f4cfabab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2307166293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfabab0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd21004ce90 tx=0x7fd2100468f0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 -- 172.21.15.131:0/2307166293 shutdown_connections 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2307166293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfabab0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 -- 172.21.15.131:0/2307166293 >> 172.21.15.131:0/2307166293 conn(0x555f4cfa79f0 msgr2=0x555f4cfa5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 -- 172.21.15.131:0/2307166293 shutdown_connections 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 -- 172.21.15.131:0/2307166293 wait complete. 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 Processor -- start 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 -- start start 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfb2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.624+0000 7fd228f0c800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555f4cfac7f0 con 0x555f4cfab690 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfb2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfb2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52544/0 (socket says 172.21.15.131:52544) 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 learned_addr learned my addr 172.21.15.131:0/4011771961 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4cfb3290 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd21ffff640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfb2d50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd2100234d0 tx=0x7fd21004ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd108ff9640 1 -- 172.21.15.131:0/4011771961 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd210034070 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd108ff9640 1 -- 172.21.15.131:0/4011771961 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd210024e10 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd108ff9640 1 -- 172.21.15.131:0/4011771961 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd210025ad0 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f4cfb3520 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.625+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4cfb3520 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd108ff9640 1 -- 172.21.15.131:0/4011771961 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd21004ed10 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd108ff9640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd0f00368b0 0x7fd0f0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd108ff9640 1 -- 172.21.15.131:0/4011771961 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd21003ad40 con 0x555f4cfab690 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd22720c640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd0f00368b0 0x7fd0f0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd22720c640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd0f00368b0 0x7fd0f0038d70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555f4cf8a700 tx=0x7fd22001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4cfbe6d0 0x555f4cfc0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.626+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc12e0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd226a0b640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4cfbe6d0 0x555f4cfc0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd226a0b640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4cfbe6d0 0x555f4cfc0b90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 20 realm 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc16f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc1fc0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.627+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2360 con 0x555f4cfbe6d0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd228f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd228f0c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd228f0c800 20 searching for the correct realm 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f4cfc4920 0x555f4cfc6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc72f0 con 0x555f4cfc4920 2024-04-24T01:44:48.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd21ffff640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f4cfc4920 0x555f4cfc6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.628+0000 7fd21ffff640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f4cfc4920 0x555f4cfc6d10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd21ffff640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd210039070 0x7fd210030440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc72f0 con 0x7fd210039070 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd22720c640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd210039070 0x7fd210030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd22720c640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd210039070 0x7fd210030440 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22001f070 con 0x7fd210039070 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd22720c640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd220031040 0x7fd220032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.629+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc72f0 con 0x7fd220031040 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.630+0000 7fd226a0b640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd220031040 0x7fd220032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.630+0000 7fd226a0b640 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd220031040 0x7fd220032940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.630+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.630+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd220031040 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd220031040 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd210039070 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22001f070 con 0x7fd210039070 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.631+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd220031040 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.632+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd210039070 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd22001f070 con 0x7fd210039070 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd220031040 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.633+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.634+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd220031040 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd210039070 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22001f070 con 0x7fd210039070 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd210039070 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.635+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22001f070 con 0x7fd210039070 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.636+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.636+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.636+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd220031040 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.636+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.636+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd210039070 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.636+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22001f070 con 0x7fd210039070 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.636+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfc4920 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd220031040 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc2bb0 con 0x7fd210039070 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd228f0c800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd228f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd228f0c800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd228f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd228f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.637+0000 7fd228f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc3400 con 0x555f4cfbe6d0 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc37f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc37f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 zone default found 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 4 Realm: () 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 zonegroup default 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc7770 con 0x7fd210039070 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.638+0000 7fd228f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc94f0 con 0x555f4cfc4920 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc9890 con 0x555f4cfc4920 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 20 started sync module instance, tier type = 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.639+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc8990 con 0x7fd210039070 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.640+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.640+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93867801874112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc8990 con 0x7fd210039070 2024-04-24T01:44:48.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.640+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfca250 con 0x555f4cfbe6d0 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.641+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93867801874112] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.641+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.641+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93867801872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfca250 con 0x555f4cfbe6d0 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.641+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcac50 con 0x555f4cfc4920 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.643+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93867801872096] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.643+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.643+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93867801877920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfca1c0 con 0x555f4cfc4920 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.643+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcbb10 con 0x7fd210039070 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.644+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93867801877920] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.644+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.644+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93867801884256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcba80 con 0x7fd210039070 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.644+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcc9d0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.645+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.645+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93867801888032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfccdf0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.645+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcd8a0 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.645+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93867801884256] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.646+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.646+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93867801886464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcd8a0 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.646+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfce2f0 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.646+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93867801888032] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.647+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93867801886464] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.647+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.647+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93867801889088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcde00 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.647+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfce7c0 con 0x7fd220031040 2024-04-24T01:44:48.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93867801889088] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93867801891712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfce7c0 con 0x7fd220031040 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 20 add_watcher() i=0 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 20 add_watcher() i=1 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 20 add_watcher() i=2 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 20 add_watcher() i=3 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 20 add_watcher() i=4 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 20 add_watcher() i=5 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.649+0000 7fd228f0c800 20 add_watcher() i=6 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.651+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93867801891712] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.651+0000 7fd228f0c800 20 add_watcher() i=7 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.651+0000 7fd228f0c800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:48.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.651+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfd1ae0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.651+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.651+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93867801896064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfced50 con 0x555f4cfbe6d0 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93867801896064] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd0dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd228f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd228f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd228f0c800 5 note: GC not initialized 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd057fff640 20 reqs_thread_entry: start 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd228f0c800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.652+0000 7fd228f0c800 20 Filter name: none 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd055ffb640 20 reqs_thread_entry: start 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd228f0c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:48.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd228f0c800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4d004e90 con 0x7fd220031040 2024-04-24T01:44:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd228f0c800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T01:44:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd228f0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.653+0000 7fd228f0c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.654+0000 7fd228f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:48.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.654+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4d00b810 con 0x7fd220031040 2024-04-24T01:44:48.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd228f0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd228f0c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd228f0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:48.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93867802145408 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555f4d006ea0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 93867801888032 notify 146028888094 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7fd218094040 con 0x555f4cfbe6d0 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd10a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 93867801888032 notifier 4884 bl.length()=679 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd10a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd10a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 93867802145408 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd10a7fc640 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd0ec003ea0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.655+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 93867802145408 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f4cf89420 con 0x555f4cfbe6d0 2024-04-24T01:44:48.666 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:48.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.656+0000 7fd0dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.656+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93867801896064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfd0cc0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.657+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93867801896064] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.657+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93867801874112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfce480 con 0x7fd210039070 2024-04-24T01:44:48.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.658+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93867801874112] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.658+0000 7fd228f0c800 20 remove_watcher() i=0 2024-04-24T01:44:48.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.658+0000 7fd228f0c800 2 removed watcher, disabling cache 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.658+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93867801872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfce480 con 0x555f4cfbe6d0 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.659+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93867801872096] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.659+0000 7fd228f0c800 20 remove_watcher() i=1 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.659+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93867801877920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfce480 con 0x555f4cfc4920 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.660+0000 7fd21ffff640 1 -- 172.21.15.131:0/4011771961 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93867801877920] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd210036030 con 0x555f4cfc4920 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.660+0000 7fd228f0c800 20 remove_watcher() i=2 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.660+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93867801884256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc9da0 con 0x7fd210039070 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.661+0000 7fd22720c640 1 -- 172.21.15.131:0/4011771961 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93867801884256] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220040040 con 0x7fd210039070 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.661+0000 7fd228f0c800 20 remove_watcher() i=3 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.661+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93867801888032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcb660 con 0x555f4cfbe6d0 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.662+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93867801888032] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x555f4cfbe6d0 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.662+0000 7fd228f0c800 20 remove_watcher() i=4 2024-04-24T01:44:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.662+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93867801886464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfc9da0 con 0x7fd220031040 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.663+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93867801886464] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.663+0000 7fd228f0c800 20 remove_watcher() i=5 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.663+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93867801889088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcc520 con 0x7fd220031040 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.664+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93867801889088] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.664+0000 7fd228f0c800 20 remove_watcher() i=6 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.664+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93867801891712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555f4cfcb660 con 0x7fd220031040 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93867801891712] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2180717f0 con 0x7fd220031040 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 20 remove_watcher() i=7 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd220031040 msgr2=0x7fd220032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fd220031040 0x7fd220032940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4cfbe6d0 msgr2=0x555f4cfc0b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4cfbe6d0 0x555f4cfc0b90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd210039070 msgr2=0x7fd210030440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fd210039070 0x7fd210030440 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f4cfc4920 msgr2=0x555f4cfc6d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.665+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x555f4cfc4920 0x555f4cfc6d10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd0f00368b0 msgr2=0x7fd0f0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd0f00368b0 0x7fd0f0038d70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555f4cf8a700 tx=0x7fd22001f000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 msgr2=0x555f4cfb2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd226a0b640 1 -- 172.21.15.131:0/4011771961 reap_dead start 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfb2d50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd2100234d0 tx=0x7fd21004ce20 comp rx=0 tx=0).stop 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 shutdown_connections 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/4011771961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cfab690 0x555f4cfb2d50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 >> 172.21.15.131:0/4011771961 conn(0x555f4cfa79f0 msgr2=0x555f4cfa5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 shutdown_connections 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/4011771961 wait complete. 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd100036900 msgr2=0x7fd100038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd100036900 0x7fd100038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x555f4cf8e3e0 tx=0x7fd220005840 comp rx=0 tx=0).stop 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cf9e350 msgr2=0x555f4cf9e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cf9e350 0x555f4cf9e770 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd210001ed0 tx=0x7fd21000d7a0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 shutdown_connections 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd100036900 0x7fd100038dc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/1174511179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4cf9e350 0x555f4cf9e770 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 >> 172.21.15.131:0/1174511179 conn(0x555f4cf923f0 msgr2=0x555f4cf927f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 shutdown_connections 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/1174511179 wait complete. 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4ce8e120 msgr2=0x555f4cf8d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.666+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4ce8e120 0x555f4cf8d1e0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd10c036950 msgr2=0x7fd10c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd10c036950 0x7fd10c038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd210000f60 tx=0x7fd2100012b0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 msgr2=0x555f4cf86040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf86040 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd218055040 tx=0x7fd218002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 shutdown_connections 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x555f4ce8e120 0x555f4cf8d1e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fd10c036950 0x7fd10c038e10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 --2- 172.21.15.131:0/2008062108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555f4ce8cfb0 0x555f4cf86040 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 >> 172.21.15.131:0/2008062108 conn(0x555f4ce88550 msgr2=0x555f4cf78720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 shutdown_connections 2024-04-24T01:44:48.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.667+0000 7fd228f0c800 1 -- 172.21.15.131:0/2008062108 wait complete. 2024-04-24T01:44:48.678 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.678 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.678 ERROR:root:0 2024-04-24T01:44:48.679 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:48.683 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:48.683 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-24T01:44:48.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-24T01:44:48.683 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-04-24T01:44:48.728 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:48.728 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:48.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.728+0000 7f909a062800 1 Processor -- start 2024-04-24T01:44:48.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.728+0000 7f909a062800 1 -- start start 2024-04-24T01:44:48.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.728+0000 7f909a062800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cb1177d420 0x55cb1177f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.728+0000 7f909a062800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb11637d40 con 0x55cb11779910 2024-04-24T01:44:48.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.728+0000 7f909a062800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55cb1160a4d0 con 0x55cb1177d420 2024-04-24T01:44:48.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.729+0000 7f9097367640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cb1177d420 0x55cb1177f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.729+0000 7f9097367640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cb1177d420 0x55cb1177f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52560/0 (socket says 172.21.15.131:52560) 2024-04-24T01:44:48.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.729+0000 7f9097367640 1 -- 172.21.15.131:0/2040156424 learned_addr learned my addr 172.21.15.131:0/2040156424 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.729+0000 7f9097367640 1 -- 172.21.15.131:0/2040156424 >> v1:172.21.15.107:6789/0 conn(0x55cb11779910 legacy=0x55cb1177bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.729+0000 7f9097367640 1 -- 172.21.15.131:0/2040156424 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb11636590 con 0x55cb1177d420 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f9097367640 1 --2- 172.21.15.131:0/2040156424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb1177d420 0x55cb1177f810 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f908c00a520 tx=0x7f908c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5e298c407d5721 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f9096b66640 1 -- 172.21.15.131:0/2040156424 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c057070 con 0x55cb1177d420 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f9096b66640 1 -- 172.21.15.131:0/2040156424 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c052570 con 0x55cb1177d420 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f9096b66640 1 -- 172.21.15.131:0/2040156424 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c04ae60 con 0x55cb1177d420 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f909a062800 1 -- 172.21.15.131:0/2040156424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb1177d420 msgr2=0x55cb1177f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f909a062800 1 --2- 172.21.15.131:0/2040156424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb1177d420 0x55cb1177f810 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f908c00a520 tx=0x7f908c01d010 comp rx=0 tx=0).stop 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f909a062800 1 -- 172.21.15.131:0/2040156424 shutdown_connections 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f909a062800 1 --2- 172.21.15.131:0/2040156424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb1177d420 0x55cb1177f810 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f909a062800 1 -- 172.21.15.131:0/2040156424 >> 172.21.15.131:0/2040156424 conn(0x55cb11773320 msgr2=0x55cb11775740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f909a062800 1 -- 172.21.15.131:0/2040156424 shutdown_connections 2024-04-24T01:44:48.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.731+0000 7f909a062800 1 -- 172.21.15.131:0/2040156424 wait complete. 2024-04-24T01:44:48.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.743+0000 7f909a062800 1 Processor -- start 2024-04-24T01:44:48.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.743+0000 7f909a062800 1 -- start start 2024-04-24T01:44:48.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.743+0000 7f909a062800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb1186a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.743+0000 7f909a062800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cb116c43b0 con 0x55cb11779910 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.743+0000 7f9097b68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb1186a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.743+0000 7f9097b68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb1186a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52576/0 (socket says 172.21.15.131:52576) 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.743+0000 7f9097b68640 1 -- 172.21.15.131:0/1660280339 learned_addr learned my addr 172.21.15.131:0/1660280339 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.744+0000 7f9097b68640 1 -- 172.21.15.131:0/1660280339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb1186a780 con 0x55cb11779910 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.744+0000 7f9097b68640 1 --2- 172.21.15.131:0/1660280339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb1186a1b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9088001d20 tx=0x7f908800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f55395e2b35751 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.744+0000 7f8f85e0b640 1 -- 172.21.15.131:0/1660280339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908800f400 con 0x55cb11779910 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.744+0000 7f8f85e0b640 1 -- 172.21.15.131:0/1660280339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908800f5a0 con 0x55cb11779910 2024-04-24T01:44:48.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.744+0000 7f8f85e0b640 1 -- 172.21.15.131:0/1660280339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908800f7d0 con 0x55cb11779910 2024-04-24T01:44:48.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 -- 172.21.15.131:0/1660280339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 msgr2=0x55cb1186a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 --2- 172.21.15.131:0/1660280339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb1186a1b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9088001d20 tx=0x7f908800b5b0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 -- 172.21.15.131:0/1660280339 shutdown_connections 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 --2- 172.21.15.131:0/1660280339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb1186a1b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 -- 172.21.15.131:0/1660280339 >> 172.21.15.131:0/1660280339 conn(0x55cb11773320 msgr2=0x55cb11865ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 -- 172.21.15.131:0/1660280339 shutdown_connections 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 -- 172.21.15.131:0/1660280339 wait complete. 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 Processor -- start 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 -- start start 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb11871d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f909a062800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cb11780050 con 0x55cb11779910 2024-04-24T01:44:48.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f9097b68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb11871d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f9097b68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb11871d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52590/0 (socket says 172.21.15.131:52590) 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.745+0000 7f9097b68640 1 -- 172.21.15.131:0/370474106 learned_addr learned my addr 172.21.15.131:0/370474106 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.746+0000 7f9097b68640 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb11872240 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.746+0000 7f9097b68640 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb11871d00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55cb1186af40 tx=0x7f9088000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.746+0000 7f8f7ffff640 1 -- 172.21.15.131:0/370474106 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908801a690 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.746+0000 7f8f7ffff640 1 -- 172.21.15.131:0/370474106 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908801a830 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.746+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb118724d0 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.746+0000 7f8f7ffff640 1 -- 172.21.15.131:0/370474106 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908801ab30 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.746+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb11875180 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f8f7ffff640 1 -- 172.21.15.131:0/370474106 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9088017070 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f8f7ffff640 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f80036950 0x7f8f80038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f8f7ffff640 1 -- 172.21.15.131:0/370474106 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9088015020 con 0x55cb11779910 2024-04-24T01:44:48.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f9097367640 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f80036950 0x7f8f80038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f909a062800 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb1177d420 0x55cb11878f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118794c0 con 0x55cb1177d420 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f9098369640 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb1177d420 0x55cb11878f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f9097367640 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f80036950 0x7f8f80038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f908c054000 tx=0x7f908c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.747+0000 7f9098369640 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb1177d420 0x55cb11878f40 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.748+0000 7f9098369640 1 -- 172.21.15.131:0/370474106 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f909000a4a0 con 0x55cb1177d420 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.748+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb11876510 con 0x55cb1177d420 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.748+0000 7f9098369640 1 -- 172.21.15.131:0/370474106 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f909000a4a0 con 0x55cb1177d420 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.748+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb1187b2c0 con 0x55cb1177d420 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.748+0000 7f9098369640 1 -- 172.21.15.131:0/370474106 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f909000a4a0 con 0x55cb1177d420 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.748+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb1187a600 con 0x55cb1177d420 2024-04-24T01:44:48.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.749+0000 7f9098369640 1 -- 172.21.15.131:0/370474106 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f909000a4a0 con 0x55cb1177d420 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.749+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb1187aa50 con 0x55cb1177d420 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.749+0000 7f9098369640 1 -- 172.21.15.131:0/370474106 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f909000a4a0 con 0x55cb1177d420 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.749+0000 7f909a062800 1 Processor -- start 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.749+0000 7f909a062800 1 -- start start 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.749+0000 7f909a062800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb117794b0 0x55cb11777920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.749+0000 7f909a062800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cb1166a6b0 con 0x55cb117794b0 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f9097367640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb117794b0 0x55cb11777920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f9097367640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb117794b0 0x55cb11777920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52596/0 (socket says 172.21.15.131:52596) 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f9097367640 1 -- 172.21.15.131:0/3640875902 learned_addr learned my addr 172.21.15.131:0/3640875902 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f9097367640 1 -- 172.21.15.131:0/3640875902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb11777e60 con 0x55cb117794b0 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f9097367640 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb117794b0 0x55cb11777920 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f908c000c00 tx=0x7f908c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f8f7d7fa640 1 -- 172.21.15.131:0/3640875902 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c057040 con 0x55cb117794b0 2024-04-24T01:44:48.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f8f7d7fa640 1 -- 172.21.15.131:0/3640875902 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c05d650 con 0x55cb117794b0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb11778090 con 0x55cb117794b0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f8f7d7fa640 1 -- 172.21.15.131:0/3640875902 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c05d930 con 0x55cb117794b0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.750+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb11778530 con 0x55cb117794b0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.751+0000 7f8f7d7fa640 1 -- 172.21.15.131:0/3640875902 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f908c067070 con 0x55cb117794b0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.751+0000 7f8f7d7fa640 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f70036900 0x7f8f70038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.751+0000 7f8f7d7fa640 1 -- 172.21.15.131:0/3640875902 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f908c08f890 con 0x55cb117794b0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.751+0000 7f9098369640 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f70036900 0x7f8f70038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.751+0000 7f909a062800 1 Processor -- start 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.751+0000 7f909a062800 1 -- start start 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.751+0000 7f9098369640 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f70036900 0x7f8f70038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55cb1187a120 tx=0x7f9090005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f909a062800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118998d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f909a062800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cb1186ab00 con 0x55cb118994b0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f9097367640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f9097367640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52598/0 (socket says 172.21.15.131:52598) 2024-04-24T01:44:48.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f9097367640 1 -- 172.21.15.131:0/3203254425 learned_addr learned my addr 172.21.15.131:0/3203254425 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f9097367640 1 -- 172.21.15.131:0/3203254425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb11899ea0 con 0x55cb118994b0 2024-04-24T01:44:48.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f9097367640 1 --2- 172.21.15.131:0/3203254425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118998d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f908c08db60 tx=0x7f908c05df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff385c309d7b9118 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f8f76ffd640 1 -- 172.21.15.131:0/3203254425 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c067360 con 0x55cb118994b0 2024-04-24T01:44:48.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f8f76ffd640 1 -- 172.21.15.131:0/3203254425 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c070c60 con 0x55cb118994b0 2024-04-24T01:44:48.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.752+0000 7f8f76ffd640 1 -- 172.21.15.131:0/3203254425 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c067500 con 0x55cb118994b0 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 -- 172.21.15.131:0/3203254425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 msgr2=0x55cb118998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 --2- 172.21.15.131:0/3203254425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118998d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f908c08db60 tx=0x7f908c05df30 comp rx=0 tx=0).stop 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 -- 172.21.15.131:0/3203254425 shutdown_connections 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 --2- 172.21.15.131:0/3203254425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118998d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 -- 172.21.15.131:0/3203254425 >> 172.21.15.131:0/3203254425 conn(0x55cb11895810 msgr2=0x55cb11893870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 -- 172.21.15.131:0/3203254425 shutdown_connections 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 -- 172.21.15.131:0/3203254425 wait complete. 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 Processor -- start 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 -- start start 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f909a062800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cb1189a610 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f9097367640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f9097367640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52606/0 (socket says 172.21.15.131:52606) 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.753+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 learned_addr learned my addr 172.21.15.131:0/2160767864 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.754+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb118a1060 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.754+0000 7f9097367640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118a0b20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f908c08ca50 tx=0x7f908c08dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.754+0000 7f8f757fa640 1 -- 172.21.15.131:0/2160767864 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c001d00 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.754+0000 7f8f757fa640 1 -- 172.21.15.131:0/2160767864 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c093030 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.754+0000 7f8f757fa640 1 -- 172.21.15.131:0/2160767864 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c070e10 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.754+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb118a12f0 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.754+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb118a3fa0 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f8f757fa640 1 -- 172.21.15.131:0/2160767864 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f908c08fb60 con 0x55cb118994b0 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f8f757fa640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f60036900 0x7f8f60038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f8f757fa640 1 -- 172.21.15.131:0/2160767864 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f908c099d10 con 0x55cb118994b0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f9098369640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f60036900 0x7f8f60038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f9098369640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f60036900 0x7f8f60038dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55cb11872f20 tx=0x7f909001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb118ac600 0x55cb118aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.755+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118af210 con 0x55cb118ac600 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f9097b68640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb118ac600 0x55cb118aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f9097b68640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb118ac600 0x55cb118aeac0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 20 realm 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118af620 con 0x55cb118ac600 2024-04-24T01:44:48.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118afef0 con 0x55cb118ac600 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.756+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b0290 con 0x55cb118ac600 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f909a062800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b0ae0 con 0x55cb118ac600 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f909a062800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f909a062800 20 searching for the correct realm 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cb118b2850 0x55cb118b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f9097367640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cb118b2850 0x55cb118b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.757+0000 7f9097367640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cb118b2850 0x55cb118b4c40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9097367640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f908c086050 0x7f908c000ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f908c086050 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9098369640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f908c086050 0x7f908c000ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9098369640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f908c086050 0x7f908c000ed0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f909001f070 con 0x7f908c086050 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9098369640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9090031040 0x7f9090032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.758+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.759+0000 7f9097b68640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9090031040 0x7f9090032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.759+0000 7f9097b68640 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9090031040 0x7f9090032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.759+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.759+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.759+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.759+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f908c086050 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f909001f070 con 0x7f908c086050 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.760+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f908c086050 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f909001f070 con 0x7f908c086050 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.761+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.762+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.762+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.762+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.762+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.762+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.762+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.763+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f908c086050 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f909001f070 con 0x7f908c086050 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.764+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f908c086050 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.765+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f909001f070 con 0x7f908c086050 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.765+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.765+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.765+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.765+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.765+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f908c086050 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.765+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f909001f070 con 0x7f908c086050 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.766+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118b2850 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.766+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.766+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f9090031040 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.766+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.766+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x55cb118ac600 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.766+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.766+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5220 con 0x7f908c086050 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:48.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b1490 con 0x55cb118ac600 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b1d30 con 0x55cb118ac600 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b56a0 con 0x55cb118ac600 2024-04-24T01:44:48.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 zone default found 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 4 Realm: () 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 zonegroup default 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b5b50 con 0x7f908c086050 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.767+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b78d0 con 0x55cb118b2850 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b7dc0 con 0x55cb118b2850 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 20 started sync module instance, tier type = 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.768+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b6d70 con 0x7f908c086050 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.769+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.769+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94330661073552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b6d70 con 0x7f908c086050 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.769+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b8840 con 0x55cb118ac600 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.770+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94330661073552] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.770+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.770+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94330661078416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b6d70 con 0x55cb118ac600 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.770+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b92c0 con 0x55cb118b2850 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.772+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94330661078416] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.772+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.772+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94330661071040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b6ce0 con 0x55cb118b2850 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.772+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118ba180 con 0x7f908c086050 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.773+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94330661071040] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.773+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.773+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94330661084368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118ba0f0 con 0x7f908c086050 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.773+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bb040 con 0x55cb118ac600 2024-04-24T01:44:48.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.774+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94330661084368] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.774+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.774+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94330661086576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bb040 con 0x55cb118ac600 2024-04-24T01:44:48.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.774+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bba40 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.775+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.775+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94330661090640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bb9b0 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.775+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bc9b0 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.776+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94330661086576] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.776+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94330661090640] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.776+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.776+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94330661088144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bc500 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.776+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bcdf0 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.777+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94330661088144] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94330661094656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bc920 con 0x7f9090031040 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 20 add_watcher() i=0 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 20 add_watcher() i=1 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 20 add_watcher() i=2 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 20 add_watcher() i=3 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 20 add_watcher() i=4 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 20 add_watcher() i=5 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.778+0000 7f909a062800 20 add_watcher() i=6 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.779+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94330661094656] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.779+0000 7f909a062800 20 add_watcher() i=7 2024-04-24T01:44:48.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.779+0000 7f909a062800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:48.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.779+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118c0290 con 0x55cb118ac600 2024-04-24T01:44:48.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.779+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.779+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94330661096880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bd720 con 0x55cb118ac600 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.780+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94330661096880] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.780+0000 7f8f4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 5 note: GC not initialized 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f8f4cfe1640 20 reqs_thread_entry: start 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 20 Filter name: none 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f8ec67fc640 20 reqs_thread_entry: start 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.781+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118f3640 con 0x7f9090031040 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.782+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.782+0000 7f909a062800 20 rados_obj.operate() r=0 bl.length=503 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.782+0000 7f909a062800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.782+0000 7f909a062800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.782+0000 7f909a062800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.782+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118f9fc0 con 0x7f9090031040 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f909a062800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f909a062800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f909a062800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94330661345840 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb118f56d0 con 0x55cb118ac600 2024-04-24T01:44:48.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94330661086576 notify 146028888095 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f9088052040 con 0x55cb118ac600 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f8f76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94330661086576 notifier 4891 bl.length()=636 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f8f76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 94330661345840 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f8f76ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.783+0000 7f8f76ffd640 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8f5c003ea0 con 0x55cb118ac600 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.784+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify_complete (2) cookie 94330661345840 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb11875180 con 0x55cb118ac600 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.784+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.800 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:48.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.785+0000 7f8f4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.785+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94330661096880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118f5ae0 con 0x55cb118ac600 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.786+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94330661096880] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.786+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94330661073552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bcdb0 con 0x7f908c086050 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.787+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94330661073552] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.787+0000 7f909a062800 20 remove_watcher() i=0 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.787+0000 7f909a062800 2 removed watcher, disabling cache 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.787+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94330661078416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bcdb0 con 0x55cb118ac600 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.788+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94330661078416] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.788+0000 7f909a062800 20 remove_watcher() i=1 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.788+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94330661071040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bcdb0 con 0x55cb118b2850 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.789+0000 7f9097367640 1 -- 172.21.15.131:0/2160767864 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94330661071040] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908c09f070 con 0x55cb118b2850 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.789+0000 7f909a062800 20 remove_watcher() i=2 2024-04-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.790+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94330661084368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b68c0 con 0x7f908c086050 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.791+0000 7f9098369640 1 -- 172.21.15.131:0/2160767864 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94330661084368] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9090040040 con 0x7f908c086050 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.791+0000 7f909a062800 20 remove_watcher() i=3 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.791+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94330661086576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b9cd0 con 0x55cb118ac600 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.792+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94330661086576] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x55cb118ac600 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.792+0000 7f909a062800 20 remove_watcher() i=4 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.792+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94330661090640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118b9cd0 con 0x7f9090031040 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.794+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94330661090640] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.794+0000 7f909a062800 20 remove_watcher() i=5 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.794+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94330661088144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118ba570 con 0x7f9090031040 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.795+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94330661088144] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.795+0000 7f909a062800 20 remove_watcher() i=6 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.795+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94330661094656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb118bb550 con 0x7f9090031040 2024-04-24T01:44:48.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94330661094656] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f908802e070 con 0x7f9090031040 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 20 remove_watcher() i=7 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9090031040 msgr2=0x7f9090032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9090031040 0x7f9090032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb118ac600 msgr2=0x55cb118aeac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb118ac600 0x55cb118aeac0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f908c086050 msgr2=0x7f908c000ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f908c086050 0x7f908c000ed0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cb118b2850 msgr2=0x55cb118b4c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55cb118b2850 0x55cb118b4c40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f60036900 msgr2=0x7f8f60038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f60036900 0x7f8f60038dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55cb11872f20 tx=0x7f909001f000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f9097b68640 1 -- 172.21.15.131:0/2160767864 reap_dead start 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 msgr2=0x55cb118a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118a0b20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f908c08ca50 tx=0x7f908c08dac0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 shutdown_connections 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/2160767864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb118994b0 0x55cb118a0b20 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 >> 172.21.15.131:0/2160767864 conn(0x55cb11895810 msgr2=0x55cb11892e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 shutdown_connections 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/2160767864 wait complete. 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f70036900 msgr2=0x7f8f70038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f70036900 0x7f8f70038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55cb1187a120 tx=0x7f9090005840 comp rx=0 tx=0).stop 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb117794b0 msgr2=0x55cb11777920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb117794b0 0x55cb11777920 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f908c000c00 tx=0x7f908c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 shutdown_connections 2024-04-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f70036900 0x7f8f70038dc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 --2- 172.21.15.131:0/3640875902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb117794b0 0x55cb11777920 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.796+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 >> 172.21.15.131:0/3640875902 conn(0x55cb1187e130 msgr2=0x55cb1187e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 shutdown_connections 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/3640875902 wait complete. 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb1177d420 msgr2=0x55cb11878f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb1177d420 0x55cb11878f40 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f80036950 msgr2=0x7f8f80038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f80036950 0x7f8f80038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f908c054000 tx=0x7f908c04e000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 msgr2=0x55cb11871d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb11871d00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55cb1186af40 tx=0x7f9088000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 shutdown_connections 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55cb1177d420 0x55cb11878f40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8f80036950 0x7f8f80038e10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 --2- 172.21.15.131:0/370474106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cb11779910 0x55cb11871d00 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 >> 172.21.15.131:0/370474106 conn(0x55cb11773320 msgr2=0x55cb118642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 shutdown_connections 2024-04-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.797+0000 7f909a062800 1 -- 172.21.15.131:0/370474106 wait complete. 2024-04-24T01:44:48.812 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.812 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.812 ERROR:root:0 2024-04-24T01:44:48.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:44:48.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:44:48.813 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-04-24T01:44:48.892 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:48.892 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:48.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.892+0000 7f877a211800 1 Processor -- start 2024-04-24T01:44:48.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.892+0000 7f877a211800 1 -- start start 2024-04-24T01:44:48.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.892+0000 7f877a211800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a8e47f32e0 0x55a8e47fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.892+0000 7f877a211800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8e46b1d40 con 0x55a8e47f17a0 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.892+0000 7f877a211800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55a8e46844d0 con 0x55a8e47f32e0 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.893+0000 7f8775169640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a8e47f32e0 0x55a8e47fbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.893+0000 7f8775169640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a8e47f32e0 0x55a8e47fbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52620/0 (socket says 172.21.15.131:52620) 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.893+0000 7f8775169640 1 -- 172.21.15.131:0/1091937606 learned_addr learned my addr 172.21.15.131:0/1091937606 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.893+0000 7f877596a640 1 --1- 172.21.15.131:0/1091937606 >> v1:172.21.15.107:6789/0 conn(0x55a8e47f17a0 0x55a8e47f1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39128/0 (socket says 172.21.15.131:39128) 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.893+0000 7f8775169640 1 -- 172.21.15.131:0/1091937606 >> v1:172.21.15.107:6789/0 conn(0x55a8e47f17a0 legacy=0x55a8e47f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.893+0000 7f8775169640 1 -- 172.21.15.131:0/1091937606 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e46b0590 con 0x55a8e47f32e0 2024-04-24T01:44:48.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f8775169640 1 --2- 172.21.15.131:0/1091937606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f32e0 0x55a8e47fbde0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f876c00a520 tx=0x7f876c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349ad8777188724d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f8774968640 1 -- 172.21.15.131:0/1091937606 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c057070 con 0x55a8e47f32e0 2024-04-24T01:44:48.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f8774968640 1 -- 172.21.15.131:0/1091937606 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c052570 con 0x55a8e47f32e0 2024-04-24T01:44:48.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f8774968640 1 -- 172.21.15.131:0/1091937606 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c052870 con 0x55a8e47f32e0 2024-04-24T01:44:48.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f877a211800 1 -- 172.21.15.131:0/1091937606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f32e0 msgr2=0x55a8e47fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f877a211800 1 --2- 172.21.15.131:0/1091937606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f32e0 0x55a8e47fbde0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f876c00a520 tx=0x7f876c01d010 comp rx=0 tx=0).stop 2024-04-24T01:44:48.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f877a211800 1 -- 172.21.15.131:0/1091937606 shutdown_connections 2024-04-24T01:44:48.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f877a211800 1 --2- 172.21.15.131:0/1091937606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f32e0 0x55a8e47fbde0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f877a211800 1 -- 172.21.15.131:0/1091937606 >> 172.21.15.131:0/1091937606 conn(0x55a8e47ed320 msgr2=0x55a8e47ef740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f877a211800 1 -- 172.21.15.131:0/1091937606 shutdown_connections 2024-04-24T01:44:48.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.895+0000 7f877a211800 1 -- 172.21.15.131:0/1091937606 wait complete. 2024-04-24T01:44:48.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.907+0000 7f877a211800 1 Processor -- start 2024-04-24T01:44:48.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.907+0000 7f877a211800 1 -- start start 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.907+0000 7f877a211800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.907+0000 7f877a211800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a8e473e3b0 con 0x55a8e47f17a0 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f877596a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f877596a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48e66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52622/0 (socket says 172.21.15.131:52622) 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f877596a640 1 -- 172.21.15.131:0/1761960165 learned_addr learned my addr 172.21.15.131:0/1761960165 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f877596a640 1 -- 172.21.15.131:0/1761960165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e48e6c80 con 0x55a8e47f17a0 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f877596a640 1 --2- 172.21.15.131:0/1761960165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48e66b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8768001e90 tx=0x7f876800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dc40b11ec809cb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f8663e07640 1 -- 172.21.15.131:0/1761960165 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876800e5c0 con 0x55a8e47f17a0 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f8663e07640 1 -- 172.21.15.131:0/1761960165 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8768006070 con 0x55a8e47f17a0 2024-04-24T01:44:48.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.908+0000 7f8663e07640 1 -- 172.21.15.131:0/1761960165 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876800e890 con 0x55a8e47f17a0 2024-04-24T01:44:48.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 -- 172.21.15.131:0/1761960165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 msgr2=0x55a8e48e66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 --2- 172.21.15.131:0/1761960165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48e66b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8768001e90 tx=0x7f876800b6c0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 -- 172.21.15.131:0/1761960165 shutdown_connections 2024-04-24T01:44:48.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 --2- 172.21.15.131:0/1761960165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48e66b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 -- 172.21.15.131:0/1761960165 >> 172.21.15.131:0/1761960165 conn(0x55a8e47ed320 msgr2=0x55a8e48e1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 -- 172.21.15.131:0/1761960165 shutdown_connections 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 -- 172.21.15.131:0/1761960165 wait complete. 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 Processor -- start 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 -- start start 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48ee220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877a211800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a8e47fe600 con 0x55a8e47f17a0 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877596a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877596a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48ee220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52626/0 (socket says 172.21.15.131:52626) 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.909+0000 7f877596a640 1 -- 172.21.15.131:0/1365814586 learned_addr learned my addr 172.21.15.131:0/1365814586 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.910+0000 7f877596a640 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e48ee760 con 0x55a8e47f17a0 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.910+0000 7f877596a640 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48ee220 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8768001ed0 tx=0x7f8768000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.910+0000 7f8662604640 1 -- 172.21.15.131:0/1365814586 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876801a880 con 0x55a8e47f17a0 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.910+0000 7f8662604640 1 -- 172.21.15.131:0/1365814586 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876801aa20 con 0x55a8e47f17a0 2024-04-24T01:44:48.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.910+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8e48ee9f0 con 0x55a8e47f17a0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.910+0000 7f8662604640 1 -- 172.21.15.131:0/1365814586 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876801ad40 con 0x55a8e47f17a0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.910+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8e48f16a0 con 0x55a8e47f17a0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f8662604640 1 -- 172.21.15.131:0/1365814586 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8768017070 con 0x55a8e47f17a0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f8662604640 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f865c036900 0x7f865c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f8662604640 1 -- 172.21.15.131:0/1365814586 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8768015020 con 0x55a8e47f17a0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f8775169640 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f865c036900 0x7f865c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f877a211800 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e47f32e0 0x55a8e48f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e48f59e0 con 0x55a8e47f32e0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f877616b640 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e47f32e0 0x55a8e48f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f8775169640 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f865c036900 0x7f865c038dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f876c054000 tx=0x7f876c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.911+0000 7f877616b640 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e47f32e0 0x55a8e48f5460 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.912+0000 7f877616b640 1 -- 172.21.15.131:0/1365814586 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f877000a4a0 con 0x55a8e47f32e0 2024-04-24T01:44:48.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.912+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e48f2a30 con 0x55a8e47f32e0 2024-04-24T01:44:48.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.912+0000 7f877616b640 1 -- 172.21.15.131:0/1365814586 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f877000a4a0 con 0x55a8e47f32e0 2024-04-24T01:44:48.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.912+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e48f7820 con 0x55a8e47f32e0 2024-04-24T01:44:48.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.912+0000 7f877616b640 1 -- 172.21.15.131:0/1365814586 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f877000a4a0 con 0x55a8e47f32e0 2024-04-24T01:44:48.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.912+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e48f6b60 con 0x55a8e47f32e0 2024-04-24T01:44:48.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.913+0000 7f877616b640 1 -- 172.21.15.131:0/1365814586 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f877000a4a0 con 0x55a8e47f32e0 2024-04-24T01:44:48.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.913+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e48f6f80 con 0x55a8e47f32e0 2024-04-24T01:44:48.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.913+0000 7f877616b640 1 -- 172.21.15.131:0/1365814586 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f877000a4a0 con 0x55a8e47f32e0 2024-04-24T01:44:48.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.913+0000 7f877a211800 1 Processor -- start 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.913+0000 7f877a211800 1 -- start start 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.913+0000 7f877a211800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e4906630 0x55a8e4906a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.913+0000 7f877a211800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a8e46e46b0 con 0x55a8e4906630 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f8775169640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e4906630 0x55a8e4906a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f8775169640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e4906630 0x55a8e4906a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52632/0 (socket says 172.21.15.131:52632) 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f8775169640 1 -- 172.21.15.131:0/1625973039 learned_addr learned my addr 172.21.15.131:0/1625973039 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f8775169640 1 -- 172.21.15.131:0/1625973039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e4906f90 con 0x55a8e4906630 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f8775169640 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e4906630 0x55a8e4906a50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f876c000c00 tx=0x7f876c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f865b7fe640 1 -- 172.21.15.131:0/1625973039 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c057040 con 0x55a8e4906630 2024-04-24T01:44:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f865b7fe640 1 -- 172.21.15.131:0/1625973039 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c06d070 con 0x55a8e4906630 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8e4907a00 con 0x55a8e4906630 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f865b7fe640 1 -- 172.21.15.131:0/1625973039 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c05d6b0 con 0x55a8e4906630 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.914+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8e4907ea0 con 0x55a8e4906630 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.915+0000 7f865b7fe640 1 -- 172.21.15.131:0/1625973039 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f876c067070 con 0x55a8e4906630 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.915+0000 7f865b7fe640 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8650036900 0x7f8650038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.915+0000 7f865b7fe640 1 -- 172.21.15.131:0/1625973039 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f876c08f710 con 0x55a8e4906630 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.915+0000 7f877616b640 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8650036900 0x7f8650038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.915+0000 7f877a211800 1 Processor -- start 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f877a211800 1 -- start start 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f877616b640 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8650036900 0x7f8650038dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55a8e48f6f00 tx=0x7f8770005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f877a211800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e4913cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f877a211800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a8e48e7000 con 0x55a8e49138b0 2024-04-24T01:44:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f8775169640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e4913cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f8775169640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e4913cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52644/0 (socket says 172.21.15.131:52644) 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f8775169640 1 -- 172.21.15.131:0/506818425 learned_addr learned my addr 172.21.15.131:0/506818425 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f8775169640 1 -- 172.21.15.131:0/506818425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e49142a0 con 0x55a8e49138b0 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f8775169640 1 --2- 172.21.15.131:0/506818425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e4913cd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f876c08daa0 tx=0x7f876c067ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7fa3b863af79f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f86597fa640 1 -- 172.21.15.131:0/506818425 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c080070 con 0x55a8e49138b0 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f86597fa640 1 -- 172.21.15.131:0/506818425 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c067360 con 0x55a8e49138b0 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.916+0000 7f86597fa640 1 -- 172.21.15.131:0/506818425 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c08b030 con 0x55a8e49138b0 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 -- 172.21.15.131:0/506818425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 msgr2=0x55a8e4913cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 --2- 172.21.15.131:0/506818425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e4913cd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f876c08daa0 tx=0x7f876c067ef0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 -- 172.21.15.131:0/506818425 shutdown_connections 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 --2- 172.21.15.131:0/506818425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e4913cd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 -- 172.21.15.131:0/506818425 >> 172.21.15.131:0/506818425 conn(0x55a8e490fc10 msgr2=0x55a8e490dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 -- 172.21.15.131:0/506818425 shutdown_connections 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 -- 172.21.15.131:0/506818425 wait complete. 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 Processor -- start 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 -- start start 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e491af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.917+0000 7f877a211800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a8e4914a10 con 0x55a8e49138b0 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f8775169640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e491af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f8775169640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e491af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52656/0 (socket says 172.21.15.131:52656) 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 learned_addr learned my addr 172.21.15.131:0/1108222651 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e491b490 con 0x55a8e49138b0 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f8775169640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e491af50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f876c055040 tx=0x7f876c08da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f86477fe640 1 -- 172.21.15.131:0/1108222651 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c080040 con 0x55a8e49138b0 2024-04-24T01:44:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f86477fe640 1 -- 172.21.15.131:0/1108222651 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c094070 con 0x55a8e49138b0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8e491b720 con 0x55a8e49138b0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f86477fe640 1 -- 172.21.15.131:0/1108222651 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876c08f4c0 con 0x55a8e49138b0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.918+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8e491e3d0 con 0x55a8e49138b0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.919+0000 7f86477fe640 1 -- 172.21.15.131:0/1108222651 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f876c08fa60 con 0x55a8e49138b0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.919+0000 7f86477fe640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8640036900 0x7f8640038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.919+0000 7f86477fe640 1 -- 172.21.15.131:0/1108222651 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f876c0740b0 con 0x55a8e49138b0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.919+0000 7f877616b640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8640036900 0x7f8640038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.919+0000 7f877616b640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8640036900 0x7f8640038dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55a8e48f6680 tx=0x7f877001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.919+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e4926a20 0x55a8e4928ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4929630 con 0x55a8e4926a20 2024-04-24T01:44:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877596a640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e4926a20 0x55a8e4928ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877596a640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e4926a20 0x55a8e4928ee0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 20 realm 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4929a40 con 0x55a8e4926a20 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.920+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492a310 con 0x55a8e4926a20 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492a6b0 con 0x55a8e4926a20 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492af00 con 0x55a8e4926a20 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 20 searching for the correct realm 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a8e492cc70 0x55a8e492f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f8775169640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a8e492cc70 0x55a8e492f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.921+0000 7f8775169640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a8e492cc70 0x55a8e492f060 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f8775169640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f876c068c20 0x7f876c099460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f876c068c20 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f877616b640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f876c068c20 0x7f876c099460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f877616b640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f876c068c20 0x7f876c099460 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f877001f070 con 0x7f876c068c20 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f877616b640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8770031040 0x7f8770032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.922+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.923+0000 7f877596a640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8770031040 0x7f8770032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.923+0000 7f877596a640 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8770031040 0x7f8770032940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.923+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.923+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.923+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f876c068c20 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f877001f070 con 0x7f876c068c20 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.924+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.925+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f876c068c20 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f877001f070 con 0x7f876c068c20 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.926+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.927+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.928+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.928+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.928+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.928+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f876c068c20 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.928+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f877001f070 con 0x7f876c068c20 2024-04-24T01:44:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.928+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f876c068c20 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f877001f070 con 0x7f876c068c20 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.929+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f876c068c20 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f877001f070 con 0x7f876c068c20 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e492cc70 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f8770031040 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x55a8e4926a20 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492f670 con 0x7f876c068c20 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.930+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492b850 con 0x55a8e4926a20 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492c0f0 con 0x55a8e4926a20 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492c0f0 con 0x55a8e4926a20 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 zone default found 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 4 Realm: () 2024-04-24T01:44:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 zonegroup default 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e492fad0 con 0x7f876c068c20 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.931+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4931850 con 0x55a8e492cc70 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4931d50 con 0x55a8e492cc70 2024-04-24T01:44:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 20 started sync module instance, tier type = 2024-04-24T01:44:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.932+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4930cf0 con 0x7f876c068c20 2024-04-24T01:44:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.933+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.933+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94183877710352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4930cf0 con 0x7f876c068c20 2024-04-24T01:44:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.933+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4932810 con 0x55a8e4926a20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.934+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94183877710352] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.935+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.935+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94183877714720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4930cf0 con 0x55a8e4926a20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.935+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4933280 con 0x55a8e492cc70 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.936+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.936+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94183877717360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4933b50 con 0x55a8e492cc70 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.936+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4934610 con 0x7f876c068c20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.936+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94183877714720] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.937+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94183877717360] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.937+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.937+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94183877719712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4930840 con 0x7f876c068c20 2024-04-24T01:44:48.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.937+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4934ee0 con 0x55a8e4926a20 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.938+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.938+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94183877724720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4934e90 con 0x55a8e4926a20 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.938+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4935e90 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.938+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94183877719712] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.939+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.939+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94183877722432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4935e50 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.939+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94183877724720] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.939+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e49363f0 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.940+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94183877722432] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.940+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.940+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94183877726928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4935e50 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.940+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4936cb0 con 0x7f8770031040 2024-04-24T01:44:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94183877726928] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94183877728672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4935dc0 con 0x7f8770031040 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 20 add_watcher() i=0 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 20 add_watcher() i=1 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 20 add_watcher() i=2 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 20 add_watcher() i=3 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 20 add_watcher() i=4 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 20 add_watcher() i=5 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.941+0000 7f877a211800 20 add_watcher() i=6 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.942+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94183877728672] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.942+0000 7f877a211800 20 add_watcher() i=7 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.942+0000 7f877a211800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:48.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.942+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e493a190 con 0x55a8e4926a20 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.942+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.943+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94183877733552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4937690 con 0x55a8e4926a20 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94183877733552] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f86277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 5 note: GC not initialized 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f86267fc640 20 reqs_thread_entry: start 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 20 Filter name: none 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f8597fff640 20 reqs_thread_entry: start 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 20 rados->read ofs=0 len=0 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.944+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e496d4e0 con 0x7f8770031040 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.945+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.945+0000 7f877a211800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.945+0000 7f877a211800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.945+0000 7f877a211800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.945+0000 7f877a211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.945+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4973af0 con 0x7f8770031040 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f877a211800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f877a211800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f877a211800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94183877981536 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8e496f200 con 0x55a8e4926a20 2024-04-24T01:44:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94183877724720 notify 146028888096 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f8768038040 con 0x55a8e4926a20 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f86597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94183877724720 notifier 4898 bl.length()=666 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f86597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f86597fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 94183877981536 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.946+0000 7f86597fa640 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8638003ea0 con 0x55a8e4926a20 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.947+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.947+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 94183877981536 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a8e48f16a0 con 0x55a8e4926a20 2024-04-24T01:44:48.960 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.948+0000 7f86277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.948+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94183877733552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e496bbe0 con 0x55a8e4926a20 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.949+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94183877733552] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.949+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94183877710352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4936cb0 con 0x7f876c068c20 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.950+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94183877710352] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.950+0000 7f877a211800 20 remove_watcher() i=0 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.950+0000 7f877a211800 2 removed watcher, disabling cache 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.950+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94183877714720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4936cb0 con 0x55a8e4926a20 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.951+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94183877714720] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.951+0000 7f877a211800 20 remove_watcher() i=1 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.951+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94183877717360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4936cb0 con 0x55a8e492cc70 2024-04-24T01:44:48.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.952+0000 7f8775169640 1 -- 172.21.15.131:0/1108222651 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94183877717360] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c083040 con 0x55a8e492cc70 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.952+0000 7f877a211800 20 remove_watcher() i=2 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.952+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94183877719712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4932320 con 0x7f876c068c20 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.953+0000 7f877616b640 1 -- 172.21.15.131:0/1108222651 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94183877719712] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8770040040 con 0x7f876c068c20 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.953+0000 7f877a211800 20 remove_watcher() i=3 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.953+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94183877724720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4932320 con 0x55a8e4926a20 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.954+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94183877724720] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x55a8e4926a20 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.954+0000 7f877a211800 20 remove_watcher() i=4 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.954+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94183877722432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4932320 con 0x7f8770031040 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.955+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94183877722432] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.955+0000 7f877a211800 20 remove_watcher() i=5 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.955+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94183877726928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4934140 con 0x7f8770031040 2024-04-24T01:44:48.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.956+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94183877726928] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.956+0000 7f877a211800 20 remove_watcher() i=6 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.956+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94183877728672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a8e4932320 con 0x7f8770031040 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94183877728672] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876802e070 con 0x7f8770031040 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 20 remove_watcher() i=7 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8770031040 msgr2=0x7f8770032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f8770031040 0x7f8770032940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e4926a20 msgr2=0x55a8e4928ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e4926a20 0x55a8e4928ee0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f876c068c20 msgr2=0x7f876c099460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f876c068c20 0x7f876c099460 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a8e492cc70 msgr2=0x55a8e492f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55a8e492cc70 0x55a8e492f060 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8640036900 msgr2=0x7f8640038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8640036900 0x7f8640038dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55a8e48f6680 tx=0x7f877001f000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 msgr2=0x55a8e491af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e491af50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f876c055040 tx=0x7f876c08da00 comp rx=0 tx=0).stop 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877596a640 1 -- 172.21.15.131:0/1108222651 reap_dead start 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 shutdown_connections 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 --2- 172.21.15.131:0/1108222651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e49138b0 0x55a8e491af50 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 >> 172.21.15.131:0/1108222651 conn(0x55a8e490fc10 msgr2=0x55a8e490d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 shutdown_connections 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.957+0000 7f877a211800 1 -- 172.21.15.131:0/1108222651 wait complete. 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8650036900 msgr2=0x7f8650038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8650036900 0x7f8650038dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55a8e48f6f00 tx=0x7f8770005840 comp rx=0 tx=0).stop 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e4906630 msgr2=0x55a8e4906a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e4906630 0x55a8e4906a50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f876c000c00 tx=0x7f876c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 shutdown_connections 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8650036900 0x7f8650038dc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1625973039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e4906630 0x55a8e4906a50 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 >> 172.21.15.131:0/1625973039 conn(0x55a8e48fa6d0 msgr2=0x55a8e48faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 shutdown_connections 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1625973039 wait complete. 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e47f32e0 msgr2=0x55a8e48f5460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e47f32e0 0x55a8e48f5460 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f865c036900 msgr2=0x7f865c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f865c036900 0x7f865c038dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f876c054000 tx=0x7f876c04e000 comp rx=0 tx=0).stop 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 msgr2=0x55a8e48ee220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48ee220 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8768001ed0 tx=0x7f8768000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 shutdown_connections 2024-04-24T01:44:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55a8e47f32e0 0x55a8e48f5460 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f865c036900 0x7f865c038dc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 --2- 172.21.15.131:0/1365814586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8e47f17a0 0x55a8e48ee220 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 >> 172.21.15.131:0/1365814586 conn(0x55a8e47ed320 msgr2=0x55a8e48e07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 shutdown_connections 2024-04-24T01:44:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:48.958+0000 7f877a211800 1 -- 172.21.15.131:0/1365814586 wait complete. 2024-04-24T01:44:48.972 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.972 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:48.972 ERROR:root:0 2024-04-24T01:44:48.972 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:48.977 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000010448687c4a6cda6-0066286410-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:44:48.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:44:48.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:44:48.977 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-04-24T01:44:49.023 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:49.024 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59613f800 1 Processor -- start 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59613f800 1 -- start start 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59613f800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558858760210 0x558858762600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59613f800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55885861bd40 con 0x55885875bd80 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59613f800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5588585ee4d0 con 0x558858760210 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59169a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558858760210 0x558858762600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59169a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558858760210 0x558858762600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52660/0 (socket says 172.21.15.131:52660) 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe591e9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55885875bd80 0x55885875c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39132/0 (socket says 172.21.15.131:39132) 2024-04-24T01:44:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.024+0000 7fe59169a640 1 -- 172.21.15.131:0/1002960655 learned_addr learned my addr 172.21.15.131:0/1002960655 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.025+0000 7fe59169a640 1 -- 172.21.15.131:0/1002960655 >> v1:172.21.15.107:6789/0 conn(0x55885875bd80 legacy=0x55885875c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.025+0000 7fe59169a640 1 -- 172.21.15.131:0/1002960655 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55885861a590 con 0x558858760210 2024-04-24T01:44:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.026+0000 7fe59169a640 1 --2- 172.21.15.131:0/1002960655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858760210 0x558858762600 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe58800a520 tx=0x7fe58801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269457378f83476a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe590e99640 1 -- 172.21.15.131:0/1002960655 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe588057070 con 0x558858760210 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe590e99640 1 -- 172.21.15.131:0/1002960655 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588052570 con 0x558858760210 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe590e99640 1 -- 172.21.15.131:0/1002960655 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58804ae60 con 0x558858760210 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe59613f800 1 -- 172.21.15.131:0/1002960655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858760210 msgr2=0x558858762600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe59613f800 1 --2- 172.21.15.131:0/1002960655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858760210 0x558858762600 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe58800a520 tx=0x7fe58801d010 comp rx=0 tx=0).stop 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe59613f800 1 -- 172.21.15.131:0/1002960655 shutdown_connections 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe59613f800 1 --2- 172.21.15.131:0/1002960655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858760210 0x558858762600 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe59613f800 1 -- 172.21.15.131:0/1002960655 >> 172.21.15.131:0/1002960655 conn(0x558858757320 msgr2=0x558858759740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe59613f800 1 -- 172.21.15.131:0/1002960655 shutdown_connections 2024-04-24T01:44:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.027+0000 7fe59613f800 1 -- 172.21.15.131:0/1002960655 wait complete. 2024-04-24T01:44:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.039+0000 7fe59613f800 1 Processor -- start 2024-04-24T01:44:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.039+0000 7fe59613f800 1 -- start start 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.039+0000 7fe59613f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x5588586d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.039+0000 7fe59613f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5588586a83b0 con 0x55885875bd80 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.039+0000 7fe591e9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x5588586d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.039+0000 7fe591e9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x5588586d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52670/0 (socket says 172.21.15.131:52670) 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.039+0000 7fe591e9b640 1 -- 172.21.15.131:0/2870293651 learned_addr learned my addr 172.21.15.131:0/2870293651 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.040+0000 7fe591e9b640 1 -- 172.21.15.131:0/2870293651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558858850ec0 con 0x55885875bd80 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.040+0000 7fe591e9b640 1 --2- 172.21.15.131:0/2870293651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x5588586d08a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe58400b230 tx=0x7fe58400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fce67f23114e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.040+0000 7fe47fe07640 1 -- 172.21.15.131:0/2870293651 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58400e5c0 con 0x55885875bd80 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.040+0000 7fe47fe07640 1 -- 172.21.15.131:0/2870293651 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584006070 con 0x55885875bd80 2024-04-24T01:44:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.040+0000 7fe47fe07640 1 -- 172.21.15.131:0/2870293651 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58400e890 con 0x55885875bd80 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 -- 172.21.15.131:0/2870293651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 msgr2=0x5588586d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 --2- 172.21.15.131:0/2870293651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x5588586d08a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe58400b230 tx=0x7fe58400b6f0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 -- 172.21.15.131:0/2870293651 shutdown_connections 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 --2- 172.21.15.131:0/2870293651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x5588586d08a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 -- 172.21.15.131:0/2870293651 >> 172.21.15.131:0/2870293651 conn(0x558858757320 msgr2=0x5588588489b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 -- 172.21.15.131:0/2870293651 shutdown_connections 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 -- 172.21.15.131:0/2870293651 wait complete. 2024-04-24T01:44:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 Processor -- start 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 -- start start 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x55885884e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe59613f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558858762ed0 con 0x55885875bd80 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe591e9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x55885884e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe591e9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x55885884e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52682/0 (socket says 172.21.15.131:52682) 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.041+0000 7fe591e9b640 1 -- 172.21.15.131:0/2176368221 learned_addr learned my addr 172.21.15.131:0/2176368221 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.042+0000 7fe591e9b640 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55885884cee0 con 0x55885875bd80 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.042+0000 7fe591e9b640 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x55885884e7f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe584000fd0 tx=0x7fe584000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.042+0000 7fe47e604640 1 -- 172.21.15.131:0/2176368221 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58400f8d0 con 0x55885875bd80 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.042+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55885884d170 con 0x55885875bd80 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.042+0000 7fe47e604640 1 -- 172.21.15.131:0/2176368221 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58400fa90 con 0x55885875bd80 2024-04-24T01:44:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.042+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55885884d690 con 0x55885875bd80 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.042+0000 7fe47e604640 1 -- 172.21.15.131:0/2176368221 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58402c060 con 0x55885875bd80 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe47e604640 1 -- 172.21.15.131:0/2176368221 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe584017070 con 0x55885875bd80 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe47e604640 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe478036900 0x7fe478038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe47e604640 1 -- 172.21.15.131:0/2176368221 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe584015020 con 0x55885875bd80 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe59169a640 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe478036900 0x7fe478038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe59613f800 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558858760210 0x55885885f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55885885f6d0 con 0x558858760210 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe59269c640 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558858760210 0x55885885f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.043+0000 7fe59169a640 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe478036900 0x7fe478038dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe588054000 tx=0x7fe58804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.044+0000 7fe59269c640 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558858760210 0x55885885f100 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.044+0000 7fe59269c640 1 -- 172.21.15.131:0/2176368221 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558858760210 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.044+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55885885ff90 con 0x558858760210 2024-04-24T01:44:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.044+0000 7fe59269c640 1 -- 172.21.15.131:0/2176368221 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558858760210 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.044+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858861380 con 0x558858760210 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.044+0000 7fe59269c640 1 -- 172.21.15.131:0/2176368221 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558858760210 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.044+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588588607e0 con 0x558858760210 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.045+0000 7fe59269c640 1 -- 172.21.15.131:0/2176368221 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558858760210 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.045+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858860c30 con 0x558858760210 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.045+0000 7fe59269c640 1 -- 172.21.15.131:0/2176368221 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558858760210 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.045+0000 7fe59613f800 1 Processor -- start 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.045+0000 7fe59613f800 1 -- start start 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.045+0000 7fe59613f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858870480 0x5588588708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.045+0000 7fe59613f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55885884ed30 con 0x558858870480 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe59169a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858870480 0x5588588708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe59169a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858870480 0x5588588708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52688/0 (socket says 172.21.15.131:52688) 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe59169a640 1 -- 172.21.15.131:0/3937127288 learned_addr learned my addr 172.21.15.131:0/3937127288 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe59169a640 1 -- 172.21.15.131:0/3937127288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558858870de0 con 0x558858870480 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe59169a640 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858870480 0x5588588708a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe588002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe4777fe640 1 -- 172.21.15.131:0/3937127288 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe588057040 con 0x558858870480 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe4777fe640 1 -- 172.21.15.131:0/3937127288 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58805d650 con 0x558858870480 2024-04-24T01:44:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.046+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558858871850 con 0x558858870480 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.047+0000 7fe4777fe640 1 -- 172.21.15.131:0/3937127288 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58805d930 con 0x558858870480 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.047+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558858871cf0 con 0x558858870480 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.047+0000 7fe4777fe640 1 -- 172.21.15.131:0/3937127288 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe588067070 con 0x558858870480 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.047+0000 7fe4777fe640 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe46c036900 0x7fe46c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.047+0000 7fe4777fe640 1 -- 172.21.15.131:0/3937127288 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe58808f7e0 con 0x558858870480 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59269c640 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe46c036900 0x7fe46c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59613f800 1 Processor -- start 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59613f800 1 -- start start 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59269c640 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe46c036900 0x7fe46c038dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55885884dca0 tx=0x7fe58c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59613f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x55885887dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59613f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55885864e6b0 con 0x55885887d6c0 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59169a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x55885887dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59169a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x55885887dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52694/0 (socket says 172.21.15.131:52694) 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59169a640 1 -- 172.21.15.131:0/1466430954 learned_addr learned my addr 172.21.15.131:0/1466430954 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.048+0000 7fe59169a640 1 -- 172.21.15.131:0/1466430954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55885887e0b0 con 0x55885887d6c0 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59169a640 1 --2- 172.21.15.131:0/1466430954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x55885887dae0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe58808db70 tx=0x7fe588071a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aca9bc94c645e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe4757fa640 1 -- 172.21.15.131:0/1466430954 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe588000ed0 con 0x55885887d6c0 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe4757fa640 1 -- 172.21.15.131:0/1466430954 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588068c50 con 0x55885887d6c0 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe4757fa640 1 -- 172.21.15.131:0/1466430954 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe588001070 con 0x55885887d6c0 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 -- 172.21.15.131:0/1466430954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 msgr2=0x55885887dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 --2- 172.21.15.131:0/1466430954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x55885887dae0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe58808db70 tx=0x7fe588071a90 comp rx=0 tx=0).stop 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 -- 172.21.15.131:0/1466430954 shutdown_connections 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 --2- 172.21.15.131:0/1466430954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x55885887dae0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 -- 172.21.15.131:0/1466430954 >> 172.21.15.131:0/1466430954 conn(0x558858879a20 msgr2=0x558858877a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 -- 172.21.15.131:0/1466430954 shutdown_connections 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 -- 172.21.15.131:0/1466430954 wait complete. 2024-04-24T01:44:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.049+0000 7fe59613f800 1 Processor -- start 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59613f800 1 -- start start 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59613f800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x558858884bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59613f800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55885887e6a0 con 0x55885887d6c0 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59169a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x558858884bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59169a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x558858884bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52700/0 (socket says 172.21.15.131:52700) 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 learned_addr learned my addr 172.21.15.131:0/1971146748 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558858885100 con 0x55885887d6c0 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59169a640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x558858884bc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe58805cec0 tx=0x7fe58808dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe4637fe640 1 -- 172.21.15.131:0/1971146748 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe588068e00 con 0x55885887d6c0 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe4637fe640 1 -- 172.21.15.131:0/1971146748 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588093030 con 0x55885887d6c0 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe4637fe640 1 -- 172.21.15.131:0/1971146748 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58808c170 con 0x55885887d6c0 2024-04-24T01:44:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.050+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558858885390 con 0x55885887d6c0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.051+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558858888040 con 0x55885887d6c0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.051+0000 7fe4637fe640 1 -- 172.21.15.131:0/1971146748 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe58808c310 con 0x55885887d6c0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.051+0000 7fe4637fe640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe45c036950 0x7fe45c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.051+0000 7fe4637fe640 1 -- 172.21.15.131:0/1971146748 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe588099d10 con 0x55885887d6c0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.051+0000 7fe59269c640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe45c036950 0x7fe45c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59269c640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe45c036950 0x7fe45c038e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55885884dae0 tx=0x7fe58c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5588588906a0 0x558858892b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588588932b0 con 0x5588588906a0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe591e9b640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5588588906a0 0x558858892b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe591e9b640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5588588906a0 0x558858892b60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.070 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59613f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59613f800 20 realm 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.052+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588588936c0 con 0x5588588906a0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858893f90 con 0x5588588906a0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858894330 con 0x5588588906a0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858894b80 con 0x5588588906a0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 20 searching for the correct realm 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5588588968f0 0x558858898ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.053+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.054+0000 7fe59169a640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5588588968f0 0x558858898ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.054+0000 7fe59169a640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5588588968f0 0x558858898ce0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.054+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.054+0000 7fe59169a640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe588086050 0x7fe5880706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.054+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe588086050 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.054+0000 7fe59269c640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe588086050 0x7fe5880706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.054+0000 7fe59269c640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe588086050 0x7fe5880706a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.055+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c01f070 con 0x7fe588086050 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.055+0000 7fe59269c640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe58c031040 0x7fe58c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.055+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.055+0000 7fe591e9b640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe58c031040 0x7fe58c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.055+0000 7fe591e9b640 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe58c031040 0x7fe58c032940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.055+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x7fe58c031040 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.055+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x7fe58c031040 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x7fe58c031040 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.056+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe588086050 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c01f070 con 0x7fe588086050 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x7fe58c031040 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.057+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe588086050 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe58c01f070 con 0x7fe588086050 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58402e070 con 0x7fe58c031040 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.058+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe58402e070 con 0x5588588906a0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.059+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe588086050 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c01f070 con 0x7fe588086050 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.060+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe588086050 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c01f070 con 0x7fe588086050 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe588086050 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c01f070 con 0x7fe588086050 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.061+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588968f0 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe58c031040 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x5588588906a0 2024-04-24T01:44:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558858899310 con 0x7fe588086050 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.062+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588588954d0 con 0x5588588906a0 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858895d70 con 0x5588588906a0 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858895d70 con 0x5588588906a0 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 zone default found 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 4 Realm: () 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 zonegroup default 2024-04-24T01:44:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558858899790 con 0x7fe588086050 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.063+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55885889b510 con 0x5588588968f0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59613f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55885889ba10 con 0x5588588968f0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59613f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59613f800 20 started sync module instance, tier type = 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59613f800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.064+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889a9b0 con 0x7fe588086050 2024-04-24T01:44:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.065+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.065+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94044089331408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889a9b0 con 0x7fe588086050 2024-04-24T01:44:49.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.065+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889c500 con 0x5588588906a0 2024-04-24T01:44:49.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.066+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.066+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94044089335824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889c4b0 con 0x5588588906a0 2024-04-24T01:44:49.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.066+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889d4d0 con 0x5588588968f0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.066+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94044089331408] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.067+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.067+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94044089339808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889d8c0 con 0x5588588968f0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.067+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889e300 con 0x7fe588086050 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.068+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94044089335824] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.068+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94044089339808] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.068+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.068+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94044089328896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889c920 con 0x7fe588086050 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.068+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889ebe0 con 0x5588588906a0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.069+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.069+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94044089345776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889eb50 con 0x5588588906a0 2024-04-24T01:44:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.069+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889fbd0 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.070+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94044089328896] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.070+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.070+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94044089349792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889fb90 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.070+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a05e0 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.071+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94044089345776] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.071+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94044089349792] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.072+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.072+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94044089343440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a0130 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.072+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a0eb0 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.072+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94044089343440] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94044089348048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a0b40 con 0x7fe58c031040 2024-04-24T01:44:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 20 add_watcher() i=0 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 20 add_watcher() i=1 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 20 add_watcher() i=2 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 20 add_watcher() i=3 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 20 add_watcher() i=4 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 20 add_watcher() i=5 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.073+0000 7fe59613f800 20 add_watcher() i=6 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.074+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94044089348048] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.074+0000 7fe59613f800 20 add_watcher() i=7 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.074+0000 7fe59613f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.074+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588588a3de0 con 0x5588588906a0 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.075+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.075+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94044089354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a10d0 con 0x5588588906a0 2024-04-24T01:44:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94044089354240] v34'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe4437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 5 note: GC not initialized 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe4427fc640 20 reqs_thread_entry: start 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 20 Filter name: none 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe3b3fff640 20 reqs_thread_entry: start 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.076+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588588d71e0 con 0x7fe58c031040 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.077+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.077+0000 7fe59613f800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T01:44:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.077+0000 7fe59613f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.077+0000 7fe59613f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.077+0000 7fe59613f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.077+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588dd9c0 con 0x7fe58c031040 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.078+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.078+0000 7fe59613f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.078+0000 7fe59613f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.078+0000 7fe59613f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.078+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94044089603120 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588588d9050 con 0x5588588906a0 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94044089345776 notify 146028888097 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fe584053080 con 0x5588588906a0 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe4757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94044089345776 notifier 4905 bl.length()=636 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe4757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe4757fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 94044089603120 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe4757fa640 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe454003ea0 con 0x5588588906a0 2024-04-24T01:44:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.079+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 94044089603120 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe584037080 con 0x5588588906a0 2024-04-24T01:44:49.092 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.080+0000 7fe4437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.080+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94044089354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a3550 con 0x5588588906a0 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.081+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94044089354240] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.081+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94044089331408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a0800 con 0x7fe588086050 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.082+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94044089331408] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.082+0000 7fe59613f800 20 remove_watcher() i=0 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.082+0000 7fe59613f800 2 removed watcher, disabling cache 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.082+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94044089335824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a0800 con 0x5588588906a0 2024-04-24T01:44:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.083+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94044089335824] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.083+0000 7fe59613f800 20 remove_watcher() i=1 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.083+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94044089339808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588588a0800 con 0x5588588968f0 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.084+0000 7fe59169a640 1 -- 172.21.15.131:0/1971146748 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94044089339808] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe588066030 con 0x5588588968f0 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.084+0000 7fe59613f800 20 remove_watcher() i=2 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.084+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94044089328896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889cfa0 con 0x7fe588086050 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.085+0000 7fe59269c640 1 -- 172.21.15.131:0/1971146748 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94044089328896] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe588086050 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.085+0000 7fe59613f800 20 remove_watcher() i=3 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.085+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94044089345776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889cfa0 con 0x5588588906a0 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.086+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94044089345776] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x5588588906a0 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.086+0000 7fe59613f800 20 remove_watcher() i=4 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.086+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94044089349792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889e6f0 con 0x7fe58c031040 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.087+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94044089349792] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.087+0000 7fe59613f800 20 remove_watcher() i=5 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.087+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94044089343440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889cfa0 con 0x7fe58c031040 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.088+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94044089343440] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.088+0000 7fe59613f800 20 remove_watcher() i=6 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.088+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94044089348048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55885889f6a0 con 0x7fe58c031040 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94044089348048] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584055040 con 0x7fe58c031040 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 20 remove_watcher() i=7 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe58c031040 msgr2=0x7fe58c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fe58c031040 0x7fe58c032940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5588588906a0 msgr2=0x558858892b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5588588906a0 0x558858892b60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe588086050 msgr2=0x7fe5880706a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fe588086050 0x7fe5880706a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5588588968f0 msgr2=0x558858898ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5588588968f0 0x558858898ce0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe45c036950 msgr2=0x7fe45c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe45c036950 0x7fe45c038e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55885884dae0 tx=0x7fe58c01f000 comp rx=0 tx=0).stop 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 msgr2=0x558858884bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe591e9b640 1 -- 172.21.15.131:0/1971146748 reap_dead start 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x558858884bc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe58805cec0 tx=0x7fe58808dad0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 shutdown_connections 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/1971146748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885887d6c0 0x558858884bc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 >> 172.21.15.131:0/1971146748 conn(0x558858879a20 msgr2=0x558858877080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 shutdown_connections 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/1971146748 wait complete. 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe46c036900 msgr2=0x7fe46c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe46c036900 0x7fe46c038dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55885884dca0 tx=0x7fe58c005840 comp rx=0 tx=0).stop 2024-04-24T01:44:49.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858870480 msgr2=0x5588588708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858870480 0x5588588708a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe588002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 shutdown_connections 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe46c036900 0x7fe46c038dc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 --2- 172.21.15.131:0/3937127288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558858870480 0x5588588708a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.089+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 >> 172.21.15.131:0/3937127288 conn(0x558858864520 msgr2=0x558858864920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 shutdown_connections 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/3937127288 wait complete. 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558858760210 msgr2=0x55885885f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558858760210 0x55885885f100 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe478036900 msgr2=0x7fe478038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe478036900 0x7fe478038dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe588054000 tx=0x7fe58804e000 comp rx=0 tx=0).stop 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 msgr2=0x55885884e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x55885884e7f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe584000fd0 tx=0x7fe584000ed0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 shutdown_connections 2024-04-24T01:44:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x558858760210 0x55885885f100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe478036900 0x7fe478038dc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 --2- 172.21.15.131:0/2176368221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55885875bd80 0x55885884e7f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 >> 172.21.15.131:0/2176368221 conn(0x558858757320 msgr2=0x5588588471b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 shutdown_connections 2024-04-24T01:44:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.090+0000 7fe59613f800 1 -- 172.21.15.131:0/2176368221 wait complete. 2024-04-24T01:44:49.103 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:49.103 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:49.103 ERROR:root:0 2024-04-24T01:44:49.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:49.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:49.104 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T01:44:49.148 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:49.148 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb9a3726800 1 Processor -- start 2024-04-24T01:44:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb9a3726800 1 -- start start 2024-04-24T01:44:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb9a3726800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56001d298760 0x56001d298b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb9a3726800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56001d158d40 con 0x56001d2990c0 2024-04-24T01:44:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb9a3726800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x56001d12b4d0 con 0x56001d298760 2024-04-24T01:44:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb99f460640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56001d298760 0x56001d298b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb99ec5f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x56001d2990c0 0x56001d299570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:39146/0 (socket says 172.21.15.131:39146) 2024-04-24T01:44:49.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.148+0000 7fb99ec5f640 1 -- 172.21.15.131:0/2483040263 learned_addr learned my addr 172.21.15.131:0/2483040263 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:44:49.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.149+0000 7fb99f460640 1 -- 172.21.15.131:0/2483040263 >> v1:172.21.15.107:6789/0 conn(0x56001d2990c0 legacy=0x56001d299570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.149+0000 7fb99f460640 1 -- 172.21.15.131:0/2483040263 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001d157590 con 0x56001d298760 2024-04-24T01:44:49.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.150+0000 7fb99f460640 1 --2- 172.21.15.131:0/2483040263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d298b80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb99000a470 tx=0x7fb99001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bee75637902b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb99e45e640 1 -- 172.21.15.131:0/2483040263 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb990057070 con 0x56001d298760 2024-04-24T01:44:49.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb99e45e640 1 -- 172.21.15.131:0/2483040263 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99004adc0 con 0x56001d298760 2024-04-24T01:44:49.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb99e45e640 1 -- 172.21.15.131:0/2483040263 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb990052590 con 0x56001d298760 2024-04-24T01:44:49.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb9a3726800 1 -- 172.21.15.131:0/2483040263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 msgr2=0x56001d298b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb9a3726800 1 --2- 172.21.15.131:0/2483040263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d298b80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb99000a470 tx=0x7fb99001ce90 comp rx=0 tx=0).stop 2024-04-24T01:44:49.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb9a3726800 1 -- 172.21.15.131:0/2483040263 shutdown_connections 2024-04-24T01:44:49.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb9a3726800 1 --2- 172.21.15.131:0/2483040263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d298b80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb9a3726800 1 -- 172.21.15.131:0/2483040263 >> 172.21.15.131:0/2483040263 conn(0x56001d2943a0 msgr2=0x56001d2967c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb9a3726800 1 -- 172.21.15.131:0/2483040263 shutdown_connections 2024-04-24T01:44:49.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.151+0000 7fb9a3726800 1 -- 172.21.15.131:0/2483040263 wait complete. 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.163+0000 7fb9a3726800 1 Processor -- start 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.163+0000 7fb9a3726800 1 -- start start 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.163+0000 7fb9a3726800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d38d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.163+0000 7fb9a3726800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56001d1e53b0 con 0x56001d298760 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.163+0000 7fb99f460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d38d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.163+0000 7fb99f460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d38d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52724/0 (socket says 172.21.15.131:52724) 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.163+0000 7fb99f460640 1 -- 172.21.15.131:0/1461446541 learned_addr learned my addr 172.21.15.131:0/1461446541 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.164+0000 7fb99f460640 1 -- 172.21.15.131:0/1461446541 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001d38da40 con 0x56001d298760 2024-04-24T01:44:49.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.164+0000 7fb99f460640 1 --2- 172.21.15.131:0/1461446541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d38d470 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb990055040 tx=0x7fb99004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca159f0dfaa783d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.164+0000 7fb88d60a640 1 -- 172.21.15.131:0/1461446541 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb990057040 con 0x56001d298760 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.164+0000 7fb88d60a640 1 -- 172.21.15.131:0/1461446541 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990062070 con 0x56001d298760 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.164+0000 7fb88d60a640 1 -- 172.21.15.131:0/1461446541 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99005d470 con 0x56001d298760 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 -- 172.21.15.131:0/1461446541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 msgr2=0x56001d38d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 --2- 172.21.15.131:0/1461446541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d38d470 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb990055040 tx=0x7fb99004c000 comp rx=0 tx=0).stop 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 -- 172.21.15.131:0/1461446541 shutdown_connections 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 --2- 172.21.15.131:0/1461446541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d38d470 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 -- 172.21.15.131:0/1461446541 >> 172.21.15.131:0/1461446541 conn(0x56001d2943a0 msgr2=0x56001d388d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 -- 172.21.15.131:0/1461446541 shutdown_connections 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 -- 172.21.15.131:0/1461446541 wait complete. 2024-04-24T01:44:49.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 Processor -- start 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 -- start start 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d394ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb9a3726800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56001d299f20 con 0x56001d298760 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb99f460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d394ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb99f460640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d394ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52734/0 (socket says 172.21.15.131:52734) 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.165+0000 7fb99f460640 1 -- 172.21.15.131:0/4186497701 learned_addr learned my addr 172.21.15.131:0/4186497701 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.166+0000 7fb99f460640 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001d3953e0 con 0x56001d298760 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.166+0000 7fb99f460640 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d394ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb99005f040 tx=0x7fb990002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.166+0000 7fb88be07640 1 -- 172.21.15.131:0/4186497701 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99006b070 con 0x56001d298760 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.166+0000 7fb88be07640 1 -- 172.21.15.131:0/4186497701 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99005d9a0 con 0x56001d298760 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.166+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56001d395670 con 0x56001d298760 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.166+0000 7fb88be07640 1 -- 172.21.15.131:0/4186497701 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb990057070 con 0x56001d298760 2024-04-24T01:44:49.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.166+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56001d398320 con 0x56001d298760 2024-04-24T01:44:49.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb88be07640 1 -- 172.21.15.131:0/4186497701 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb99005dca0 con 0x56001d298760 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb88be07640 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb884036950 0x7fb884038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb88be07640 1 -- 172.21.15.131:0/4186497701 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb99008e300 con 0x56001d298760 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb884036950 0x7fb884038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb9a3726800 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d2990c0 0x56001d39c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d39c620 con 0x56001d2990c0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb99fc61640 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d2990c0 0x56001d39c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.167+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb884036950 0x7fb884038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb994000f60 tx=0x7fb9940012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.168+0000 7fb99fc61640 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d2990c0 0x56001d39c0e0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.168+0000 7fb99fc61640 1 -- 172.21.15.131:0/4186497701 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99800a4a0 con 0x56001d2990c0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.168+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3996b0 con 0x56001d2990c0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.168+0000 7fb99fc61640 1 -- 172.21.15.131:0/4186497701 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb99800a4a0 con 0x56001d2990c0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.168+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d39e470 con 0x56001d2990c0 2024-04-24T01:44:49.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.168+0000 7fb99fc61640 1 -- 172.21.15.131:0/4186497701 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb99800a4a0 con 0x56001d2990c0 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.168+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d39d7b0 con 0x56001d2990c0 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.169+0000 7fb99fc61640 1 -- 172.21.15.131:0/4186497701 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb99800a4a0 con 0x56001d2990c0 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.169+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d39dc00 con 0x56001d2990c0 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.169+0000 7fb99fc61640 1 -- 172.21.15.131:0/4186497701 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb99800a4a0 con 0x56001d2990c0 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.169+0000 7fb9a3726800 1 Processor -- start 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.169+0000 7fb9a3726800 1 -- start start 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.169+0000 7fb9a3726800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ad240 0x56001d3ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.169+0000 7fb9a3726800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56001d18b6b0 con 0x56001d3ad240 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb99ec5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ad240 0x56001d3ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb99ec5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ad240 0x56001d3ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52738/0 (socket says 172.21.15.131:52738) 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb99ec5f640 1 -- 172.21.15.131:0/2503122009 learned_addr learned my addr 172.21.15.131:0/2503122009 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb99ec5f640 1 -- 172.21.15.131:0/2503122009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001d3adba0 con 0x56001d3ad240 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ad240 0x56001d3ad660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb994001ed0 tx=0x7fb99400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb889602640 1 -- 172.21.15.131:0/2503122009 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99401b550 con 0x56001d3ad240 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb889602640 1 -- 172.21.15.131:0/2503122009 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99401b6f0 con 0x56001d3ad240 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb889602640 1 -- 172.21.15.131:0/2503122009 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99401b9d0 con 0x56001d3ad240 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56001d3ae610 con 0x56001d3ad240 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.170+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56001d3aeb10 con 0x56001d3ad240 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.171+0000 7fb889602640 1 -- 172.21.15.131:0/2503122009 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb994023020 con 0x56001d3ad240 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.171+0000 7fb889602640 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb878036900 0x7fb878038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.171+0000 7fb889602640 1 -- 172.21.15.131:0/2503122009 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb994021020 con 0x56001d3ad240 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.171+0000 7fb99fc61640 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb878036900 0x7fb878038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb9a3726800 1 Processor -- start 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb9a3726800 1 -- start start 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb99fc61640 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb878036900 0x7fb878038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56001d39d2d0 tx=0x7fb998005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb9a3726800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb9a3726800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56001d38dd00 con 0x56001d3ba580 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb99ec5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb99ec5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3ba9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52748/0 (socket says 172.21.15.131:52748) 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb99ec5f640 1 -- 172.21.15.131:0/671854460 learned_addr learned my addr 172.21.15.131:0/671854460 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb99ec5f640 1 -- 172.21.15.131:0/671854460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001d3baf70 con 0x56001d3ba580 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/671854460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3ba9a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb99404ce90 tx=0x7fb9940468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57da7112ad02c935 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb882ffd640 1 -- 172.21.15.131:0/671854460 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb99401be20 con 0x56001d3ba580 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb882ffd640 1 -- 172.21.15.131:0/671854460 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99404a070 con 0x56001d3ba580 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.172+0000 7fb882ffd640 1 -- 172.21.15.131:0/671854460 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb994024e10 con 0x56001d3ba580 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 -- 172.21.15.131:0/671854460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 msgr2=0x56001d3ba9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 --2- 172.21.15.131:0/671854460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3ba9a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb99404ce90 tx=0x7fb9940468f0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 -- 172.21.15.131:0/671854460 shutdown_connections 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 --2- 172.21.15.131:0/671854460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3ba9a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 -- 172.21.15.131:0/671854460 >> 172.21.15.131:0/671854460 conn(0x56001d3b68e0 msgr2=0x56001d3b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 -- 172.21.15.131:0/671854460 shutdown_connections 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 -- 172.21.15.131:0/671854460 wait complete. 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 Processor -- start 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 -- start start 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.173+0000 7fb9a3726800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56001d3bb6e0 con 0x56001d3ba580 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb99ec5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb99ec5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52752/0 (socket says 172.21.15.131:52752) 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 learned_addr learned my addr 172.21.15.131:0/296343199 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001d3c2180 con 0x56001d3ba580 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3c1c40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb9940234d0 tx=0x7fb99404ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb8817fa640 1 -- 172.21.15.131:0/296343199 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb994034070 con 0x56001d3ba580 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb8817fa640 1 -- 172.21.15.131:0/296343199 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb994024e10 con 0x56001d3ba580 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56001d3c2410 con 0x56001d3ba580 2024-04-24T01:44:49.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb8817fa640 1 -- 172.21.15.131:0/296343199 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb994025ad0 con 0x56001d3ba580 2024-04-24T01:44:49.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.174+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56001d3c2410 con 0x56001d3ba580 2024-04-24T01:44:49.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.175+0000 7fb8817fa640 1 -- 172.21.15.131:0/296343199 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb99404ed10 con 0x56001d3ba580 2024-04-24T01:44:49.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.175+0000 7fb8817fa640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8680368b0 0x7fb868038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.175+0000 7fb8817fa640 1 -- 172.21.15.131:0/296343199 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb99403ad40 con 0x56001d3ba580 2024-04-24T01:44:49.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.175+0000 7fb99fc61640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8680368b0 0x7fb868038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb99fc61640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8680368b0 0x7fb868038d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x56001d399600 tx=0x7fb99801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d3cd5d0 0x56001d3cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d01e0 con 0x56001d3cd5d0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb99f460640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d3cd5d0 0x56001d3cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb99f460640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d3cd5d0 0x56001d3cfa90 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb9a3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb9a3726800 20 realm 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.176+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d05f0 con 0x56001d3cd5d0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d0ec0 con 0x56001d3cd5d0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d1260 con 0x56001d3cd5d0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d1ab0 con 0x56001d3cd5d0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 20 searching for the correct realm 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56001d3d3820 0x56001d3d5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.177+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56001d3d3820 0x56001d3d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.178+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56001d3d3820 0x56001d3d5c10 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.178+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.178+0000 7fb99ec5f640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb994039070 0x7fb994030440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.178+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb994039070 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.178+0000 7fb99fc61640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb994039070 0x7fb994030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.178+0000 7fb99fc61640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb994039070 0x7fb994030440 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.179+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99801f070 con 0x7fb994039070 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.179+0000 7fb99fc61640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb998031040 0x7fb998032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.179+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.179+0000 7fb99f460640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb998031040 0x7fb998032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.179+0000 7fb99f460640 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb998031040 0x7fb998032430 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.179+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.179+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.180+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb994039070 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99801f070 con 0x7fb994039070 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.181+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb994039070 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb99801f070 con 0x7fb994039070 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.182+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.183+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb994039070 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99801f070 con 0x7fb994039070 2024-04-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.184+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb994039070 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.185+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99801f070 con 0x7fb994039070 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.185+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.185+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.185+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.185+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.185+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb994039070 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99801f070 con 0x7fb994039070 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3d3820 2024-04-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb998031040 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x56001d3cd5d0 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.186+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6220 con 0x7fb994039070 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d2430 con 0x56001d3cd5d0 2024-04-24T01:44:49.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d2cd0 con 0x56001d3cd5d0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d2cd0 con 0x56001d3cd5d0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 zone default found 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 4 Realm: () 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 zonegroup default 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.187+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d6680 con 0x7fb994039070 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d2a40 con 0x56001d3d3820 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d8a20 con 0x56001d3d3820 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 20 started sync module instance, tier type = 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.188+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d7d40 con 0x7fb994039070 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.189+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.189+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94558490559040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d7d40 con 0x7fb994039070 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.189+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d94a0 con 0x56001d3cd5d0 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.190+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.190+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94558490559040] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.190+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94558490556560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d94a0 con 0x56001d3cd5d0 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.190+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d9e60 con 0x56001d3d3820 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.191+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94558490556560] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.192+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.192+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94558490562544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d9410 con 0x56001d3d3820 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.192+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dad20 con 0x7fb994039070 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.193+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94558490562544] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.193+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.193+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94558490568816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dac90 con 0x7fb994039070 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.193+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dbbe0 con 0x56001d3cd5d0 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.194+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.194+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94558490572592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dbb50 con 0x56001d3cd5d0 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.194+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dcb00 con 0x7fb998031040 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.194+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94558490568816] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.195+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.195+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94558490571024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dcad0 con 0x7fb998031040 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.195+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dd510 con 0x7fb998031040 2024-04-24T01:44:49.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.195+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94558490572592] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.196+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94558490571024] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.196+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.196+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94558490576416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dd060 con 0x7fb998031040 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.196+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3dd910 con 0x7fb998031040 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94558490576416] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94558490579040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3ddfc0 con 0x7fb998031040 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 20 add_watcher() i=0 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 20 add_watcher() i=1 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 20 add_watcher() i=2 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 20 add_watcher() i=3 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 20 add_watcher() i=4 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 20 add_watcher() i=5 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.197+0000 7fb9a3726800 20 add_watcher() i=6 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.198+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94558490579040] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.198+0000 7fb9a3726800 20 add_watcher() i=7 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.198+0000 7fb9a3726800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.198+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d3e0ec0 con 0x56001d3cd5d0 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.198+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.198+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94558490581472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3de2b0 con 0x56001d3cd5d0 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.199+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94558490581472] v34'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.199+0000 7fb855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.199+0000 7fb9a3726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.199+0000 7fb9a3726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb9a3726800 5 note: GC not initialized 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb854fe1640 20 reqs_thread_entry: start 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb9a3726800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb9a3726800 20 Filter name: none 2024-04-24T01:44:49.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb7ce7fc640 20 reqs_thread_entry: start 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb9a3726800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb9a3726800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.200+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d4140f0 con 0x7fb998031040 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.201+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.201+0000 7fb9a3726800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.201+0000 7fb9a3726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.201+0000 7fb9a3726800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.201+0000 7fb9a3726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.201+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d41a6d0 con 0x7fb998031040 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb9a3726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb9a3726800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb9a3726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94558490829120 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56001d415d60 con 0x56001d3cd5d0 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94558490572592 notify 146028888098 ret 0) ==== 691+0+0 (crc 0 0 0) 0x56001d398320 con 0x56001d3cd5d0 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 94558490829120 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb882ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94558490572592 notifier 4912 bl.length()=649 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb882ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb882ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb882ffd640 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb864003ea0 con 0x56001d3cd5d0 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.202+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.203+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== watch-notify(notify_complete (2) cookie 94558490829120 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56001d395670 con 0x56001d3cd5d0 2024-04-24T01:44:49.215 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:49.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.203+0000 7fb855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.203+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94558490581472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d416520 con 0x56001d3cd5d0 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.204+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94558490581472] v34'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.204+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94558490559040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d416520 con 0x7fb994039070 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.205+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94558490559040] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.205+0000 7fb9a3726800 20 remove_watcher() i=0 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.205+0000 7fb9a3726800 2 removed watcher, disabling cache 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.205+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94558490556560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d416520 con 0x56001d3cd5d0 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.207+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94558490556560] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.207+0000 7fb9a3726800 20 remove_watcher() i=1 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.207+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94558490562544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d416520 con 0x56001d3d3820 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.208+0000 7fb99ec5f640 1 -- 172.21.15.131:0/296343199 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94558490562544] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb994036030 con 0x56001d3d3820 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.208+0000 7fb9a3726800 20 remove_watcher() i=2 2024-04-24T01:44:49.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.208+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94558490568816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d7890 con 0x7fb994039070 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.209+0000 7fb99fc61640 1 -- 172.21.15.131:0/296343199 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94558490568816] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040040 con 0x7fb994039070 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.209+0000 7fb9a3726800 20 remove_watcher() i=3 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.209+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94558490572592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d8ff0 con 0x56001d3cd5d0 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.210+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94558490572592] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x56001d3cd5d0 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.210+0000 7fb9a3726800 20 remove_watcher() i=4 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.210+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94558490571024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3da870 con 0x7fb998031040 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.211+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94558490571024] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.211+0000 7fb9a3726800 20 remove_watcher() i=5 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.211+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94558490576416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3d7890 con 0x7fb998031040 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.212+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94558490576416] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.212+0000 7fb9a3726800 20 remove_watcher() i=6 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.212+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94558490579040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56001d3db730 con 0x7fb998031040 2024-04-24T01:44:49.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94558490579040] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb99005a040 con 0x7fb998031040 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 20 remove_watcher() i=7 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb998031040 msgr2=0x7fb998032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fb998031040 0x7fb998032430 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d3cd5d0 msgr2=0x56001d3cfa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d3cd5d0 0x56001d3cfa90 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb994039070 msgr2=0x7fb994030440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fb994039070 0x7fb994030440 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56001d3d3820 msgr2=0x56001d3d5c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x56001d3d3820 0x56001d3d5c10 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8680368b0 msgr2=0x7fb868038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb8680368b0 0x7fb868038d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x56001d399600 tx=0x7fb99801f000 comp rx=0 tx=0).stop 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 msgr2=0x56001d3c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb99f460640 1 -- 172.21.15.131:0/296343199 reap_dead start 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3c1c40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb9940234d0 tx=0x7fb99404ce20 comp rx=0 tx=0).stop 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 shutdown_connections 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/296343199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ba580 0x56001d3c1c40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 >> 172.21.15.131:0/296343199 conn(0x56001d3b68e0 msgr2=0x56001d3b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 shutdown_connections 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/296343199 wait complete. 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb878036900 msgr2=0x7fb878038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb878036900 0x7fb878038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56001d39d2d0 tx=0x7fb998005840 comp rx=0 tx=0).stop 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ad240 msgr2=0x56001d3ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ad240 0x56001d3ad660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb994001ed0 tx=0x7fb99400d7a0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 shutdown_connections 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb878036900 0x7fb878038dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 --2- 172.21.15.131:0/2503122009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d3ad240 0x56001d3ad660 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 >> 172.21.15.131:0/2503122009 conn(0x56001d3a12e0 msgr2=0x56001d3a16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 shutdown_connections 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.213+0000 7fb9a3726800 1 -- 172.21.15.131:0/2503122009 wait complete. 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d2990c0 msgr2=0x56001d39c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d2990c0 0x56001d39c0e0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb884036950 msgr2=0x7fb884038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb884036950 0x7fb884038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb994000f60 tx=0x7fb9940012b0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 msgr2=0x56001d394ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d394ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb99005f040 tx=0x7fb990002fb0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 shutdown_connections 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x56001d2990c0 0x56001d39c0e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb884036950 0x7fb884038e10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 --2- 172.21.15.131:0/4186497701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56001d298760 0x56001d394ea0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 >> 172.21.15.131:0/4186497701 conn(0x56001d2943a0 msgr2=0x56001d387650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 shutdown_connections 2024-04-24T01:44:49.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.214+0000 7fb9a3726800 1 -- 172.21.15.131:0/4186497701 wait complete. 2024-04-24T01:44:49.226 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:49.227 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:49.227 ERROR:root:0 2024-04-24T01:44:49.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:49.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:44:49.227 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T01:44:49.272 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:44:49.272 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:44:49.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb87c16800 1 Processor -- start 2024-04-24T01:44:49.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb87c16800 1 -- start start 2024-04-24T01:44:49.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb87c16800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b99b7e4d40 0x55b99b7e5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb87c16800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b99b6a4d40 con 0x55b99b7e5fa0 2024-04-24T01:44:49.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb87c16800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x55b99b6774d0 con 0x55b99b7e4d40 2024-04-24T01:44:49.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb83284640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b99b7e4d40 0x55b99b7e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb83284640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b99b7e4d40 0x55b99b7e5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52760/0 (socket says 172.21.15.131:52760) 2024-04-24T01:44:49.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.272+0000 7fcb83284640 1 -- 172.21.15.131:0/2322627677 learned_addr learned my addr 172.21.15.131:0/2322627677 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.273+0000 7fcb83284640 1 -- 172.21.15.131:0/2322627677 >> v1:172.21.15.107:6789/0 conn(0x55b99b7e5fa0 legacy=0x55b99b7e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.273+0000 7fcb83284640 1 -- 172.21.15.131:0/2322627677 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99b6a3590 con 0x55b99b7e4d40 2024-04-24T01:44:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.274+0000 7fcb83284640 1 --2- 172.21.15.131:0/2322627677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e4d40 0x55b99b7e5160 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400a520 tx=0x7fcb7401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61321750ba6a9ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.274+0000 7fcb82a83640 1 -- 172.21.15.131:0/2322627677 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb74057070 con 0x55b99b7e4d40 2024-04-24T01:44:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.274+0000 7fcb82a83640 1 -- 172.21.15.131:0/2322627677 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb74052570 con 0x55b99b7e4d40 2024-04-24T01:44:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.274+0000 7fcb82a83640 1 -- 172.21.15.131:0/2322627677 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7404ae60 con 0x55b99b7e4d40 2024-04-24T01:44:49.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.275+0000 7fcb87c16800 1 -- 172.21.15.131:0/2322627677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e4d40 msgr2=0x55b99b7e5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.275+0000 7fcb87c16800 1 --2- 172.21.15.131:0/2322627677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e4d40 0x55b99b7e5160 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400a520 tx=0x7fcb7401d010 comp rx=0 tx=0).stop 2024-04-24T01:44:49.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.275+0000 7fcb87c16800 1 -- 172.21.15.131:0/2322627677 shutdown_connections 2024-04-24T01:44:49.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.275+0000 7fcb87c16800 1 --2- 172.21.15.131:0/2322627677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e4d40 0x55b99b7e5160 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.275+0000 7fcb87c16800 1 -- 172.21.15.131:0/2322627677 >> 172.21.15.131:0/2322627677 conn(0x55b99b7e03a0 msgr2=0x55b99b7e27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.275+0000 7fcb87c16800 1 -- 172.21.15.131:0/2322627677 shutdown_connections 2024-04-24T01:44:49.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.275+0000 7fcb87c16800 1 -- 172.21.15.131:0/2322627677 wait complete. 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb87c16800 1 Processor -- start 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb87c16800 1 -- start start 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb87c16800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8d6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb87c16800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b99b7313b0 con 0x55b99b7e5fa0 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb83284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8d6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb83284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8d6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52766/0 (socket says 172.21.15.131:52766) 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb83284640 1 -- 172.21.15.131:0/1471143623 learned_addr learned my addr 172.21.15.131:0/1471143623 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb83284640 1 -- 172.21.15.131:0/1471143623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99b8d6bf0 con 0x55b99b7e5fa0 2024-04-24T01:44:49.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.287+0000 7fcb83284640 1 --2- 172.21.15.131:0/1471143623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8d6620 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcb74044940 tx=0x7fcb7404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3910683be65170 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fca7160a640 1 -- 172.21.15.131:0/1471143623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb74057040 con 0x55b99b7e5fa0 2024-04-24T01:44:49.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fca7160a640 1 -- 172.21.15.131:0/1471143623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb74052720 con 0x55b99b7e5fa0 2024-04-24T01:44:49.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fca7160a640 1 -- 172.21.15.131:0/1471143623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb74052a00 con 0x55b99b7e5fa0 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fcb87c16800 1 -- 172.21.15.131:0/1471143623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 msgr2=0x55b99b8d6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fcb87c16800 1 --2- 172.21.15.131:0/1471143623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8d6620 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcb74044940 tx=0x7fcb7404c000 comp rx=0 tx=0).stop 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fcb87c16800 1 -- 172.21.15.131:0/1471143623 shutdown_connections 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fcb87c16800 1 --2- 172.21.15.131:0/1471143623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8d6620 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fcb87c16800 1 -- 172.21.15.131:0/1471143623 >> 172.21.15.131:0/1471143623 conn(0x55b99b7e03a0 msgr2=0x55b99b8d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fcb87c16800 1 -- 172.21.15.131:0/1471143623 shutdown_connections 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.288+0000 7fcb87c16800 1 -- 172.21.15.131:0/1471143623 wait complete. 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb87c16800 1 Processor -- start 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb87c16800 1 -- start start 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb87c16800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb87c16800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b99b7ee410 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb83284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb83284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52772/0 (socket says 172.21.15.131:52772) 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb83284640 1 -- 172.21.15.131:0/4263329566 learned_addr learned my addr 172.21.15.131:0/4263329566 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.289+0000 7fcb83284640 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99b8de5c0 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.290+0000 7fcb83284640 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8de080 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcb74044940 tx=0x7fcb74003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.290+0000 7fca6fe07640 1 -- 172.21.15.131:0/4263329566 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb74057070 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.290+0000 7fca6fe07640 1 -- 172.21.15.131:0/4263329566 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb74052b50 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.290+0000 7fca6fe07640 1 -- 172.21.15.131:0/4263329566 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb74052e30 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.290+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b99b8de850 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.290+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99b8e1500 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.290+0000 7fca6fe07640 1 -- 172.21.15.131:0/4263329566 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb7405d440 con 0x55b99b7e5fa0 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fca6fe07640 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fca6fe07640 1 -- 172.21.15.131:0/4263329566 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fcb7408dc30 con 0x55b99b7e5fa0 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb87c16800 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b8e32b0 0x55b99b8e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b8e5be0 con 0x55b99b8e32b0 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb83a85640 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b8e32b0 0x55b99b8e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca68036950 0x7fca68038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c000f60 tx=0x7fcb6c001410 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb83a85640 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b8e32b0 0x55b99b8e56a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb83a85640 1 -- 172.21.15.131:0/4263329566 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x55b99b8e32b0 2024-04-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.291+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b8e64c0 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.292+0000 7fcb83a85640 1 -- 172.21.15.131:0/4263329566 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.292+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b8e7870 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.292+0000 7fcb83a85640 1 -- 172.21.15.131:0/4263329566 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.292+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b8e6d10 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.292+0000 7fcb83a85640 1 -- 172.21.15.131:0/4263329566 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.292+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b8e7160 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb83a85640 1 -- 172.21.15.131:0/4263329566 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x55b99b8e32b0 2024-04-24T01:44:49.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb87c16800 1 Processor -- start 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb87c16800 1 -- start start 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb87c16800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f8430 0x55b99b8fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb87c16800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b99b6d76b0 con 0x55b99b8f8430 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f8430 0x55b99b8fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f8430 0x55b99b8fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52786/0 (socket says 172.21.15.131:52786) 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.293+0000 7fcb7bfff640 1 -- 172.21.15.131:0/2162433019 learned_addr learned my addr 172.21.15.131:0/2162433019 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.294+0000 7fcb7bfff640 1 -- 172.21.15.131:0/2162433019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99b759350 con 0x55b99b8f8430 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.294+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f8430 0x55b99b8fa820 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00be30 tx=0x7fcb6c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.294+0000 7fca6d602640 1 -- 172.21.15.131:0/2162433019 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c01c540 con 0x55b99b8f8430 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.294+0000 7fca6d602640 1 -- 172.21.15.131:0/2162433019 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c017050 con 0x55b99b8f8430 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.294+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b99b8fadc0 con 0x55b99b8f8430 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.294+0000 7fca6d602640 1 -- 172.21.15.131:0/2162433019 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c01c870 con 0x55b99b8f8430 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.294+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99b8fb2c0 con 0x55b99b8f8430 2024-04-24T01:44:49.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fca6d602640 1 -- 172.21.15.131:0/2162433019 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb6c00e070 con 0x55b99b8f8430 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fca6d602640 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca5c036950 0x7fca5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fca6d602640 1 -- 172.21.15.131:0/2162433019 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fcb6c04e320 con 0x55b99b8f8430 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fcb83a85640 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca5c036950 0x7fca5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fcb87c16800 1 Processor -- start 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fcb87c16800 1 -- start start 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fcb83a85640 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca5c036950 0x7fca5c038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b99b8e29c0 tx=0x7fcb7c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fcb87c16800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b8f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.295+0000 7fcb87c16800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b99b8d6eb0 con 0x55b99b8f7a20 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b8f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b8f7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52798/0 (socket says 172.21.15.131:52798) 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fcb7bfff640 1 -- 172.21.15.131:0/3297381186 learned_addr learned my addr 172.21.15.131:0/3297381186 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fcb7bfff640 1 -- 172.21.15.131:0/3297381186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99b8f6220 con 0x55b99b8f7a20 2024-04-24T01:44:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/3297381186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b8f7e40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c027030 tx=0x7fcb6c01ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c25561a3e0a010 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fca66ffd640 1 -- 172.21.15.131:0/3297381186 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c04b020 con 0x55b99b8f7a20 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fca66ffd640 1 -- 172.21.15.131:0/3297381186 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c04e110 con 0x55b99b8f7a20 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.296+0000 7fca66ffd640 1 -- 172.21.15.131:0/3297381186 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c023d90 con 0x55b99b8f7a20 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 -- 172.21.15.131:0/3297381186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 msgr2=0x55b99b8f7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 --2- 172.21.15.131:0/3297381186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b8f7e40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c027030 tx=0x7fcb6c01ae40 comp rx=0 tx=0).stop 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 -- 172.21.15.131:0/3297381186 shutdown_connections 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 --2- 172.21.15.131:0/3297381186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b8f7e40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 -- 172.21.15.131:0/3297381186 >> 172.21.15.131:0/3297381186 conn(0x55b99b900fd0 msgr2=0x55b99b8ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 -- 172.21.15.131:0/3297381186 shutdown_connections 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 -- 172.21.15.131:0/3297381186 wait complete. 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 Processor -- start 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 -- start start 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b90e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb87c16800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b99b8f66f0 con 0x55b99b8f7a20 2024-04-24T01:44:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b90e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b90e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:52800/0 (socket says 172.21.15.131:52800) 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.297+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 learned_addr learned my addr 172.21.15.131:0/584020898 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99b90e990 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b90e450 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0234c0 tx=0x7fcb6c04c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fca657fa640 1 -- 172.21.15.131:0/584020898 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c034070 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fca657fa640 1 -- 172.21.15.131:0/584020898 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c023e40 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fca657fa640 1 -- 172.21.15.131:0/584020898 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c01a310 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b99b90ec20 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99b9118d0 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.298+0000 7fca657fa640 1 -- 172.21.15.131:0/584020898 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb6c037070 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fca657fa640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca4c036950 0x7fca4c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fca657fa640 1 -- 172.21.15.131:0/584020898 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fcb6c030d90 con 0x55b99b8f7a20 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fcb83a85640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca4c036950 0x7fca4c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fcb83a85640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca4c036950 0x7fca4c038e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55b99b8e27e0 tx=0x7fcb7c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b919f20 0x55b99b91c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91cb30 con 0x55b99b919f20 2024-04-24T01:44:49.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.299+0000 7fcb83284640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b919f20 0x55b99b91c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb83284640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b919f20 0x55b99b91c3e0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 20 realm 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91cf40 con 0x55b99b919f20 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:44:49.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91d810 con 0x55b99b919f20 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.300+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91dbb0 con 0x55b99b919f20 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb87c16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91e400 con 0x55b99b919f20 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb87c16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb87c16800 20 searching for the correct realm 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b99b920170 0x55b99b922560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b99b920170 0x55b99b922560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.301+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b99b920170 0x55b99b922560 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb7bfff640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcb6c039060 0x7fcb6c013a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb6c039060 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb83a85640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcb6c039060 0x7fcb6c013a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb83a85640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcb6c039060 0x7fcb6c013a60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c01f070 con 0x7fcb6c039060 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb83a85640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcb7c031040 0x7fcb7c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.302+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.303+0000 7fcb83284640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcb7c031040 0x7fcb7c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.303+0000 7fcb83284640 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcb7c031040 0x7fcb7c032940 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.303+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.303+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.303+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.303+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb6c039060 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c01f070 con 0x7fcb6c039060 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.304+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.305+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb6c039060 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb7c01f070 con 0x7fcb6c039060 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.306+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.307+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb6c039060 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c01f070 con 0x7fcb6c039060 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.308+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb6c039060 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.309+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c01f070 con 0x7fcb6c039060 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.309+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.309+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.309+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.309+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.309+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb6c039060 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c01f070 con 0x7fcb6c039060 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b920170 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb7c031040 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x55b99b919f20 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.310+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922b40 con 0x7fcb6c039060 2024-04-24T01:44:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91ed80 con 0x55b99b919f20 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91f620 con 0x55b99b919f20 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b922fc0 con 0x55b99b919f20 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 zone default found 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 4 Realm: () 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 zonegroup default 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.311+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b91f280 con 0x7fcb6c039060 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b925380 con 0x55b99b920170 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b925720 con 0x55b99b920170 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 20 started sync module instance, tier type = 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.312+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924810 con 0x7fcb6c039060 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.313+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.313+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94255667367216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924810 con 0x7fcb6c039060 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.313+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b926130 con 0x55b99b919f20 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.314+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94255667367216] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.315+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.315+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94255667371616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924810 con 0x55b99b919f20 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.315+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b926ba0 con 0x55b99b920170 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.316+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94255667371616] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.316+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.316+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94255667364704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924780 con 0x55b99b920170 2024-04-24T01:44:49.327 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.316+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b927a60 con 0x7fcb6c039060 2024-04-24T01:44:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.317+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.317+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94255667378096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b928300 con 0x7fcb6c039060 2024-04-24T01:44:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.317+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b928db0 con 0x55b99b919f20 2024-04-24T01:44:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.317+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94255667364704] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.318+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94255667378096] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.318+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.318+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94255667376016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b927e50 con 0x55b99b919f20 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.318+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b929650 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.319+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.319+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94255667384480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b929970 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.319+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94255667376016] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.319+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b928890 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.320+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94255667384480] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.320+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.320+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94255667385536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b929d90 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.320+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b92a6d0 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94255667385536] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94255667388928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b92a8b0 con 0x7fcb7c031040 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 20 add_watcher() i=0 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 20 add_watcher() i=1 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 20 add_watcher() i=2 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 20 add_watcher() i=3 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 20 add_watcher() i=4 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 20 add_watcher() i=5 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.321+0000 7fcb87c16800 20 add_watcher() i=6 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.322+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94255667388928] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.322+0000 7fcb87c16800 20 add_watcher() i=7 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.322+0000 7fcb87c16800 2 all 8 watchers are set, enabling cache 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.322+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b92dc80 con 0x55b99b919f20 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.323+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.323+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94255667390368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b92b070 con 0x55b99b919f20 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94255667390368] v34'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fca39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 5 note: GC not initialized 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fca38fe1640 20 reqs_thread_entry: start 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 20 init_complete bucket index max shards: 11 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 20 Filter name: none 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fc9b27fc640 20 reqs_thread_entry: start 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 20 rados->read ofs=0 len=0 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.324+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b960ea0 con 0x7fcb7c031040 2024-04-24T01:44:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.325+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.325+0000 7fcb87c16800 20 rados_obj.operate() r=0 bl.length=473 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.325+0000 7fcb87c16800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.325+0000 7fcb87c16800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.325+0000 7fcb87c16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.325+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b967750 con 0x7fcb7c031040 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fcb87c16800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fcb87c16800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fcb87c16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94255667638720 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b99b962e60 con 0x55b99b919f20 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== watch-notify(notify (1) cookie 94255667376016 notify 146028888099 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fcb74094040 con 0x55b99b919f20 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fca66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94255667376016 notifier 4919 bl.length()=649 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fca66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:44:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fca66ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:44:49.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(64 notify.4 [notify cookie 94255667638720 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.326+0000 7fca66ffd640 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fca48003ea0 con 0x55b99b919f20 2024-04-24T01:44:49.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.327+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== watch-notify(notify_complete (2) cookie 94255667638720 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b99b8e1500 con 0x55b99b919f20 2024-04-24T01:44:49.337 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.327+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.337 INFO:teuthology.orchestra.run.smithi131.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:44:47.397449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:44:47.397437Z","tags":[],"group_ids":[]} 2024-04-24T01:44:49.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.328+0000 7fca39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:44:49.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.328+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94255667390368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b963620 con 0x55b99b919f20 2024-04-24T01:44:49.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.329+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94255667390368] v34'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.329+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94255667367216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b963620 con 0x7fcb6c039060 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.330+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94255667367216] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.330+0000 7fcb87c16800 20 remove_watcher() i=0 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.330+0000 7fcb87c16800 2 removed watcher, disabling cache 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.330+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94255667371616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b963620 con 0x55b99b919f20 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.331+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94255667371616] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.331+0000 7fcb87c16800 20 remove_watcher() i=1 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.331+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94255667364704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b963620 con 0x55b99b920170 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.332+0000 7fcb7bfff640 1 -- 172.21.15.131:0/584020898 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94255667364704] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c036030 con 0x55b99b920170 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.332+0000 7fcb87c16800 20 remove_watcher() i=2 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.332+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94255667378096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924360 con 0x7fcb6c039060 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.333+0000 7fcb83a85640 1 -- 172.21.15.131:0/584020898 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94255667378096] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c040040 con 0x7fcb6c039060 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.333+0000 7fcb87c16800 20 remove_watcher() i=3 2024-04-24T01:44:49.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.333+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94255667376016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924360 con 0x55b99b919f20 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.334+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94255667376016] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x55b99b919f20 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.334+0000 7fcb87c16800 20 remove_watcher() i=4 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.334+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94255667384480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924360 con 0x7fcb7c031040 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.335+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94255667384480] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.335+0000 7fcb87c16800 20 remove_watcher() i=5 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.335+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94255667385536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b9290a0 con 0x7fcb7c031040 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.336+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94255667385536] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.336+0000 7fcb87c16800 20 remove_watcher() i=6 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.336+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94255667388928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b99b924360 con 0x7fcb7c031040 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94255667388928] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7406c070 con 0x7fcb7c031040 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 20 remove_watcher() i=7 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcb7c031040 msgr2=0x7fcb7c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7fcb7c031040 0x7fcb7c032940 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b919f20 msgr2=0x55b99b91c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b919f20 0x55b99b91c3e0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcb6c039060 msgr2=0x7fcb6c013a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7fcb6c039060 0x7fcb6c013a60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b99b920170 msgr2=0x55b99b922560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x55b99b920170 0x55b99b922560 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca4c036950 msgr2=0x7fca4c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca4c036950 0x7fca4c038e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55b99b8e27e0 tx=0x7fcb7c01f000 comp rx=0 tx=0).stop 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 msgr2=0x55b99b90e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 --2- 172.21.15.131:0/584020898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f7a20 0x55b99b90e450 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0234c0 tx=0x7fcb6c04c550 comp rx=0 tx=0).stop 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb83284640 1 -- 172.21.15.131:0/584020898 reap_dead start 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 shutdown_connections 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 >> 172.21.15.131:0/584020898 conn(0x55b99b900fd0 msgr2=0x55b99b8fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 shutdown_connections 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.337+0000 7fcb87c16800 1 -- 172.21.15.131:0/584020898 wait complete. 2024-04-24T01:44:49.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca5c036950 msgr2=0x7fca5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca5c036950 0x7fca5c038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b99b8e29c0 tx=0x7fcb7c005840 comp rx=0 tx=0).stop 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f8430 msgr2=0x55b99b8fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f8430 0x55b99b8fa820 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00be30 tx=0x7fcb6c00f790 comp rx=0 tx=0).stop 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 shutdown_connections 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca5c036950 0x7fca5c038e10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/2162433019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b8f8430 0x55b99b8fa820 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 >> 172.21.15.131:0/2162433019 conn(0x55b99b8ea8b0 msgr2=0x55b99b8eacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 shutdown_connections 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/2162433019 wait complete. 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b8e32b0 msgr2=0x55b99b8e56a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b8e32b0 0x55b99b8e56a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca68036950 msgr2=0x7fca68038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca68036950 0x7fca68038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c000f60 tx=0x7fcb6c001410 comp rx=0 tx=0).stop 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 msgr2=0x55b99b8de080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8de080 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcb74044940 tx=0x7fcb74003020 comp rx=0 tx=0).stop 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 shutdown_connections 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x55b99b8e32b0 0x55b99b8e56a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 --2- 172.21.15.131:0/4263329566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b99b7e5fa0 0x55b99b8de080 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 >> 172.21.15.131:0/4263329566 conn(0x55b99b7e03a0 msgr2=0x55b99b8d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 shutdown_connections 2024-04-24T01:44:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:44:49.338+0000 7fcb87c16800 1 -- 172.21.15.131:0/4263329566 wait complete. 2024-04-24T01:44:49.348 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:49.348 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:44:47.397449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:44:47.397437Z', 'tags': [], 'group_ids': []} 2024-04-24T01:44:49.348 ERROR:root:0 2024-04-24T01:44:49.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-24T01:44:49.355 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.356 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.359 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.360 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-24T01:44:49.365 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.368 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.369 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-24T01:44:49.376 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-04-24T01:44:49.376 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.380 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.380 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-24T01:44:49.387 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.387 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.391 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.391 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-24T01:44:49.398 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-24T01:44:49.398 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.402 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.402 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-24T01:44:49.410 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-24T01:44:49.410 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.413 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-24T01:44:49.420 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.421 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.425 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.425 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-24T01:44:49.431 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.431 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.434 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-24T01:44:49.441 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.442 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.445 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.445 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.449 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T01:44:49.450 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-24T01:44:49.454 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T01:44:49.467 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-24T01:44:49.471 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-24T01:44:49.471 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T01:44:49.475 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:44:49.463579Z', 'creation_time': '2024-04-24T01:44:49.458740Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:44:49.476 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-24T01:44:49.480 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:44:49.463579Z', 'creation_time': '2024-04-24T01:44:49.458740Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-24T01:44:49.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T01:44:49.489 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:44:49.463579Z', 'creation_time': '2024-04-24T01:44:49.458740Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:44:49.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-24T01:44:49.494 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000fdeb9aa5f6417c93-0066286411-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:44:49.498 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-24T01:44:49.504 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.505 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-24T01:44:49.512 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:44:49.522 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11'} 2024-04-24T01:44:49.531 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.575 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11'} 2024-04-24T01:44:49.585 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.586 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-24T01:44:49.595 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.602 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-24T01:44:49.608 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:44:49.608 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T01:44:49.612 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'e8007cb0-7095-49ae-9c09-cc804d4cc0c2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'marker': '57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:44:49.581709Z', 'creation_time': '2024-04-24T01:44:49.458740Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:45:49.657 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-24T01:45:49.677 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-04-24T01:45:49.677 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-24T01:45:49.693 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-04-24T01:45:49.693 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-24T01:45:49.699 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-04-24T01:45:49.699 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-24T01:45:49.704 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-04-24T01:45:49.704 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-24T01:45:49.708 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T01:45:49.708 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-24T01:45:49.713 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-04-24T01:45:49.713 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-24T01:45:49.717 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-04-24T01:45:49.717 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-24T01:45:49.725 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:45:49.725 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-24T01:45:49.729 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-24T01:45:49.729 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-24T01:45:49.739 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:45:49.743 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-24T01:45:49.752 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:45:50.006 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-24T01:45:50.013 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000008153eb6853ba9442-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.119 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-24T01:45:50.124 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-24T01:45:50.128 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-24T01:45:50.133 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-24T01:45:50.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-24T01:45:50.284 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:45:50.284 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-24T01:45:50.290 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-24T01:45:50.290 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-24T01:45:50.296 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T01:45:50.307 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-24T01:45:50.311 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000049c06fb94acd48b8-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.331 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-24T01:45:50.362 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:45:50.362 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:45:50.366 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000a0ec9cef98b69dfc-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-24T01:45:50.370 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'bbf4dd9c-0d50-4da0-921c-8b1690fa6e43'}]}} 2024-04-24T01:45:50.370 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-24T01:45:50.380 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:45:50.380 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-24T01:45:50.384 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T01:45:50.384 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-24T01:45:50.389 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000094bec6d61ee75ff9-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.389 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-24T01:45:50.393 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000b2c3b8d15429659d-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.403 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-24T01:45:50.408 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T01:45:50.408 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-24T01:45:50.412 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000ce2ee64c996b1b97-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.412 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-24T01:45:50.416 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000004bdccc3cea57950b-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.416 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-24T01:45:50.421 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T01:45:50.422 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-24T01:45:50.425 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000fdd958bb993fb0dd-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.426 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-24T01:45:50.429 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000003bf80de144d1faa-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.430 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-24T01:45:50.433 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000003302f01abfb7f06d-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.434 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-24T01:45:50.437 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000002fb8009cf38138a0-006628644e-4226-default', 'HostId': '4226-default-default'} 2024-04-24T01:45:50.437 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-24T01:45:50.446 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:45:50.446 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-24T01:45:50.450 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-24T01:45:50.450 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-24T01:45:50.455 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:45:50.455 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-24T01:45:50.459 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-24T01:45:50.459 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-24T01:45:50.464 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:45:50.469 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-24T01:45:50.479 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-24T01:45:50.479 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:45:50.480 INFO:tasks.rgw.client.0.smithi131.stdout:2024-04-24T01:45:50.480+0000 7ffa0a17f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35265) UID: 0 2024-04-24T01:45:50.480 INFO:tasks.rgw.client.0.smithi131.stdout:2024-04-24T01:45:50.480+0000 7ffa0f91f880 -1 shutting down 2024-04-24T01:45:52.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-24T01:45:56.580 INFO:tasks.rgw.client.0:Stopped 2024-04-24T01:45:56.581 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-24T01:45:56.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/vault-root-token 2024-04-24T01:45:56.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-24T01:45:56.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-24T01:45:56.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-24T01:45:56.735 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-24T01:45:56.820 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:45:56.820 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:45:56.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.820+0000 7f1eada38800 1 Processor -- start 2024-04-24T01:45:56.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.820+0000 7f1eada38800 1 -- start start 2024-04-24T01:45:56.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.820+0000 7f1eada38800 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5649a9d0a1b0 0x5649a9d0c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.820+0000 7f1eada38800 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649a9bc5d40 con 0x5649a9d05d20 2024-04-24T01:45:56.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.820+0000 7f1eada38800 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x5649a9b984d0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.821+0000 7f1eaad36640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5649a9d0a1b0 0x5649a9d0c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.821+0000 7f1eab537640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5649a9d05d20 0x5649a9d06140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.131:44368/0 (socket says 172.21.15.131:44368) 2024-04-24T01:45:56.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.821+0000 7f1eab537640 1 -- 172.21.15.131:0/2606280778 learned_addr learned my addr 172.21.15.131:0/2606280778 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-24T01:45:56.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.821+0000 7f1eaad36640 1 -- 172.21.15.131:0/2606280778 >> v1:172.21.15.107:6789/0 conn(0x5649a9d05d20 legacy=0x5649a9d06140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:56.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.821+0000 7f1eaad36640 1 -- 172.21.15.131:0/2606280778 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a9bc4590 con 0x5649a9d0a1b0 2024-04-24T01:45:56.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.823+0000 7f1eaad36640 1 --2- 172.21.15.131:0/2606280778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d0a1b0 0x5649a9d0c5a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000a470 tx=0x7f1ea001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb328e427b6bf3ee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.823+0000 7f1eaa535640 1 -- 172.21.15.131:0/2606280778 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0057070 con 0x5649a9d0a1b0 2024-04-24T01:45:56.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.823+0000 7f1eaa535640 1 -- 172.21.15.131:0/2606280778 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0052570 con 0x5649a9d0a1b0 2024-04-24T01:45:56.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.823+0000 7f1eaa535640 1 -- 172.21.15.131:0/2606280778 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0052870 con 0x5649a9d0a1b0 2024-04-24T01:45:56.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.824+0000 7f1eada38800 1 -- 172.21.15.131:0/2606280778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d0a1b0 msgr2=0x5649a9d0c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:56.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.824+0000 7f1eada38800 1 --2- 172.21.15.131:0/2606280778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d0a1b0 0x5649a9d0c5a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000a470 tx=0x7f1ea001ce90 comp rx=0 tx=0).stop 2024-04-24T01:45:56.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.824+0000 7f1eada38800 1 -- 172.21.15.131:0/2606280778 shutdown_connections 2024-04-24T01:45:56.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.824+0000 7f1eada38800 1 --2- 172.21.15.131:0/2606280778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d0a1b0 0x5649a9d0c5a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:56.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.824+0000 7f1eada38800 1 -- 172.21.15.131:0/2606280778 >> 172.21.15.131:0/2606280778 conn(0x5649a9d01380 msgr2=0x5649a9d037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:56.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.824+0000 7f1eada38800 1 -- 172.21.15.131:0/2606280778 shutdown_connections 2024-04-24T01:45:56.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.824+0000 7f1eada38800 1 -- 172.21.15.131:0/2606280778 wait complete. 2024-04-24T01:45:56.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.837+0000 7f1eada38800 1 Processor -- start 2024-04-24T01:45:56.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.837+0000 7f1eada38800 1 -- start start 2024-04-24T01:45:56.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.837+0000 7f1eada38800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9c79ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.837+0000 7f1eada38800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5649a9c523c0 con 0x5649a9d05d20 2024-04-24T01:45:56.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1eab537640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9c79ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1eab537640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9c79ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54452/0 (socket says 172.21.15.131:54452) 2024-04-24T01:45:56.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1eab537640 1 -- 172.21.15.131:0/1031224288 learned_addr learned my addr 172.21.15.131:0/1031224288 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1eab537640 1 -- 172.21.15.131:0/1031224288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a9dfae00 con 0x5649a9d05d20 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1eab537640 1 --2- 172.21.15.131:0/1031224288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9c79ff0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c001d80 tx=0x7f1e9c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a810e39b39a006 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1d9960a640 1 -- 172.21.15.131:0/1031224288 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9c013030 con 0x5649a9d05d20 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1d9960a640 1 -- 172.21.15.131:0/1031224288 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c00e470 con 0x5649a9d05d20 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.838+0000 7f1d9960a640 1 -- 172.21.15.131:0/1031224288 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9c00e810 con 0x5649a9d05d20 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.839+0000 7f1eada38800 1 -- 172.21.15.131:0/1031224288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 msgr2=0x5649a9c79ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.839+0000 7f1eada38800 1 --2- 172.21.15.131:0/1031224288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9c79ff0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c001d80 tx=0x7f1e9c001e70 comp rx=0 tx=0).stop 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.839+0000 7f1eada38800 1 -- 172.21.15.131:0/1031224288 shutdown_connections 2024-04-24T01:45:56.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.839+0000 7f1eada38800 1 --2- 172.21.15.131:0/1031224288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9c79ff0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.839+0000 7f1eada38800 1 -- 172.21.15.131:0/1031224288 >> 172.21.15.131:0/1031224288 conn(0x5649a9d01380 msgr2=0x5649a9df28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.839+0000 7f1eada38800 1 -- 172.21.15.131:0/1031224288 shutdown_connections 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.839+0000 7f1eada38800 1 -- 172.21.15.131:0/1031224288 wait complete. 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eada38800 1 Processor -- start 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eada38800 1 -- start start 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eada38800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9df8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eada38800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5649a9d0ce70 con 0x5649a9d05d20 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eab537640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9df8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eab537640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9df8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54458/0 (socket says 172.21.15.131:54458) 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eab537640 1 -- 172.21.15.131:0/119193727 learned_addr learned my addr 172.21.15.131:0/119193727 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:45:56.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.840+0000 7f1eab537640 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a9df6e20 con 0x5649a9d05d20 2024-04-24T01:45:56.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.841+0000 7f1eab537640 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9df8730 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c004000 tx=0x7f1e9c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.841+0000 7f1d97e07640 1 -- 172.21.15.131:0/119193727 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9c027070 con 0x5649a9d05d20 2024-04-24T01:45:56.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.841+0000 7f1d97e07640 1 -- 172.21.15.131:0/119193727 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c019900 con 0x5649a9d05d20 2024-04-24T01:45:56.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.841+0000 7f1d97e07640 1 -- 172.21.15.131:0/119193727 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9c019c60 con 0x5649a9d05d20 2024-04-24T01:45:56.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.841+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649a9df70b0 con 0x5649a9d05d20 2024-04-24T01:45:56.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.841+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a9df75d0 con 0x5649a9d05d20 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1d97e07640 1 -- 172.21.15.131:0/119193727 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e9c02a070 con 0x5649a9d05d20 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1d97e07640 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d90036900 0x7f1d90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1d97e07640 1 -- 172.21.15.131:0/119193727 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1e9c01f070 con 0x5649a9d05d20 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1eaad36640 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d90036900 0x7f1d90038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1eada38800 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9d0a1b0 0x5649a9e090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e096e0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1eabd38640 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9d0a1b0 0x5649a9e090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1eaad36640 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d90036900 0x7f1d90038dc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0054000 tx=0x7f1ea004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.842+0000 7f1eabd38640 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9d0a1b0 0x5649a9e090c0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.843+0000 7f1eabd38640 1 -- 172.21.15.131:0/119193727 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ea400a4a0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.843+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e09f80 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.843+0000 7f1eabd38640 1 -- 172.21.15.131:0/119193727 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ea400a4a0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.843+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e0b330 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.843+0000 7f1eabd38640 1 -- 172.21.15.131:0/119193727 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ea400a4a0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.843+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e0a7d0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.844+0000 7f1eabd38640 1 -- 172.21.15.131:0/119193727 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ea400a4a0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.844+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e0abf0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.844+0000 7f1eabd38640 1 -- 172.21.15.131:0/119193727 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ea400a4a0 con 0x5649a9d0a1b0 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.844+0000 7f1eada38800 1 Processor -- start 2024-04-24T01:45:56.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.844+0000 7f1eada38800 1 -- start start 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.845+0000 7f1eada38800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e1a3c0 0x5649a9e1a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.845+0000 7f1eada38800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5649a9df8c70 con 0x5649a9e1a3c0 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.845+0000 7f1eaad36640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e1a3c0 0x5649a9e1a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.845+0000 7f1eaad36640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e1a3c0 0x5649a9e1a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54468/0 (socket says 172.21.15.131:54468) 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.845+0000 7f1eaad36640 1 -- 172.21.15.131:0/1584534801 learned_addr learned my addr 172.21.15.131:0/1584534801 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.845+0000 7f1eaad36640 1 -- 172.21.15.131:0/1584534801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a9e1ad20 con 0x5649a9e1a3c0 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.845+0000 7f1eaad36640 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e1a3c0 0x5649a9e1a7e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0044840 tx=0x7f1ea0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.846+0000 7f1d95602640 1 -- 172.21.15.131:0/1584534801 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0070070 con 0x5649a9e1a3c0 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.846+0000 7f1d95602640 1 -- 172.21.15.131:0/1584534801 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0058050 con 0x5649a9e1a3c0 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.846+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649a9e1b790 con 0x5649a9e1a3c0 2024-04-24T01:45:56.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.846+0000 7f1d95602640 1 -- 172.21.15.131:0/1584534801 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0060650 con 0x5649a9e1a3c0 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.846+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a9e1bc30 con 0x5649a9e1a3c0 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.846+0000 7f1d95602640 1 -- 172.21.15.131:0/1584534801 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1ea0073070 con 0x5649a9e1a3c0 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1d95602640 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d84036900 0x7f1d84038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1d95602640 1 -- 172.21.15.131:0/1584534801 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1ea0067030 con 0x5649a9e1a3c0 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1eabd38640 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d84036900 0x7f1d84038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1eada38800 1 Processor -- start 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1eabd38640 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d84036900 0x7f1d84038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5649a9e0ab70 tx=0x7f1ea4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1eada38800 1 -- start start 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1eada38800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e27a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.847+0000 7f1eada38800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5649a9bf86b0 con 0x5649a9e27600 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1eaad36640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e27a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1eaad36640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e27a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54480/0 (socket says 172.21.15.131:54480) 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1eaad36640 1 -- 172.21.15.131:0/2706631154 learned_addr learned my addr 172.21.15.131:0/2706631154 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1eaad36640 1 -- 172.21.15.131:0/2706631154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a9e27ff0 con 0x5649a9e27600 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1eaad36640 1 --2- 172.21.15.131:0/2706631154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e27a20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1ea005ef70 tx=0x7f1ea0073f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead7bc2747a81b4c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1d8effd640 1 -- 172.21.15.131:0/2706631154 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea00607f0 con 0x5649a9e27600 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1d8effd640 1 -- 172.21.15.131:0/2706631154 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea005e3f0 con 0x5649a9e27600 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1d8effd640 1 -- 172.21.15.131:0/2706631154 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0060b70 con 0x5649a9e27600 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1eada38800 1 -- 172.21.15.131:0/2706631154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 msgr2=0x5649a9e27a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.848+0000 7f1eada38800 1 --2- 172.21.15.131:0/2706631154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e27a20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1ea005ef70 tx=0x7f1ea0073f50 comp rx=0 tx=0).stop 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 -- 172.21.15.131:0/2706631154 shutdown_connections 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 --2- 172.21.15.131:0/2706631154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e27a20 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 -- 172.21.15.131:0/2706631154 >> 172.21.15.131:0/2706631154 conn(0x5649a9e23960 msgr2=0x5649a9e219c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:56.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 -- 172.21.15.131:0/2706631154 shutdown_connections 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 -- 172.21.15.131:0/2706631154 wait complete. 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 Processor -- start 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 -- start start 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e2ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eada38800 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5649a9e285e0 con 0x5649a9e27600 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eaad36640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e2ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eaad36640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e2ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.131:54484/0 (socket says 172.21.15.131:54484) 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.849+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 learned_addr learned my addr 172.21.15.131:0/1169856924 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.850+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a9e2f010 con 0x5649a9e27600 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.850+0000 7f1eaad36640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e2ead0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1ea005d500 tx=0x7f1ea008d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.850+0000 7f1d8d7fa640 1 -- 172.21.15.131:0/1169856924 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0093070 con 0x5649a9e27600 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.850+0000 7f1d8d7fa640 1 -- 172.21.15.131:0/1169856924 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0060b70 con 0x5649a9e27600 2024-04-24T01:45:56.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.850+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649a9e2f2a0 con 0x5649a9e27600 2024-04-24T01:45:56.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.850+0000 7f1d8d7fa640 1 -- 172.21.15.131:0/1169856924 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0087040 con 0x5649a9e27600 2024-04-24T01:45:56.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.850+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a9e31f50 con 0x5649a9e27600 2024-04-24T01:45:56.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.851+0000 7f1d8d7fa640 1 -- 172.21.15.131:0/1169856924 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1ea0096070 con 0x5649a9e27600 2024-04-24T01:45:56.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.851+0000 7f1d8d7fa640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d74036950 0x7f1d74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.851+0000 7f1d8d7fa640 1 -- 172.21.15.131:0/1169856924 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1ea0099d80 con 0x5649a9e27600 2024-04-24T01:45:56.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.852+0000 7f1eabd38640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d74036950 0x7f1d74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.852+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.852+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9e3a5a0 0x5649a9e3ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.852+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3d1b0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.852+0000 7f1eabd38640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d74036950 0x7f1d74038e10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5649a9df7bb0 tx=0x7f1ea401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.852+0000 7f1eab537640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9e3a5a0 0x5649a9e3ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.852+0000 7f1eab537640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9e3a5a0 0x5649a9e3ca60 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 realm 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3d5c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3de90 con 0x5649a9e3a5a0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3e230 con 0x5649a9e3a5a0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.853+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:5 5.18 5:1c0fe5af:::zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3ea80 con 0x5649a9e3a5a0 2024-04-24T01:45:56.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 5 ==== osd_op_reply(5 zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eada38800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eada38800 20 searching for the correct realm 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5649a9e407f0 0x5649a9e42be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eaad36640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5649a9e407f0 0x5649a9e42be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eaad36640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5649a9e407f0 0x5649a9e42be0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eaad36640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1ea0098070 0x7f1ea0065890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.854+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea0098070 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.855+0000 7f1eabd38640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1ea0098070 0x7f1ea0065890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.855+0000 7f1eabd38640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1ea0098070 0x7f1ea0065890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.855+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea401f070 con 0x7f1ea0098070 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.855+0000 7f1eabd38640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1ea4031040 0x7f1ea4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.855+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.855+0000 7f1eab537640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1ea4031040 0x7f1ea4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.856+0000 7f1eab537640 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1ea4031040 0x7f1ea4032940 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.856+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.856+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.856+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.856+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea0098070 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea401f070 con 0x7f1ea0098070 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.857+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.858+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea0098070 2024-04-24T01:45:56.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ea401f070 con 0x7f1ea0098070 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.859+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.860+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea0098070 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea401f070 con 0x7f1ea0098070 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea0098070 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f1ea401f070 con 0x7f1ea0098070 2024-04-24T01:45:56.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.861+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.862+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.862+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.862+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.862+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea0098070 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.862+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea401f070 con 0x7f1ea0098070 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.862+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e407f0 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.863+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.863+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea4031040 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.863+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.863+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.863+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.863+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e431c0 con 0x7f1ea0098070 2024-04-24T01:45:56.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 RGWRados::pool_iterate: got zone_info.57339dfa-6744-4aa2-9c16-e58ce0599faf 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 RGWRados::pool_iterate: got zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 RGWRados::pool_iterate: got period_config.default 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3f400 con 0x5649a9e3a5a0 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3fca0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:40 5.9 5:91c09517:::zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e3fca0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 16 ==== osd_op_reply(40 zonegroup_info.e8007cb0-7095-49ae-9c09-cc804d4cc0c2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 zone default found 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 4 Realm: () 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 4 ZoneGroup: default (e8007cb0-7095-49ae-9c09-cc804d4cc0c2) 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 4 Zone: default (57339dfa-6744-4aa2-9c16-e58ce0599faf) 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:45:56.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 zonegroup default 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.864+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e43640 con 0x7f1ea0098070 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eada38800 20 rados_obj.operate() r=0 bl.length=187 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e45870 con 0x5649a9e407f0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eada38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eada38800 20 rados->read ofs=0 len=0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e45c10 con 0x5649a9e407f0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.865+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.866+0000 7f1eada38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:45:56.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.866+0000 7f1eada38800 20 started sync module instance, tier type = 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.866+0000 7f1eada38800 20 started zone id=57339dfa-6744-4aa2-9c16-e58ce0599faf (name=default) with tier type = 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.866+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e44cb0 con 0x7f1ea0098070 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.867+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 9 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.867+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94874382914000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e44cb0 con 0x7f1ea0098070 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.867+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e465d0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.868+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94874382914000] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.868+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 17 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.868+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94874382911760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e465d0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.868+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e46f90 con 0x5649a9e407f0 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.869+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94874382911760] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.870+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.870+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94874382917920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e46540 con 0x5649a9e407f0 2024-04-24T01:45:56.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.870+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e47e00 con 0x7f1ea0098070 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.871+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 11 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.871+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94874382917920] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.871+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94874382922544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e48060 con 0x7f1ea0098070 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.871+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e48b70 con 0x5649a9e3a5a0 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.872+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94874382922544] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.872+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 19 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.872+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94874382927392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e48b30 con 0x5649a9e3a5a0 2024-04-24T01:45:56.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.872+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e495a0 con 0x7f1ea4031040 2024-04-24T01:45:56.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.873+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94874382927392] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.873+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 9 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.873+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94874382930128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e495a0 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.873+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e49fe0 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.874+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94874382930128] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.874+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 11 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.875+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94874382924592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e49fe0 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.875+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e4a9a0 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94874382924592] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 13 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94874382932784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e4ab80 con 0x7f1ea4031040 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 20 add_watcher() i=0 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 20 add_watcher() i=1 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 20 add_watcher() i=2 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 20 add_watcher() i=3 2024-04-24T01:45:56.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 20 add_watcher() i=4 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 20 add_watcher() i=5 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.876+0000 7f1eada38800 20 add_watcher() i=6 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.877+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94874382932784] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.877+0000 7f1eada38800 20 add_watcher() i=7 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.877+0000 7f1eada38800 2 all 8 watchers are set, enabling cache 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.877+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e4dd40 con 0x5649a9e3a5a0 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.877+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.877+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94874382948080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e4aac0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.878+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94874382948080] v34'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.878+0000 7f1d61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.879+0000 7f1eada38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.879+0000 7f1eada38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:45:56.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.879+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e4cf40 con 0x5649a9e3a5a0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.880+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'64 uv63 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.880+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x7f1ea4031040 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.881+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.881+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x5649a9e407f0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.882+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'40 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.882+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x5649a9e3a5a0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.883+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'281 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.883+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x7f1ea0098070 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.884+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'90 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.884+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x5649a9e407f0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.885+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'67 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.885+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x5649a9e3a5a0 2024-04-24T01:45:56.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.886+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.886+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x7f1ea4031040 2024-04-24T01:45:56.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.888+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'61 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.888+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x7f1ea0098070 2024-04-24T01:45:56.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.889+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.889+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x5649a9e407f0 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.890+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.890+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e56e00 con 0x7f1ea0098070 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.891+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'91 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.891+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58070 con 0x7f1ea4031040 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.892+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.892+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58070 con 0x7f1ea0098070 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.893+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.893+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58070 con 0x7f1ea4031040 2024-04-24T01:45:56.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.894+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.895 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.894+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58070 con 0x5649a9e3a5a0 2024-04-24T01:45:56.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.895+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'282 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.896 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.896+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58070 con 0x5649a9e407f0 2024-04-24T01:45:56.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.897+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.897 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.897+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58130 con 0x7f1ea0098070 2024-04-24T01:45:56.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.898+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'92 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.898+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58130 con 0x5649a9e407f0 2024-04-24T01:45:56.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.899+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.899+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58100 con 0x5649a9e3a5a0 2024-04-24T01:45:56.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.900+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.900+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58100 con 0x5649a9e3a5a0 2024-04-24T01:45:56.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.901+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'283 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.901+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x5649a9e407f0 2024-04-24T01:45:56.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.902+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.902+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x7f1ea0098070 2024-04-24T01:45:56.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.903+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.903+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x5649a9e407f0 2024-04-24T01:45:56.904 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.904+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'41 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.904+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x5649a9e407f0 2024-04-24T01:45:56.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.905+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'51 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.905+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x5649a9e407f0 2024-04-24T01:45:56.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.906+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.906+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x5649a9e407f0 2024-04-24T01:45:56.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.907+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'68 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.907+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x7f1ea4031040 2024-04-24T01:45:56.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.908+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.908+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x5649a9e407f0 2024-04-24T01:45:56.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.909+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'45 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.909+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x7f1ea4031040 2024-04-24T01:45:56.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.910+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.910+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x5649a9e407f0 2024-04-24T01:45:56.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.912+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.912+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x7f1ea4031040 2024-04-24T01:45:56.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.913+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'77 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.913+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e58660 con 0x7f1ea0098070 2024-04-24T01:45:56.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.914+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.914+0000 7f1d60fe1640 20 reqs_thread_entry: start 2024-04-24T01:45:56.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.915+0000 7f1eada38800 20 init_complete bucket index max shards: 11 2024-04-24T01:45:56.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.915+0000 7f1eada38800 20 Filter name: none 2024-04-24T01:45:56.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.915+0000 7f1cda7fc640 20 reqs_thread_entry: start 2024-04-24T01:45:56.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.915+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-24T01:45:56.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.915+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.916+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 26 ==== osd_op_reply(94 gc.20 [call] v34'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.916+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.916+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 27 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.916+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.916+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:96 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.916+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 28 ==== osd_op_reply(96 gc.20 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.916+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:97 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.917+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 29 ==== osd_op_reply(97 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.917+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.917+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:98 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.917+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 30 ==== osd_op_reply(98 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.917+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.917+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:99 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.918+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 31 ==== osd_op_reply(99 gc.20 [call] v34'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.918+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-24T01:45:56.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.918+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:100 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.919+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 20 ==== osd_op_reply(100 gc.21 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.919+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:101 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.919+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 21 ==== osd_op_reply(101 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.919+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.919+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:102 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x7f1ea0098070 2024-04-24T01:45:56.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 22 ==== osd_op_reply(102 gc.21 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:103 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 23 ==== osd_op_reply(103 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:104 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 24 ==== osd_op_reply(104 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.920+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:105 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.921+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 25 ==== osd_op_reply(105 gc.21 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.921+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-24T01:45:56.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.921+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:106 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.922+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 32 ==== osd_op_reply(106 gc.22 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.922+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:107 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.922+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 33 ==== osd_op_reply(107 gc.22 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.922+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.922+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:108 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 34 ==== osd_op_reply(108 gc.22 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:109 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 35 ==== osd_op_reply(109 gc.22 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:110 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 36 ==== osd_op_reply(110 gc.22 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.923+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:111 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.924+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 37 ==== osd_op_reply(111 gc.22 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.924+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-24T01:45:56.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.924+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:112 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.925+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 38 ==== osd_op_reply(112 gc.23 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.925+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:113 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.925+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 39 ==== osd_op_reply(113 gc.23 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.925+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.925+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:114 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e407f0 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.925+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 40 ==== osd_op_reply(114 gc.23 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.925+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:115 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.926+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 41 ==== osd_op_reply(115 gc.23 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.926+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.926+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:116 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.926+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 42 ==== osd_op_reply(116 gc.23 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.926+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.926+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:117 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.927+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 43 ==== osd_op_reply(117 gc.23 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.927+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.927+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:118 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.928+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 44 ==== osd_op_reply(118 gc.24 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.928+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:119 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.928+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 45 ==== osd_op_reply(119 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.928+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.928+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:120 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e407f0 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.928+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 46 ==== osd_op_reply(120 gc.24 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.928+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:121 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.929+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 47 ==== osd_op_reply(121 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.929+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.929+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:122 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.929+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 48 ==== osd_op_reply(122 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.929+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.929+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:123 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.930+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 49 ==== osd_op_reply(123 gc.24 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.930+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-24T01:45:56.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.930+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:124 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.931+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 50 ==== osd_op_reply(124 gc.25 [call] v34'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.931+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:125 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.931+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 51 ==== osd_op_reply(125 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.931+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.931+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:126 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 52 ==== osd_op_reply(126 gc.25 [call out=24b] v0'0 uv69 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:127 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 53 ==== osd_op_reply(127 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:128 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 54 ==== osd_op_reply(128 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.932+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:129 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.933+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 55 ==== osd_op_reply(129 gc.25 [call] v34'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.933+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-24T01:45:56.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.933+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:130 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.934+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 22 ==== osd_op_reply(130 gc.26 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.934+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:131 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.934+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 23 ==== osd_op_reply(131 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.934+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.934+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:132 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 24 ==== osd_op_reply(132 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:133 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 25 ==== osd_op_reply(133 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:134 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 26 ==== osd_op_reply(134 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.935+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:135 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.936+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 27 ==== osd_op_reply(135 gc.26 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.936+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-24T01:45:56.938 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.936+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:136 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.937+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 56 ==== osd_op_reply(136 gc.27 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.937+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:137 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.937+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 57 ==== osd_op_reply(137 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.937+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.937+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:138 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.937+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 58 ==== osd_op_reply(138 gc.27 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.937+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:139 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.938+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 59 ==== osd_op_reply(139 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.938+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.938+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:140 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.938+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 60 ==== osd_op_reply(140 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.938+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.938+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:141 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.939+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 61 ==== osd_op_reply(141 gc.27 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.939+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-24T01:45:56.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.939+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:142 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.940+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 28 ==== osd_op_reply(142 gc.28 [call] v34'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.940+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:143 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.940+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 29 ==== osd_op_reply(143 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.940+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.940+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:144 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.941+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 30 ==== osd_op_reply(144 gc.28 [call out=24b] v0'0 uv63 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.941+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:145 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.941+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 31 ==== osd_op_reply(145 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.941+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.941+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:146 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.942+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 32 ==== osd_op_reply(146 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.942+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.942+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:147 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.943+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 33 ==== osd_op_reply(147 gc.28 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.943+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-24T01:45:56.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.943+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:148 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.944+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 62 ==== osd_op_reply(148 gc.29 [call] v34'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.944+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:149 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 63 ==== osd_op_reply(149 gc.29 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:150 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e407f0 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 64 ==== osd_op_reply(150 gc.29 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:151 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 65 ==== osd_op_reply(151 gc.29 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:152 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 66 ==== osd_op_reply(152 gc.29 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.945+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:153 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e407f0 2024-04-24T01:45:56.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.946+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 67 ==== osd_op_reply(153 gc.29 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.946+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-24T01:45:56.948 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.946+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:154 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 34 ==== osd_op_reply(154 gc.30 [call] v34'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:155 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 35 ==== osd_op_reply(155 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:156 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x7f1ea4031040 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 36 ==== osd_op_reply(156 gc.30 [call out=24b] v0'0 uv78 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:157 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 37 ==== osd_op_reply(157 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.948+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:158 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.949+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 38 ==== osd_op_reply(158 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.949+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.949+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:159 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea4031040 2024-04-24T01:45:56.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.950+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 39 ==== osd_op_reply(159 gc.30 [call] v34'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.950+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-24T01:45:56.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.950+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:160 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.951+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 26 ==== osd_op_reply(160 gc.31 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.951+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:161 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 27 ==== osd_op_reply(161 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:162 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x7f1ea0098070 2024-04-24T01:45:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 28 ==== osd_op_reply(162 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:163 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 29 ==== osd_op_reply(163 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:164 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 30 ==== osd_op_reply(164 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.952+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:165 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x7f1ea0098070 2024-04-24T01:45:56.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.954+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 31 ==== osd_op_reply(165 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.954+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-24T01:45:56.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.954+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:166 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.955+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 29 ==== osd_op_reply(166 gc.0 [call] v34'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.955+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:167 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.955+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 30 ==== osd_op_reply(167 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.955+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.955+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:168 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e832a0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.955+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 31 ==== osd_op_reply(168 gc.0 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.955+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:169 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 32 ==== osd_op_reply(169 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:170 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e842b0 con 0x5649a9e3a5a0 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 33 ==== osd_op_reply(170 gc.0 [call out=1716b] v0'0 uv65 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 20 garbage collection: RGWGC::process iterating over entry tag='57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11210972906954469181', time=2024-04-24T01:46:05.005782+0000, chain.objs.size()=7 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_1 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:171 3.2es0 3:74ac15ae:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82a00 con 0x7f1ea0098070 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_2 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:172 3.20s0 3:063a25df:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e877f0 con 0x7f1ea0098070 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_3 2024-04-24T01:45:56.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:173 3.35s0 3:ad61e108:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x5649a9e3a5a0 2024-04-24T01:45:56.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_4 2024-04-24T01:45:56.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:174 3.31s0 3:8db55a65:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8ccd0 con 0x7f1ea4031040 2024-04-24T01:45:56.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_5 2024-04-24T01:45:56.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:175 3.2ds0 3:b5f29583:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x5649a9e407f0 2024-04-24T01:45:56.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_6 2024-04-24T01:45:56.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:176 3.30s0 3:0e7faf80:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8ccd0 con 0x5649a9e407f0 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_7 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.956+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:177 3.3es0 3:7d128d75:::57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x7f1ea4031040 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.958+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 68 ==== osd_op_reply(175 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_5 [call] v34'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.958+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 32 ==== osd_op_reply(171 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_1 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.958+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 40 ==== osd_op_reply(177 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_7 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.959+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 41 ==== osd_op_reply(174 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_4 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.959+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 33 ==== osd_op_reply(172 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.960+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 69 ==== osd_op_reply(176 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_6 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.960+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 34 ==== osd_op_reply(173 57339dfa-6744-4aa2-9c16-e58ce0599faf.4226.11__shadow_.AgaPTqF7sWc313fNknMbGjplwC-mWLf_3 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.960+0000 7f1eada38800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-24T01:45:56.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.960+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:178 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x5649a9e3a5a0 2024-04-24T01:45:56.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.962+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 35 ==== osd_op_reply(178 gc.0 [call] v34'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.962+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:179 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x5649a9e3a5a0 2024-04-24T01:45:56.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.963+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 36 ==== osd_op_reply(179 gc.0 [call] v34'67 uv67 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.963+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-24T01:45:56.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.963+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:180 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x7f1ea4031040 2024-04-24T01:45:56.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.964+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 42 ==== osd_op_reply(180 gc.1 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.964+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:181 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x7f1ea4031040 2024-04-24T01:45:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.965+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 43 ==== osd_op_reply(181 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.965+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.965+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:182 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x7f1ea4031040 2024-04-24T01:45:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.965+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 44 ==== osd_op_reply(182 gc.1 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.965+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:183 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x7f1ea4031040 2024-04-24T01:45:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.966+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 45 ==== osd_op_reply(183 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.966+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.966+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:184 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x7f1ea4031040 2024-04-24T01:45:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.966+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 46 ==== osd_op_reply(184 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.966+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.966+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:185 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x7f1ea4031040 2024-04-24T01:45:56.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.967+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 47 ==== osd_op_reply(185 gc.1 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.967+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-24T01:45:56.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.967+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:186 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e8a320 con 0x5649a9e407f0 2024-04-24T01:45:56.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.968+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 70 ==== osd_op_reply(186 gc.2 [call] v34'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.968+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:187 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89c00 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.968+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 71 ==== osd_op_reply(187 gc.2 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.968+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.968+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:188 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e88bf0 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 72 ==== osd_op_reply(188 gc.2 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:189 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89c00 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 73 ==== osd_op_reply(189 gc.2 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:190 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89c00 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 74 ==== osd_op_reply(190 gc.2 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.969+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:191 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89c00 con 0x5649a9e407f0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.970+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 75 ==== osd_op_reply(191 gc.2 [call] v34'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.970+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.970+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:192 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89c00 con 0x5649a9e3a5a0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.971+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 37 ==== osd_op_reply(192 gc.3 [call] v34'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.971+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:193 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e3a5a0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.971+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 38 ==== osd_op_reply(193 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.971+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.971+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:194 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e3a5a0 2024-04-24T01:45:56.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 39 ==== osd_op_reply(194 gc.3 [call out=24b] v0'0 uv284 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:195 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e3a5a0 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 40 ==== osd_op_reply(195 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:196 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e3a5a0 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 41 ==== osd_op_reply(196 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.972+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:197 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e3a5a0 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.973+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 42 ==== osd_op_reply(197 gc.3 [call] v34'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.973+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-24T01:45:56.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.973+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:198 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x7f1ea0098070 2024-04-24T01:45:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.974+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 34 ==== osd_op_reply(198 gc.4 [call] v34'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.974+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:199 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x7f1ea0098070 2024-04-24T01:45:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 35 ==== osd_op_reply(199 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:200 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x7f1ea0098070 2024-04-24T01:45:56.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 36 ==== osd_op_reply(200 gc.4 [call out=24b] v0'0 uv93 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:201 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x7f1ea0098070 2024-04-24T01:45:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 37 ==== osd_op_reply(201 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.975+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:202 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x7f1ea0098070 2024-04-24T01:45:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.976+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 38 ==== osd_op_reply(202 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.976+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.976+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:203 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x7f1ea0098070 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.977+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 39 ==== osd_op_reply(203 gc.4 [call] v34'94 uv94 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.977+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.977+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:204 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e407f0 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.977+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 76 ==== osd_op_reply(204 gc.5 [call] v34'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:205 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e407f0 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 77 ==== osd_op_reply(205 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:206 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e82400 con 0x5649a9e407f0 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 78 ==== osd_op_reply(206 gc.5 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:207 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 79 ==== osd_op_reply(207 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:208 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 80 ==== osd_op_reply(208 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.978+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:209 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.979+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 81 ==== osd_op_reply(209 gc.5 [call] v34'72 uv72 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.979+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-24T01:45:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.979+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:210 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.980+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 43 ==== osd_op_reply(210 gc.6 [call] v34'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:211 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 44 ==== osd_op_reply(211 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:212 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e40 con 0x5649a9e3a5a0 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 45 ==== osd_op_reply(212 gc.6 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:213 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 46 ==== osd_op_reply(213 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:214 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 47 ==== osd_op_reply(214 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.981+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:215 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:56.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.982+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 48 ==== osd_op_reply(215 gc.6 [call] v34'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:56.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.982+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-24T01:45:56.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.983+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:216 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.984+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 48 ==== osd_op_reply(216 gc.7 [call] v34'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.984+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:217 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.984+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 49 ==== osd_op_reply(217 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.984+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.984+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:218 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e40 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.984+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 50 ==== osd_op_reply(218 gc.7 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.984+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:219 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.985+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 51 ==== osd_op_reply(219 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.985+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.985+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:220 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.985+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 52 ==== osd_op_reply(220 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.985+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.985+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:221 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.986+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 53 ==== osd_op_reply(221 gc.7 [call] v34'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.986+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.986+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:222 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 40 ==== osd_op_reply(222 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:223 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 41 ==== osd_op_reply(223 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:224 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e40 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 42 ==== osd_op_reply(224 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:225 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 43 ==== osd_op_reply(225 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.987+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:226 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.988+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 44 ==== osd_op_reply(226 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.988+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.988+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:227 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.989+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 45 ==== osd_op_reply(227 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.989+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.989+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:228 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.990+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 82 ==== osd_op_reply(228 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.990+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:229 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.990+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 83 ==== osd_op_reply(229 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.990+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.990+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:230 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e88a40 con 0x5649a9e407f0 2024-04-24T01:45:56.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.990+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 84 ==== osd_op_reply(230 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.990+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:231 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.991+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 85 ==== osd_op_reply(231 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.991+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.991+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:232 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.991+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 86 ==== osd_op_reply(232 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.991+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.991+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:233 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:56.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.992+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 87 ==== osd_op_reply(233 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:56.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.992+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-24T01:45:56.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.992+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:234 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 46 ==== osd_op_reply(234 gc.10 [call] v34'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:235 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 47 ==== osd_op_reply(235 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:236 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e10 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 48 ==== osd_op_reply(236 gc.10 [call out=24b] v0'0 uv95 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:237 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 49 ==== osd_op_reply(237 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.993+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:238 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.994+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 50 ==== osd_op_reply(238 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.994+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.994+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:239 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.994+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 51 ==== osd_op_reply(239 gc.10 [call] v34'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.994+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-24T01:45:56.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.994+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:240 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.996+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 54 ==== osd_op_reply(240 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.996+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:241 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.996+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 55 ==== osd_op_reply(241 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.996+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.996+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:242 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e88a40 con 0x7f1ea4031040 2024-04-24T01:45:56.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.997+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 56 ==== osd_op_reply(242 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.997+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:243 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.997+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 57 ==== osd_op_reply(243 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.998+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:56.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.998+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:244 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:56.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.998+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 58 ==== osd_op_reply(244 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:56.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.998+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:56.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.998+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:245 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:57.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.999+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 59 ==== osd_op_reply(245 gc.11 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.999+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-24T01:45:57.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:56.999+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:246 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.000+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 52 ==== osd_op_reply(246 gc.12 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.000+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:247 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.000+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 53 ==== osd_op_reply(247 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:248 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e30 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 54 ==== osd_op_reply(248 gc.12 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:249 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 55 ==== osd_op_reply(249 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:250 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 56 ==== osd_op_reply(250 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.001+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:251 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.002+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 57 ==== osd_op_reply(251 gc.12 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.002+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-24T01:45:57.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.002+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:252 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:57.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.003+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 60 ==== osd_op_reply(252 gc.13 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.003+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:253 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 61 ==== osd_op_reply(253 gc.13 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:254 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e10 con 0x7f1ea4031040 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 62 ==== osd_op_reply(254 gc.13 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:255 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 63 ==== osd_op_reply(255 gc.13 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.004+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:256 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:57.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.005+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 64 ==== osd_op_reply(256 gc.13 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.005+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.005+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:257 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea4031040 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.006+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 65 ==== osd_op_reply(257 gc.13 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.006+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.006+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:258 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.007+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 49 ==== osd_op_reply(258 gc.14 [call] v34'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.007+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:259 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.007+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 50 ==== osd_op_reply(259 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.007+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.007+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:260 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e88a40 con 0x5649a9e3a5a0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 51 ==== osd_op_reply(260 gc.14 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:261 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 52 ==== osd_op_reply(261 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:262 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 53 ==== osd_op_reply(262 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.008+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:263 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.009+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 54 ==== osd_op_reply(263 gc.14 [call] v34'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.009+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.009+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:264 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.010+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 88 ==== osd_op_reply(264 gc.15 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.010+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:265 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 89 ==== osd_op_reply(265 gc.15 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:266 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e30 con 0x5649a9e407f0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 90 ==== osd_op_reply(266 gc.15 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:267 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 91 ==== osd_op_reply(267 gc.15 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:268 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 92 ==== osd_op_reply(268 gc.15 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.011+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:269 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.012+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 93 ==== osd_op_reply(269 gc.15 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.012+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.012+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:270 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.013+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 58 ==== osd_op_reply(270 gc.16 [call] v34'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.013+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:271 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 59 ==== osd_op_reply(271 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:272 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e88a40 con 0x7f1ea0098070 2024-04-24T01:45:57.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 60 ==== osd_op_reply(272 gc.16 [call out=24b] v0'0 uv97 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:273 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 61 ==== osd_op_reply(273 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:274 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 62 ==== osd_op_reply(274 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea4040040 con 0x7f1ea0098070 2024-04-24T01:45:57.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.014+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:275 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x7f1ea0098070 2024-04-24T01:45:57.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.015+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 63 ==== osd_op_reply(275 gc.16 [call] v34'98 uv98 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea404e040 con 0x7f1ea0098070 2024-04-24T01:45:57.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.015+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-24T01:45:57.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.015+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:276 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.016+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 94 ==== osd_op_reply(276 gc.17 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.016+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:277 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.016+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 95 ==== osd_op_reply(277 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.016+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.016+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:278 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e88a40 con 0x5649a9e407f0 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 96 ==== osd_op_reply(278 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:279 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 97 ==== osd_op_reply(279 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:280 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 98 ==== osd_op_reply(280 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.017+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:281 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e407f0 2024-04-24T01:45:57.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.018+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 99 ==== osd_op_reply(281 gc.17 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.018+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-24T01:45:57.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.018+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:282 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 55 ==== osd_op_reply(282 gc.18 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:283 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 56 ==== osd_op_reply(283 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:284 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e60 con 0x5649a9e3a5a0 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 57 ==== osd_op_reply(284 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:285 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e60 con 0x5649a9e3a5a0 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 58 ==== osd_op_reply(285 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.020+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:286 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.021+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 59 ==== osd_op_reply(286 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.021+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.021+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:287 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.022+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 60 ==== osd_op_reply(287 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.022+0000 7f1eada38800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-24T01:45:57.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.022+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:288 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 61 ==== osd_op_reply(288 gc.19 [call] v34'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:289 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 62 ==== osd_op_reply(289 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:290 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e88a40 con 0x5649a9e3a5a0 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 63 ==== osd_op_reply(290 gc.19 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:291 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 64 ==== osd_op_reply(291 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.023+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:292 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.024+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 65 ==== osd_op_reply(292 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.024+0000 7f1eada38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:45:57.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.024+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:293 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89a50 con 0x5649a9e3a5a0 2024-04-24T01:45:57.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.025+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 66 ==== osd_op_reply(293 gc.19 [call] v34'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.025+0000 7f1d61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:45:57.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.025+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94874382948080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e89e40 con 0x5649a9e3a5a0 2024-04-24T01:45:57.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.026+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94874382948080] v34'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.026+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94874382914000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e4d6f0 con 0x7f1ea0098070 2024-04-24T01:45:57.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.027+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94874382914000] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea404e040 con 0x7f1ea0098070 2024-04-24T01:45:57.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.027+0000 7f1eada38800 20 remove_watcher() i=0 2024-04-24T01:45:57.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.027+0000 7f1eada38800 2 removed watcher, disabling cache 2024-04-24T01:45:57.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.027+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94874382911760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e451d0 con 0x5649a9e3a5a0 2024-04-24T01:45:57.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.028+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94874382911760] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.028+0000 7f1eada38800 20 remove_watcher() i=1 2024-04-24T01:45:57.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.028+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94874382917920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e44910 con 0x5649a9e407f0 2024-04-24T01:45:57.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.030+0000 7f1eaad36640 1 -- 172.21.15.131:0/1169856924 <== osd.3 v2:172.21.15.131:6800/3849831825 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94874382917920] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea0095030 con 0x5649a9e407f0 2024-04-24T01:45:57.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.030+0000 7f1eada38800 20 remove_watcher() i=2 2024-04-24T01:45:57.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.030+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94874382922544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e46120 con 0x7f1ea0098070 2024-04-24T01:45:57.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.031+0000 7f1eabd38640 1 -- 172.21.15.131:0/1169856924 <== osd.2 v2:172.21.15.131:6809/3673094383 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94874382922544] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea404e040 con 0x7f1ea0098070 2024-04-24T01:45:57.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.031+0000 7f1eada38800 20 remove_watcher() i=3 2024-04-24T01:45:57.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.031+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94874382927392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e46120 con 0x5649a9e3a5a0 2024-04-24T01:45:57.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.032+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.1 v2:172.21.15.131:6808/2417718615 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94874382927392] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x5649a9e3a5a0 2024-04-24T01:45:57.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.032+0000 7f1eada38800 20 remove_watcher() i=4 2024-04-24T01:45:57.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.032+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94874382930128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e46120 con 0x7f1ea4031040 2024-04-24T01:45:57.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.033+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94874382930128] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.033+0000 7f1eada38800 20 remove_watcher() i=5 2024-04-24T01:45:57.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.033+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94874382924592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e490d0 con 0x7f1ea4031040 2024-04-24T01:45:57.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.034+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94874382924592] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.034+0000 7f1eada38800 20 remove_watcher() i=6 2024-04-24T01:45:57.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.034+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94874382932784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649a9e47b30 con 0x7f1ea4031040 2024-04-24T01:45:57.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 <== osd.0 v2:172.21.15.107:6800/2413654117 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94874382932784] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e9c029030 con 0x7f1ea4031040 2024-04-24T01:45:57.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 20 remove_watcher() i=7 2024-04-24T01:45:57.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1ea4031040 msgr2=0x7f1ea4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f1ea4031040 0x7f1ea4032940 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9e3a5a0 msgr2=0x5649a9e3ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9e3a5a0 0x5649a9e3ca60 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1ea0098070 msgr2=0x7f1ea0065890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f1ea0098070 0x7f1ea0065890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5649a9e407f0 msgr2=0x5649a9e42be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.035+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x5649a9e407f0 0x5649a9e42be0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d74036950 msgr2=0x7f1d74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d74036950 0x7f1d74038e10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5649a9df7bb0 tx=0x7f1ea401f000 comp rx=0 tx=0).stop 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 msgr2=0x5649a9e2ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/1169856924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e27600 0x5649a9e2ead0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1ea005d500 tx=0x7f1ea008d960 comp rx=0 tx=0).stop 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 reap_dead start 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eab537640 1 -- 172.21.15.131:0/1169856924 reap_dead start 2024-04-24T01:45:57.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 shutdown_connections 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 >> 172.21.15.131:0/1169856924 conn(0x5649a9e23960 msgr2=0x5649a9e20fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 shutdown_connections 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1169856924 wait complete. 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d84036900 msgr2=0x7f1d84038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d84036900 0x7f1d84038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5649a9e0ab70 tx=0x7f1ea4005840 comp rx=0 tx=0).stop 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e1a3c0 msgr2=0x5649a9e1a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e1a3c0 0x5649a9e1a7e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0044840 tx=0x7f1ea0002fb0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 shutdown_connections 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d84036900 0x7f1d84038dc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/1584534801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9e1a3c0 0x5649a9e1a7e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 >> 172.21.15.131:0/1584534801 conn(0x5649a9e0e460 msgr2=0x5649a9e0e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 shutdown_connections 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/1584534801 wait complete. 2024-04-24T01:45:57.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9d0a1b0 msgr2=0x5649a9e090c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9d0a1b0 0x5649a9e090c0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d90036900 msgr2=0x7f1d90038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d90036900 0x7f1d90038dc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0054000 tx=0x7f1ea004e000 comp rx=0 tx=0).stop 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 msgr2=0x5649a9df8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.036+0000 7f1eada38800 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9df8730 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c004000 tx=0x7f1e9c000bc0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.037+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 shutdown_connections 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.037+0000 7f1eada38800 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x5649a9d0a1b0 0x5649a9e090c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.037+0000 7f1eada38800 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f1d90036900 0x7f1d90038dc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.037+0000 7f1eada38800 1 --2- 172.21.15.131:0/119193727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649a9d05d20 0x5649a9df8730 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.037+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 >> 172.21.15.131:0/119193727 conn(0x5649a9d01380 msgr2=0x5649a9df11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.037+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 shutdown_connections 2024-04-24T01:45:57.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-24T01:45:57.037+0000 7f1eada38800 1 -- 172.21.15.131:0/119193727 wait complete. 2024-04-24T01:45:57.045 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T01:45:57.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T01:45:57.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:45:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.151+0000 7fc94deba640 1 Processor -- start 2024-04-24T01:45:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.151+0000 7fc94deba640 1 -- start start 2024-04-24T01:45:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.151+0000 7fc94deba640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc948127ce0 0x7fc9481280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.151+0000 7fc94deba640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc948127b00 con 0x7fc948070100 2024-04-24T01:45:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.151+0000 7fc94deba640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc9480708e0 con 0x7fc948127ce0 2024-04-24T01:45:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.152+0000 7fc9477fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc948127ce0 0x7fc9481280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.152+0000 7fc946ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc948070100 0x7fc94812b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35868/0 (socket says 172.21.15.107:35868) 2024-04-24T01:45:57.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.152+0000 7fc946ffd640 1 -- 172.21.15.107:0/4113625926 learned_addr learned my addr 172.21.15.107:0/4113625926 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:45:57.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.152+0000 7fc9477fe640 1 -- 172.21.15.107:0/4113625926 >> v1:172.21.15.107:6789/0 conn(0x7fc948070100 legacy=0x7fc94812b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.152+0000 7fc9467fc640 1 -- 172.21.15.107:0/4113625926 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497041747 0 0) 0x7fc93c001110 con 0x7fc948070100 2024-04-24T01:45:57.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.152+0000 7fc9477fe640 1 -- 172.21.15.107:0/4113625926 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc948098800 con 0x7fc948127ce0 2024-04-24T01:45:57.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc9477fe640 1 --2- 172.21.15.107:0/4113625926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948127ce0 0x7fc9481280c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc938009720 tx=0x7fc93802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9959c79346c0c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc9467fc640 1 -- 172.21.15.107:0/4113625926 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9380316d0 con 0x7fc948127ce0 2024-04-24T01:45:57.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc9467fc640 1 -- 172.21.15.107:0/4113625926 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc938037070 con 0x7fc948127ce0 2024-04-24T01:45:57.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc9467fc640 1 -- 172.21.15.107:0/4113625926 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9380319c0 con 0x7fc948127ce0 2024-04-24T01:45:57.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc94deba640 1 -- 172.21.15.107:0/4113625926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948127ce0 msgr2=0x7fc9481280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc94deba640 1 --2- 172.21.15.107:0/4113625926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948127ce0 0x7fc9481280c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc938009720 tx=0x7fc93802b840 comp rx=0 tx=0).stop 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc94deba640 1 -- 172.21.15.107:0/4113625926 shutdown_connections 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc94deba640 1 --2- 172.21.15.107:0/4113625926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948127ce0 0x7fc9481280c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc94deba640 1 -- 172.21.15.107:0/4113625926 >> 172.21.15.107:0/4113625926 conn(0x7fc948099680 msgr2=0x7fc948099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc94deba640 1 -- 172.21.15.107:0/4113625926 shutdown_connections 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.153+0000 7fc94deba640 1 -- 172.21.15.107:0/4113625926 wait complete. 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.154+0000 7fc94deba640 1 Processor -- start 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.154+0000 7fc94deba640 1 -- start start 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.154+0000 7fc94deba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948070100 0x7fc948089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc94deba640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc948128780 con 0x7fc948070100 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc9477fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948070100 0x7fc948089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc9477fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948070100 0x7fc948089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47904/0 (socket says 172.21.15.107:47904) 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc9477fe640 1 -- 172.21.15.107:0/171709701 learned_addr learned my addr 172.21.15.107:0/171709701 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc9477fe640 1 -- 172.21.15.107:0/171709701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94812b020 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc9477fe640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948070100 0x7fc948089f90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc93802b880 tx=0x7fc9380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc92ffff640 1 -- 172.21.15.107:0/171709701 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc938004160 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc92ffff640 1 -- 172.21.15.107:0/171709701 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc938004300 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94808b720 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc92ffff640 1 -- 172.21.15.107:0/171709701 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc938032640 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.155+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94808cf60 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.156+0000 7fc92ffff640 1 -- 172.21.15.107:0/171709701 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9380327e0 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.156+0000 7fc92ffff640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc934038060 0x7fc93403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.156+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc948071710 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.156+0000 7fc92ffff640 1 -- 172.21.15.107:0/171709701 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc93802f050 con 0x7fc948070100 2024-04-24T01:45:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.156+0000 7fc946ffd640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc934038060 0x7fc93403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.157+0000 7fc946ffd640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc934038060 0x7fc93403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c00 tx=0x7fc93c001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.161+0000 7fc92ffff640 1 -- 172.21.15.107:0/171709701 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fc948071710 con 0x7fc948070100 2024-04-24T01:45:57.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.332+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc948062da0 con 0x7fc934038060 2024-04-24T01:45:57.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.347+0000 7fc92ffff640 1 -- 172.21.15.107:0/171709701 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665681 (secure 0 0 0) 0x7fc948062da0 con 0x7fc934038060 2024-04-24T01:45:57.357 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:45:57.363 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc934038060 msgr2=0x7fc93403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc934038060 0x7fc93403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c00 tx=0x7fc93c001310 comp rx=0 tx=0).stop 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948070100 msgr2=0x7fc948089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948070100 0x7fc948089f90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc93802b880 tx=0x7fc9380046c0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 shutdown_connections 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc934038060 0x7fc93403a520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 --2- 172.21.15.107:0/171709701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc948070100 0x7fc948089f90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.352+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 >> 172.21.15.107:0/171709701 conn(0x7fc948099680 msgr2=0x7fc94809ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.353+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 shutdown_connections 2024-04-24T01:45:57.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.353+0000 7fc94deba640 1 -- 172.21.15.107:0/171709701 wait complete. 2024-04-24T01:45:57.368 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-24T01:45:56.065867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":259,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5177,"num_read_kb":4722,"num_write":2296,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4673,"ondisk_log_size":4673,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186220,"kb_used_data":40716,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301140,"statfs":{"total":386547056640,"available":386356367360,"internally_reserved":0,"allocated":41693184,"data_stored":40506245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003703"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810312+0000","last_change":"2024-04-24T01:42:40.781437+0000","last_active":"2024-04-24T01:43:21.810312+0000","last_peered":"2024-04-24T01:43:21.810312+0000","last_clean":"2024-04-24T01:43:21.810312+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:43:21.810312+0000","last_undegraded":"2024-04-24T01:43:21.810312+0000","last_fullsized":"2024-04-24T01:43:21.810312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138190+0000","last_change":"2024-04-24T01:42:42.785371+0000","last_active":"2024-04-24T01:45:50.138190+0000","last_peered":"2024-04-24T01:45:50.138190+0000","last_clean":"2024-04-24T01:45:50.138190+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:45:50.138190+0000","last_undegraded":"2024-04-24T01:45:50.138190+0000","last_fullsized":"2024-04-24T01:45:50.138190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082623+0000","last_change":"2024-04-24T01:42:40.769679+0000","last_active":"2024-04-24T01:44:49.082623+0000","last_peered":"2024-04-24T01:44:49.082623+0000","last_clean":"2024-04-24T01:44:49.082623+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:44:49.082623+0000","last_undegraded":"2024-04-24T01:44:49.082623+0000","last_fullsized":"2024-04-24T01:44:49.082623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:45.687433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.044899+0000","last_change":"2024-04-24T01:42:42.780099+0000","last_active":"2024-04-24T01:45:50.044899+0000","last_peered":"2024-04-24T01:45:50.044899+0000","last_clean":"2024-04-24T01:45:50.044899+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:45:50.044899+0000","last_undegraded":"2024-04-24T01:45:50.044899+0000","last_fullsized":"2024-04-24T01:45:50.044899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:41.652689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814577+0000","last_change":"2024-04-24T01:42:40.787360+0000","last_active":"2024-04-24T01:43:21.814577+0000","last_peered":"2024-04-24T01:43:21.814577+0000","last_clean":"2024-04-24T01:43:21.814577+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:43:21.814577+0000","last_undegraded":"2024-04-24T01:43:21.814577+0000","last_fullsized":"2024-04-24T01:43:21.814577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:17.246961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315339+0000","last_change":"2024-04-24T01:42:42.777928+0000","last_active":"2024-04-24T01:45:50.315339+0000","last_peered":"2024-04-24T01:45:50.315339+0000","last_clean":"2024-04-24T01:45:50.315339+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:45:50.315339+0000","last_undegraded":"2024-04-24T01:45:50.315339+0000","last_fullsized":"2024-04-24T01:45:50.315339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:43.330594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808622+0000","last_change":"2024-04-24T01:42:40.777293+0000","last_active":"2024-04-24T01:43:21.808622+0000","last_peered":"2024-04-24T01:43:21.808622+0000","last_clean":"2024-04-24T01:43:21.808622+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:43:21.808622+0000","last_undegraded":"2024-04-24T01:43:21.808622+0000","last_fullsized":"2024-04-24T01:43:21.808622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812539+0000","last_change":"2024-04-24T01:42:42.782433+0000","last_active":"2024-04-24T01:43:21.812539+0000","last_peered":"2024-04-24T01:43:21.812539+0000","last_clean":"2024-04-24T01:43:21.812539+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:43:21.812539+0000","last_undegraded":"2024-04-24T01:43:21.812539+0000","last_fullsized":"2024-04-24T01:43:21.812539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:46.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.252337+0000","last_change":"2024-04-24T01:42:40.787185+0000","last_active":"2024-04-24T01:45:50.252337+0000","last_peered":"2024-04-24T01:45:50.252337+0000","last_clean":"2024-04-24T01:45:50.252337+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:45:50.252337+0000","last_undegraded":"2024-04-24T01:45:50.252337+0000","last_fullsized":"2024-04-24T01:45:50.252337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:54.284107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321632+0000","last_change":"2024-04-24T01:42:42.783384+0000","last_active":"2024-04-24T01:45:50.321632+0000","last_peered":"2024-04-24T01:45:50.321632+0000","last_clean":"2024-04-24T01:45:50.321632+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:45:50.321632+0000","last_undegraded":"2024-04-24T01:45:50.321632+0000","last_fullsized":"2024-04-24T01:45:50.321632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:43.429543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808027+0000","last_change":"2024-04-24T01:42:40.775908+0000","last_active":"2024-04-24T01:43:21.808027+0000","last_peered":"2024-04-24T01:43:21.808027+0000","last_clean":"2024-04-24T01:43:21.808027+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:43:21.808027+0000","last_undegraded":"2024-04-24T01:43:21.808027+0000","last_fullsized":"2024-04-24T01:43:21.808027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.800378+0000","last_change":"2024-04-24T01:43:21.820449+0000","last_active":"2024-04-24T01:44:05.800378+0000","last_peered":"2024-04-24T01:44:05.800378+0000","last_clean":"2024-04-24T01:44:05.800378+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:44:05.800378+0000","last_undegraded":"2024-04-24T01:44:05.800378+0000","last_fullsized":"2024-04-24T01:44:05.800378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:18.138123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812225+0000","last_change":"2024-04-24T01:42:40.785983+0000","last_active":"2024-04-24T01:43:21.812225+0000","last_peered":"2024-04-24T01:43:21.812225+0000","last_clean":"2024-04-24T01:43:21.812225+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:43:21.812225+0000","last_undegraded":"2024-04-24T01:43:21.812225+0000","last_fullsized":"2024-04-24T01:43:21.812225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:42.761936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270804+0000","last_change":"2024-04-24T01:42:42.788032+0000","last_active":"2024-04-24T01:45:50.270804+0000","last_peered":"2024-04-24T01:45:50.270804+0000","last_clean":"2024-04-24T01:45:50.270804+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:45:50.270804+0000","last_undegraded":"2024-04-24T01:45:50.270804+0000","last_fullsized":"2024-04-24T01:45:50.270804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862584+0000","last_change":"2024-04-24T01:42:40.778279+0000","last_active":"2024-04-24T01:43:21.862584+0000","last_peered":"2024-04-24T01:43:21.862584+0000","last_clean":"2024-04-24T01:43:21.862584+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:43:21.862584+0000","last_undegraded":"2024-04-24T01:43:21.862584+0000","last_fullsized":"2024-04-24T01:43:21.862584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:39.530334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138297+0000","last_change":"2024-04-24T01:42:42.789315+0000","last_active":"2024-04-24T01:45:50.138297+0000","last_peered":"2024-04-24T01:45:50.138297+0000","last_clean":"2024-04-24T01:45:50.138297+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:45:50.138297+0000","last_undegraded":"2024-04-24T01:45:50.138297+0000","last_fullsized":"2024-04-24T01:45:50.138297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270574+0000","last_change":"2024-04-24T01:42:42.779841+0000","last_active":"2024-04-24T01:45:50.270574+0000","last_peered":"2024-04-24T01:45:50.270574+0000","last_clean":"2024-04-24T01:45:50.270574+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:45:50.270574+0000","last_undegraded":"2024-04-24T01:45:50.270574+0000","last_fullsized":"2024-04-24T01:45:50.270574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:31.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817068+0000","last_change":"2024-04-24T01:42:40.791488+0000","last_active":"2024-04-24T01:43:21.817068+0000","last_peered":"2024-04-24T01:43:21.817068+0000","last_clean":"2024-04-24T01:43:21.817068+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:43:21.817068+0000","last_undegraded":"2024-04-24T01:43:21.817068+0000","last_fullsized":"2024-04-24T01:43:21.817068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315684+0000","last_change":"2024-04-24T01:42:42.782524+0000","last_active":"2024-04-24T01:45:50.315684+0000","last_peered":"2024-04-24T01:45:50.315684+0000","last_clean":"2024-04-24T01:45:50.315684+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:45:50.315684+0000","last_undegraded":"2024-04-24T01:45:50.315684+0000","last_fullsized":"2024-04-24T01:45:50.315684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:25.756967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811766+0000","last_change":"2024-04-24T01:42:40.784169+0000","last_active":"2024-04-24T01:43:21.811766+0000","last_peered":"2024-04-24T01:43:21.811766+0000","last_clean":"2024-04-24T01:43:21.811766+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:43:21.811766+0000","last_undegraded":"2024-04-24T01:43:21.811766+0000","last_fullsized":"2024-04-24T01:43:21.811766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353379+0000","last_change":"2024-04-24T01:42:42.783807+0000","last_active":"2024-04-24T01:45:50.353379+0000","last_peered":"2024-04-24T01:45:50.353379+0000","last_clean":"2024-04-24T01:45:50.353379+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:45:50.353379+0000","last_undegraded":"2024-04-24T01:45:50.353379+0000","last_fullsized":"2024-04-24T01:45:50.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:04.077606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090155+0000","last_change":"2024-04-24T01:42:40.792423+0000","last_active":"2024-04-24T01:45:06.090155+0000","last_peered":"2024-04-24T01:45:06.090155+0000","last_clean":"2024-04-24T01:45:06.090155+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:45:06.090155+0000","last_undegraded":"2024-04-24T01:45:06.090155+0000","last_fullsized":"2024-04-24T01:45:06.090155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654988+0000","last_change":"2024-04-24T01:42:42.790737+0000","last_active":"2024-04-24T01:44:49.654988+0000","last_peered":"2024-04-24T01:44:49.654988+0000","last_clean":"2024-04-24T01:44:49.654988+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:44:49.654988+0000","last_undegraded":"2024-04-24T01:44:49.654988+0000","last_fullsized":"2024-04-24T01:44:49.654988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:20.557905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.632047+0000","last_change":"2024-04-24T01:42:40.782750+0000","last_active":"2024-04-24T01:44:49.632047+0000","last_peered":"2024-04-24T01:44:49.632047+0000","last_clean":"2024-04-24T01:44:49.632047+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:44:49.632047+0000","last_undegraded":"2024-04-24T01:44:49.632047+0000","last_fullsized":"2024-04-24T01:44:49.632047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270479+0000","last_change":"2024-04-24T01:42:42.790992+0000","last_active":"2024-04-24T01:45:50.270479+0000","last_peered":"2024-04-24T01:45:50.270479+0000","last_clean":"2024-04-24T01:45:50.270479+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:45:50.270479+0000","last_undegraded":"2024-04-24T01:45:50.270479+0000","last_fullsized":"2024-04-24T01:45:50.270479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:12.881341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864678+0000","last_change":"2024-04-24T01:42:40.769585+0000","last_active":"2024-04-24T01:43:21.864678+0000","last_peered":"2024-04-24T01:43:21.864678+0000","last_clean":"2024-04-24T01:43:21.864678+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:43:21.864678+0000","last_undegraded":"2024-04-24T01:43:21.864678+0000","last_fullsized":"2024-04-24T01:43:21.864678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:33:56.281356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137384+0000","last_change":"2024-04-24T01:42:42.784217+0000","last_active":"2024-04-24T01:45:50.137384+0000","last_peered":"2024-04-24T01:45:50.137384+0000","last_clean":"2024-04-24T01:45:50.137384+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:45:50.137384+0000","last_undegraded":"2024-04-24T01:45:50.137384+0000","last_fullsized":"2024-04-24T01:45:50.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:21.185447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.340485+0000","last_change":"2024-04-24T01:42:40.786476+0000","last_active":"2024-04-24T01:45:50.340485+0000","last_peered":"2024-04-24T01:45:50.340485+0000","last_clean":"2024-04-24T01:45:50.340485+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:45:50.340485+0000","last_undegraded":"2024-04-24T01:45:50.340485+0000","last_fullsized":"2024-04-24T01:45:50.340485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:50.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.295799+0000","last_change":"2024-04-24T01:42:50.802941+0000","last_active":"2024-04-24T01:45:50.295799+0000","last_peered":"2024-04-24T01:45:50.295799+0000","last_clean":"2024-04-24T01:45:50.295799+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:45:50.295799+0000","last_undegraded":"2024-04-24T01:45:50.295799+0000","last_fullsized":"2024-04-24T01:45:50.295799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:19.486282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351833+0000","last_change":"2024-04-24T01:42:42.786160+0000","last_active":"2024-04-24T01:45:50.351833+0000","last_peered":"2024-04-24T01:45:50.351833+0000","last_clean":"2024-04-24T01:45:50.351833+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:45:50.351833+0000","last_undegraded":"2024-04-24T01:45:50.351833+0000","last_fullsized":"2024-04-24T01:45:50.351833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:05.195853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791802+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:36.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818082+0000","last_change":"2024-04-24T01:43:21.817222+0000","last_active":"2024-04-24T01:43:21.818082+0000","last_peered":"2024-04-24T01:43:21.818082+0000","last_clean":"2024-04-24T01:43:21.818082+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:43:21.818082+0000","last_undegraded":"2024-04-24T01:43:21.818082+0000","last_fullsized":"2024-04-24T01:43:21.818082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:34.889879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.217678+0000","last_change":"2024-04-24T01:42:46.785609+0000","last_active":"2024-04-24T01:44:48.217678+0000","last_peered":"2024-04-24T01:44:48.217678+0000","last_clean":"2024-04-24T01:44:48.217678+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:44:48.217678+0000","last_undegraded":"2024-04-24T01:44:48.217678+0000","last_fullsized":"2024-04-24T01:44:48.217678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:24.228056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816972+0000","last_change":"2024-04-24T01:42:48.793869+0000","last_active":"2024-04-24T01:43:21.816972+0000","last_peered":"2024-04-24T01:43:21.816972+0000","last_clean":"2024-04-24T01:43:21.816972+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:43:21.816972+0000","last_undegraded":"2024-04-24T01:43:21.816972+0000","last_fullsized":"2024-04-24T01:43:21.816972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:23.315540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.805565+0000","last_change":"2024-04-24T01:42:50.802222+0000","last_active":"2024-04-24T01:44:05.805565+0000","last_peered":"2024-04-24T01:44:05.805565+0000","last_clean":"2024-04-24T01:44:05.805565+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:44:05.805565+0000","last_undegraded":"2024-04-24T01:44:05.805565+0000","last_fullsized":"2024-04-24T01:44:05.805565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:26.157145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.020370+0000","last_change":"2024-04-24T01:42:42.784837+0000","last_active":"2024-04-24T01:44:06.020370+0000","last_peered":"2024-04-24T01:44:06.020370+0000","last_clean":"2024-04-24T01:44:06.020370+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:44:06.020370+0000","last_undegraded":"2024-04-24T01:44:06.020370+0000","last_fullsized":"2024-04-24T01:44:06.020370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:40.033902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.432410+0000","last_change":"2024-04-24T01:42:40.782079+0000","last_active":"2024-04-24T01:43:23.432410+0000","last_peered":"2024-04-24T01:43:23.432410+0000","last_clean":"2024-04-24T01:43:23.432410+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:43:23.432410+0000","last_undegraded":"2024-04-24T01:43:23.432410+0000","last_fullsized":"2024-04-24T01:43:23.432410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863552+0000","last_change":"2024-04-24T01:42:44.776066+0000","last_active":"2024-04-24T01:43:21.863552+0000","last_peered":"2024-04-24T01:43:21.863552+0000","last_clean":"2024-04-24T01:43:21.863552+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:43:21.863552+0000","last_undegraded":"2024-04-24T01:43:21.863552+0000","last_fullsized":"2024-04-24T01:43:21.863552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:21.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814388+0000","last_change":"2024-04-24T01:42:46.778609+0000","last_active":"2024-04-24T01:43:21.814388+0000","last_peered":"2024-04-24T01:43:21.814388+0000","last_clean":"2024-04-24T01:43:21.814388+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:43:21.814388+0000","last_undegraded":"2024-04-24T01:43:21.814388+0000","last_fullsized":"2024-04-24T01:43:21.814388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:18.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814658+0000","last_change":"2024-04-24T01:42:48.790498+0000","last_active":"2024-04-24T01:43:21.814658+0000","last_peered":"2024-04-24T01:43:21.814658+0000","last_clean":"2024-04-24T01:43:21.814658+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:43:21.814658+0000","last_undegraded":"2024-04-24T01:43:21.814658+0000","last_fullsized":"2024-04-24T01:43:21.814658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:35.394375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.749783+0000","last_change":"2024-04-24T01:42:50.793834+0000","last_active":"2024-04-24T01:45:49.749783+0000","last_peered":"2024-04-24T01:45:49.749783+0000","last_clean":"2024-04-24T01:45:49.749783+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:45:49.749783+0000","last_undegraded":"2024-04-24T01:45:49.749783+0000","last_fullsized":"2024-04-24T01:45:49.749783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:58.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'21","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351802+0000","last_change":"2024-04-24T01:42:42.777752+0000","last_active":"2024-04-24T01:45:50.351802+0000","last_peered":"2024-04-24T01:45:50.351802+0000","last_clean":"2024-04-24T01:45:50.351802+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:45:50.351802+0000","last_undegraded":"2024-04-24T01:45:50.351802+0000","last_fullsized":"2024-04-24T01:45:50.351802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:23.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.522600+0000","last_change":"2024-04-24T01:42:40.790240+0000","last_active":"2024-04-24T01:44:49.522600+0000","last_peered":"2024-04-24T01:44:49.522600+0000","last_clean":"2024-04-24T01:44:49.522600+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:44:49.522600+0000","last_undegraded":"2024-04-24T01:44:49.522600+0000","last_fullsized":"2024-04-24T01:44:49.522600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:25.852835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865041+0000","last_change":"2024-04-24T01:42:44.780561+0000","last_active":"2024-04-24T01:43:21.865041+0000","last_peered":"2024-04-24T01:43:21.865041+0000","last_clean":"2024-04-24T01:43:21.865041+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:43:21.865041+0000","last_undegraded":"2024-04-24T01:43:21.865041+0000","last_fullsized":"2024-04-24T01:43:21.865041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:25.708863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810210+0000","last_change":"2024-04-24T01:42:46.780855+0000","last_active":"2024-04-24T01:43:21.810210+0000","last_peered":"2024-04-24T01:43:21.810210+0000","last_clean":"2024-04-24T01:43:21.810210+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:43:21.810210+0000","last_undegraded":"2024-04-24T01:43:21.810210+0000","last_fullsized":"2024-04-24T01:43:21.810210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:13.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.455955+0000","last_change":"2024-04-24T01:42:48.789383+0000","last_active":"2024-04-24T01:45:50.455955+0000","last_peered":"2024-04-24T01:45:50.455955+0000","last_clean":"2024-04-24T01:45:50.455955+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:45:50.455955+0000","last_undegraded":"2024-04-24T01:45:50.455955+0000","last_fullsized":"2024-04-24T01:45:50.455955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:14.292086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.188045+0000","last_change":"2024-04-24T01:42:50.800444+0000","last_active":"2024-04-24T01:43:23.188045+0000","last_peered":"2024-04-24T01:43:23.188045+0000","last_clean":"2024-04-24T01:43:23.188045+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:43:23.188045+0000","last_undegraded":"2024-04-24T01:43:23.188045+0000","last_fullsized":"2024-04-24T01:43:23.188045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506203+0000","last_change":"2024-04-24T01:42:42.785246+0000","last_active":"2024-04-24T01:44:46.506203+0000","last_peered":"2024-04-24T01:44:46.506203+0000","last_clean":"2024-04-24T01:44:46.506203+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:44:46.506203+0000","last_undegraded":"2024-04-24T01:44:46.506203+0000","last_fullsized":"2024-04-24T01:44:46.506203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:37.621286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815603+0000","last_change":"2024-04-24T01:42:40.791168+0000","last_active":"2024-04-24T01:43:21.815603+0000","last_peered":"2024-04-24T01:43:21.815603+0000","last_clean":"2024-04-24T01:43:21.815603+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:43:21.815603+0000","last_undegraded":"2024-04-24T01:43:21.815603+0000","last_fullsized":"2024-04-24T01:43:21.815603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818755+0000","last_change":"2024-04-24T01:43:21.818140+0000","last_active":"2024-04-24T01:43:21.818755+0000","last_peered":"2024-04-24T01:43:21.818755+0000","last_clean":"2024-04-24T01:43:21.818755+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:43:21.818755+0000","last_undegraded":"2024-04-24T01:43:21.818755+0000","last_fullsized":"2024-04-24T01:43:21.818755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:00:16.051162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.212359+0000","last_change":"2024-04-24T01:42:46.784079+0000","last_active":"2024-04-24T01:44:48.212359+0000","last_peered":"2024-04-24T01:44:48.212359+0000","last_clean":"2024-04-24T01:44:48.212359+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:44:48.212359+0000","last_undegraded":"2024-04-24T01:44:48.212359+0000","last_fullsized":"2024-04-24T01:44:48.212359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:07:04.029756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.348346+0000","last_change":"2024-04-24T01:42:48.783790+0000","last_active":"2024-04-24T01:45:50.348346+0000","last_peered":"2024-04-24T01:45:50.348346+0000","last_clean":"2024-04-24T01:45:50.348346+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:45:50.348346+0000","last_undegraded":"2024-04-24T01:45:50.348346+0000","last_fullsized":"2024-04-24T01:45:50.348346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:09.325458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137974+0000","last_change":"2024-04-24T01:42:42.787100+0000","last_active":"2024-04-24T01:45:50.137974+0000","last_peered":"2024-04-24T01:45:50.137974+0000","last_clean":"2024-04-24T01:45:50.137974+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:45:50.137974+0000","last_undegraded":"2024-04-24T01:45:50.137974+0000","last_fullsized":"2024-04-24T01:45:50.137974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:02.956782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334280+0000","last_change":"2024-04-24T01:42:40.780599+0000","last_active":"2024-04-24T01:43:22.334280+0000","last_peered":"2024-04-24T01:43:22.334280+0000","last_clean":"2024-04-24T01:43:22.334280+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:43:22.334280+0000","last_undegraded":"2024-04-24T01:43:22.334280+0000","last_fullsized":"2024-04-24T01:43:22.334280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312638+0000","last_change":"2024-04-24T01:42:44.778111+0000","last_active":"2024-04-24T01:44:49.312638+0000","last_peered":"2024-04-24T01:44:49.312638+0000","last_clean":"2024-04-24T01:44:49.312638+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:44:49.312638+0000","last_undegraded":"2024-04-24T01:44:49.312638+0000","last_fullsized":"2024-04-24T01:44:49.312638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:33.157332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'46","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.221905+0000","last_change":"2024-04-24T01:42:46.779467+0000","last_active":"2024-04-24T01:44:48.221905+0000","last_peered":"2024-04-24T01:44:48.221905+0000","last_clean":"2024-04-24T01:44:48.221905+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:44:48.221905+0000","last_undegraded":"2024-04-24T01:44:48.221905+0000","last_fullsized":"2024-04-24T01:44:48.221905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:35.159479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864048+0000","last_change":"2024-04-24T01:42:48.784060+0000","last_active":"2024-04-24T01:43:21.864048+0000","last_peered":"2024-04-24T01:43:21.864048+0000","last_clean":"2024-04-24T01:43:21.864048+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:43:21.864048+0000","last_undegraded":"2024-04-24T01:43:21.864048+0000","last_fullsized":"2024-04-24T01:43:21.864048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:03.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.807187+0000","last_change":"2024-04-24T01:42:50.799924+0000","last_active":"2024-04-24T01:44:05.807187+0000","last_peered":"2024-04-24T01:44:05.807187+0000","last_clean":"2024-04-24T01:44:05.807187+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:44:05.807187+0000","last_undegraded":"2024-04-24T01:44:05.807187+0000","last_fullsized":"2024-04-24T01:44:05.807187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:09.299604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.017080+0000","last_change":"2024-04-24T01:42:42.781439+0000","last_active":"2024-04-24T01:44:06.017080+0000","last_peered":"2024-04-24T01:44:06.017080+0000","last_clean":"2024-04-24T01:44:06.017080+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:44:06.017080+0000","last_undegraded":"2024-04-24T01:44:06.017080+0000","last_fullsized":"2024-04-24T01:44:06.017080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:12.726720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811228+0000","last_change":"2024-04-24T01:42:40.777460+0000","last_active":"2024-04-24T01:43:21.811228+0000","last_peered":"2024-04-24T01:43:21.811228+0000","last_clean":"2024-04-24T01:43:21.811228+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:43:21.811228+0000","last_undegraded":"2024-04-24T01:43:21.811228+0000","last_fullsized":"2024-04-24T01:43:21.811228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:49.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862742+0000","last_change":"2024-04-24T01:42:44.775818+0000","last_active":"2024-04-24T01:43:21.862742+0000","last_peered":"2024-04-24T01:43:21.862742+0000","last_clean":"2024-04-24T01:43:21.862742+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:43:21.862742+0000","last_undegraded":"2024-04-24T01:43:21.862742+0000","last_fullsized":"2024-04-24T01:43:21.862742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:05.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.055415+0000","last_change":"2024-04-24T01:42:46.779918+0000","last_active":"2024-04-24T01:45:50.055415+0000","last_peered":"2024-04-24T01:45:50.055415+0000","last_clean":"2024-04-24T01:45:50.055415+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:45:50.055415+0000","last_undegraded":"2024-04-24T01:45:50.055415+0000","last_fullsized":"2024-04-24T01:45:50.055415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:59.779931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862428+0000","last_change":"2024-04-24T01:42:48.788792+0000","last_active":"2024-04-24T01:43:21.862428+0000","last_peered":"2024-04-24T01:43:21.862428+0000","last_clean":"2024-04-24T01:43:21.862428+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:43:21.862428+0000","last_undegraded":"2024-04-24T01:43:21.862428+0000","last_fullsized":"2024-04-24T01:43:21.862428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.253658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:00.287330+0000","last_change":"2024-04-24T01:42:50.797194+0000","last_active":"2024-04-24T01:44:00.287330+0000","last_peered":"2024-04-24T01:44:00.287330+0000","last_clean":"2024-04-24T01:44:00.287330+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:44:00.287330+0000","last_undegraded":"2024-04-24T01:44:00.287330+0000","last_fullsized":"2024-04-24T01:44:00.287330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:13.552621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.279399+0000","last_change":"2024-04-24T01:42:42.790042+0000","last_active":"2024-04-24T01:45:50.279399+0000","last_peered":"2024-04-24T01:45:50.279399+0000","last_clean":"2024-04-24T01:45:50.279399+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:45:50.279399+0000","last_undegraded":"2024-04-24T01:45:50.279399+0000","last_fullsized":"2024-04-24T01:45:50.279399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:06.040706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814459+0000","last_change":"2024-04-24T01:42:40.790278+0000","last_active":"2024-04-24T01:43:21.814459+0000","last_peered":"2024-04-24T01:43:21.814459+0000","last_clean":"2024-04-24T01:43:21.814459+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:43:21.814459+0000","last_undegraded":"2024-04-24T01:43:21.814459+0000","last_fullsized":"2024-04-24T01:43:21.814459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:52.256340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865715+0000","last_change":"2024-04-24T01:42:44.776056+0000","last_active":"2024-04-24T01:43:21.865715+0000","last_peered":"2024-04-24T01:43:21.865715+0000","last_clean":"2024-04-24T01:43:21.865715+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:43:21.865715+0000","last_undegraded":"2024-04-24T01:43:21.865715+0000","last_fullsized":"2024-04-24T01:43:21.865715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:41.981588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'50","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.223861+0000","last_change":"2024-04-24T01:42:46.778746+0000","last_active":"2024-04-24T01:44:48.223861+0000","last_peered":"2024-04-24T01:44:48.223861+0000","last_clean":"2024-04-24T01:44:48.223861+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:44:48.223861+0000","last_undegraded":"2024-04-24T01:44:48.223861+0000","last_fullsized":"2024-04-24T01:44:48.223861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:42:45.514004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.464970+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:45:50.464970+0000","last_peered":"2024-04-24T01:45:50.464970+0000","last_clean":"2024-04-24T01:45:50.464970+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:45:50.464970+0000","last_undegraded":"2024-04-24T01:45:50.464970+0000","last_fullsized":"2024-04-24T01:45:50.464970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:47.496571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.808097+0000","last_change":"2024-04-24T01:42:50.794892+0000","last_active":"2024-04-24T01:43:22.808097+0000","last_peered":"2024-04-24T01:43:22.808097+0000","last_clean":"2024-04-24T01:43:22.808097+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:43:22.808097+0000","last_undegraded":"2024-04-24T01:43:22.808097+0000","last_fullsized":"2024-04-24T01:43:22.808097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:09.754900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.453036+0000","last_change":"2024-04-24T01:42:42.778719+0000","last_active":"2024-04-24T01:43:23.453036+0000","last_peered":"2024-04-24T01:43:23.453036+0000","last_clean":"2024-04-24T01:43:23.453036+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:43:23.453036+0000","last_undegraded":"2024-04-24T01:43:23.453036+0000","last_fullsized":"2024-04-24T01:43:23.453036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:31.558960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811441+0000","last_change":"2024-04-24T01:42:40.776747+0000","last_active":"2024-04-24T01:43:21.811441+0000","last_peered":"2024-04-24T01:43:21.811441+0000","last_clean":"2024-04-24T01:43:21.811441+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:43:21.811441+0000","last_undegraded":"2024-04-24T01:43:21.811441+0000","last_fullsized":"2024-04-24T01:43:21.811441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:04.407692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862746+0000","last_change":"2024-04-24T01:42:44.775830+0000","last_active":"2024-04-24T01:43:21.862746+0000","last_peered":"2024-04-24T01:43:21.862746+0000","last_clean":"2024-04-24T01:43:21.862746+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:43:21.862746+0000","last_undegraded":"2024-04-24T01:43:21.862746+0000","last_fullsized":"2024-04-24T01:43:21.862746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:41.803290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.225733+0000","last_change":"2024-04-24T01:42:46.782288+0000","last_active":"2024-04-24T01:44:48.225733+0000","last_peered":"2024-04-24T01:44:48.225733+0000","last_clean":"2024-04-24T01:44:48.225733+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:44:48.225733+0000","last_undegraded":"2024-04-24T01:44:48.225733+0000","last_fullsized":"2024-04-24T01:44:48.225733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862182+0000","last_change":"2024-04-24T01:42:48.794747+0000","last_active":"2024-04-24T01:43:21.862182+0000","last_peered":"2024-04-24T01:43:21.862182+0000","last_clean":"2024-04-24T01:43:21.862182+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:43:21.862182+0000","last_undegraded":"2024-04-24T01:43:21.862182+0000","last_fullsized":"2024-04-24T01:43:21.862182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:37.208241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.442897+0000","last_change":"2024-04-24T01:42:50.802460+0000","last_active":"2024-04-24T01:45:50.442897+0000","last_peered":"2024-04-24T01:45:50.442897+0000","last_clean":"2024-04-24T01:45:50.442897+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:45:50.442897+0000","last_undegraded":"2024-04-24T01:45:50.442897+0000","last_fullsized":"2024-04-24T01:45:50.442897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:30.284232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315664+0000","last_change":"2024-04-24T01:42:42.783715+0000","last_active":"2024-04-24T01:45:50.315664+0000","last_peered":"2024-04-24T01:45:50.315664+0000","last_clean":"2024-04-24T01:45:50.315664+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:45:50.315664+0000","last_undegraded":"2024-04-24T01:45:50.315664+0000","last_fullsized":"2024-04-24T01:45:50.315664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:20.736658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863777+0000","last_change":"2024-04-24T01:42:40.780994+0000","last_active":"2024-04-24T01:43:21.863777+0000","last_peered":"2024-04-24T01:43:21.863777+0000","last_clean":"2024-04-24T01:43:21.863777+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:43:21.863777+0000","last_undegraded":"2024-04-24T01:43:21.863777+0000","last_fullsized":"2024-04-24T01:43:21.863777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:37.569542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809308+0000","last_change":"2024-04-24T01:42:44.778275+0000","last_active":"2024-04-24T01:43:21.809308+0000","last_peered":"2024-04-24T01:43:21.809308+0000","last_clean":"2024-04-24T01:43:21.809308+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:43:21.809308+0000","last_undegraded":"2024-04-24T01:43:21.809308+0000","last_fullsized":"2024-04-24T01:43:21.809308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.192699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.205713+0000","last_change":"2024-04-24T01:42:46.778607+0000","last_active":"2024-04-24T01:44:48.205713+0000","last_peered":"2024-04-24T01:44:48.205713+0000","last_clean":"2024-04-24T01:44:48.205713+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:44:48.205713+0000","last_undegraded":"2024-04-24T01:44:48.205713+0000","last_fullsized":"2024-04-24T01:44:48.205713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:23.477131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813319+0000","last_change":"2024-04-24T01:42:48.790228+0000","last_active":"2024-04-24T01:43:21.813319+0000","last_peered":"2024-04-24T01:43:21.813319+0000","last_clean":"2024-04-24T01:43:21.813319+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:43:21.813319+0000","last_undegraded":"2024-04-24T01:43:21.813319+0000","last_fullsized":"2024-04-24T01:43:21.813319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:17.814113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087985+0000","last_change":"2024-04-24T01:42:50.799183+0000","last_active":"2024-04-24T01:44:51.087985+0000","last_peered":"2024-04-24T01:44:51.087985+0000","last_clean":"2024-04-24T01:44:51.087985+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:44:51.087985+0000","last_undegraded":"2024-04-24T01:44:51.087985+0000","last_fullsized":"2024-04-24T01:44:51.087985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:14.732138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399594+0000","last_change":"2024-04-24T01:42:42.783267+0000","last_active":"2024-04-24T01:45:50.399594+0000","last_peered":"2024-04-24T01:45:50.399594+0000","last_clean":"2024-04-24T01:45:50.399594+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:45:50.399594+0000","last_undegraded":"2024-04-24T01:45:50.399594+0000","last_fullsized":"2024-04-24T01:45:50.399594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:41.395053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.441523+0000","last_change":"2024-04-24T01:42:40.790965+0000","last_active":"2024-04-24T01:43:23.441523+0000","last_peered":"2024-04-24T01:43:23.441523+0000","last_clean":"2024-04-24T01:43:23.441523+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:43:23.441523+0000","last_undegraded":"2024-04-24T01:43:23.441523+0000","last_fullsized":"2024-04-24T01:43:23.441523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:10.970016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863141+0000","last_change":"2024-04-24T01:42:44.776243+0000","last_active":"2024-04-24T01:43:21.863141+0000","last_peered":"2024-04-24T01:43:21.863141+0000","last_clean":"2024-04-24T01:43:21.863141+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:43:21.863141+0000","last_undegraded":"2024-04-24T01:43:21.863141+0000","last_fullsized":"2024-04-24T01:43:21.863141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:59.166147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.232605+0000","last_change":"2024-04-24T01:42:46.770097+0000","last_active":"2024-04-24T01:44:48.232605+0000","last_peered":"2024-04-24T01:44:48.232605+0000","last_clean":"2024-04-24T01:44:48.232605+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:44:48.232605+0000","last_undegraded":"2024-04-24T01:44:48.232605+0000","last_fullsized":"2024-04-24T01:44:48.232605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:06.966181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.446644+0000","last_change":"2024-04-24T01:42:48.794733+0000","last_active":"2024-04-24T01:45:50.446644+0000","last_peered":"2024-04-24T01:45:50.446644+0000","last_clean":"2024-04-24T01:45:50.446644+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:45:50.446644+0000","last_undegraded":"2024-04-24T01:45:50.446644+0000","last_fullsized":"2024-04-24T01:45:50.446644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:25.479779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084036+0000","last_change":"2024-04-24T01:42:50.793825+0000","last_active":"2024-04-24T01:44:59.084036+0000","last_peered":"2024-04-24T01:44:59.084036+0000","last_clean":"2024-04-24T01:44:59.084036+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:44:59.084036+0000","last_undegraded":"2024-04-24T01:44:59.084036+0000","last_fullsized":"2024-04-24T01:44:59.084036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:33.276602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270904+0000","last_change":"2024-04-24T01:42:42.790926+0000","last_active":"2024-04-24T01:45:50.270904+0000","last_peered":"2024-04-24T01:45:50.270904+0000","last_clean":"2024-04-24T01:45:50.270904+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:45:50.270904+0000","last_undegraded":"2024-04-24T01:45:50.270904+0000","last_fullsized":"2024-04-24T01:45:50.270904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812785+0000","last_change":"2024-04-24T01:42:40.789191+0000","last_active":"2024-04-24T01:43:21.812785+0000","last_peered":"2024-04-24T01:43:21.812785+0000","last_clean":"2024-04-24T01:43:21.812785+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:43:21.812785+0000","last_undegraded":"2024-04-24T01:43:21.812785+0000","last_fullsized":"2024-04-24T01:43:21.812785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:37.925439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312396+0000","last_change":"2024-04-24T01:42:44.776093+0000","last_active":"2024-04-24T01:44:49.312396+0000","last_peered":"2024-04-24T01:44:49.312396+0000","last_clean":"2024-04-24T01:44:49.312396+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:44:49.312396+0000","last_undegraded":"2024-04-24T01:44:49.312396+0000","last_fullsized":"2024-04-24T01:44:49.312396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:07.203105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812310+0000","last_change":"2024-04-24T01:42:46.782280+0000","last_active":"2024-04-24T01:43:21.812310+0000","last_peered":"2024-04-24T01:43:21.812310+0000","last_clean":"2024-04-24T01:43:21.812310+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:43:21.812310+0000","last_undegraded":"2024-04-24T01:43:21.812310+0000","last_fullsized":"2024-04-24T01:43:21.812310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:26.243203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.402880+0000","last_change":"2024-04-24T01:42:48.791028+0000","last_active":"2024-04-24T01:45:50.402880+0000","last_peered":"2024-04-24T01:45:50.402880+0000","last_clean":"2024-04-24T01:45:50.402880+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:45:50.402880+0000","last_undegraded":"2024-04-24T01:45:50.402880+0000","last_fullsized":"2024-04-24T01:45:50.402880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:02.110375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.318221+0000","last_change":"2024-04-24T01:42:50.796703+0000","last_active":"2024-04-24T01:45:50.318221+0000","last_peered":"2024-04-24T01:45:50.318221+0000","last_clean":"2024-04-24T01:45:50.318221+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:45:50.318221+0000","last_undegraded":"2024-04-24T01:45:50.318221+0000","last_fullsized":"2024-04-24T01:45:50.318221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:51.030865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353512+0000","last_change":"2024-04-24T01:42:42.791687+0000","last_active":"2024-04-24T01:45:50.353512+0000","last_peered":"2024-04-24T01:45:50.353512+0000","last_clean":"2024-04-24T01:45:50.353512+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:45:50.353512+0000","last_undegraded":"2024-04-24T01:45:50.353512+0000","last_fullsized":"2024-04-24T01:45:50.353512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:02:24.201055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.791074+0000","last_change":"2024-04-24T01:42:40.787611+0000","last_active":"2024-04-24T01:44:05.791074+0000","last_peered":"2024-04-24T01:44:05.791074+0000","last_clean":"2024-04-24T01:44:05.791074+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:44:05.791074+0000","last_undegraded":"2024-04-24T01:44:05.791074+0000","last_fullsized":"2024-04-24T01:44:05.791074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:04.033349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814496+0000","last_change":"2024-04-24T01:42:44.777294+0000","last_active":"2024-04-24T01:43:21.814496+0000","last_peered":"2024-04-24T01:43:21.814496+0000","last_clean":"2024-04-24T01:43:21.814496+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:43:21.814496+0000","last_undegraded":"2024-04-24T01:43:21.814496+0000","last_fullsized":"2024-04-24T01:43:21.814496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:11.779877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.218762+0000","last_change":"2024-04-24T01:42:46.779272+0000","last_active":"2024-04-24T01:44:48.218762+0000","last_peered":"2024-04-24T01:44:48.218762+0000","last_clean":"2024-04-24T01:44:48.218762+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:44:48.218762+0000","last_undegraded":"2024-04-24T01:44:48.218762+0000","last_fullsized":"2024-04-24T01:44:48.218762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:45.404452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810071+0000","last_change":"2024-04-24T01:42:48.790268+0000","last_active":"2024-04-24T01:43:21.810071+0000","last_peered":"2024-04-24T01:43:21.810071+0000","last_clean":"2024-04-24T01:43:21.810071+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:43:21.810071+0000","last_undegraded":"2024-04-24T01:43:21.810071+0000","last_fullsized":"2024-04-24T01:43:21.810071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:46.045950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.378677+0000","last_change":"2024-04-24T01:42:50.798885+0000","last_active":"2024-04-24T01:45:50.378677+0000","last_peered":"2024-04-24T01:45:50.378677+0000","last_clean":"2024-04-24T01:45:50.378677+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:45:50.378677+0000","last_undegraded":"2024-04-24T01:45:50.378677+0000","last_fullsized":"2024-04-24T01:45:50.378677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:18:00.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270588+0000","last_change":"2024-04-24T01:42:42.787563+0000","last_active":"2024-04-24T01:45:50.270588+0000","last_peered":"2024-04-24T01:45:50.270588+0000","last_clean":"2024-04-24T01:45:50.270588+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:45:50.270588+0000","last_undegraded":"2024-04-24T01:45:50.270588+0000","last_fullsized":"2024-04-24T01:45:50.270588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:54.554156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815596+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:43:21.815596+0000","last_peered":"2024-04-24T01:43:21.815596+0000","last_clean":"2024-04-24T01:43:21.815596+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:43:21.815596+0000","last_undegraded":"2024-04-24T01:43:21.815596+0000","last_fullsized":"2024-04-24T01:43:21.815596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:54.970096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812194+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:43:21.812194+0000","last_peered":"2024-04-24T01:43:21.812194+0000","last_clean":"2024-04-24T01:43:21.812194+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:43:21.812194+0000","last_undegraded":"2024-04-24T01:43:21.812194+0000","last_fullsized":"2024-04-24T01:43:21.812194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:50.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811274+0000","last_change":"2024-04-24T01:42:40.787192+0000","last_active":"2024-04-24T01:43:21.811274+0000","last_peered":"2024-04-24T01:43:21.811274+0000","last_clean":"2024-04-24T01:43:21.811274+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:43:21.811274+0000","last_undegraded":"2024-04-24T01:43:21.811274+0000","last_fullsized":"2024-04-24T01:43:21.811274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:51.864862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817451+0000","last_change":"2024-04-24T01:42:44.776026+0000","last_active":"2024-04-24T01:43:21.817451+0000","last_peered":"2024-04-24T01:43:21.817451+0000","last_clean":"2024-04-24T01:43:21.817451+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:43:21.817451+0000","last_undegraded":"2024-04-24T01:43:21.817451+0000","last_fullsized":"2024-04-24T01:43:21.817451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:43.659940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'82","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.230340+0000","last_change":"2024-04-24T01:42:46.785058+0000","last_active":"2024-04-24T01:44:48.230340+0000","last_peered":"2024-04-24T01:44:48.230340+0000","last_clean":"2024-04-24T01:44:48.230340+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:44:48.230340+0000","last_undegraded":"2024-04-24T01:44:48.230340+0000","last_fullsized":"2024-04-24T01:44:48.230340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:09.881326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864430+0000","last_change":"2024-04-24T01:42:48.793592+0000","last_active":"2024-04-24T01:43:21.864430+0000","last_peered":"2024-04-24T01:43:21.864430+0000","last_clean":"2024-04-24T01:43:21.864430+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:43:21.864430+0000","last_undegraded":"2024-04-24T01:43:21.864430+0000","last_fullsized":"2024-04-24T01:43:21.864430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:15.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.355879+0000","last_change":"2024-04-24T01:42:50.792016+0000","last_active":"2024-04-24T01:45:50.355879+0000","last_peered":"2024-04-24T01:45:50.355879+0000","last_clean":"2024-04-24T01:45:50.355879+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:45:50.355879+0000","last_undegraded":"2024-04-24T01:45:50.355879+0000","last_fullsized":"2024-04-24T01:45:50.355879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:14.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654646+0000","last_change":"2024-04-24T01:42:42.786097+0000","last_active":"2024-04-24T01:44:49.654646+0000","last_peered":"2024-04-24T01:44:49.654646+0000","last_clean":"2024-04-24T01:44:49.654646+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:44:49.654646+0000","last_undegraded":"2024-04-24T01:44:49.654646+0000","last_fullsized":"2024-04-24T01:44:49.654646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:44.030398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809847+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:43:21.809847+0000","last_peered":"2024-04-24T01:43:21.809847+0000","last_clean":"2024-04-24T01:43:21.809847+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:43:21.809847+0000","last_undegraded":"2024-04-24T01:43:21.809847+0000","last_fullsized":"2024-04-24T01:43:21.809847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:29.896910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862322+0000","last_change":"2024-04-24T01:42:40.781303+0000","last_active":"2024-04-24T01:43:21.862322+0000","last_peered":"2024-04-24T01:43:21.862322+0000","last_clean":"2024-04-24T01:43:21.862322+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:43:21.862322+0000","last_undegraded":"2024-04-24T01:43:21.862322+0000","last_fullsized":"2024-04-24T01:43:21.862322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:59.215704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814458+0000","last_change":"2024-04-24T01:42:44.777664+0000","last_active":"2024-04-24T01:43:21.814458+0000","last_peered":"2024-04-24T01:43:21.814458+0000","last_clean":"2024-04-24T01:43:21.814458+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:43:21.814458+0000","last_undegraded":"2024-04-24T01:43:21.814458+0000","last_fullsized":"2024-04-24T01:43:21.814458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:08.483048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853754+0000","last_change":"2024-04-24T01:42:46.782817+0000","last_active":"2024-04-24T01:45:49.853754+0000","last_peered":"2024-04-24T01:45:49.853754+0000","last_clean":"2024-04-24T01:45:49.853754+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:45:49.853754+0000","last_undegraded":"2024-04-24T01:45:49.853754+0000","last_fullsized":"2024-04-24T01:45:49.853754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:27.024858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812247+0000","last_change":"2024-04-24T01:42:48.789708+0000","last_active":"2024-04-24T01:43:21.812247+0000","last_peered":"2024-04-24T01:43:21.812247+0000","last_clean":"2024-04-24T01:43:21.812247+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:43:21.812247+0000","last_undegraded":"2024-04-24T01:43:21.812247+0000","last_fullsized":"2024-04-24T01:43:21.812247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:49.899834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.803771+0000","last_change":"2024-04-24T01:42:50.795739+0000","last_active":"2024-04-24T01:44:05.803771+0000","last_peered":"2024-04-24T01:44:05.803771+0000","last_clean":"2024-04-24T01:44:05.803771+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:44:05.803771+0000","last_undegraded":"2024-04-24T01:44:05.803771+0000","last_fullsized":"2024-04-24T01:44:05.803771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:11:53.190598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864709+0000","last_change":"2024-04-24T01:42:42.783605+0000","last_active":"2024-04-24T01:43:21.864709+0000","last_peered":"2024-04-24T01:43:21.864709+0000","last_clean":"2024-04-24T01:43:21.864709+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:43:21.864709+0000","last_undegraded":"2024-04-24T01:43:21.864709+0000","last_fullsized":"2024-04-24T01:43:21.864709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:05.066861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807726+0000","last_change":"2024-04-24T01:42:32.739720+0000","last_active":"2024-04-24T01:43:21.807726+0000","last_peered":"2024-04-24T01:43:21.807726+0000","last_clean":"2024-04-24T01:43:21.807726+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:43:21.807726+0000","last_undegraded":"2024-04-24T01:43:21.807726+0000","last_fullsized":"2024-04-24T01:43:21.807726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.270545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.255333+0000","last_change":"2024-04-24T01:42:40.769426+0000","last_active":"2024-04-24T01:45:50.255333+0000","last_peered":"2024-04-24T01:45:50.255333+0000","last_clean":"2024-04-24T01:45:50.255333+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:45:50.255333+0000","last_undegraded":"2024-04-24T01:45:50.255333+0000","last_fullsized":"2024-04-24T01:45:50.255333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:24.208037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811063+0000","last_change":"2024-04-24T01:42:44.768708+0000","last_active":"2024-04-24T01:43:21.811063+0000","last_peered":"2024-04-24T01:43:21.811063+0000","last_clean":"2024-04-24T01:43:21.811063+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:43:21.811063+0000","last_undegraded":"2024-04-24T01:43:21.811063+0000","last_fullsized":"2024-04-24T01:43:21.811063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:22.037850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853586+0000","last_change":"2024-04-24T01:42:46.780747+0000","last_active":"2024-04-24T01:45:49.853586+0000","last_peered":"2024-04-24T01:45:49.853586+0000","last_clean":"2024-04-24T01:45:49.853586+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:45:49.853586+0000","last_undegraded":"2024-04-24T01:45:49.853586+0000","last_fullsized":"2024-04-24T01:45:49.853586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:35.740405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863693+0000","last_change":"2024-04-24T01:42:48.793578+0000","last_active":"2024-04-24T01:43:21.863693+0000","last_peered":"2024-04-24T01:43:21.863693+0000","last_clean":"2024-04-24T01:43:21.863693+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:43:21.863693+0000","last_undegraded":"2024-04-24T01:43:21.863693+0000","last_fullsized":"2024-04-24T01:43:21.863693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:53.516063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810739+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:43:21.810739+0000","last_peered":"2024-04-24T01:43:21.810739+0000","last_clean":"2024-04-24T01:43:21.810739+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:43:21.810739+0000","last_undegraded":"2024-04-24T01:43:21.810739+0000","last_fullsized":"2024-04-24T01:43:21.810739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:35.532430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864702+0000","last_change":"2024-04-24T01:42:42.775667+0000","last_active":"2024-04-24T01:43:21.864702+0000","last_peered":"2024-04-24T01:43:21.864702+0000","last_clean":"2024-04-24T01:43:21.864702+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:43:21.864702+0000","last_undegraded":"2024-04-24T01:43:21.864702+0000","last_fullsized":"2024-04-24T01:43:21.864702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:37.338206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811072+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:43:21.811072+0000","last_peered":"2024-04-24T01:43:21.811072+0000","last_clean":"2024-04-24T01:43:21.811072+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:43:21.811072+0000","last_undegraded":"2024-04-24T01:43:21.811072+0000","last_fullsized":"2024-04-24T01:43:21.811072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:23.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.787552+0000","last_change":"2024-04-24T01:42:40.769234+0000","last_active":"2024-04-24T01:43:22.787552+0000","last_peered":"2024-04-24T01:43:22.787552+0000","last_clean":"2024-04-24T01:43:22.787552+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:43:22.787552+0000","last_undegraded":"2024-04-24T01:43:22.787552+0000","last_fullsized":"2024-04-24T01:43:22.787552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864632+0000","last_change":"2024-04-24T01:42:44.778281+0000","last_active":"2024-04-24T01:43:21.864632+0000","last_peered":"2024-04-24T01:43:21.864632+0000","last_clean":"2024-04-24T01:43:21.864632+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:43:21.864632+0000","last_undegraded":"2024-04-24T01:43:21.864632+0000","last_fullsized":"2024-04-24T01:43:21.864632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:36.551915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.667766+0000","last_change":"2024-04-24T01:42:46.783117+0000","last_active":"2024-04-24T01:45:49.667766+0000","last_peered":"2024-04-24T01:45:49.667766+0000","last_clean":"2024-04-24T01:45:49.667766+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:45:49.667766+0000","last_undegraded":"2024-04-24T01:45:49.667766+0000","last_fullsized":"2024-04-24T01:45:49.667766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:06.561328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813544+0000","last_change":"2024-04-24T01:42:48.789629+0000","last_active":"2024-04-24T01:43:21.813544+0000","last_peered":"2024-04-24T01:43:21.813544+0000","last_clean":"2024-04-24T01:43:21.813544+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:43:21.813544+0000","last_undegraded":"2024-04-24T01:43:21.813544+0000","last_fullsized":"2024-04-24T01:43:21.813544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:25.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.420833+0000","last_change":"2024-04-24T01:42:50.802434+0000","last_active":"2024-04-24T01:44:49.420833+0000","last_peered":"2024-04-24T01:44:49.420833+0000","last_clean":"2024-04-24T01:44:49.420833+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:44:49.420833+0000","last_undegraded":"2024-04-24T01:44:49.420833+0000","last_fullsized":"2024-04-24T01:44:49.420833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.519476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506812+0000","last_change":"2024-04-24T01:42:42.783375+0000","last_active":"2024-04-24T01:44:46.506812+0000","last_peered":"2024-04-24T01:44:46.506812+0000","last_clean":"2024-04-24T01:44:46.506812+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:44:46.506812+0000","last_undegraded":"2024-04-24T01:44:46.506812+0000","last_fullsized":"2024-04-24T01:44:46.506812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:53.032722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.496293+0000","last_change":"2024-04-24T01:42:40.774629+0000","last_active":"2024-04-24T01:44:49.496293+0000","last_peered":"2024-04-24T01:44:49.496293+0000","last_clean":"2024-04-24T01:44:49.496293+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:44:49.496293+0000","last_undegraded":"2024-04-24T01:44:49.496293+0000","last_fullsized":"2024-04-24T01:44:49.496293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863436+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:43:21.863436+0000","last_peered":"2024-04-24T01:43:21.863436+0000","last_clean":"2024-04-24T01:43:21.863436+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:43:21.863436+0000","last_undegraded":"2024-04-24T01:43:21.863436+0000","last_fullsized":"2024-04-24T01:43:21.863436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:38.785738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:31.093588+0000","last_change":"2024-04-24T01:43:21.814238+0000","last_active":"2024-04-24T01:45:31.093588+0000","last_peered":"2024-04-24T01:45:31.093588+0000","last_clean":"2024-04-24T01:45:31.093588+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:45:31.093588+0000","last_undegraded":"2024-04-24T01:45:31.093588+0000","last_fullsized":"2024-04-24T01:45:31.093588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:13.474511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'75","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082491+0000","last_change":"2024-04-24T01:42:46.779689+0000","last_active":"2024-04-24T01:44:49.082491+0000","last_peered":"2024-04-24T01:44:49.082491+0000","last_clean":"2024-04-24T01:44:49.082491+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:44:49.082491+0000","last_undegraded":"2024-04-24T01:44:49.082491+0000","last_fullsized":"2024-04-24T01:44:49.082491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:19.052361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":84,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808841+0000","last_change":"2024-04-24T01:42:48.792847+0000","last_active":"2024-04-24T01:43:21.808841+0000","last_peered":"2024-04-24T01:43:21.808841+0000","last_clean":"2024-04-24T01:43:21.808841+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:43:21.808841+0000","last_undegraded":"2024-04-24T01:43:21.808841+0000","last_fullsized":"2024-04-24T01:43:21.808841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:50.042446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.595124+0000","last_change":"2024-04-24T01:42:50.793302+0000","last_active":"2024-04-24T01:44:49.595124+0000","last_peered":"2024-04-24T01:44:49.595124+0000","last_clean":"2024-04-24T01:44:49.595124+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:44:49.595124+0000","last_undegraded":"2024-04-24T01:44:49.595124+0000","last_fullsized":"2024-04-24T01:44:49.595124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:08:15.582676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137934+0000","last_change":"2024-04-24T01:42:42.789819+0000","last_active":"2024-04-24T01:45:50.137934+0000","last_peered":"2024-04-24T01:45:50.137934+0000","last_clean":"2024-04-24T01:45:50.137934+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:45:50.137934+0000","last_undegraded":"2024-04-24T01:45:50.137934+0000","last_fullsized":"2024-04-24T01:45:50.137934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:13.290315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.435621+0000","last_change":"2024-04-24T01:42:40.778312+0000","last_active":"2024-04-24T01:43:23.435621+0000","last_peered":"2024-04-24T01:43:23.435621+0000","last_clean":"2024-04-24T01:43:23.435621+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:43:23.435621+0000","last_undegraded":"2024-04-24T01:43:23.435621+0000","last_fullsized":"2024-04-24T01:43:23.435621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:05.002271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813065+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:43:21.813065+0000","last_peered":"2024-04-24T01:43:21.813065+0000","last_clean":"2024-04-24T01:43:21.813065+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:43:21.813065+0000","last_undegraded":"2024-04-24T01:43:21.813065+0000","last_fullsized":"2024-04-24T01:43:21.813065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:28.855827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810966+0000","last_change":"2024-04-24T01:42:44.773194+0000","last_active":"2024-04-24T01:43:21.810966+0000","last_peered":"2024-04-24T01:43:21.810966+0000","last_clean":"2024-04-24T01:43:21.810966+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:43:21.810966+0000","last_undegraded":"2024-04-24T01:43:21.810966+0000","last_fullsized":"2024-04-24T01:43:21.810966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:31.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.021595+0000","last_change":"2024-04-24T01:42:46.780073+0000","last_active":"2024-04-24T01:44:06.021595+0000","last_peered":"2024-04-24T01:44:06.021595+0000","last_clean":"2024-04-24T01:44:06.021595+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:44:06.021595+0000","last_undegraded":"2024-04-24T01:44:06.021595+0000","last_fullsized":"2024-04-24T01:44:06.021595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:58.563555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853489+0000","last_change":"2024-04-24T01:42:48.794484+0000","last_active":"2024-04-24T01:45:49.853489+0000","last_peered":"2024-04-24T01:45:49.853489+0000","last_clean":"2024-04-24T01:45:49.853489+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:45:49.853489+0000","last_undegraded":"2024-04-24T01:45:49.853489+0000","last_fullsized":"2024-04-24T01:45:49.853489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:07.370372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813179+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:43:21.813179+0000","last_peered":"2024-04-24T01:43:21.813179+0000","last_clean":"2024-04-24T01:43:21.813179+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:43:21.813179+0000","last_undegraded":"2024-04-24T01:43:21.813179+0000","last_fullsized":"2024-04-24T01:43:21.813179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:33.848940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345353+0000","last_change":"2024-04-24T01:42:42.788049+0000","last_active":"2024-04-24T01:45:50.345353+0000","last_peered":"2024-04-24T01:45:50.345353+0000","last_clean":"2024-04-24T01:45:50.345353+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:45:50.345353+0000","last_undegraded":"2024-04-24T01:45:50.345353+0000","last_fullsized":"2024-04-24T01:45:50.345353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:57.647339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814304+0000","last_change":"2024-04-24T01:42:40.786621+0000","last_active":"2024-04-24T01:43:21.814304+0000","last_peered":"2024-04-24T01:43:21.814304+0000","last_clean":"2024-04-24T01:43:21.814304+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:43:21.814304+0000","last_undegraded":"2024-04-24T01:43:21.814304+0000","last_fullsized":"2024-04-24T01:43:21.814304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:23.749610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864853+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:43:21.864853+0000","last_peered":"2024-04-24T01:43:21.864853+0000","last_clean":"2024-04-24T01:43:21.864853+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:43:21.864853+0000","last_undegraded":"2024-04-24T01:43:21.864853+0000","last_fullsized":"2024-04-24T01:43:21.864853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:49.159738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813003+0000","last_change":"2024-04-24T01:42:44.777271+0000","last_active":"2024-04-24T01:43:21.813003+0000","last_peered":"2024-04-24T01:43:21.813003+0000","last_clean":"2024-04-24T01:43:21.813003+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:43:21.813003+0000","last_undegraded":"2024-04-24T01:43:21.813003+0000","last_fullsized":"2024-04-24T01:43:21.813003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.077015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088156+0000","last_change":"2024-04-24T01:42:46.782589+0000","last_active":"2024-04-24T01:44:51.088156+0000","last_peered":"2024-04-24T01:44:51.088156+0000","last_clean":"2024-04-24T01:44:51.088156+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:44:51.088156+0000","last_undegraded":"2024-04-24T01:44:51.088156+0000","last_fullsized":"2024-04-24T01:44:51.088156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:02.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.443476+0000","last_change":"2024-04-24T01:42:48.784318+0000","last_active":"2024-04-24T01:45:50.443476+0000","last_peered":"2024-04-24T01:45:50.443476+0000","last_clean":"2024-04-24T01:45:50.443476+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:45:50.443476+0000","last_undegraded":"2024-04-24T01:45:50.443476+0000","last_fullsized":"2024-04-24T01:45:50.443476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:27:07.076053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.140307+0000","last_change":"2024-04-24T01:42:50.802205+0000","last_active":"2024-04-24T01:45:50.140307+0000","last_peered":"2024-04-24T01:45:50.140307+0000","last_clean":"2024-04-24T01:45:50.140307+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:45:50.140307+0000","last_undegraded":"2024-04-24T01:45:50.140307+0000","last_fullsized":"2024-04-24T01:45:50.140307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:15.474464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144862+0000","last_change":"2024-04-24T01:42:42.788944+0000","last_active":"2024-04-24T01:45:50.144862+0000","last_peered":"2024-04-24T01:45:50.144862+0000","last_clean":"2024-04-24T01:45:50.144862+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:45:50.144862+0000","last_undegraded":"2024-04-24T01:45:50.144862+0000","last_fullsized":"2024-04-24T01:45:50.144862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:38.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816740+0000","last_change":"2024-04-24T01:42:40.788616+0000","last_active":"2024-04-24T01:43:21.816740+0000","last_peered":"2024-04-24T01:43:21.816740+0000","last_clean":"2024-04-24T01:43:21.816740+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:43:21.816740+0000","last_undegraded":"2024-04-24T01:43:21.816740+0000","last_fullsized":"2024-04-24T01:43:21.816740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814295+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:43:21.814295+0000","last_peered":"2024-04-24T01:43:21.814295+0000","last_clean":"2024-04-24T01:43:21.814295+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:43:21.814295+0000","last_undegraded":"2024-04-24T01:43:21.814295+0000","last_fullsized":"2024-04-24T01:43:21.814295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.254736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812231+0000","last_change":"2024-04-24T01:42:44.776836+0000","last_active":"2024-04-24T01:43:21.812231+0000","last_peered":"2024-04-24T01:43:21.812231+0000","last_clean":"2024-04-24T01:43:21.812231+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:43:21.812231+0000","last_undegraded":"2024-04-24T01:43:21.812231+0000","last_fullsized":"2024-04-24T01:43:21.812231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:52.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'89","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.216733+0000","last_change":"2024-04-24T01:42:46.781816+0000","last_active":"2024-04-24T01:44:48.216733+0000","last_peered":"2024-04-24T01:44:48.216733+0000","last_clean":"2024-04-24T01:44:48.216733+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:44:48.216733+0000","last_undegraded":"2024-04-24T01:44:48.216733+0000","last_fullsized":"2024-04-24T01:44:48.216733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:38.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863116+0000","last_change":"2024-04-24T01:42:48.791388+0000","last_active":"2024-04-24T01:43:21.863116+0000","last_peered":"2024-04-24T01:43:21.863116+0000","last_clean":"2024-04-24T01:43:21.863116+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:43:21.863116+0000","last_undegraded":"2024-04-24T01:43:21.863116+0000","last_fullsized":"2024-04-24T01:43:21.863116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:21.062631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810182+0000","last_change":"2024-04-24T01:42:50.791385+0000","last_active":"2024-04-24T01:43:21.810182+0000","last_peered":"2024-04-24T01:43:21.810182+0000","last_clean":"2024-04-24T01:43:21.810182+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:43:21.810182+0000","last_undegraded":"2024-04-24T01:43:21.810182+0000","last_fullsized":"2024-04-24T01:43:21.810182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:37.401350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809642+0000","last_change":"2024-04-24T01:42:50.800231+0000","last_active":"2024-04-24T01:43:21.809642+0000","last_peered":"2024-04-24T01:43:21.809642+0000","last_clean":"2024-04-24T01:43:21.809642+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:43:21.809642+0000","last_undegraded":"2024-04-24T01:43:21.809642+0000","last_fullsized":"2024-04-24T01:43:21.809642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:04.117350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809954+0000","last_change":"2024-04-24T01:42:42.791072+0000","last_active":"2024-04-24T01:43:21.809954+0000","last_peered":"2024-04-24T01:43:21.809954+0000","last_clean":"2024-04-24T01:43:21.809954+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:43:21.809954+0000","last_undegraded":"2024-04-24T01:43:21.809954+0000","last_fullsized":"2024-04-24T01:43:21.809954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:06.415050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811530+0000","last_change":"2024-04-24T01:42:40.776494+0000","last_active":"2024-04-24T01:43:21.811530+0000","last_peered":"2024-04-24T01:43:21.811530+0000","last_clean":"2024-04-24T01:43:21.811530+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:43:21.811530+0000","last_undegraded":"2024-04-24T01:43:21.811530+0000","last_fullsized":"2024-04-24T01:43:21.811530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:10.873984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817518+0000","last_change":"2024-04-24T01:42:44.776151+0000","last_active":"2024-04-24T01:43:21.817518+0000","last_peered":"2024-04-24T01:43:21.817518+0000","last_clean":"2024-04-24T01:43:21.817518+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:43:21.817518+0000","last_undegraded":"2024-04-24T01:43:21.817518+0000","last_fullsized":"2024-04-24T01:43:21.817518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:36.228002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.222877+0000","last_change":"2024-04-24T01:42:46.779944+0000","last_active":"2024-04-24T01:44:48.222877+0000","last_peered":"2024-04-24T01:44:48.222877+0000","last_clean":"2024-04-24T01:44:48.222877+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:44:48.222877+0000","last_undegraded":"2024-04-24T01:44:48.222877+0000","last_fullsized":"2024-04-24T01:44:48.222877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:37.615741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811011+0000","last_change":"2024-04-24T01:42:48.786495+0000","last_active":"2024-04-24T01:43:21.811011+0000","last_peered":"2024-04-24T01:43:21.811011+0000","last_clean":"2024-04-24T01:43:21.811011+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:43:21.811011+0000","last_undegraded":"2024-04-24T01:43:21.811011+0000","last_fullsized":"2024-04-24T01:43:21.811011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:20:25.150998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:47.901186+0000","last_change":"2024-04-24T01:42:50.802495+0000","last_active":"2024-04-24T01:44:47.901186+0000","last_peered":"2024-04-24T01:44:47.901186+0000","last_clean":"2024-04-24T01:44:47.901186+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:44:47.901186+0000","last_undegraded":"2024-04-24T01:44:47.901186+0000","last_fullsized":"2024-04-24T01:44:47.901186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:43.202204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506883+0000","last_change":"2024-04-24T01:42:42.781334+0000","last_active":"2024-04-24T01:44:46.506883+0000","last_peered":"2024-04-24T01:44:46.506883+0000","last_clean":"2024-04-24T01:44:46.506883+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:44:46.506883+0000","last_undegraded":"2024-04-24T01:44:46.506883+0000","last_fullsized":"2024-04-24T01:44:46.506883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:36.471270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.264145+0000","last_change":"2024-04-24T01:42:40.783014+0000","last_active":"2024-04-24T01:45:50.264145+0000","last_peered":"2024-04-24T01:45:50.264145+0000","last_clean":"2024-04-24T01:45:50.264145+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:45:50.264145+0000","last_undegraded":"2024-04-24T01:45:50.264145+0000","last_fullsized":"2024-04-24T01:45:50.264145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812848+0000","last_change":"2024-04-24T01:42:44.777503+0000","last_active":"2024-04-24T01:43:21.812848+0000","last_peered":"2024-04-24T01:43:21.812848+0000","last_clean":"2024-04-24T01:43:21.812848+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:43:21.812848+0000","last_undegraded":"2024-04-24T01:43:21.812848+0000","last_fullsized":"2024-04-24T01:43:21.812848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:19.310744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672156+0000","last_change":"2024-04-24T01:42:46.776129+0000","last_active":"2024-04-24T01:45:49.672156+0000","last_peered":"2024-04-24T01:45:49.672156+0000","last_clean":"2024-04-24T01:45:49.672156+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:45:49.672156+0000","last_undegraded":"2024-04-24T01:45:49.672156+0000","last_fullsized":"2024-04-24T01:45:49.672156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:06:55.737138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808083+0000","last_change":"2024-04-24T01:42:48.789269+0000","last_active":"2024-04-24T01:43:21.808083+0000","last_peered":"2024-04-24T01:43:21.808083+0000","last_clean":"2024-04-24T01:43:21.808083+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:43:21.808083+0000","last_undegraded":"2024-04-24T01:43:21.808083+0000","last_fullsized":"2024-04-24T01:43:21.808083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:23.719981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.020578+0000","last_change":"2024-04-24T01:42:50.793424+0000","last_active":"2024-04-24T01:43:24.020578+0000","last_peered":"2024-04-24T01:43:24.020578+0000","last_clean":"2024-04-24T01:43:24.020578+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:43:24.020578+0000","last_undegraded":"2024-04-24T01:43:24.020578+0000","last_fullsized":"2024-04-24T01:43:24.020578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:31.628249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345135+0000","last_change":"2024-04-24T01:42:42.790386+0000","last_active":"2024-04-24T01:45:50.345135+0000","last_peered":"2024-04-24T01:45:50.345135+0000","last_clean":"2024-04-24T01:45:50.345135+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:45:50.345135+0000","last_undegraded":"2024-04-24T01:45:50.345135+0000","last_fullsized":"2024-04-24T01:45:50.345135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:20.812984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811368+0000","last_change":"2024-04-24T01:42:40.777727+0000","last_active":"2024-04-24T01:43:21.811368+0000","last_peered":"2024-04-24T01:43:21.811368+0000","last_clean":"2024-04-24T01:43:21.811368+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:43:21.811368+0000","last_undegraded":"2024-04-24T01:43:21.811368+0000","last_fullsized":"2024-04-24T01:43:21.811368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807855+0000","last_change":"2024-04-24T01:42:44.779726+0000","last_active":"2024-04-24T01:43:21.807855+0000","last_peered":"2024-04-24T01:43:21.807855+0000","last_clean":"2024-04-24T01:43:21.807855+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:43:21.807855+0000","last_undegraded":"2024-04-24T01:43:21.807855+0000","last_fullsized":"2024-04-24T01:43:21.807855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:52.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.729900+0000","last_change":"2024-04-24T01:42:46.779267+0000","last_active":"2024-04-24T01:45:49.729900+0000","last_peered":"2024-04-24T01:45:49.729900+0000","last_clean":"2024-04-24T01:45:49.729900+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:45:49.729900+0000","last_undegraded":"2024-04-24T01:45:49.729900+0000","last_fullsized":"2024-04-24T01:45:49.729900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:12.649320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814064+0000","last_change":"2024-04-24T01:42:48.791281+0000","last_active":"2024-04-24T01:43:21.814064+0000","last_peered":"2024-04-24T01:43:21.814064+0000","last_clean":"2024-04-24T01:43:21.814064+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:43:21.814064+0000","last_undegraded":"2024-04-24T01:43:21.814064+0000","last_fullsized":"2024-04-24T01:43:21.814064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:56.691092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.450921+0000","last_change":"2024-04-24T01:42:50.801137+0000","last_active":"2024-04-24T01:43:23.450921+0000","last_peered":"2024-04-24T01:43:23.450921+0000","last_clean":"2024-04-24T01:43:23.450921+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:43:23.450921+0000","last_undegraded":"2024-04-24T01:43:23.450921+0000","last_fullsized":"2024-04-24T01:43:23.450921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:41.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.185393+0000","last_change":"2024-04-24T01:42:42.786306+0000","last_active":"2024-04-24T01:43:23.185393+0000","last_peered":"2024-04-24T01:43:23.185393+0000","last_clean":"2024-04-24T01:43:23.185393+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:43:23.185393+0000","last_undegraded":"2024-04-24T01:43:23.185393+0000","last_fullsized":"2024-04-24T01:43:23.185393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:24.062336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816678+0000","last_change":"2024-04-24T01:42:40.790215+0000","last_active":"2024-04-24T01:43:21.816678+0000","last_peered":"2024-04-24T01:43:21.816678+0000","last_clean":"2024-04-24T01:43:21.816678+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:43:21.816678+0000","last_undegraded":"2024-04-24T01:43:21.816678+0000","last_fullsized":"2024-04-24T01:43:21.816678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811343+0000","last_change":"2024-04-24T01:42:44.775854+0000","last_active":"2024-04-24T01:43:21.811343+0000","last_peered":"2024-04-24T01:43:21.811343+0000","last_clean":"2024-04-24T01:43:21.811343+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:43:21.811343+0000","last_undegraded":"2024-04-24T01:43:21.811343+0000","last_fullsized":"2024-04-24T01:43:21.811343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:58.105579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.207876+0000","last_change":"2024-04-24T01:42:46.777619+0000","last_active":"2024-04-24T01:44:48.207876+0000","last_peered":"2024-04-24T01:44:48.207876+0000","last_clean":"2024-04-24T01:44:48.207876+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:44:48.207876+0000","last_undegraded":"2024-04-24T01:44:48.207876+0000","last_fullsized":"2024-04-24T01:44:48.207876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:23.977698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809142+0000","last_change":"2024-04-24T01:42:48.783348+0000","last_active":"2024-04-24T01:43:21.809142+0000","last_peered":"2024-04-24T01:43:21.809142+0000","last_clean":"2024-04-24T01:43:21.809142+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:43:21.809142+0000","last_undegraded":"2024-04-24T01:43:21.809142+0000","last_fullsized":"2024-04-24T01:43:21.809142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:29.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345667+0000","last_change":"2024-04-24T01:43:21.862671+0000","last_active":"2024-04-24T01:45:50.345667+0000","last_peered":"2024-04-24T01:45:50.345667+0000","last_clean":"2024-04-24T01:45:50.345667+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:45:50.345667+0000","last_undegraded":"2024-04-24T01:45:50.345667+0000","last_fullsized":"2024-04-24T01:45:50.345667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:07.455442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.333865+0000","last_change":"2024-04-24T01:42:40.787886+0000","last_active":"2024-04-24T01:43:22.333865+0000","last_peered":"2024-04-24T01:43:22.333865+0000","last_clean":"2024-04-24T01:43:22.333865+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:43:22.333865+0000","last_undegraded":"2024-04-24T01:43:22.333865+0000","last_fullsized":"2024-04-24T01:43:22.333865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:56.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865914+0000","last_change":"2024-04-24T01:42:44.773584+0000","last_active":"2024-04-24T01:43:21.865914+0000","last_peered":"2024-04-24T01:43:21.865914+0000","last_clean":"2024-04-24T01:43:21.865914+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:43:21.865914+0000","last_undegraded":"2024-04-24T01:43:21.865914+0000","last_fullsized":"2024-04-24T01:43:21.865914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:23.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.229299+0000","last_change":"2024-04-24T01:42:46.777975+0000","last_active":"2024-04-24T01:44:48.229299+0000","last_peered":"2024-04-24T01:44:48.229299+0000","last_clean":"2024-04-24T01:44:48.229299+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:44:48.229299+0000","last_undegraded":"2024-04-24T01:44:48.229299+0000","last_fullsized":"2024-04-24T01:44:48.229299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:13.422542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808471+0000","last_change":"2024-04-24T01:42:48.782421+0000","last_active":"2024-04-24T01:43:21.808471+0000","last_peered":"2024-04-24T01:43:21.808471+0000","last_clean":"2024-04-24T01:43:21.808471+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:43:21.808471+0000","last_undegraded":"2024-04-24T01:43:21.808471+0000","last_fullsized":"2024-04-24T01:43:21.808471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:57.847015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.067180+0000","last_change":"2024-04-24T01:42:50.794926+0000","last_active":"2024-04-24T01:45:50.067180+0000","last_peered":"2024-04-24T01:45:50.067180+0000","last_clean":"2024-04-24T01:45:50.067180+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:45:50.067180+0000","last_undegraded":"2024-04-24T01:45:50.067180+0000","last_fullsized":"2024-04-24T01:45:50.067180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:45.839756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.014892+0000","last_change":"2024-04-24T01:42:42.783533+0000","last_active":"2024-04-24T01:43:24.014892+0000","last_peered":"2024-04-24T01:43:24.014892+0000","last_clean":"2024-04-24T01:43:24.014892+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:43:24.014892+0000","last_undegraded":"2024-04-24T01:43:24.014892+0000","last_fullsized":"2024-04-24T01:43:24.014892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:09.403789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815922+0000","last_change":"2024-04-24T01:42:40.788925+0000","last_active":"2024-04-24T01:43:21.815922+0000","last_peered":"2024-04-24T01:43:21.815922+0000","last_clean":"2024-04-24T01:43:21.815922+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:43:21.815922+0000","last_undegraded":"2024-04-24T01:43:21.815922+0000","last_fullsized":"2024-04-24T01:43:21.815922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810144+0000","last_change":"2024-04-24T01:42:44.774986+0000","last_active":"2024-04-24T01:43:21.810144+0000","last_peered":"2024-04-24T01:43:21.810144+0000","last_clean":"2024-04-24T01:43:21.810144+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:43:21.810144+0000","last_undegraded":"2024-04-24T01:43:21.810144+0000","last_fullsized":"2024-04-24T01:43:21.810144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:15.297566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.208815+0000","last_change":"2024-04-24T01:42:46.783203+0000","last_active":"2024-04-24T01:44:48.208815+0000","last_peered":"2024-04-24T01:44:48.208815+0000","last_clean":"2024-04-24T01:44:48.208815+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:44:48.208815+0000","last_undegraded":"2024-04-24T01:44:48.208815+0000","last_fullsized":"2024-04-24T01:44:48.208815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:26:21.983975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814006+0000","last_change":"2024-04-24T01:42:48.791647+0000","last_active":"2024-04-24T01:43:21.814006+0000","last_peered":"2024-04-24T01:43:21.814006+0000","last_clean":"2024-04-24T01:43:21.814006+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:43:21.814006+0000","last_undegraded":"2024-04-24T01:43:21.814006+0000","last_fullsized":"2024-04-24T01:43:21.814006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:07.292630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.304388+0000","last_change":"2024-04-24T01:42:50.797843+0000","last_active":"2024-04-24T01:45:50.304388+0000","last_peered":"2024-04-24T01:45:50.304388+0000","last_clean":"2024-04-24T01:45:50.304388+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:45:50.304388+0000","last_undegraded":"2024-04-24T01:45:50.304388+0000","last_fullsized":"2024-04-24T01:45:50.304388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:49.177816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814977+0000","last_change":"2024-04-24T01:42:42.786283+0000","last_active":"2024-04-24T01:43:21.814977+0000","last_peered":"2024-04-24T01:43:21.814977+0000","last_clean":"2024-04-24T01:43:21.814977+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:43:21.814977+0000","last_undegraded":"2024-04-24T01:43:21.814977+0000","last_fullsized":"2024-04-24T01:43:21.814977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:14.187364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.608549+0000","last_change":"2024-04-24T01:42:40.769690+0000","last_active":"2024-04-24T01:44:49.608549+0000","last_peered":"2024-04-24T01:44:49.608549+0000","last_clean":"2024-04-24T01:44:49.608549+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:44:49.608549+0000","last_undegraded":"2024-04-24T01:44:49.608549+0000","last_fullsized":"2024-04-24T01:44:49.608549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808700+0000","last_change":"2024-04-24T01:42:44.775092+0000","last_active":"2024-04-24T01:43:21.808700+0000","last_peered":"2024-04-24T01:43:21.808700+0000","last_clean":"2024-04-24T01:43:21.808700+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:43:21.808700+0000","last_undegraded":"2024-04-24T01:43:21.808700+0000","last_fullsized":"2024-04-24T01:43:21.808700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:22.743910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.226891+0000","last_change":"2024-04-24T01:42:46.777052+0000","last_active":"2024-04-24T01:44:48.226891+0000","last_peered":"2024-04-24T01:44:48.226891+0000","last_clean":"2024-04-24T01:44:48.226891+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:44:48.226891+0000","last_undegraded":"2024-04-24T01:44:48.226891+0000","last_fullsized":"2024-04-24T01:44:48.226891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:56.838568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864024+0000","last_change":"2024-04-24T01:42:48.783841+0000","last_active":"2024-04-24T01:43:21.864024+0000","last_peered":"2024-04-24T01:43:21.864024+0000","last_clean":"2024-04-24T01:43:21.864024+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:43:21.864024+0000","last_undegraded":"2024-04-24T01:43:21.864024+0000","last_fullsized":"2024-04-24T01:43:21.864024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:56:50.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.650746+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:44:49.650746+0000","last_peered":"2024-04-24T01:44:49.650746+0000","last_clean":"2024-04-24T01:44:49.650746+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:44:49.650746+0000","last_undegraded":"2024-04-24T01:44:49.650746+0000","last_fullsized":"2024-04-24T01:44:49.650746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:59.151288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315999+0000","last_change":"2024-04-24T01:42:42.776215+0000","last_active":"2024-04-24T01:45:50.315999+0000","last_peered":"2024-04-24T01:45:50.315999+0000","last_clean":"2024-04-24T01:45:50.315999+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:45:50.315999+0000","last_undegraded":"2024-04-24T01:45:50.315999+0000","last_fullsized":"2024-04-24T01:45:50.315999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:29.635969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791055+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:46.075375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816801+0000","last_change":"2024-04-24T01:42:44.775371+0000","last_active":"2024-04-24T01:43:21.816801+0000","last_peered":"2024-04-24T01:43:21.816801+0000","last_clean":"2024-04-24T01:43:21.816801+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:43:21.816801+0000","last_undegraded":"2024-04-24T01:43:21.816801+0000","last_fullsized":"2024-04-24T01:43:21.816801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:48.566887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813558+0000","last_change":"2024-04-24T01:42:46.785255+0000","last_active":"2024-04-24T01:43:21.813558+0000","last_peered":"2024-04-24T01:43:21.813558+0000","last_clean":"2024-04-24T01:43:21.813558+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:43:21.813558+0000","last_undegraded":"2024-04-24T01:43:21.813558+0000","last_fullsized":"2024-04-24T01:43:21.813558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:55.734489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.349973+0000","last_change":"2024-04-24T01:42:48.791368+0000","last_active":"2024-04-24T01:45:50.349973+0000","last_peered":"2024-04-24T01:45:50.349973+0000","last_clean":"2024-04-24T01:45:50.349973+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:45:50.349973+0000","last_undegraded":"2024-04-24T01:45:50.349973+0000","last_fullsized":"2024-04-24T01:45:50.349973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:36.125996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809311+0000","last_change":"2024-04-24T01:42:50.799047+0000","last_active":"2024-04-24T01:43:21.809311+0000","last_peered":"2024-04-24T01:43:21.809311+0000","last_clean":"2024-04-24T01:43:21.809311+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:43:21.809311+0000","last_undegraded":"2024-04-24T01:43:21.809311+0000","last_fullsized":"2024-04-24T01:43:21.809311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:48.985276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270565+0000","last_change":"2024-04-24T01:42:42.779703+0000","last_active":"2024-04-24T01:45:50.270565+0000","last_peered":"2024-04-24T01:45:50.270565+0000","last_clean":"2024-04-24T01:45:50.270565+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:45:50.270565+0000","last_undegraded":"2024-04-24T01:45:50.270565+0000","last_fullsized":"2024-04-24T01:45:50.270565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:48.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817526+0000","last_change":"2024-04-24T01:42:40.783048+0000","last_active":"2024-04-24T01:43:21.817526+0000","last_peered":"2024-04-24T01:43:21.817526+0000","last_clean":"2024-04-24T01:43:21.817526+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:43:21.817526+0000","last_undegraded":"2024-04-24T01:43:21.817526+0000","last_fullsized":"2024-04-24T01:43:21.817526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817275+0000","last_change":"2024-04-24T01:42:44.776357+0000","last_active":"2024-04-24T01:43:21.817275+0000","last_peered":"2024-04-24T01:43:21.817275+0000","last_clean":"2024-04-24T01:43:21.817275+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:43:21.817275+0000","last_undegraded":"2024-04-24T01:43:21.817275+0000","last_fullsized":"2024-04-24T01:43:21.817275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:59.654590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'63","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090843+0000","last_change":"2024-04-24T01:42:46.776292+0000","last_active":"2024-04-24T01:45:11.090843+0000","last_peered":"2024-04-24T01:45:11.090843+0000","last_clean":"2024-04-24T01:45:11.090843+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:45:11.090843+0000","last_undegraded":"2024-04-24T01:45:11.090843+0000","last_fullsized":"2024-04-24T01:45:11.090843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:34.123347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":76,"num_read_kb":63,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.861850+0000","last_change":"2024-04-24T01:42:48.788971+0000","last_active":"2024-04-24T01:43:21.861850+0000","last_peered":"2024-04-24T01:43:21.861850+0000","last_clean":"2024-04-24T01:43:21.861850+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:43:21.861850+0000","last_undegraded":"2024-04-24T01:43:21.861850+0000","last_fullsized":"2024-04-24T01:43:21.861850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:30:22.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817135+0000","last_change":"2024-04-24T01:42:50.796877+0000","last_active":"2024-04-24T01:43:21.817135+0000","last_peered":"2024-04-24T01:43:21.817135+0000","last_clean":"2024-04-24T01:43:21.817135+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:43:21.817135+0000","last_undegraded":"2024-04-24T01:43:21.817135+0000","last_fullsized":"2024-04-24T01:43:21.817135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:01:14.162912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345596+0000","last_change":"2024-04-24T01:42:42.779537+0000","last_active":"2024-04-24T01:45:50.345596+0000","last_peered":"2024-04-24T01:45:50.345596+0000","last_clean":"2024-04-24T01:45:50.345596+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:45:50.345596+0000","last_undegraded":"2024-04-24T01:45:50.345596+0000","last_fullsized":"2024-04-24T01:45:50.345596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:12.977374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.261154+0000","last_change":"2024-04-24T01:42:40.788381+0000","last_active":"2024-04-24T01:45:50.261154+0000","last_peered":"2024-04-24T01:45:50.261154+0000","last_clean":"2024-04-24T01:45:50.261154+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:45:50.261154+0000","last_undegraded":"2024-04-24T01:45:50.261154+0000","last_fullsized":"2024-04-24T01:45:50.261154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:10.719363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810382+0000","last_change":"2024-04-24T01:42:44.775775+0000","last_active":"2024-04-24T01:43:21.810382+0000","last_peered":"2024-04-24T01:43:21.810382+0000","last_clean":"2024-04-24T01:43:21.810382+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:43:21.810382+0000","last_undegraded":"2024-04-24T01:43:21.810382+0000","last_fullsized":"2024-04-24T01:43:21.810382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:06.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.200340+0000","last_change":"2024-04-24T01:42:46.777066+0000","last_active":"2024-04-24T01:44:48.200340+0000","last_peered":"2024-04-24T01:44:48.200340+0000","last_clean":"2024-04-24T01:44:48.200340+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:44:48.200340+0000","last_undegraded":"2024-04-24T01:44:48.200340+0000","last_fullsized":"2024-04-24T01:44:48.200340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:17.835974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810707+0000","last_change":"2024-04-24T01:42:48.785198+0000","last_active":"2024-04-24T01:43:21.810707+0000","last_peered":"2024-04-24T01:43:21.810707+0000","last_clean":"2024-04-24T01:43:21.810707+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:43:21.810707+0000","last_undegraded":"2024-04-24T01:43:21.810707+0000","last_fullsized":"2024-04-24T01:43:21.810707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:01.822047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.400789+0000","last_change":"2024-04-24T01:42:50.801689+0000","last_active":"2024-04-24T01:45:50.400789+0000","last_peered":"2024-04-24T01:45:50.400789+0000","last_clean":"2024-04-24T01:45:50.400789+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:45:50.400789+0000","last_undegraded":"2024-04-24T01:45:50.400789+0000","last_fullsized":"2024-04-24T01:45:50.400789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:45.044072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654504+0000","last_change":"2024-04-24T01:43:21.864360+0000","last_active":"2024-04-24T01:44:49.654504+0000","last_peered":"2024-04-24T01:44:49.654504+0000","last_clean":"2024-04-24T01:44:49.654504+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:44:49.654504+0000","last_undegraded":"2024-04-24T01:44:49.654504+0000","last_fullsized":"2024-04-24T01:44:49.654504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:52.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865009+0000","last_change":"2024-04-24T01:42:40.778077+0000","last_active":"2024-04-24T01:43:21.865009+0000","last_peered":"2024-04-24T01:43:21.865009+0000","last_clean":"2024-04-24T01:43:21.865009+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:43:21.865009+0000","last_undegraded":"2024-04-24T01:43:21.865009+0000","last_fullsized":"2024-04-24T01:43:21.865009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:51.699851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.302204+0000","last_change":"2024-04-24T01:42:44.778211+0000","last_active":"2024-04-24T01:44:49.302204+0000","last_peered":"2024-04-24T01:44:49.302204+0000","last_clean":"2024-04-24T01:44:49.302204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:44:49.302204+0000","last_undegraded":"2024-04-24T01:44:49.302204+0000","last_fullsized":"2024-04-24T01:44:49.302204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:36.446305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.224750+0000","last_change":"2024-04-24T01:42:46.782809+0000","last_active":"2024-04-24T01:44:48.224750+0000","last_peered":"2024-04-24T01:44:48.224750+0000","last_clean":"2024-04-24T01:44:48.224750+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:44:48.224750+0000","last_undegraded":"2024-04-24T01:44:48.224750+0000","last_fullsized":"2024-04-24T01:44:48.224750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:38.612473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811004+0000","last_change":"2024-04-24T01:42:48.793613+0000","last_active":"2024-04-24T01:43:21.811004+0000","last_peered":"2024-04-24T01:43:21.811004+0000","last_clean":"2024-04-24T01:43:21.811004+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:43:21.811004+0000","last_undegraded":"2024-04-24T01:43:21.811004+0000","last_fullsized":"2024-04-24T01:43:21.811004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:14.394175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.234782+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:44:48.234782+0000","last_peered":"2024-04-24T01:44:48.234782+0000","last_clean":"2024-04-24T01:44:48.234782+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:44:48.234782+0000","last_undegraded":"2024-04-24T01:44:48.234782+0000","last_fullsized":"2024-04-24T01:44:48.234782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:18.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345345+0000","last_change":"2024-04-24T01:42:42.779597+0000","last_active":"2024-04-24T01:45:50.345345+0000","last_peered":"2024-04-24T01:45:50.345345+0000","last_clean":"2024-04-24T01:45:50.345345+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:45:50.345345+0000","last_undegraded":"2024-04-24T01:45:50.345345+0000","last_fullsized":"2024-04-24T01:45:50.345345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:39.932797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.258347+0000","last_change":"2024-04-24T01:42:40.789710+0000","last_active":"2024-04-24T01:45:50.258347+0000","last_peered":"2024-04-24T01:45:50.258347+0000","last_clean":"2024-04-24T01:45:50.258347+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:45:50.258347+0000","last_undegraded":"2024-04-24T01:45:50.258347+0000","last_fullsized":"2024-04-24T01:45:50.258347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.900262+0000","last_change":"2024-04-24T01:42:44.778763+0000","last_active":"2024-04-24T01:44:46.900262+0000","last_peered":"2024-04-24T01:44:46.900262+0000","last_clean":"2024-04-24T01:44:46.900262+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:44:46.900262+0000","last_undegraded":"2024-04-24T01:44:46.900262+0000","last_fullsized":"2024-04-24T01:44:46.900262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:04.964034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672992+0000","last_change":"2024-04-24T01:42:46.782978+0000","last_active":"2024-04-24T01:45:49.672992+0000","last_peered":"2024-04-24T01:45:49.672992+0000","last_clean":"2024-04-24T01:45:49.672992+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:45:49.672992+0000","last_undegraded":"2024-04-24T01:45:49.672992+0000","last_fullsized":"2024-04-24T01:45:49.672992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:19.005767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863044+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:43:21.863044+0000","last_peered":"2024-04-24T01:43:21.863044+0000","last_clean":"2024-04-24T01:43:21.863044+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:43:21.863044+0000","last_undegraded":"2024-04-24T01:43:21.863044+0000","last_fullsized":"2024-04-24T01:43:21.863044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:02.008836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.237757+0000","last_change":"2024-04-24T01:42:50.800862+0000","last_active":"2024-04-24T01:44:48.237757+0000","last_peered":"2024-04-24T01:44:48.237757+0000","last_clean":"2024-04-24T01:44:48.237757+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:44:48.237757+0000","last_undegraded":"2024-04-24T01:44:48.237757+0000","last_fullsized":"2024-04-24T01:44:48.237757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:16:03.004170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088543+0000","last_change":"2024-04-24T01:42:42.791052+0000","last_active":"2024-04-24T01:44:56.088543+0000","last_peered":"2024-04-24T01:44:56.088543+0000","last_clean":"2024-04-24T01:44:56.088543+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:44:56.088543+0000","last_undegraded":"2024-04-24T01:44:56.088543+0000","last_fullsized":"2024-04-24T01:44:56.088543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:09.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.086702+0000","last_change":"2024-04-24T01:42:40.778401+0000","last_active":"2024-04-24T01:44:46.086702+0000","last_peered":"2024-04-24T01:44:46.086702+0000","last_clean":"2024-04-24T01:44:46.086702+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:44:46.086702+0000","last_undegraded":"2024-04-24T01:44:46.086702+0000","last_fullsized":"2024-04-24T01:44:46.086702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315993+0000","last_change":"2024-04-24T01:42:42.779808+0000","last_active":"2024-04-24T01:45:50.315993+0000","last_peered":"2024-04-24T01:45:50.315993+0000","last_clean":"2024-04-24T01:45:50.315993+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:45:50.315993+0000","last_undegraded":"2024-04-24T01:45:50.315993+0000","last_fullsized":"2024-04-24T01:45:50.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:39.808849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862090+0000","last_change":"2024-04-24T01:42:40.781020+0000","last_active":"2024-04-24T01:43:21.862090+0000","last_peered":"2024-04-24T01:43:21.862090+0000","last_clean":"2024-04-24T01:43:21.862090+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:43:21.862090+0000","last_undegraded":"2024-04-24T01:43:21.862090+0000","last_fullsized":"2024-04-24T01:43:21.862090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:11:49.303845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'21","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.051046+0000","last_change":"2024-04-24T01:42:42.782200+0000","last_active":"2024-04-24T01:45:50.051046+0000","last_peered":"2024-04-24T01:45:50.051046+0000","last_clean":"2024-04-24T01:45:50.051046+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:45:50.051046+0000","last_undegraded":"2024-04-24T01:45:50.051046+0000","last_fullsized":"2024-04-24T01:45:50.051046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:51.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.023917+0000","last_change":"2024-04-24T01:42:40.785740+0000","last_active":"2024-04-24T01:45:50.023917+0000","last_peered":"2024-04-24T01:45:50.023917+0000","last_clean":"2024-04-24T01:45:50.023917+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:45:50.023917+0000","last_undegraded":"2024-04-24T01:45:50.023917+0000","last_fullsized":"2024-04-24T01:45:50.023917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:06.241519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315979+0000","last_change":"2024-04-24T01:42:42.775754+0000","last_active":"2024-04-24T01:45:50.315979+0000","last_peered":"2024-04-24T01:45:50.315979+0000","last_clean":"2024-04-24T01:45:50.315979+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:45:50.315979+0000","last_undegraded":"2024-04-24T01:45:50.315979+0000","last_fullsized":"2024-04-24T01:45:50.315979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:14.133212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864641+0000","last_change":"2024-04-24T01:42:40.768297+0000","last_active":"2024-04-24T01:43:21.864641+0000","last_peered":"2024-04-24T01:43:21.864641+0000","last_clean":"2024-04-24T01:43:21.864641+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:43:21.864641+0000","last_undegraded":"2024-04-24T01:43:21.864641+0000","last_fullsized":"2024-04-24T01:43:21.864641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:41.931823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864431+0000","last_change":"2024-04-24T01:42:42.790746+0000","last_active":"2024-04-24T01:43:21.864431+0000","last_peered":"2024-04-24T01:43:21.864431+0000","last_clean":"2024-04-24T01:43:21.864431+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:43:21.864431+0000","last_undegraded":"2024-04-24T01:43:21.864431+0000","last_fullsized":"2024-04-24T01:43:21.864431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:23.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334072+0000","last_change":"2024-04-24T01:42:40.778267+0000","last_active":"2024-04-24T01:43:22.334072+0000","last_peered":"2024-04-24T01:43:22.334072+0000","last_clean":"2024-04-24T01:43:22.334072+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:43:22.334072+0000","last_undegraded":"2024-04-24T01:43:22.334072+0000","last_fullsized":"2024-04-24T01:43:22.334072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:54.513268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506919+0000","last_change":"2024-04-24T01:42:42.783600+0000","last_active":"2024-04-24T01:44:46.506919+0000","last_peered":"2024-04-24T01:44:46.506919+0000","last_clean":"2024-04-24T01:44:46.506919+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:44:46.506919+0000","last_undegraded":"2024-04-24T01:44:46.506919+0000","last_fullsized":"2024-04-24T01:44:46.506919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:54.263697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.438378+0000","last_change":"2024-04-24T01:42:40.792747+0000","last_active":"2024-04-24T01:43:23.438378+0000","last_peered":"2024-04-24T01:43:23.438378+0000","last_clean":"2024-04-24T01:43:23.438378+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:43:23.438378+0000","last_undegraded":"2024-04-24T01:43:23.438378+0000","last_fullsized":"2024-04-24T01:43:23.438378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.455490+0000","last_change":"2024-04-24T01:42:42.783541+0000","last_active":"2024-04-24T01:43:23.455490+0000","last_peered":"2024-04-24T01:43:23.455490+0000","last_clean":"2024-04-24T01:43:23.455490+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:43:23.455490+0000","last_undegraded":"2024-04-24T01:43:23.455490+0000","last_fullsized":"2024-04-24T01:43:23.455490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:29.669455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.496096+0000","last_change":"2024-04-24T01:42:40.784834+0000","last_active":"2024-04-24T01:44:46.496096+0000","last_peered":"2024-04-24T01:44:46.496096+0000","last_clean":"2024-04-24T01:44:46.496096+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:44:46.496096+0000","last_undegraded":"2024-04-24T01:44:46.496096+0000","last_fullsized":"2024-04-24T01:44:46.496096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654733+0000","last_change":"2024-04-24T01:42:42.784939+0000","last_active":"2024-04-24T01:44:49.654733+0000","last_peered":"2024-04-24T01:44:49.654733+0000","last_clean":"2024-04-24T01:44:49.654733+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:44:49.654733+0000","last_undegraded":"2024-04-24T01:44:49.654733+0000","last_fullsized":"2024-04-24T01:44:49.654733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.002401+0000","last_change":"2024-04-24T01:42:40.774338+0000","last_active":"2024-04-24T01:45:50.002401+0000","last_peered":"2024-04-24T01:45:50.002401+0000","last_clean":"2024-04-24T01:45:50.002401+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:45:50.002401+0000","last_undegraded":"2024-04-24T01:45:50.002401+0000","last_fullsized":"2024-04-24T01:45:50.002401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:47.446497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654753+0000","last_change":"2024-04-24T01:42:42.783518+0000","last_active":"2024-04-24T01:44:49.654753+0000","last_peered":"2024-04-24T01:44:49.654753+0000","last_clean":"2024-04-24T01:44:49.654753+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:44:49.654753+0000","last_undegraded":"2024-04-24T01:44:49.654753+0000","last_fullsized":"2024-04-24T01:44:49.654753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:48.893933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810266+0000","last_change":"2024-04-24T01:42:40.776220+0000","last_active":"2024-04-24T01:43:21.810266+0000","last_peered":"2024-04-24T01:43:21.810266+0000","last_clean":"2024-04-24T01:43:21.810266+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:43:21.810266+0000","last_undegraded":"2024-04-24T01:43:21.810266+0000","last_fullsized":"2024-04-24T01:43:21.810266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:52.166943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654997+0000","last_change":"2024-04-24T01:42:42.780704+0000","last_active":"2024-04-24T01:44:49.654997+0000","last_peered":"2024-04-24T01:44:49.654997+0000","last_clean":"2024-04-24T01:44:49.654997+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:44:49.654997+0000","last_undegraded":"2024-04-24T01:44:49.654997+0000","last_fullsized":"2024-04-24T01:44:49.654997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:19.467731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334617+0000","last_change":"2024-04-24T01:42:40.774379+0000","last_active":"2024-04-24T01:43:22.334617+0000","last_peered":"2024-04-24T01:43:22.334617+0000","last_clean":"2024-04-24T01:43:22.334617+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:43:22.334617+0000","last_undegraded":"2024-04-24T01:43:22.334617+0000","last_fullsized":"2024-04-24T01:43:22.334617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:56.807661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321950+0000","last_change":"2024-04-24T01:42:42.790910+0000","last_active":"2024-04-24T01:45:50.321950+0000","last_peered":"2024-04-24T01:45:50.321950+0000","last_clean":"2024-04-24T01:45:50.321950+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:45:50.321950+0000","last_undegraded":"2024-04-24T01:45:50.321950+0000","last_fullsized":"2024-04-24T01:45:50.321950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:52.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816518+0000","last_change":"2024-04-24T01:42:40.793467+0000","last_active":"2024-04-24T01:43:21.816518+0000","last_peered":"2024-04-24T01:43:21.816518+0000","last_clean":"2024-04-24T01:43:21.816518+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:43:21.816518+0000","last_undegraded":"2024-04-24T01:43:21.816518+0000","last_fullsized":"2024-04-24T01:43:21.816518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.019736+0000","last_change":"2024-04-24T01:42:42.781172+0000","last_active":"2024-04-24T01:44:06.019736+0000","last_peered":"2024-04-24T01:44:06.019736+0000","last_clean":"2024-04-24T01:44:06.019736+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:44:06.019736+0000","last_undegraded":"2024-04-24T01:44:06.019736+0000","last_fullsized":"2024-04-24T01:44:06.019736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:50.255990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815448+0000","last_change":"2024-04-24T01:42:40.771155+0000","last_active":"2024-04-24T01:43:21.815448+0000","last_peered":"2024-04-24T01:43:21.815448+0000","last_clean":"2024-04-24T01:43:21.815448+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:43:21.815448+0000","last_undegraded":"2024-04-24T01:43:21.815448+0000","last_fullsized":"2024-04-24T01:43:21.815448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816208+0000","last_change":"2024-04-24T01:42:42.782402+0000","last_active":"2024-04-24T01:43:21.816208+0000","last_peered":"2024-04-24T01:43:21.816208+0000","last_clean":"2024-04-24T01:43:21.816208+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:43:21.816208+0000","last_undegraded":"2024-04-24T01:43:21.816208+0000","last_fullsized":"2024-04-24T01:43:21.816208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:01.719700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811712+0000","last_change":"2024-04-24T01:42:40.785750+0000","last_active":"2024-04-24T01:43:21.811712+0000","last_peered":"2024-04-24T01:43:21.811712+0000","last_clean":"2024-04-24T01:43:21.811712+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:43:21.811712+0000","last_undegraded":"2024-04-24T01:43:21.811712+0000","last_fullsized":"2024-04-24T01:43:21.811712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:29.551602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'11","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.050515+0000","last_change":"2024-04-24T01:42:42.783870+0000","last_active":"2024-04-24T01:45:50.050515+0000","last_peered":"2024-04-24T01:45:50.050515+0000","last_clean":"2024-04-24T01:45:50.050515+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:45:50.050515+0000","last_undegraded":"2024-04-24T01:45:50.050515+0000","last_fullsized":"2024-04-24T01:45:50.050515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:19.254318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089090+0000","last_change":"2024-04-24T01:42:40.787075+0000","last_active":"2024-04-24T01:44:56.089090+0000","last_peered":"2024-04-24T01:44:56.089090+0000","last_clean":"2024-04-24T01:44:56.089090+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:44:56.089090+0000","last_undegraded":"2024-04-24T01:44:56.089090+0000","last_fullsized":"2024-04-24T01:44:56.089090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:11.008229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812646+0000","last_change":"2024-04-24T01:42:42.783035+0000","last_active":"2024-04-24T01:43:21.812646+0000","last_peered":"2024-04-24T01:43:21.812646+0000","last_clean":"2024-04-24T01:43:21.812646+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:43:21.812646+0000","last_undegraded":"2024-04-24T01:43:21.812646+0000","last_fullsized":"2024-04-24T01:43:21.812646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:34.220751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089213+0000","last_change":"2024-04-24T01:42:40.780277+0000","last_active":"2024-04-24T01:45:01.089213+0000","last_peered":"2024-04-24T01:45:01.089213+0000","last_clean":"2024-04-24T01:45:01.089213+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:45:01.089213+0000","last_undegraded":"2024-04-24T01:45:01.089213+0000","last_fullsized":"2024-04-24T01:45:01.089213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088282+0000","last_change":"2024-04-24T01:42:42.785135+0000","last_active":"2024-04-24T01:44:56.088282+0000","last_peered":"2024-04-24T01:44:56.088282+0000","last_clean":"2024-04-24T01:44:56.088282+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:44:56.088282+0000","last_undegraded":"2024-04-24T01:44:56.088282+0000","last_fullsized":"2024-04-24T01:44:56.088282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813648+0000","last_change":"2024-04-24T01:42:40.785768+0000","last_active":"2024-04-24T01:43:21.813648+0000","last_peered":"2024-04-24T01:43:21.813648+0000","last_clean":"2024-04-24T01:43:21.813648+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:43:21.813648+0000","last_undegraded":"2024-04-24T01:43:21.813648+0000","last_fullsized":"2024-04-24T01:43:21.813648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:41.422186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089710+0000","last_change":"2024-04-24T01:42:40.778631+0000","last_active":"2024-04-24T01:45:01.089710+0000","last_peered":"2024-04-24T01:45:01.089710+0000","last_clean":"2024-04-24T01:45:01.089710+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:45:01.089710+0000","last_undegraded":"2024-04-24T01:45:01.089710+0000","last_fullsized":"2024-04-24T01:45:01.089710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:55.030083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270563+0000","last_change":"2024-04-24T01:42:42.785218+0000","last_active":"2024-04-24T01:45:50.270563+0000","last_peered":"2024-04-24T01:45:50.270563+0000","last_clean":"2024-04-24T01:45:50.270563+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:45:50.270563+0000","last_undegraded":"2024-04-24T01:45:50.270563+0000","last_fullsized":"2024-04-24T01:45:50.270563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:11.578528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:04.084957+0000","last_change":"2024-04-24T01:42:40.781285+0000","last_active":"2024-04-24T01:45:04.084957+0000","last_peered":"2024-04-24T01:45:04.084957+0000","last_clean":"2024-04-24T01:45:04.084957+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:45:04.084957+0000","last_undegraded":"2024-04-24T01:45:04.084957+0000","last_fullsized":"2024-04-24T01:45:04.084957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.038340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345306+0000","last_change":"2024-04-24T01:42:42.785126+0000","last_active":"2024-04-24T01:45:50.345306+0000","last_peered":"2024-04-24T01:45:50.345306+0000","last_clean":"2024-04-24T01:45:50.345306+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:45:50.345306+0000","last_undegraded":"2024-04-24T01:45:50.345306+0000","last_fullsized":"2024-04-24T01:45:50.345306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1472,"ondisk_log_size":1472,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48096,"kb_used_data":12760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323744,"statfs":{"total":96636764160,"available":96587513856,"internally_reserved":0,"allocated":13066240,"data_stored":12741353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48928,"kb_used_data":13592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322912,"statfs":{"total":96636764160,"available":96586661888,"internally_reserved":0,"allocated":13918208,"data_stored":13644432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640301,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38712,"kb_used_data":3376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333128,"statfs":{"total":96636764160,"available":96597123072,"internally_reserved":0,"allocated":3457024,"data_stored":3161357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":10988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":11251712,"data_stored":10959103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2420736,"data_stored":2420736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:45:57.382 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:45:57.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.498+0000 7f9987dce640 1 Processor -- start 2024-04-24T01:45:57.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9987dce640 1 -- start start 2024-04-24T01:45:57.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9987dce640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9980071090 0x7f9980131430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9987dce640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980098800 con 0x7f9980096430 2024-04-24T01:45:57.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9987dce640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9980071930 con 0x7f9980071090 2024-04-24T01:45:57.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9985369640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9980071090 0x7f9980131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9985b6a640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9980096430 0x7f9980096810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35882/0 (socket says 172.21.15.107:35882) 2024-04-24T01:45:57.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9985b6a640 1 -- 172.21.15.107:0/1236792671 learned_addr learned my addr 172.21.15.107:0/1236792671 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:45:57.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9985369640 1 -- 172.21.15.107:0/1236792671 >> v1:172.21.15.107:6789/0 conn(0x7f9980096430 legacy=0x7f9980096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.499+0000 7f9985369640 1 -- 172.21.15.107:0/1236792671 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980071f50 con 0x7f9980071090 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.500+0000 7f9985369640 1 --2- 172.21.15.107:0/1236792671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f9980131430 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9970009720 tx=0x7f997002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1faca4ca82b406 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.500+0000 7f9984b68640 1 -- 172.21.15.107:0/1236792671 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99700316d0 con 0x7f9980071090 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.500+0000 7f9984b68640 1 -- 172.21.15.107:0/1236792671 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9970037070 con 0x7f9980071090 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.500+0000 7f9984b68640 1 -- 172.21.15.107:0/1236792671 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99700319c0 con 0x7f9980071090 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.501+0000 7f9987dce640 1 -- 172.21.15.107:0/1236792671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 msgr2=0x7f9980131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.501+0000 7f9987dce640 1 --2- 172.21.15.107:0/1236792671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f9980131430 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9970009720 tx=0x7f997002b840 comp rx=0 tx=0).stop 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.501+0000 7f9987dce640 1 -- 172.21.15.107:0/1236792671 shutdown_connections 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.501+0000 7f9987dce640 1 --2- 172.21.15.107:0/1236792671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f9980131430 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.501+0000 7f9987dce640 1 -- 172.21.15.107:0/1236792671 >> 172.21.15.107:0/1236792671 conn(0x7f9980099680 msgr2=0x7f9980099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.501+0000 7f9987dce640 1 -- 172.21.15.107:0/1236792671 shutdown_connections 2024-04-24T01:45:57.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.501+0000 7f9987dce640 1 -- 172.21.15.107:0/1236792671 wait complete. 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9987dce640 1 Processor -- start 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9987dce640 1 -- start start 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9987dce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f99801250f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9987dce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9980131af0 con 0x7f9980071090 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9985b6a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f99801250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9985b6a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f99801250f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47916/0 (socket says 172.21.15.107:47916) 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9985b6a640 1 -- 172.21.15.107:0/3943942930 learned_addr learned my addr 172.21.15.107:0/3943942930 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9985b6a640 1 -- 172.21.15.107:0/3943942930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980124580 con 0x7f9980071090 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.502+0000 7f9985b6a640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f99801250f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c4a0 tx=0x7f997c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.503+0000 7f99767fc640 1 -- 172.21.15.107:0/3943942930 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f997c017070 con 0x7f9980071090 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.503+0000 7f99767fc640 1 -- 172.21.15.107:0/3943942930 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c005c10 con 0x7f9980071090 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.503+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99801311c0 con 0x7f9980071090 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.503+0000 7f99767fc640 1 -- 172.21.15.107:0/3943942930 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f997c007070 con 0x7f9980071090 2024-04-24T01:45:57.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.503+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9980125630 con 0x7f9980071090 2024-04-24T01:45:57.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.503+0000 7f99767fc640 1 -- 172.21.15.107:0/3943942930 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f997c01a070 con 0x7f9980071090 2024-04-24T01:45:57.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.504+0000 7f99767fc640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9964038060 0x7f996403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.503+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9980062da0 con 0x7f9980071090 2024-04-24T01:45:57.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.504+0000 7f99767fc640 1 -- 172.21.15.107:0/3943942930 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f997c04acf0 con 0x7f9980071090 2024-04-24T01:45:57.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.504+0000 7f9985369640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9964038060 0x7f996403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.504+0000 7f9985369640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9964038060 0x7f996403a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9970036000 tx=0x7f9970008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.508+0000 7f99767fc640 1 -- 172.21.15.107:0/3943942930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f997c01b3b0 con 0x7f9980071090 2024-04-24T01:45:57.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.679+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f998006c170 con 0x7f9964038060 2024-04-24T01:45:57.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.694+0000 7f99767fc640 1 -- 172.21.15.107:0/3943942930 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665681 (secure 0 0 0) 0x7f998006c170 con 0x7f9964038060 2024-04-24T01:45:57.703 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:45:57.709 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9964038060 msgr2=0x7f996403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9964038060 0x7f996403a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9970036000 tx=0x7f9970008030 comp rx=0 tx=0).stop 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 msgr2=0x7f99801250f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f99801250f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c4a0 tx=0x7f997c00c960 comp rx=0 tx=0).stop 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 shutdown_connections 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9964038060 0x7f996403a520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 --2- 172.21.15.107:0/3943942930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9980071090 0x7f99801250f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 >> 172.21.15.107:0/3943942930 conn(0x7f9980099680 msgr2=0x7f9980129ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.698+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 shutdown_connections 2024-04-24T01:45:57.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.699+0000 7f9987dce640 1 -- 172.21.15.107:0/3943942930 wait complete. 2024-04-24T01:45:57.714 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-24T01:45:56.065867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":259,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5177,"num_read_kb":4722,"num_write":2296,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4673,"ondisk_log_size":4673,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186220,"kb_used_data":40716,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301140,"statfs":{"total":386547056640,"available":386356367360,"internally_reserved":0,"allocated":41693184,"data_stored":40506245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003703"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810312+0000","last_change":"2024-04-24T01:42:40.781437+0000","last_active":"2024-04-24T01:43:21.810312+0000","last_peered":"2024-04-24T01:43:21.810312+0000","last_clean":"2024-04-24T01:43:21.810312+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:43:21.810312+0000","last_undegraded":"2024-04-24T01:43:21.810312+0000","last_fullsized":"2024-04-24T01:43:21.810312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138190+0000","last_change":"2024-04-24T01:42:42.785371+0000","last_active":"2024-04-24T01:45:50.138190+0000","last_peered":"2024-04-24T01:45:50.138190+0000","last_clean":"2024-04-24T01:45:50.138190+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:45:50.138190+0000","last_undegraded":"2024-04-24T01:45:50.138190+0000","last_fullsized":"2024-04-24T01:45:50.138190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082623+0000","last_change":"2024-04-24T01:42:40.769679+0000","last_active":"2024-04-24T01:44:49.082623+0000","last_peered":"2024-04-24T01:44:49.082623+0000","last_clean":"2024-04-24T01:44:49.082623+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:44:49.082623+0000","last_undegraded":"2024-04-24T01:44:49.082623+0000","last_fullsized":"2024-04-24T01:44:49.082623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:45.687433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.044899+0000","last_change":"2024-04-24T01:42:42.780099+0000","last_active":"2024-04-24T01:45:50.044899+0000","last_peered":"2024-04-24T01:45:50.044899+0000","last_clean":"2024-04-24T01:45:50.044899+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:45:50.044899+0000","last_undegraded":"2024-04-24T01:45:50.044899+0000","last_fullsized":"2024-04-24T01:45:50.044899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:41.652689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814577+0000","last_change":"2024-04-24T01:42:40.787360+0000","last_active":"2024-04-24T01:43:21.814577+0000","last_peered":"2024-04-24T01:43:21.814577+0000","last_clean":"2024-04-24T01:43:21.814577+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:43:21.814577+0000","last_undegraded":"2024-04-24T01:43:21.814577+0000","last_fullsized":"2024-04-24T01:43:21.814577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:17.246961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315339+0000","last_change":"2024-04-24T01:42:42.777928+0000","last_active":"2024-04-24T01:45:50.315339+0000","last_peered":"2024-04-24T01:45:50.315339+0000","last_clean":"2024-04-24T01:45:50.315339+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:45:50.315339+0000","last_undegraded":"2024-04-24T01:45:50.315339+0000","last_fullsized":"2024-04-24T01:45:50.315339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:43.330594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808622+0000","last_change":"2024-04-24T01:42:40.777293+0000","last_active":"2024-04-24T01:43:21.808622+0000","last_peered":"2024-04-24T01:43:21.808622+0000","last_clean":"2024-04-24T01:43:21.808622+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:43:21.808622+0000","last_undegraded":"2024-04-24T01:43:21.808622+0000","last_fullsized":"2024-04-24T01:43:21.808622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812539+0000","last_change":"2024-04-24T01:42:42.782433+0000","last_active":"2024-04-24T01:43:21.812539+0000","last_peered":"2024-04-24T01:43:21.812539+0000","last_clean":"2024-04-24T01:43:21.812539+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:43:21.812539+0000","last_undegraded":"2024-04-24T01:43:21.812539+0000","last_fullsized":"2024-04-24T01:43:21.812539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:46.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.252337+0000","last_change":"2024-04-24T01:42:40.787185+0000","last_active":"2024-04-24T01:45:50.252337+0000","last_peered":"2024-04-24T01:45:50.252337+0000","last_clean":"2024-04-24T01:45:50.252337+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:45:50.252337+0000","last_undegraded":"2024-04-24T01:45:50.252337+0000","last_fullsized":"2024-04-24T01:45:50.252337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:54.284107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321632+0000","last_change":"2024-04-24T01:42:42.783384+0000","last_active":"2024-04-24T01:45:50.321632+0000","last_peered":"2024-04-24T01:45:50.321632+0000","last_clean":"2024-04-24T01:45:50.321632+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:45:50.321632+0000","last_undegraded":"2024-04-24T01:45:50.321632+0000","last_fullsized":"2024-04-24T01:45:50.321632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:43.429543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808027+0000","last_change":"2024-04-24T01:42:40.775908+0000","last_active":"2024-04-24T01:43:21.808027+0000","last_peered":"2024-04-24T01:43:21.808027+0000","last_clean":"2024-04-24T01:43:21.808027+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:43:21.808027+0000","last_undegraded":"2024-04-24T01:43:21.808027+0000","last_fullsized":"2024-04-24T01:43:21.808027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.800378+0000","last_change":"2024-04-24T01:43:21.820449+0000","last_active":"2024-04-24T01:44:05.800378+0000","last_peered":"2024-04-24T01:44:05.800378+0000","last_clean":"2024-04-24T01:44:05.800378+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:44:05.800378+0000","last_undegraded":"2024-04-24T01:44:05.800378+0000","last_fullsized":"2024-04-24T01:44:05.800378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:18.138123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812225+0000","last_change":"2024-04-24T01:42:40.785983+0000","last_active":"2024-04-24T01:43:21.812225+0000","last_peered":"2024-04-24T01:43:21.812225+0000","last_clean":"2024-04-24T01:43:21.812225+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:43:21.812225+0000","last_undegraded":"2024-04-24T01:43:21.812225+0000","last_fullsized":"2024-04-24T01:43:21.812225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:42.761936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270804+0000","last_change":"2024-04-24T01:42:42.788032+0000","last_active":"2024-04-24T01:45:50.270804+0000","last_peered":"2024-04-24T01:45:50.270804+0000","last_clean":"2024-04-24T01:45:50.270804+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:45:50.270804+0000","last_undegraded":"2024-04-24T01:45:50.270804+0000","last_fullsized":"2024-04-24T01:45:50.270804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862584+0000","last_change":"2024-04-24T01:42:40.778279+0000","last_active":"2024-04-24T01:43:21.862584+0000","last_peered":"2024-04-24T01:43:21.862584+0000","last_clean":"2024-04-24T01:43:21.862584+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:43:21.862584+0000","last_undegraded":"2024-04-24T01:43:21.862584+0000","last_fullsized":"2024-04-24T01:43:21.862584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:39.530334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138297+0000","last_change":"2024-04-24T01:42:42.789315+0000","last_active":"2024-04-24T01:45:50.138297+0000","last_peered":"2024-04-24T01:45:50.138297+0000","last_clean":"2024-04-24T01:45:50.138297+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:45:50.138297+0000","last_undegraded":"2024-04-24T01:45:50.138297+0000","last_fullsized":"2024-04-24T01:45:50.138297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270574+0000","last_change":"2024-04-24T01:42:42.779841+0000","last_active":"2024-04-24T01:45:50.270574+0000","last_peered":"2024-04-24T01:45:50.270574+0000","last_clean":"2024-04-24T01:45:50.270574+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:45:50.270574+0000","last_undegraded":"2024-04-24T01:45:50.270574+0000","last_fullsized":"2024-04-24T01:45:50.270574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:31.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817068+0000","last_change":"2024-04-24T01:42:40.791488+0000","last_active":"2024-04-24T01:43:21.817068+0000","last_peered":"2024-04-24T01:43:21.817068+0000","last_clean":"2024-04-24T01:43:21.817068+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:43:21.817068+0000","last_undegraded":"2024-04-24T01:43:21.817068+0000","last_fullsized":"2024-04-24T01:43:21.817068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315684+0000","last_change":"2024-04-24T01:42:42.782524+0000","last_active":"2024-04-24T01:45:50.315684+0000","last_peered":"2024-04-24T01:45:50.315684+0000","last_clean":"2024-04-24T01:45:50.315684+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:45:50.315684+0000","last_undegraded":"2024-04-24T01:45:50.315684+0000","last_fullsized":"2024-04-24T01:45:50.315684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:25.756967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811766+0000","last_change":"2024-04-24T01:42:40.784169+0000","last_active":"2024-04-24T01:43:21.811766+0000","last_peered":"2024-04-24T01:43:21.811766+0000","last_clean":"2024-04-24T01:43:21.811766+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:43:21.811766+0000","last_undegraded":"2024-04-24T01:43:21.811766+0000","last_fullsized":"2024-04-24T01:43:21.811766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353379+0000","last_change":"2024-04-24T01:42:42.783807+0000","last_active":"2024-04-24T01:45:50.353379+0000","last_peered":"2024-04-24T01:45:50.353379+0000","last_clean":"2024-04-24T01:45:50.353379+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:45:50.353379+0000","last_undegraded":"2024-04-24T01:45:50.353379+0000","last_fullsized":"2024-04-24T01:45:50.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:04.077606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090155+0000","last_change":"2024-04-24T01:42:40.792423+0000","last_active":"2024-04-24T01:45:06.090155+0000","last_peered":"2024-04-24T01:45:06.090155+0000","last_clean":"2024-04-24T01:45:06.090155+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:45:06.090155+0000","last_undegraded":"2024-04-24T01:45:06.090155+0000","last_fullsized":"2024-04-24T01:45:06.090155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654988+0000","last_change":"2024-04-24T01:42:42.790737+0000","last_active":"2024-04-24T01:44:49.654988+0000","last_peered":"2024-04-24T01:44:49.654988+0000","last_clean":"2024-04-24T01:44:49.654988+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:44:49.654988+0000","last_undegraded":"2024-04-24T01:44:49.654988+0000","last_fullsized":"2024-04-24T01:44:49.654988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:20.557905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.632047+0000","last_change":"2024-04-24T01:42:40.782750+0000","last_active":"2024-04-24T01:44:49.632047+0000","last_peered":"2024-04-24T01:44:49.632047+0000","last_clean":"2024-04-24T01:44:49.632047+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:44:49.632047+0000","last_undegraded":"2024-04-24T01:44:49.632047+0000","last_fullsized":"2024-04-24T01:44:49.632047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270479+0000","last_change":"2024-04-24T01:42:42.790992+0000","last_active":"2024-04-24T01:45:50.270479+0000","last_peered":"2024-04-24T01:45:50.270479+0000","last_clean":"2024-04-24T01:45:50.270479+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:45:50.270479+0000","last_undegraded":"2024-04-24T01:45:50.270479+0000","last_fullsized":"2024-04-24T01:45:50.270479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:12.881341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864678+0000","last_change":"2024-04-24T01:42:40.769585+0000","last_active":"2024-04-24T01:43:21.864678+0000","last_peered":"2024-04-24T01:43:21.864678+0000","last_clean":"2024-04-24T01:43:21.864678+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:43:21.864678+0000","last_undegraded":"2024-04-24T01:43:21.864678+0000","last_fullsized":"2024-04-24T01:43:21.864678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:33:56.281356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137384+0000","last_change":"2024-04-24T01:42:42.784217+0000","last_active":"2024-04-24T01:45:50.137384+0000","last_peered":"2024-04-24T01:45:50.137384+0000","last_clean":"2024-04-24T01:45:50.137384+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:45:50.137384+0000","last_undegraded":"2024-04-24T01:45:50.137384+0000","last_fullsized":"2024-04-24T01:45:50.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:21.185447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.340485+0000","last_change":"2024-04-24T01:42:40.786476+0000","last_active":"2024-04-24T01:45:50.340485+0000","last_peered":"2024-04-24T01:45:50.340485+0000","last_clean":"2024-04-24T01:45:50.340485+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:45:50.340485+0000","last_undegraded":"2024-04-24T01:45:50.340485+0000","last_fullsized":"2024-04-24T01:45:50.340485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:50.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.295799+0000","last_change":"2024-04-24T01:42:50.802941+0000","last_active":"2024-04-24T01:45:50.295799+0000","last_peered":"2024-04-24T01:45:50.295799+0000","last_clean":"2024-04-24T01:45:50.295799+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:45:50.295799+0000","last_undegraded":"2024-04-24T01:45:50.295799+0000","last_fullsized":"2024-04-24T01:45:50.295799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:19.486282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351833+0000","last_change":"2024-04-24T01:42:42.786160+0000","last_active":"2024-04-24T01:45:50.351833+0000","last_peered":"2024-04-24T01:45:50.351833+0000","last_clean":"2024-04-24T01:45:50.351833+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:45:50.351833+0000","last_undegraded":"2024-04-24T01:45:50.351833+0000","last_fullsized":"2024-04-24T01:45:50.351833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:05.195853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791802+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:36.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818082+0000","last_change":"2024-04-24T01:43:21.817222+0000","last_active":"2024-04-24T01:43:21.818082+0000","last_peered":"2024-04-24T01:43:21.818082+0000","last_clean":"2024-04-24T01:43:21.818082+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:43:21.818082+0000","last_undegraded":"2024-04-24T01:43:21.818082+0000","last_fullsized":"2024-04-24T01:43:21.818082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:34.889879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.217678+0000","last_change":"2024-04-24T01:42:46.785609+0000","last_active":"2024-04-24T01:44:48.217678+0000","last_peered":"2024-04-24T01:44:48.217678+0000","last_clean":"2024-04-24T01:44:48.217678+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:44:48.217678+0000","last_undegraded":"2024-04-24T01:44:48.217678+0000","last_fullsized":"2024-04-24T01:44:48.217678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:24.228056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816972+0000","last_change":"2024-04-24T01:42:48.793869+0000","last_active":"2024-04-24T01:43:21.816972+0000","last_peered":"2024-04-24T01:43:21.816972+0000","last_clean":"2024-04-24T01:43:21.816972+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:43:21.816972+0000","last_undegraded":"2024-04-24T01:43:21.816972+0000","last_fullsized":"2024-04-24T01:43:21.816972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:23.315540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.805565+0000","last_change":"2024-04-24T01:42:50.802222+0000","last_active":"2024-04-24T01:44:05.805565+0000","last_peered":"2024-04-24T01:44:05.805565+0000","last_clean":"2024-04-24T01:44:05.805565+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:44:05.805565+0000","last_undegraded":"2024-04-24T01:44:05.805565+0000","last_fullsized":"2024-04-24T01:44:05.805565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:26.157145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.020370+0000","last_change":"2024-04-24T01:42:42.784837+0000","last_active":"2024-04-24T01:44:06.020370+0000","last_peered":"2024-04-24T01:44:06.020370+0000","last_clean":"2024-04-24T01:44:06.020370+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:44:06.020370+0000","last_undegraded":"2024-04-24T01:44:06.020370+0000","last_fullsized":"2024-04-24T01:44:06.020370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:40.033902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.432410+0000","last_change":"2024-04-24T01:42:40.782079+0000","last_active":"2024-04-24T01:43:23.432410+0000","last_peered":"2024-04-24T01:43:23.432410+0000","last_clean":"2024-04-24T01:43:23.432410+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:43:23.432410+0000","last_undegraded":"2024-04-24T01:43:23.432410+0000","last_fullsized":"2024-04-24T01:43:23.432410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863552+0000","last_change":"2024-04-24T01:42:44.776066+0000","last_active":"2024-04-24T01:43:21.863552+0000","last_peered":"2024-04-24T01:43:21.863552+0000","last_clean":"2024-04-24T01:43:21.863552+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:43:21.863552+0000","last_undegraded":"2024-04-24T01:43:21.863552+0000","last_fullsized":"2024-04-24T01:43:21.863552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:21.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814388+0000","last_change":"2024-04-24T01:42:46.778609+0000","last_active":"2024-04-24T01:43:21.814388+0000","last_peered":"2024-04-24T01:43:21.814388+0000","last_clean":"2024-04-24T01:43:21.814388+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:43:21.814388+0000","last_undegraded":"2024-04-24T01:43:21.814388+0000","last_fullsized":"2024-04-24T01:43:21.814388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:18.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814658+0000","last_change":"2024-04-24T01:42:48.790498+0000","last_active":"2024-04-24T01:43:21.814658+0000","last_peered":"2024-04-24T01:43:21.814658+0000","last_clean":"2024-04-24T01:43:21.814658+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:43:21.814658+0000","last_undegraded":"2024-04-24T01:43:21.814658+0000","last_fullsized":"2024-04-24T01:43:21.814658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:35.394375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.749783+0000","last_change":"2024-04-24T01:42:50.793834+0000","last_active":"2024-04-24T01:45:49.749783+0000","last_peered":"2024-04-24T01:45:49.749783+0000","last_clean":"2024-04-24T01:45:49.749783+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:45:49.749783+0000","last_undegraded":"2024-04-24T01:45:49.749783+0000","last_fullsized":"2024-04-24T01:45:49.749783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:58.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'21","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351802+0000","last_change":"2024-04-24T01:42:42.777752+0000","last_active":"2024-04-24T01:45:50.351802+0000","last_peered":"2024-04-24T01:45:50.351802+0000","last_clean":"2024-04-24T01:45:50.351802+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:45:50.351802+0000","last_undegraded":"2024-04-24T01:45:50.351802+0000","last_fullsized":"2024-04-24T01:45:50.351802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:23.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.522600+0000","last_change":"2024-04-24T01:42:40.790240+0000","last_active":"2024-04-24T01:44:49.522600+0000","last_peered":"2024-04-24T01:44:49.522600+0000","last_clean":"2024-04-24T01:44:49.522600+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:44:49.522600+0000","last_undegraded":"2024-04-24T01:44:49.522600+0000","last_fullsized":"2024-04-24T01:44:49.522600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:25.852835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865041+0000","last_change":"2024-04-24T01:42:44.780561+0000","last_active":"2024-04-24T01:43:21.865041+0000","last_peered":"2024-04-24T01:43:21.865041+0000","last_clean":"2024-04-24T01:43:21.865041+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:43:21.865041+0000","last_undegraded":"2024-04-24T01:43:21.865041+0000","last_fullsized":"2024-04-24T01:43:21.865041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:25.708863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810210+0000","last_change":"2024-04-24T01:42:46.780855+0000","last_active":"2024-04-24T01:43:21.810210+0000","last_peered":"2024-04-24T01:43:21.810210+0000","last_clean":"2024-04-24T01:43:21.810210+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:43:21.810210+0000","last_undegraded":"2024-04-24T01:43:21.810210+0000","last_fullsized":"2024-04-24T01:43:21.810210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:13.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.455955+0000","last_change":"2024-04-24T01:42:48.789383+0000","last_active":"2024-04-24T01:45:50.455955+0000","last_peered":"2024-04-24T01:45:50.455955+0000","last_clean":"2024-04-24T01:45:50.455955+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:45:50.455955+0000","last_undegraded":"2024-04-24T01:45:50.455955+0000","last_fullsized":"2024-04-24T01:45:50.455955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:14.292086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.188045+0000","last_change":"2024-04-24T01:42:50.800444+0000","last_active":"2024-04-24T01:43:23.188045+0000","last_peered":"2024-04-24T01:43:23.188045+0000","last_clean":"2024-04-24T01:43:23.188045+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:43:23.188045+0000","last_undegraded":"2024-04-24T01:43:23.188045+0000","last_fullsized":"2024-04-24T01:43:23.188045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506203+0000","last_change":"2024-04-24T01:42:42.785246+0000","last_active":"2024-04-24T01:44:46.506203+0000","last_peered":"2024-04-24T01:44:46.506203+0000","last_clean":"2024-04-24T01:44:46.506203+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:44:46.506203+0000","last_undegraded":"2024-04-24T01:44:46.506203+0000","last_fullsized":"2024-04-24T01:44:46.506203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:37.621286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815603+0000","last_change":"2024-04-24T01:42:40.791168+0000","last_active":"2024-04-24T01:43:21.815603+0000","last_peered":"2024-04-24T01:43:21.815603+0000","last_clean":"2024-04-24T01:43:21.815603+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:43:21.815603+0000","last_undegraded":"2024-04-24T01:43:21.815603+0000","last_fullsized":"2024-04-24T01:43:21.815603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818755+0000","last_change":"2024-04-24T01:43:21.818140+0000","last_active":"2024-04-24T01:43:21.818755+0000","last_peered":"2024-04-24T01:43:21.818755+0000","last_clean":"2024-04-24T01:43:21.818755+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:43:21.818755+0000","last_undegraded":"2024-04-24T01:43:21.818755+0000","last_fullsized":"2024-04-24T01:43:21.818755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:00:16.051162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.212359+0000","last_change":"2024-04-24T01:42:46.784079+0000","last_active":"2024-04-24T01:44:48.212359+0000","last_peered":"2024-04-24T01:44:48.212359+0000","last_clean":"2024-04-24T01:44:48.212359+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:44:48.212359+0000","last_undegraded":"2024-04-24T01:44:48.212359+0000","last_fullsized":"2024-04-24T01:44:48.212359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:07:04.029756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.348346+0000","last_change":"2024-04-24T01:42:48.783790+0000","last_active":"2024-04-24T01:45:50.348346+0000","last_peered":"2024-04-24T01:45:50.348346+0000","last_clean":"2024-04-24T01:45:50.348346+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:45:50.348346+0000","last_undegraded":"2024-04-24T01:45:50.348346+0000","last_fullsized":"2024-04-24T01:45:50.348346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:09.325458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137974+0000","last_change":"2024-04-24T01:42:42.787100+0000","last_active":"2024-04-24T01:45:50.137974+0000","last_peered":"2024-04-24T01:45:50.137974+0000","last_clean":"2024-04-24T01:45:50.137974+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:45:50.137974+0000","last_undegraded":"2024-04-24T01:45:50.137974+0000","last_fullsized":"2024-04-24T01:45:50.137974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:02.956782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334280+0000","last_change":"2024-04-24T01:42:40.780599+0000","last_active":"2024-04-24T01:43:22.334280+0000","last_peered":"2024-04-24T01:43:22.334280+0000","last_clean":"2024-04-24T01:43:22.334280+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:43:22.334280+0000","last_undegraded":"2024-04-24T01:43:22.334280+0000","last_fullsized":"2024-04-24T01:43:22.334280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312638+0000","last_change":"2024-04-24T01:42:44.778111+0000","last_active":"2024-04-24T01:44:49.312638+0000","last_peered":"2024-04-24T01:44:49.312638+0000","last_clean":"2024-04-24T01:44:49.312638+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:44:49.312638+0000","last_undegraded":"2024-04-24T01:44:49.312638+0000","last_fullsized":"2024-04-24T01:44:49.312638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:33.157332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'46","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.221905+0000","last_change":"2024-04-24T01:42:46.779467+0000","last_active":"2024-04-24T01:44:48.221905+0000","last_peered":"2024-04-24T01:44:48.221905+0000","last_clean":"2024-04-24T01:44:48.221905+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:44:48.221905+0000","last_undegraded":"2024-04-24T01:44:48.221905+0000","last_fullsized":"2024-04-24T01:44:48.221905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:35.159479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864048+0000","last_change":"2024-04-24T01:42:48.784060+0000","last_active":"2024-04-24T01:43:21.864048+0000","last_peered":"2024-04-24T01:43:21.864048+0000","last_clean":"2024-04-24T01:43:21.864048+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:43:21.864048+0000","last_undegraded":"2024-04-24T01:43:21.864048+0000","last_fullsized":"2024-04-24T01:43:21.864048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:03.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.807187+0000","last_change":"2024-04-24T01:42:50.799924+0000","last_active":"2024-04-24T01:44:05.807187+0000","last_peered":"2024-04-24T01:44:05.807187+0000","last_clean":"2024-04-24T01:44:05.807187+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:44:05.807187+0000","last_undegraded":"2024-04-24T01:44:05.807187+0000","last_fullsized":"2024-04-24T01:44:05.807187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:09.299604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.017080+0000","last_change":"2024-04-24T01:42:42.781439+0000","last_active":"2024-04-24T01:44:06.017080+0000","last_peered":"2024-04-24T01:44:06.017080+0000","last_clean":"2024-04-24T01:44:06.017080+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:44:06.017080+0000","last_undegraded":"2024-04-24T01:44:06.017080+0000","last_fullsized":"2024-04-24T01:44:06.017080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:12.726720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811228+0000","last_change":"2024-04-24T01:42:40.777460+0000","last_active":"2024-04-24T01:43:21.811228+0000","last_peered":"2024-04-24T01:43:21.811228+0000","last_clean":"2024-04-24T01:43:21.811228+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:43:21.811228+0000","last_undegraded":"2024-04-24T01:43:21.811228+0000","last_fullsized":"2024-04-24T01:43:21.811228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:49.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862742+0000","last_change":"2024-04-24T01:42:44.775818+0000","last_active":"2024-04-24T01:43:21.862742+0000","last_peered":"2024-04-24T01:43:21.862742+0000","last_clean":"2024-04-24T01:43:21.862742+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:43:21.862742+0000","last_undegraded":"2024-04-24T01:43:21.862742+0000","last_fullsized":"2024-04-24T01:43:21.862742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:05.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.055415+0000","last_change":"2024-04-24T01:42:46.779918+0000","last_active":"2024-04-24T01:45:50.055415+0000","last_peered":"2024-04-24T01:45:50.055415+0000","last_clean":"2024-04-24T01:45:50.055415+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:45:50.055415+0000","last_undegraded":"2024-04-24T01:45:50.055415+0000","last_fullsized":"2024-04-24T01:45:50.055415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:59.779931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862428+0000","last_change":"2024-04-24T01:42:48.788792+0000","last_active":"2024-04-24T01:43:21.862428+0000","last_peered":"2024-04-24T01:43:21.862428+0000","last_clean":"2024-04-24T01:43:21.862428+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:43:21.862428+0000","last_undegraded":"2024-04-24T01:43:21.862428+0000","last_fullsized":"2024-04-24T01:43:21.862428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.253658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:00.287330+0000","last_change":"2024-04-24T01:42:50.797194+0000","last_active":"2024-04-24T01:44:00.287330+0000","last_peered":"2024-04-24T01:44:00.287330+0000","last_clean":"2024-04-24T01:44:00.287330+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:44:00.287330+0000","last_undegraded":"2024-04-24T01:44:00.287330+0000","last_fullsized":"2024-04-24T01:44:00.287330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:13.552621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.279399+0000","last_change":"2024-04-24T01:42:42.790042+0000","last_active":"2024-04-24T01:45:50.279399+0000","last_peered":"2024-04-24T01:45:50.279399+0000","last_clean":"2024-04-24T01:45:50.279399+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:45:50.279399+0000","last_undegraded":"2024-04-24T01:45:50.279399+0000","last_fullsized":"2024-04-24T01:45:50.279399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:06.040706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814459+0000","last_change":"2024-04-24T01:42:40.790278+0000","last_active":"2024-04-24T01:43:21.814459+0000","last_peered":"2024-04-24T01:43:21.814459+0000","last_clean":"2024-04-24T01:43:21.814459+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:43:21.814459+0000","last_undegraded":"2024-04-24T01:43:21.814459+0000","last_fullsized":"2024-04-24T01:43:21.814459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:52.256340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865715+0000","last_change":"2024-04-24T01:42:44.776056+0000","last_active":"2024-04-24T01:43:21.865715+0000","last_peered":"2024-04-24T01:43:21.865715+0000","last_clean":"2024-04-24T01:43:21.865715+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:43:21.865715+0000","last_undegraded":"2024-04-24T01:43:21.865715+0000","last_fullsized":"2024-04-24T01:43:21.865715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:41.981588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'50","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.223861+0000","last_change":"2024-04-24T01:42:46.778746+0000","last_active":"2024-04-24T01:44:48.223861+0000","last_peered":"2024-04-24T01:44:48.223861+0000","last_clean":"2024-04-24T01:44:48.223861+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:44:48.223861+0000","last_undegraded":"2024-04-24T01:44:48.223861+0000","last_fullsized":"2024-04-24T01:44:48.223861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:42:45.514004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.464970+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:45:50.464970+0000","last_peered":"2024-04-24T01:45:50.464970+0000","last_clean":"2024-04-24T01:45:50.464970+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:45:50.464970+0000","last_undegraded":"2024-04-24T01:45:50.464970+0000","last_fullsized":"2024-04-24T01:45:50.464970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:47.496571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.808097+0000","last_change":"2024-04-24T01:42:50.794892+0000","last_active":"2024-04-24T01:43:22.808097+0000","last_peered":"2024-04-24T01:43:22.808097+0000","last_clean":"2024-04-24T01:43:22.808097+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:43:22.808097+0000","last_undegraded":"2024-04-24T01:43:22.808097+0000","last_fullsized":"2024-04-24T01:43:22.808097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:09.754900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.453036+0000","last_change":"2024-04-24T01:42:42.778719+0000","last_active":"2024-04-24T01:43:23.453036+0000","last_peered":"2024-04-24T01:43:23.453036+0000","last_clean":"2024-04-24T01:43:23.453036+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:43:23.453036+0000","last_undegraded":"2024-04-24T01:43:23.453036+0000","last_fullsized":"2024-04-24T01:43:23.453036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:31.558960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811441+0000","last_change":"2024-04-24T01:42:40.776747+0000","last_active":"2024-04-24T01:43:21.811441+0000","last_peered":"2024-04-24T01:43:21.811441+0000","last_clean":"2024-04-24T01:43:21.811441+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:43:21.811441+0000","last_undegraded":"2024-04-24T01:43:21.811441+0000","last_fullsized":"2024-04-24T01:43:21.811441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:04.407692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862746+0000","last_change":"2024-04-24T01:42:44.775830+0000","last_active":"2024-04-24T01:43:21.862746+0000","last_peered":"2024-04-24T01:43:21.862746+0000","last_clean":"2024-04-24T01:43:21.862746+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:43:21.862746+0000","last_undegraded":"2024-04-24T01:43:21.862746+0000","last_fullsized":"2024-04-24T01:43:21.862746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:41.803290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.225733+0000","last_change":"2024-04-24T01:42:46.782288+0000","last_active":"2024-04-24T01:44:48.225733+0000","last_peered":"2024-04-24T01:44:48.225733+0000","last_clean":"2024-04-24T01:44:48.225733+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:44:48.225733+0000","last_undegraded":"2024-04-24T01:44:48.225733+0000","last_fullsized":"2024-04-24T01:44:48.225733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862182+0000","last_change":"2024-04-24T01:42:48.794747+0000","last_active":"2024-04-24T01:43:21.862182+0000","last_peered":"2024-04-24T01:43:21.862182+0000","last_clean":"2024-04-24T01:43:21.862182+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:43:21.862182+0000","last_undegraded":"2024-04-24T01:43:21.862182+0000","last_fullsized":"2024-04-24T01:43:21.862182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:37.208241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.442897+0000","last_change":"2024-04-24T01:42:50.802460+0000","last_active":"2024-04-24T01:45:50.442897+0000","last_peered":"2024-04-24T01:45:50.442897+0000","last_clean":"2024-04-24T01:45:50.442897+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:45:50.442897+0000","last_undegraded":"2024-04-24T01:45:50.442897+0000","last_fullsized":"2024-04-24T01:45:50.442897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:30.284232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315664+0000","last_change":"2024-04-24T01:42:42.783715+0000","last_active":"2024-04-24T01:45:50.315664+0000","last_peered":"2024-04-24T01:45:50.315664+0000","last_clean":"2024-04-24T01:45:50.315664+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:45:50.315664+0000","last_undegraded":"2024-04-24T01:45:50.315664+0000","last_fullsized":"2024-04-24T01:45:50.315664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:20.736658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863777+0000","last_change":"2024-04-24T01:42:40.780994+0000","last_active":"2024-04-24T01:43:21.863777+0000","last_peered":"2024-04-24T01:43:21.863777+0000","last_clean":"2024-04-24T01:43:21.863777+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:43:21.863777+0000","last_undegraded":"2024-04-24T01:43:21.863777+0000","last_fullsized":"2024-04-24T01:43:21.863777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:37.569542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809308+0000","last_change":"2024-04-24T01:42:44.778275+0000","last_active":"2024-04-24T01:43:21.809308+0000","last_peered":"2024-04-24T01:43:21.809308+0000","last_clean":"2024-04-24T01:43:21.809308+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:43:21.809308+0000","last_undegraded":"2024-04-24T01:43:21.809308+0000","last_fullsized":"2024-04-24T01:43:21.809308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.192699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.205713+0000","last_change":"2024-04-24T01:42:46.778607+0000","last_active":"2024-04-24T01:44:48.205713+0000","last_peered":"2024-04-24T01:44:48.205713+0000","last_clean":"2024-04-24T01:44:48.205713+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:44:48.205713+0000","last_undegraded":"2024-04-24T01:44:48.205713+0000","last_fullsized":"2024-04-24T01:44:48.205713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:23.477131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813319+0000","last_change":"2024-04-24T01:42:48.790228+0000","last_active":"2024-04-24T01:43:21.813319+0000","last_peered":"2024-04-24T01:43:21.813319+0000","last_clean":"2024-04-24T01:43:21.813319+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:43:21.813319+0000","last_undegraded":"2024-04-24T01:43:21.813319+0000","last_fullsized":"2024-04-24T01:43:21.813319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:17.814113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087985+0000","last_change":"2024-04-24T01:42:50.799183+0000","last_active":"2024-04-24T01:44:51.087985+0000","last_peered":"2024-04-24T01:44:51.087985+0000","last_clean":"2024-04-24T01:44:51.087985+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:44:51.087985+0000","last_undegraded":"2024-04-24T01:44:51.087985+0000","last_fullsized":"2024-04-24T01:44:51.087985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:14.732138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399594+0000","last_change":"2024-04-24T01:42:42.783267+0000","last_active":"2024-04-24T01:45:50.399594+0000","last_peered":"2024-04-24T01:45:50.399594+0000","last_clean":"2024-04-24T01:45:50.399594+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:45:50.399594+0000","last_undegraded":"2024-04-24T01:45:50.399594+0000","last_fullsized":"2024-04-24T01:45:50.399594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:41.395053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.441523+0000","last_change":"2024-04-24T01:42:40.790965+0000","last_active":"2024-04-24T01:43:23.441523+0000","last_peered":"2024-04-24T01:43:23.441523+0000","last_clean":"2024-04-24T01:43:23.441523+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:43:23.441523+0000","last_undegraded":"2024-04-24T01:43:23.441523+0000","last_fullsized":"2024-04-24T01:43:23.441523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:10.970016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863141+0000","last_change":"2024-04-24T01:42:44.776243+0000","last_active":"2024-04-24T01:43:21.863141+0000","last_peered":"2024-04-24T01:43:21.863141+0000","last_clean":"2024-04-24T01:43:21.863141+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:43:21.863141+0000","last_undegraded":"2024-04-24T01:43:21.863141+0000","last_fullsized":"2024-04-24T01:43:21.863141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:59.166147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.232605+0000","last_change":"2024-04-24T01:42:46.770097+0000","last_active":"2024-04-24T01:44:48.232605+0000","last_peered":"2024-04-24T01:44:48.232605+0000","last_clean":"2024-04-24T01:44:48.232605+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:44:48.232605+0000","last_undegraded":"2024-04-24T01:44:48.232605+0000","last_fullsized":"2024-04-24T01:44:48.232605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:06.966181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.446644+0000","last_change":"2024-04-24T01:42:48.794733+0000","last_active":"2024-04-24T01:45:50.446644+0000","last_peered":"2024-04-24T01:45:50.446644+0000","last_clean":"2024-04-24T01:45:50.446644+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:45:50.446644+0000","last_undegraded":"2024-04-24T01:45:50.446644+0000","last_fullsized":"2024-04-24T01:45:50.446644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:25.479779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084036+0000","last_change":"2024-04-24T01:42:50.793825+0000","last_active":"2024-04-24T01:44:59.084036+0000","last_peered":"2024-04-24T01:44:59.084036+0000","last_clean":"2024-04-24T01:44:59.084036+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:44:59.084036+0000","last_undegraded":"2024-04-24T01:44:59.084036+0000","last_fullsized":"2024-04-24T01:44:59.084036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:33.276602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270904+0000","last_change":"2024-04-24T01:42:42.790926+0000","last_active":"2024-04-24T01:45:50.270904+0000","last_peered":"2024-04-24T01:45:50.270904+0000","last_clean":"2024-04-24T01:45:50.270904+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:45:50.270904+0000","last_undegraded":"2024-04-24T01:45:50.270904+0000","last_fullsized":"2024-04-24T01:45:50.270904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812785+0000","last_change":"2024-04-24T01:42:40.789191+0000","last_active":"2024-04-24T01:43:21.812785+0000","last_peered":"2024-04-24T01:43:21.812785+0000","last_clean":"2024-04-24T01:43:21.812785+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:43:21.812785+0000","last_undegraded":"2024-04-24T01:43:21.812785+0000","last_fullsized":"2024-04-24T01:43:21.812785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:37.925439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312396+0000","last_change":"2024-04-24T01:42:44.776093+0000","last_active":"2024-04-24T01:44:49.312396+0000","last_peered":"2024-04-24T01:44:49.312396+0000","last_clean":"2024-04-24T01:44:49.312396+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:44:49.312396+0000","last_undegraded":"2024-04-24T01:44:49.312396+0000","last_fullsized":"2024-04-24T01:44:49.312396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:07.203105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812310+0000","last_change":"2024-04-24T01:42:46.782280+0000","last_active":"2024-04-24T01:43:21.812310+0000","last_peered":"2024-04-24T01:43:21.812310+0000","last_clean":"2024-04-24T01:43:21.812310+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:43:21.812310+0000","last_undegraded":"2024-04-24T01:43:21.812310+0000","last_fullsized":"2024-04-24T01:43:21.812310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:26.243203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.402880+0000","last_change":"2024-04-24T01:42:48.791028+0000","last_active":"2024-04-24T01:45:50.402880+0000","last_peered":"2024-04-24T01:45:50.402880+0000","last_clean":"2024-04-24T01:45:50.402880+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:45:50.402880+0000","last_undegraded":"2024-04-24T01:45:50.402880+0000","last_fullsized":"2024-04-24T01:45:50.402880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:02.110375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.318221+0000","last_change":"2024-04-24T01:42:50.796703+0000","last_active":"2024-04-24T01:45:50.318221+0000","last_peered":"2024-04-24T01:45:50.318221+0000","last_clean":"2024-04-24T01:45:50.318221+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:45:50.318221+0000","last_undegraded":"2024-04-24T01:45:50.318221+0000","last_fullsized":"2024-04-24T01:45:50.318221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:51.030865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353512+0000","last_change":"2024-04-24T01:42:42.791687+0000","last_active":"2024-04-24T01:45:50.353512+0000","last_peered":"2024-04-24T01:45:50.353512+0000","last_clean":"2024-04-24T01:45:50.353512+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:45:50.353512+0000","last_undegraded":"2024-04-24T01:45:50.353512+0000","last_fullsized":"2024-04-24T01:45:50.353512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:02:24.201055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.791074+0000","last_change":"2024-04-24T01:42:40.787611+0000","last_active":"2024-04-24T01:44:05.791074+0000","last_peered":"2024-04-24T01:44:05.791074+0000","last_clean":"2024-04-24T01:44:05.791074+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:44:05.791074+0000","last_undegraded":"2024-04-24T01:44:05.791074+0000","last_fullsized":"2024-04-24T01:44:05.791074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:04.033349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814496+0000","last_change":"2024-04-24T01:42:44.777294+0000","last_active":"2024-04-24T01:43:21.814496+0000","last_peered":"2024-04-24T01:43:21.814496+0000","last_clean":"2024-04-24T01:43:21.814496+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:43:21.814496+0000","last_undegraded":"2024-04-24T01:43:21.814496+0000","last_fullsized":"2024-04-24T01:43:21.814496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:11.779877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.218762+0000","last_change":"2024-04-24T01:42:46.779272+0000","last_active":"2024-04-24T01:44:48.218762+0000","last_peered":"2024-04-24T01:44:48.218762+0000","last_clean":"2024-04-24T01:44:48.218762+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:44:48.218762+0000","last_undegraded":"2024-04-24T01:44:48.218762+0000","last_fullsized":"2024-04-24T01:44:48.218762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:45.404452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810071+0000","last_change":"2024-04-24T01:42:48.790268+0000","last_active":"2024-04-24T01:43:21.810071+0000","last_peered":"2024-04-24T01:43:21.810071+0000","last_clean":"2024-04-24T01:43:21.810071+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:43:21.810071+0000","last_undegraded":"2024-04-24T01:43:21.810071+0000","last_fullsized":"2024-04-24T01:43:21.810071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:46.045950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.378677+0000","last_change":"2024-04-24T01:42:50.798885+0000","last_active":"2024-04-24T01:45:50.378677+0000","last_peered":"2024-04-24T01:45:50.378677+0000","last_clean":"2024-04-24T01:45:50.378677+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:45:50.378677+0000","last_undegraded":"2024-04-24T01:45:50.378677+0000","last_fullsized":"2024-04-24T01:45:50.378677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:18:00.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270588+0000","last_change":"2024-04-24T01:42:42.787563+0000","last_active":"2024-04-24T01:45:50.270588+0000","last_peered":"2024-04-24T01:45:50.270588+0000","last_clean":"2024-04-24T01:45:50.270588+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:45:50.270588+0000","last_undegraded":"2024-04-24T01:45:50.270588+0000","last_fullsized":"2024-04-24T01:45:50.270588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:54.554156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815596+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:43:21.815596+0000","last_peered":"2024-04-24T01:43:21.815596+0000","last_clean":"2024-04-24T01:43:21.815596+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:43:21.815596+0000","last_undegraded":"2024-04-24T01:43:21.815596+0000","last_fullsized":"2024-04-24T01:43:21.815596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:54.970096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812194+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:43:21.812194+0000","last_peered":"2024-04-24T01:43:21.812194+0000","last_clean":"2024-04-24T01:43:21.812194+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:43:21.812194+0000","last_undegraded":"2024-04-24T01:43:21.812194+0000","last_fullsized":"2024-04-24T01:43:21.812194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:50.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811274+0000","last_change":"2024-04-24T01:42:40.787192+0000","last_active":"2024-04-24T01:43:21.811274+0000","last_peered":"2024-04-24T01:43:21.811274+0000","last_clean":"2024-04-24T01:43:21.811274+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:43:21.811274+0000","last_undegraded":"2024-04-24T01:43:21.811274+0000","last_fullsized":"2024-04-24T01:43:21.811274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:51.864862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817451+0000","last_change":"2024-04-24T01:42:44.776026+0000","last_active":"2024-04-24T01:43:21.817451+0000","last_peered":"2024-04-24T01:43:21.817451+0000","last_clean":"2024-04-24T01:43:21.817451+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:43:21.817451+0000","last_undegraded":"2024-04-24T01:43:21.817451+0000","last_fullsized":"2024-04-24T01:43:21.817451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:43.659940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'82","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.230340+0000","last_change":"2024-04-24T01:42:46.785058+0000","last_active":"2024-04-24T01:44:48.230340+0000","last_peered":"2024-04-24T01:44:48.230340+0000","last_clean":"2024-04-24T01:44:48.230340+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:44:48.230340+0000","last_undegraded":"2024-04-24T01:44:48.230340+0000","last_fullsized":"2024-04-24T01:44:48.230340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:09.881326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864430+0000","last_change":"2024-04-24T01:42:48.793592+0000","last_active":"2024-04-24T01:43:21.864430+0000","last_peered":"2024-04-24T01:43:21.864430+0000","last_clean":"2024-04-24T01:43:21.864430+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:43:21.864430+0000","last_undegraded":"2024-04-24T01:43:21.864430+0000","last_fullsized":"2024-04-24T01:43:21.864430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:15.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.355879+0000","last_change":"2024-04-24T01:42:50.792016+0000","last_active":"2024-04-24T01:45:50.355879+0000","last_peered":"2024-04-24T01:45:50.355879+0000","last_clean":"2024-04-24T01:45:50.355879+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:45:50.355879+0000","last_undegraded":"2024-04-24T01:45:50.355879+0000","last_fullsized":"2024-04-24T01:45:50.355879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:14.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654646+0000","last_change":"2024-04-24T01:42:42.786097+0000","last_active":"2024-04-24T01:44:49.654646+0000","last_peered":"2024-04-24T01:44:49.654646+0000","last_clean":"2024-04-24T01:44:49.654646+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:44:49.654646+0000","last_undegraded":"2024-04-24T01:44:49.654646+0000","last_fullsized":"2024-04-24T01:44:49.654646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:44.030398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809847+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:43:21.809847+0000","last_peered":"2024-04-24T01:43:21.809847+0000","last_clean":"2024-04-24T01:43:21.809847+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:43:21.809847+0000","last_undegraded":"2024-04-24T01:43:21.809847+0000","last_fullsized":"2024-04-24T01:43:21.809847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:29.896910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862322+0000","last_change":"2024-04-24T01:42:40.781303+0000","last_active":"2024-04-24T01:43:21.862322+0000","last_peered":"2024-04-24T01:43:21.862322+0000","last_clean":"2024-04-24T01:43:21.862322+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:43:21.862322+0000","last_undegraded":"2024-04-24T01:43:21.862322+0000","last_fullsized":"2024-04-24T01:43:21.862322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:59.215704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814458+0000","last_change":"2024-04-24T01:42:44.777664+0000","last_active":"2024-04-24T01:43:21.814458+0000","last_peered":"2024-04-24T01:43:21.814458+0000","last_clean":"2024-04-24T01:43:21.814458+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:43:21.814458+0000","last_undegraded":"2024-04-24T01:43:21.814458+0000","last_fullsized":"2024-04-24T01:43:21.814458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:08.483048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853754+0000","last_change":"2024-04-24T01:42:46.782817+0000","last_active":"2024-04-24T01:45:49.853754+0000","last_peered":"2024-04-24T01:45:49.853754+0000","last_clean":"2024-04-24T01:45:49.853754+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:45:49.853754+0000","last_undegraded":"2024-04-24T01:45:49.853754+0000","last_fullsized":"2024-04-24T01:45:49.853754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:27.024858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812247+0000","last_change":"2024-04-24T01:42:48.789708+0000","last_active":"2024-04-24T01:43:21.812247+0000","last_peered":"2024-04-24T01:43:21.812247+0000","last_clean":"2024-04-24T01:43:21.812247+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:43:21.812247+0000","last_undegraded":"2024-04-24T01:43:21.812247+0000","last_fullsized":"2024-04-24T01:43:21.812247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:49.899834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.803771+0000","last_change":"2024-04-24T01:42:50.795739+0000","last_active":"2024-04-24T01:44:05.803771+0000","last_peered":"2024-04-24T01:44:05.803771+0000","last_clean":"2024-04-24T01:44:05.803771+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:44:05.803771+0000","last_undegraded":"2024-04-24T01:44:05.803771+0000","last_fullsized":"2024-04-24T01:44:05.803771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:11:53.190598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864709+0000","last_change":"2024-04-24T01:42:42.783605+0000","last_active":"2024-04-24T01:43:21.864709+0000","last_peered":"2024-04-24T01:43:21.864709+0000","last_clean":"2024-04-24T01:43:21.864709+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:43:21.864709+0000","last_undegraded":"2024-04-24T01:43:21.864709+0000","last_fullsized":"2024-04-24T01:43:21.864709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:05.066861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807726+0000","last_change":"2024-04-24T01:42:32.739720+0000","last_active":"2024-04-24T01:43:21.807726+0000","last_peered":"2024-04-24T01:43:21.807726+0000","last_clean":"2024-04-24T01:43:21.807726+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:43:21.807726+0000","last_undegraded":"2024-04-24T01:43:21.807726+0000","last_fullsized":"2024-04-24T01:43:21.807726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.270545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.255333+0000","last_change":"2024-04-24T01:42:40.769426+0000","last_active":"2024-04-24T01:45:50.255333+0000","last_peered":"2024-04-24T01:45:50.255333+0000","last_clean":"2024-04-24T01:45:50.255333+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:45:50.255333+0000","last_undegraded":"2024-04-24T01:45:50.255333+0000","last_fullsized":"2024-04-24T01:45:50.255333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:24.208037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811063+0000","last_change":"2024-04-24T01:42:44.768708+0000","last_active":"2024-04-24T01:43:21.811063+0000","last_peered":"2024-04-24T01:43:21.811063+0000","last_clean":"2024-04-24T01:43:21.811063+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:43:21.811063+0000","last_undegraded":"2024-04-24T01:43:21.811063+0000","last_fullsized":"2024-04-24T01:43:21.811063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:22.037850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853586+0000","last_change":"2024-04-24T01:42:46.780747+0000","last_active":"2024-04-24T01:45:49.853586+0000","last_peered":"2024-04-24T01:45:49.853586+0000","last_clean":"2024-04-24T01:45:49.853586+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:45:49.853586+0000","last_undegraded":"2024-04-24T01:45:49.853586+0000","last_fullsized":"2024-04-24T01:45:49.853586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:35.740405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863693+0000","last_change":"2024-04-24T01:42:48.793578+0000","last_active":"2024-04-24T01:43:21.863693+0000","last_peered":"2024-04-24T01:43:21.863693+0000","last_clean":"2024-04-24T01:43:21.863693+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:43:21.863693+0000","last_undegraded":"2024-04-24T01:43:21.863693+0000","last_fullsized":"2024-04-24T01:43:21.863693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:53.516063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810739+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:43:21.810739+0000","last_peered":"2024-04-24T01:43:21.810739+0000","last_clean":"2024-04-24T01:43:21.810739+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:43:21.810739+0000","last_undegraded":"2024-04-24T01:43:21.810739+0000","last_fullsized":"2024-04-24T01:43:21.810739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:35.532430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864702+0000","last_change":"2024-04-24T01:42:42.775667+0000","last_active":"2024-04-24T01:43:21.864702+0000","last_peered":"2024-04-24T01:43:21.864702+0000","last_clean":"2024-04-24T01:43:21.864702+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:43:21.864702+0000","last_undegraded":"2024-04-24T01:43:21.864702+0000","last_fullsized":"2024-04-24T01:43:21.864702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:37.338206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811072+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:43:21.811072+0000","last_peered":"2024-04-24T01:43:21.811072+0000","last_clean":"2024-04-24T01:43:21.811072+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:43:21.811072+0000","last_undegraded":"2024-04-24T01:43:21.811072+0000","last_fullsized":"2024-04-24T01:43:21.811072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:23.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.787552+0000","last_change":"2024-04-24T01:42:40.769234+0000","last_active":"2024-04-24T01:43:22.787552+0000","last_peered":"2024-04-24T01:43:22.787552+0000","last_clean":"2024-04-24T01:43:22.787552+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:43:22.787552+0000","last_undegraded":"2024-04-24T01:43:22.787552+0000","last_fullsized":"2024-04-24T01:43:22.787552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864632+0000","last_change":"2024-04-24T01:42:44.778281+0000","last_active":"2024-04-24T01:43:21.864632+0000","last_peered":"2024-04-24T01:43:21.864632+0000","last_clean":"2024-04-24T01:43:21.864632+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:43:21.864632+0000","last_undegraded":"2024-04-24T01:43:21.864632+0000","last_fullsized":"2024-04-24T01:43:21.864632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:36.551915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.667766+0000","last_change":"2024-04-24T01:42:46.783117+0000","last_active":"2024-04-24T01:45:49.667766+0000","last_peered":"2024-04-24T01:45:49.667766+0000","last_clean":"2024-04-24T01:45:49.667766+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:45:49.667766+0000","last_undegraded":"2024-04-24T01:45:49.667766+0000","last_fullsized":"2024-04-24T01:45:49.667766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:06.561328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813544+0000","last_change":"2024-04-24T01:42:48.789629+0000","last_active":"2024-04-24T01:43:21.813544+0000","last_peered":"2024-04-24T01:43:21.813544+0000","last_clean":"2024-04-24T01:43:21.813544+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:43:21.813544+0000","last_undegraded":"2024-04-24T01:43:21.813544+0000","last_fullsized":"2024-04-24T01:43:21.813544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:25.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.420833+0000","last_change":"2024-04-24T01:42:50.802434+0000","last_active":"2024-04-24T01:44:49.420833+0000","last_peered":"2024-04-24T01:44:49.420833+0000","last_clean":"2024-04-24T01:44:49.420833+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:44:49.420833+0000","last_undegraded":"2024-04-24T01:44:49.420833+0000","last_fullsized":"2024-04-24T01:44:49.420833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.519476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506812+0000","last_change":"2024-04-24T01:42:42.783375+0000","last_active":"2024-04-24T01:44:46.506812+0000","last_peered":"2024-04-24T01:44:46.506812+0000","last_clean":"2024-04-24T01:44:46.506812+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:44:46.506812+0000","last_undegraded":"2024-04-24T01:44:46.506812+0000","last_fullsized":"2024-04-24T01:44:46.506812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:53.032722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.496293+0000","last_change":"2024-04-24T01:42:40.774629+0000","last_active":"2024-04-24T01:44:49.496293+0000","last_peered":"2024-04-24T01:44:49.496293+0000","last_clean":"2024-04-24T01:44:49.496293+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:44:49.496293+0000","last_undegraded":"2024-04-24T01:44:49.496293+0000","last_fullsized":"2024-04-24T01:44:49.496293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863436+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:43:21.863436+0000","last_peered":"2024-04-24T01:43:21.863436+0000","last_clean":"2024-04-24T01:43:21.863436+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:43:21.863436+0000","last_undegraded":"2024-04-24T01:43:21.863436+0000","last_fullsized":"2024-04-24T01:43:21.863436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:38.785738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:31.093588+0000","last_change":"2024-04-24T01:43:21.814238+0000","last_active":"2024-04-24T01:45:31.093588+0000","last_peered":"2024-04-24T01:45:31.093588+0000","last_clean":"2024-04-24T01:45:31.093588+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:45:31.093588+0000","last_undegraded":"2024-04-24T01:45:31.093588+0000","last_fullsized":"2024-04-24T01:45:31.093588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:13.474511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'75","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082491+0000","last_change":"2024-04-24T01:42:46.779689+0000","last_active":"2024-04-24T01:44:49.082491+0000","last_peered":"2024-04-24T01:44:49.082491+0000","last_clean":"2024-04-24T01:44:49.082491+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:44:49.082491+0000","last_undegraded":"2024-04-24T01:44:49.082491+0000","last_fullsized":"2024-04-24T01:44:49.082491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:19.052361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":84,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808841+0000","last_change":"2024-04-24T01:42:48.792847+0000","last_active":"2024-04-24T01:43:21.808841+0000","last_peered":"2024-04-24T01:43:21.808841+0000","last_clean":"2024-04-24T01:43:21.808841+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:43:21.808841+0000","last_undegraded":"2024-04-24T01:43:21.808841+0000","last_fullsized":"2024-04-24T01:43:21.808841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:50.042446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.595124+0000","last_change":"2024-04-24T01:42:50.793302+0000","last_active":"2024-04-24T01:44:49.595124+0000","last_peered":"2024-04-24T01:44:49.595124+0000","last_clean":"2024-04-24T01:44:49.595124+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:44:49.595124+0000","last_undegraded":"2024-04-24T01:44:49.595124+0000","last_fullsized":"2024-04-24T01:44:49.595124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:08:15.582676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137934+0000","last_change":"2024-04-24T01:42:42.789819+0000","last_active":"2024-04-24T01:45:50.137934+0000","last_peered":"2024-04-24T01:45:50.137934+0000","last_clean":"2024-04-24T01:45:50.137934+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:45:50.137934+0000","last_undegraded":"2024-04-24T01:45:50.137934+0000","last_fullsized":"2024-04-24T01:45:50.137934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:13.290315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.435621+0000","last_change":"2024-04-24T01:42:40.778312+0000","last_active":"2024-04-24T01:43:23.435621+0000","last_peered":"2024-04-24T01:43:23.435621+0000","last_clean":"2024-04-24T01:43:23.435621+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:43:23.435621+0000","last_undegraded":"2024-04-24T01:43:23.435621+0000","last_fullsized":"2024-04-24T01:43:23.435621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:05.002271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813065+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:43:21.813065+0000","last_peered":"2024-04-24T01:43:21.813065+0000","last_clean":"2024-04-24T01:43:21.813065+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:43:21.813065+0000","last_undegraded":"2024-04-24T01:43:21.813065+0000","last_fullsized":"2024-04-24T01:43:21.813065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:28.855827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810966+0000","last_change":"2024-04-24T01:42:44.773194+0000","last_active":"2024-04-24T01:43:21.810966+0000","last_peered":"2024-04-24T01:43:21.810966+0000","last_clean":"2024-04-24T01:43:21.810966+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:43:21.810966+0000","last_undegraded":"2024-04-24T01:43:21.810966+0000","last_fullsized":"2024-04-24T01:43:21.810966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:31.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.021595+0000","last_change":"2024-04-24T01:42:46.780073+0000","last_active":"2024-04-24T01:44:06.021595+0000","last_peered":"2024-04-24T01:44:06.021595+0000","last_clean":"2024-04-24T01:44:06.021595+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:44:06.021595+0000","last_undegraded":"2024-04-24T01:44:06.021595+0000","last_fullsized":"2024-04-24T01:44:06.021595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:58.563555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853489+0000","last_change":"2024-04-24T01:42:48.794484+0000","last_active":"2024-04-24T01:45:49.853489+0000","last_peered":"2024-04-24T01:45:49.853489+0000","last_clean":"2024-04-24T01:45:49.853489+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:45:49.853489+0000","last_undegraded":"2024-04-24T01:45:49.853489+0000","last_fullsized":"2024-04-24T01:45:49.853489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:07.370372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813179+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:43:21.813179+0000","last_peered":"2024-04-24T01:43:21.813179+0000","last_clean":"2024-04-24T01:43:21.813179+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:43:21.813179+0000","last_undegraded":"2024-04-24T01:43:21.813179+0000","last_fullsized":"2024-04-24T01:43:21.813179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:33.848940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345353+0000","last_change":"2024-04-24T01:42:42.788049+0000","last_active":"2024-04-24T01:45:50.345353+0000","last_peered":"2024-04-24T01:45:50.345353+0000","last_clean":"2024-04-24T01:45:50.345353+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:45:50.345353+0000","last_undegraded":"2024-04-24T01:45:50.345353+0000","last_fullsized":"2024-04-24T01:45:50.345353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:57.647339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814304+0000","last_change":"2024-04-24T01:42:40.786621+0000","last_active":"2024-04-24T01:43:21.814304+0000","last_peered":"2024-04-24T01:43:21.814304+0000","last_clean":"2024-04-24T01:43:21.814304+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:43:21.814304+0000","last_undegraded":"2024-04-24T01:43:21.814304+0000","last_fullsized":"2024-04-24T01:43:21.814304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:23.749610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864853+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:43:21.864853+0000","last_peered":"2024-04-24T01:43:21.864853+0000","last_clean":"2024-04-24T01:43:21.864853+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:43:21.864853+0000","last_undegraded":"2024-04-24T01:43:21.864853+0000","last_fullsized":"2024-04-24T01:43:21.864853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:49.159738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813003+0000","last_change":"2024-04-24T01:42:44.777271+0000","last_active":"2024-04-24T01:43:21.813003+0000","last_peered":"2024-04-24T01:43:21.813003+0000","last_clean":"2024-04-24T01:43:21.813003+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:43:21.813003+0000","last_undegraded":"2024-04-24T01:43:21.813003+0000","last_fullsized":"2024-04-24T01:43:21.813003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.077015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088156+0000","last_change":"2024-04-24T01:42:46.782589+0000","last_active":"2024-04-24T01:44:51.088156+0000","last_peered":"2024-04-24T01:44:51.088156+0000","last_clean":"2024-04-24T01:44:51.088156+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:44:51.088156+0000","last_undegraded":"2024-04-24T01:44:51.088156+0000","last_fullsized":"2024-04-24T01:44:51.088156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:02.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.443476+0000","last_change":"2024-04-24T01:42:48.784318+0000","last_active":"2024-04-24T01:45:50.443476+0000","last_peered":"2024-04-24T01:45:50.443476+0000","last_clean":"2024-04-24T01:45:50.443476+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:45:50.443476+0000","last_undegraded":"2024-04-24T01:45:50.443476+0000","last_fullsized":"2024-04-24T01:45:50.443476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:27:07.076053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.140307+0000","last_change":"2024-04-24T01:42:50.802205+0000","last_active":"2024-04-24T01:45:50.140307+0000","last_peered":"2024-04-24T01:45:50.140307+0000","last_clean":"2024-04-24T01:45:50.140307+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:45:50.140307+0000","last_undegraded":"2024-04-24T01:45:50.140307+0000","last_fullsized":"2024-04-24T01:45:50.140307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:15.474464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144862+0000","last_change":"2024-04-24T01:42:42.788944+0000","last_active":"2024-04-24T01:45:50.144862+0000","last_peered":"2024-04-24T01:45:50.144862+0000","last_clean":"2024-04-24T01:45:50.144862+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:45:50.144862+0000","last_undegraded":"2024-04-24T01:45:50.144862+0000","last_fullsized":"2024-04-24T01:45:50.144862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:38.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816740+0000","last_change":"2024-04-24T01:42:40.788616+0000","last_active":"2024-04-24T01:43:21.816740+0000","last_peered":"2024-04-24T01:43:21.816740+0000","last_clean":"2024-04-24T01:43:21.816740+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:43:21.816740+0000","last_undegraded":"2024-04-24T01:43:21.816740+0000","last_fullsized":"2024-04-24T01:43:21.816740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814295+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:43:21.814295+0000","last_peered":"2024-04-24T01:43:21.814295+0000","last_clean":"2024-04-24T01:43:21.814295+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:43:21.814295+0000","last_undegraded":"2024-04-24T01:43:21.814295+0000","last_fullsized":"2024-04-24T01:43:21.814295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.254736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812231+0000","last_change":"2024-04-24T01:42:44.776836+0000","last_active":"2024-04-24T01:43:21.812231+0000","last_peered":"2024-04-24T01:43:21.812231+0000","last_clean":"2024-04-24T01:43:21.812231+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:43:21.812231+0000","last_undegraded":"2024-04-24T01:43:21.812231+0000","last_fullsized":"2024-04-24T01:43:21.812231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:52.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'89","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.216733+0000","last_change":"2024-04-24T01:42:46.781816+0000","last_active":"2024-04-24T01:44:48.216733+0000","last_peered":"2024-04-24T01:44:48.216733+0000","last_clean":"2024-04-24T01:44:48.216733+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:44:48.216733+0000","last_undegraded":"2024-04-24T01:44:48.216733+0000","last_fullsized":"2024-04-24T01:44:48.216733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:38.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863116+0000","last_change":"2024-04-24T01:42:48.791388+0000","last_active":"2024-04-24T01:43:21.863116+0000","last_peered":"2024-04-24T01:43:21.863116+0000","last_clean":"2024-04-24T01:43:21.863116+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:43:21.863116+0000","last_undegraded":"2024-04-24T01:43:21.863116+0000","last_fullsized":"2024-04-24T01:43:21.863116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:21.062631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810182+0000","last_change":"2024-04-24T01:42:50.791385+0000","last_active":"2024-04-24T01:43:21.810182+0000","last_peered":"2024-04-24T01:43:21.810182+0000","last_clean":"2024-04-24T01:43:21.810182+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:43:21.810182+0000","last_undegraded":"2024-04-24T01:43:21.810182+0000","last_fullsized":"2024-04-24T01:43:21.810182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:37.401350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809642+0000","last_change":"2024-04-24T01:42:50.800231+0000","last_active":"2024-04-24T01:43:21.809642+0000","last_peered":"2024-04-24T01:43:21.809642+0000","last_clean":"2024-04-24T01:43:21.809642+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:43:21.809642+0000","last_undegraded":"2024-04-24T01:43:21.809642+0000","last_fullsized":"2024-04-24T01:43:21.809642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:04.117350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809954+0000","last_change":"2024-04-24T01:42:42.791072+0000","last_active":"2024-04-24T01:43:21.809954+0000","last_peered":"2024-04-24T01:43:21.809954+0000","last_clean":"2024-04-24T01:43:21.809954+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:43:21.809954+0000","last_undegraded":"2024-04-24T01:43:21.809954+0000","last_fullsized":"2024-04-24T01:43:21.809954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:06.415050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811530+0000","last_change":"2024-04-24T01:42:40.776494+0000","last_active":"2024-04-24T01:43:21.811530+0000","last_peered":"2024-04-24T01:43:21.811530+0000","last_clean":"2024-04-24T01:43:21.811530+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:43:21.811530+0000","last_undegraded":"2024-04-24T01:43:21.811530+0000","last_fullsized":"2024-04-24T01:43:21.811530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:10.873984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817518+0000","last_change":"2024-04-24T01:42:44.776151+0000","last_active":"2024-04-24T01:43:21.817518+0000","last_peered":"2024-04-24T01:43:21.817518+0000","last_clean":"2024-04-24T01:43:21.817518+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:43:21.817518+0000","last_undegraded":"2024-04-24T01:43:21.817518+0000","last_fullsized":"2024-04-24T01:43:21.817518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:36.228002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.222877+0000","last_change":"2024-04-24T01:42:46.779944+0000","last_active":"2024-04-24T01:44:48.222877+0000","last_peered":"2024-04-24T01:44:48.222877+0000","last_clean":"2024-04-24T01:44:48.222877+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:44:48.222877+0000","last_undegraded":"2024-04-24T01:44:48.222877+0000","last_fullsized":"2024-04-24T01:44:48.222877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:37.615741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811011+0000","last_change":"2024-04-24T01:42:48.786495+0000","last_active":"2024-04-24T01:43:21.811011+0000","last_peered":"2024-04-24T01:43:21.811011+0000","last_clean":"2024-04-24T01:43:21.811011+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:43:21.811011+0000","last_undegraded":"2024-04-24T01:43:21.811011+0000","last_fullsized":"2024-04-24T01:43:21.811011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:20:25.150998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:47.901186+0000","last_change":"2024-04-24T01:42:50.802495+0000","last_active":"2024-04-24T01:44:47.901186+0000","last_peered":"2024-04-24T01:44:47.901186+0000","last_clean":"2024-04-24T01:44:47.901186+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:44:47.901186+0000","last_undegraded":"2024-04-24T01:44:47.901186+0000","last_fullsized":"2024-04-24T01:44:47.901186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:43.202204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506883+0000","last_change":"2024-04-24T01:42:42.781334+0000","last_active":"2024-04-24T01:44:46.506883+0000","last_peered":"2024-04-24T01:44:46.506883+0000","last_clean":"2024-04-24T01:44:46.506883+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:44:46.506883+0000","last_undegraded":"2024-04-24T01:44:46.506883+0000","last_fullsized":"2024-04-24T01:44:46.506883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:36.471270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.264145+0000","last_change":"2024-04-24T01:42:40.783014+0000","last_active":"2024-04-24T01:45:50.264145+0000","last_peered":"2024-04-24T01:45:50.264145+0000","last_clean":"2024-04-24T01:45:50.264145+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:45:50.264145+0000","last_undegraded":"2024-04-24T01:45:50.264145+0000","last_fullsized":"2024-04-24T01:45:50.264145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812848+0000","last_change":"2024-04-24T01:42:44.777503+0000","last_active":"2024-04-24T01:43:21.812848+0000","last_peered":"2024-04-24T01:43:21.812848+0000","last_clean":"2024-04-24T01:43:21.812848+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:43:21.812848+0000","last_undegraded":"2024-04-24T01:43:21.812848+0000","last_fullsized":"2024-04-24T01:43:21.812848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:19.310744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672156+0000","last_change":"2024-04-24T01:42:46.776129+0000","last_active":"2024-04-24T01:45:49.672156+0000","last_peered":"2024-04-24T01:45:49.672156+0000","last_clean":"2024-04-24T01:45:49.672156+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:45:49.672156+0000","last_undegraded":"2024-04-24T01:45:49.672156+0000","last_fullsized":"2024-04-24T01:45:49.672156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:06:55.737138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808083+0000","last_change":"2024-04-24T01:42:48.789269+0000","last_active":"2024-04-24T01:43:21.808083+0000","last_peered":"2024-04-24T01:43:21.808083+0000","last_clean":"2024-04-24T01:43:21.808083+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:43:21.808083+0000","last_undegraded":"2024-04-24T01:43:21.808083+0000","last_fullsized":"2024-04-24T01:43:21.808083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:23.719981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.020578+0000","last_change":"2024-04-24T01:42:50.793424+0000","last_active":"2024-04-24T01:43:24.020578+0000","last_peered":"2024-04-24T01:43:24.020578+0000","last_clean":"2024-04-24T01:43:24.020578+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:43:24.020578+0000","last_undegraded":"2024-04-24T01:43:24.020578+0000","last_fullsized":"2024-04-24T01:43:24.020578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:31.628249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345135+0000","last_change":"2024-04-24T01:42:42.790386+0000","last_active":"2024-04-24T01:45:50.345135+0000","last_peered":"2024-04-24T01:45:50.345135+0000","last_clean":"2024-04-24T01:45:50.345135+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:45:50.345135+0000","last_undegraded":"2024-04-24T01:45:50.345135+0000","last_fullsized":"2024-04-24T01:45:50.345135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:20.812984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811368+0000","last_change":"2024-04-24T01:42:40.777727+0000","last_active":"2024-04-24T01:43:21.811368+0000","last_peered":"2024-04-24T01:43:21.811368+0000","last_clean":"2024-04-24T01:43:21.811368+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:43:21.811368+0000","last_undegraded":"2024-04-24T01:43:21.811368+0000","last_fullsized":"2024-04-24T01:43:21.811368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807855+0000","last_change":"2024-04-24T01:42:44.779726+0000","last_active":"2024-04-24T01:43:21.807855+0000","last_peered":"2024-04-24T01:43:21.807855+0000","last_clean":"2024-04-24T01:43:21.807855+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:43:21.807855+0000","last_undegraded":"2024-04-24T01:43:21.807855+0000","last_fullsized":"2024-04-24T01:43:21.807855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:52.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.729900+0000","last_change":"2024-04-24T01:42:46.779267+0000","last_active":"2024-04-24T01:45:49.729900+0000","last_peered":"2024-04-24T01:45:49.729900+0000","last_clean":"2024-04-24T01:45:49.729900+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:45:49.729900+0000","last_undegraded":"2024-04-24T01:45:49.729900+0000","last_fullsized":"2024-04-24T01:45:49.729900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:12.649320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814064+0000","last_change":"2024-04-24T01:42:48.791281+0000","last_active":"2024-04-24T01:43:21.814064+0000","last_peered":"2024-04-24T01:43:21.814064+0000","last_clean":"2024-04-24T01:43:21.814064+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:43:21.814064+0000","last_undegraded":"2024-04-24T01:43:21.814064+0000","last_fullsized":"2024-04-24T01:43:21.814064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:56.691092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.450921+0000","last_change":"2024-04-24T01:42:50.801137+0000","last_active":"2024-04-24T01:43:23.450921+0000","last_peered":"2024-04-24T01:43:23.450921+0000","last_clean":"2024-04-24T01:43:23.450921+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:43:23.450921+0000","last_undegraded":"2024-04-24T01:43:23.450921+0000","last_fullsized":"2024-04-24T01:43:23.450921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:41.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.185393+0000","last_change":"2024-04-24T01:42:42.786306+0000","last_active":"2024-04-24T01:43:23.185393+0000","last_peered":"2024-04-24T01:43:23.185393+0000","last_clean":"2024-04-24T01:43:23.185393+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:43:23.185393+0000","last_undegraded":"2024-04-24T01:43:23.185393+0000","last_fullsized":"2024-04-24T01:43:23.185393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:24.062336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816678+0000","last_change":"2024-04-24T01:42:40.790215+0000","last_active":"2024-04-24T01:43:21.816678+0000","last_peered":"2024-04-24T01:43:21.816678+0000","last_clean":"2024-04-24T01:43:21.816678+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:43:21.816678+0000","last_undegraded":"2024-04-24T01:43:21.816678+0000","last_fullsized":"2024-04-24T01:43:21.816678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811343+0000","last_change":"2024-04-24T01:42:44.775854+0000","last_active":"2024-04-24T01:43:21.811343+0000","last_peered":"2024-04-24T01:43:21.811343+0000","last_clean":"2024-04-24T01:43:21.811343+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:43:21.811343+0000","last_undegraded":"2024-04-24T01:43:21.811343+0000","last_fullsized":"2024-04-24T01:43:21.811343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:58.105579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.207876+0000","last_change":"2024-04-24T01:42:46.777619+0000","last_active":"2024-04-24T01:44:48.207876+0000","last_peered":"2024-04-24T01:44:48.207876+0000","last_clean":"2024-04-24T01:44:48.207876+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:44:48.207876+0000","last_undegraded":"2024-04-24T01:44:48.207876+0000","last_fullsized":"2024-04-24T01:44:48.207876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:23.977698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809142+0000","last_change":"2024-04-24T01:42:48.783348+0000","last_active":"2024-04-24T01:43:21.809142+0000","last_peered":"2024-04-24T01:43:21.809142+0000","last_clean":"2024-04-24T01:43:21.809142+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:43:21.809142+0000","last_undegraded":"2024-04-24T01:43:21.809142+0000","last_fullsized":"2024-04-24T01:43:21.809142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:29.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345667+0000","last_change":"2024-04-24T01:43:21.862671+0000","last_active":"2024-04-24T01:45:50.345667+0000","last_peered":"2024-04-24T01:45:50.345667+0000","last_clean":"2024-04-24T01:45:50.345667+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:45:50.345667+0000","last_undegraded":"2024-04-24T01:45:50.345667+0000","last_fullsized":"2024-04-24T01:45:50.345667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:07.455442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.333865+0000","last_change":"2024-04-24T01:42:40.787886+0000","last_active":"2024-04-24T01:43:22.333865+0000","last_peered":"2024-04-24T01:43:22.333865+0000","last_clean":"2024-04-24T01:43:22.333865+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:43:22.333865+0000","last_undegraded":"2024-04-24T01:43:22.333865+0000","last_fullsized":"2024-04-24T01:43:22.333865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:56.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865914+0000","last_change":"2024-04-24T01:42:44.773584+0000","last_active":"2024-04-24T01:43:21.865914+0000","last_peered":"2024-04-24T01:43:21.865914+0000","last_clean":"2024-04-24T01:43:21.865914+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:43:21.865914+0000","last_undegraded":"2024-04-24T01:43:21.865914+0000","last_fullsized":"2024-04-24T01:43:21.865914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:23.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.229299+0000","last_change":"2024-04-24T01:42:46.777975+0000","last_active":"2024-04-24T01:44:48.229299+0000","last_peered":"2024-04-24T01:44:48.229299+0000","last_clean":"2024-04-24T01:44:48.229299+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:44:48.229299+0000","last_undegraded":"2024-04-24T01:44:48.229299+0000","last_fullsized":"2024-04-24T01:44:48.229299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:13.422542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808471+0000","last_change":"2024-04-24T01:42:48.782421+0000","last_active":"2024-04-24T01:43:21.808471+0000","last_peered":"2024-04-24T01:43:21.808471+0000","last_clean":"2024-04-24T01:43:21.808471+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:43:21.808471+0000","last_undegraded":"2024-04-24T01:43:21.808471+0000","last_fullsized":"2024-04-24T01:43:21.808471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:57.847015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.067180+0000","last_change":"2024-04-24T01:42:50.794926+0000","last_active":"2024-04-24T01:45:50.067180+0000","last_peered":"2024-04-24T01:45:50.067180+0000","last_clean":"2024-04-24T01:45:50.067180+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:45:50.067180+0000","last_undegraded":"2024-04-24T01:45:50.067180+0000","last_fullsized":"2024-04-24T01:45:50.067180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:45.839756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.014892+0000","last_change":"2024-04-24T01:42:42.783533+0000","last_active":"2024-04-24T01:43:24.014892+0000","last_peered":"2024-04-24T01:43:24.014892+0000","last_clean":"2024-04-24T01:43:24.014892+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:43:24.014892+0000","last_undegraded":"2024-04-24T01:43:24.014892+0000","last_fullsized":"2024-04-24T01:43:24.014892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:09.403789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815922+0000","last_change":"2024-04-24T01:42:40.788925+0000","last_active":"2024-04-24T01:43:21.815922+0000","last_peered":"2024-04-24T01:43:21.815922+0000","last_clean":"2024-04-24T01:43:21.815922+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:43:21.815922+0000","last_undegraded":"2024-04-24T01:43:21.815922+0000","last_fullsized":"2024-04-24T01:43:21.815922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810144+0000","last_change":"2024-04-24T01:42:44.774986+0000","last_active":"2024-04-24T01:43:21.810144+0000","last_peered":"2024-04-24T01:43:21.810144+0000","last_clean":"2024-04-24T01:43:21.810144+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:43:21.810144+0000","last_undegraded":"2024-04-24T01:43:21.810144+0000","last_fullsized":"2024-04-24T01:43:21.810144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:15.297566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.208815+0000","last_change":"2024-04-24T01:42:46.783203+0000","last_active":"2024-04-24T01:44:48.208815+0000","last_peered":"2024-04-24T01:44:48.208815+0000","last_clean":"2024-04-24T01:44:48.208815+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:44:48.208815+0000","last_undegraded":"2024-04-24T01:44:48.208815+0000","last_fullsized":"2024-04-24T01:44:48.208815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:26:21.983975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814006+0000","last_change":"2024-04-24T01:42:48.791647+0000","last_active":"2024-04-24T01:43:21.814006+0000","last_peered":"2024-04-24T01:43:21.814006+0000","last_clean":"2024-04-24T01:43:21.814006+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:43:21.814006+0000","last_undegraded":"2024-04-24T01:43:21.814006+0000","last_fullsized":"2024-04-24T01:43:21.814006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:07.292630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.304388+0000","last_change":"2024-04-24T01:42:50.797843+0000","last_active":"2024-04-24T01:45:50.304388+0000","last_peered":"2024-04-24T01:45:50.304388+0000","last_clean":"2024-04-24T01:45:50.304388+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:45:50.304388+0000","last_undegraded":"2024-04-24T01:45:50.304388+0000","last_fullsized":"2024-04-24T01:45:50.304388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:49.177816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814977+0000","last_change":"2024-04-24T01:42:42.786283+0000","last_active":"2024-04-24T01:43:21.814977+0000","last_peered":"2024-04-24T01:43:21.814977+0000","last_clean":"2024-04-24T01:43:21.814977+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:43:21.814977+0000","last_undegraded":"2024-04-24T01:43:21.814977+0000","last_fullsized":"2024-04-24T01:43:21.814977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:14.187364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.608549+0000","last_change":"2024-04-24T01:42:40.769690+0000","last_active":"2024-04-24T01:44:49.608549+0000","last_peered":"2024-04-24T01:44:49.608549+0000","last_clean":"2024-04-24T01:44:49.608549+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:44:49.608549+0000","last_undegraded":"2024-04-24T01:44:49.608549+0000","last_fullsized":"2024-04-24T01:44:49.608549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808700+0000","last_change":"2024-04-24T01:42:44.775092+0000","last_active":"2024-04-24T01:43:21.808700+0000","last_peered":"2024-04-24T01:43:21.808700+0000","last_clean":"2024-04-24T01:43:21.808700+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:43:21.808700+0000","last_undegraded":"2024-04-24T01:43:21.808700+0000","last_fullsized":"2024-04-24T01:43:21.808700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:22.743910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.226891+0000","last_change":"2024-04-24T01:42:46.777052+0000","last_active":"2024-04-24T01:44:48.226891+0000","last_peered":"2024-04-24T01:44:48.226891+0000","last_clean":"2024-04-24T01:44:48.226891+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:44:48.226891+0000","last_undegraded":"2024-04-24T01:44:48.226891+0000","last_fullsized":"2024-04-24T01:44:48.226891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:56.838568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864024+0000","last_change":"2024-04-24T01:42:48.783841+0000","last_active":"2024-04-24T01:43:21.864024+0000","last_peered":"2024-04-24T01:43:21.864024+0000","last_clean":"2024-04-24T01:43:21.864024+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:43:21.864024+0000","last_undegraded":"2024-04-24T01:43:21.864024+0000","last_fullsized":"2024-04-24T01:43:21.864024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:56:50.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.650746+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:44:49.650746+0000","last_peered":"2024-04-24T01:44:49.650746+0000","last_clean":"2024-04-24T01:44:49.650746+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:44:49.650746+0000","last_undegraded":"2024-04-24T01:44:49.650746+0000","last_fullsized":"2024-04-24T01:44:49.650746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:59.151288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315999+0000","last_change":"2024-04-24T01:42:42.776215+0000","last_active":"2024-04-24T01:45:50.315999+0000","last_peered":"2024-04-24T01:45:50.315999+0000","last_clean":"2024-04-24T01:45:50.315999+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:45:50.315999+0000","last_undegraded":"2024-04-24T01:45:50.315999+0000","last_fullsized":"2024-04-24T01:45:50.315999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:29.635969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791055+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:46.075375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816801+0000","last_change":"2024-04-24T01:42:44.775371+0000","last_active":"2024-04-24T01:43:21.816801+0000","last_peered":"2024-04-24T01:43:21.816801+0000","last_clean":"2024-04-24T01:43:21.816801+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:43:21.816801+0000","last_undegraded":"2024-04-24T01:43:21.816801+0000","last_fullsized":"2024-04-24T01:43:21.816801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:48.566887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813558+0000","last_change":"2024-04-24T01:42:46.785255+0000","last_active":"2024-04-24T01:43:21.813558+0000","last_peered":"2024-04-24T01:43:21.813558+0000","last_clean":"2024-04-24T01:43:21.813558+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:43:21.813558+0000","last_undegraded":"2024-04-24T01:43:21.813558+0000","last_fullsized":"2024-04-24T01:43:21.813558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:55.734489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.349973+0000","last_change":"2024-04-24T01:42:48.791368+0000","last_active":"2024-04-24T01:45:50.349973+0000","last_peered":"2024-04-24T01:45:50.349973+0000","last_clean":"2024-04-24T01:45:50.349973+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:45:50.349973+0000","last_undegraded":"2024-04-24T01:45:50.349973+0000","last_fullsized":"2024-04-24T01:45:50.349973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:36.125996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809311+0000","last_change":"2024-04-24T01:42:50.799047+0000","last_active":"2024-04-24T01:43:21.809311+0000","last_peered":"2024-04-24T01:43:21.809311+0000","last_clean":"2024-04-24T01:43:21.809311+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:43:21.809311+0000","last_undegraded":"2024-04-24T01:43:21.809311+0000","last_fullsized":"2024-04-24T01:43:21.809311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:48.985276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270565+0000","last_change":"2024-04-24T01:42:42.779703+0000","last_active":"2024-04-24T01:45:50.270565+0000","last_peered":"2024-04-24T01:45:50.270565+0000","last_clean":"2024-04-24T01:45:50.270565+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:45:50.270565+0000","last_undegraded":"2024-04-24T01:45:50.270565+0000","last_fullsized":"2024-04-24T01:45:50.270565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:48.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817526+0000","last_change":"2024-04-24T01:42:40.783048+0000","last_active":"2024-04-24T01:43:21.817526+0000","last_peered":"2024-04-24T01:43:21.817526+0000","last_clean":"2024-04-24T01:43:21.817526+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:43:21.817526+0000","last_undegraded":"2024-04-24T01:43:21.817526+0000","last_fullsized":"2024-04-24T01:43:21.817526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817275+0000","last_change":"2024-04-24T01:42:44.776357+0000","last_active":"2024-04-24T01:43:21.817275+0000","last_peered":"2024-04-24T01:43:21.817275+0000","last_clean":"2024-04-24T01:43:21.817275+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:43:21.817275+0000","last_undegraded":"2024-04-24T01:43:21.817275+0000","last_fullsized":"2024-04-24T01:43:21.817275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:59.654590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'63","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090843+0000","last_change":"2024-04-24T01:42:46.776292+0000","last_active":"2024-04-24T01:45:11.090843+0000","last_peered":"2024-04-24T01:45:11.090843+0000","last_clean":"2024-04-24T01:45:11.090843+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:45:11.090843+0000","last_undegraded":"2024-04-24T01:45:11.090843+0000","last_fullsized":"2024-04-24T01:45:11.090843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:34.123347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":76,"num_read_kb":63,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.861850+0000","last_change":"2024-04-24T01:42:48.788971+0000","last_active":"2024-04-24T01:43:21.861850+0000","last_peered":"2024-04-24T01:43:21.861850+0000","last_clean":"2024-04-24T01:43:21.861850+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:43:21.861850+0000","last_undegraded":"2024-04-24T01:43:21.861850+0000","last_fullsized":"2024-04-24T01:43:21.861850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:30:22.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817135+0000","last_change":"2024-04-24T01:42:50.796877+0000","last_active":"2024-04-24T01:43:21.817135+0000","last_peered":"2024-04-24T01:43:21.817135+0000","last_clean":"2024-04-24T01:43:21.817135+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:43:21.817135+0000","last_undegraded":"2024-04-24T01:43:21.817135+0000","last_fullsized":"2024-04-24T01:43:21.817135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:01:14.162912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345596+0000","last_change":"2024-04-24T01:42:42.779537+0000","last_active":"2024-04-24T01:45:50.345596+0000","last_peered":"2024-04-24T01:45:50.345596+0000","last_clean":"2024-04-24T01:45:50.345596+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:45:50.345596+0000","last_undegraded":"2024-04-24T01:45:50.345596+0000","last_fullsized":"2024-04-24T01:45:50.345596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:12.977374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.261154+0000","last_change":"2024-04-24T01:42:40.788381+0000","last_active":"2024-04-24T01:45:50.261154+0000","last_peered":"2024-04-24T01:45:50.261154+0000","last_clean":"2024-04-24T01:45:50.261154+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:45:50.261154+0000","last_undegraded":"2024-04-24T01:45:50.261154+0000","last_fullsized":"2024-04-24T01:45:50.261154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:10.719363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810382+0000","last_change":"2024-04-24T01:42:44.775775+0000","last_active":"2024-04-24T01:43:21.810382+0000","last_peered":"2024-04-24T01:43:21.810382+0000","last_clean":"2024-04-24T01:43:21.810382+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:43:21.810382+0000","last_undegraded":"2024-04-24T01:43:21.810382+0000","last_fullsized":"2024-04-24T01:43:21.810382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:06.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.200340+0000","last_change":"2024-04-24T01:42:46.777066+0000","last_active":"2024-04-24T01:44:48.200340+0000","last_peered":"2024-04-24T01:44:48.200340+0000","last_clean":"2024-04-24T01:44:48.200340+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:44:48.200340+0000","last_undegraded":"2024-04-24T01:44:48.200340+0000","last_fullsized":"2024-04-24T01:44:48.200340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:17.835974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810707+0000","last_change":"2024-04-24T01:42:48.785198+0000","last_active":"2024-04-24T01:43:21.810707+0000","last_peered":"2024-04-24T01:43:21.810707+0000","last_clean":"2024-04-24T01:43:21.810707+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:43:21.810707+0000","last_undegraded":"2024-04-24T01:43:21.810707+0000","last_fullsized":"2024-04-24T01:43:21.810707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:01.822047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.400789+0000","last_change":"2024-04-24T01:42:50.801689+0000","last_active":"2024-04-24T01:45:50.400789+0000","last_peered":"2024-04-24T01:45:50.400789+0000","last_clean":"2024-04-24T01:45:50.400789+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:45:50.400789+0000","last_undegraded":"2024-04-24T01:45:50.400789+0000","last_fullsized":"2024-04-24T01:45:50.400789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:45.044072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654504+0000","last_change":"2024-04-24T01:43:21.864360+0000","last_active":"2024-04-24T01:44:49.654504+0000","last_peered":"2024-04-24T01:44:49.654504+0000","last_clean":"2024-04-24T01:44:49.654504+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:44:49.654504+0000","last_undegraded":"2024-04-24T01:44:49.654504+0000","last_fullsized":"2024-04-24T01:44:49.654504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:52.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865009+0000","last_change":"2024-04-24T01:42:40.778077+0000","last_active":"2024-04-24T01:43:21.865009+0000","last_peered":"2024-04-24T01:43:21.865009+0000","last_clean":"2024-04-24T01:43:21.865009+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:43:21.865009+0000","last_undegraded":"2024-04-24T01:43:21.865009+0000","last_fullsized":"2024-04-24T01:43:21.865009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:51.699851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.302204+0000","last_change":"2024-04-24T01:42:44.778211+0000","last_active":"2024-04-24T01:44:49.302204+0000","last_peered":"2024-04-24T01:44:49.302204+0000","last_clean":"2024-04-24T01:44:49.302204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:44:49.302204+0000","last_undegraded":"2024-04-24T01:44:49.302204+0000","last_fullsized":"2024-04-24T01:44:49.302204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:36.446305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.224750+0000","last_change":"2024-04-24T01:42:46.782809+0000","last_active":"2024-04-24T01:44:48.224750+0000","last_peered":"2024-04-24T01:44:48.224750+0000","last_clean":"2024-04-24T01:44:48.224750+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:44:48.224750+0000","last_undegraded":"2024-04-24T01:44:48.224750+0000","last_fullsized":"2024-04-24T01:44:48.224750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:38.612473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811004+0000","last_change":"2024-04-24T01:42:48.793613+0000","last_active":"2024-04-24T01:43:21.811004+0000","last_peered":"2024-04-24T01:43:21.811004+0000","last_clean":"2024-04-24T01:43:21.811004+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:43:21.811004+0000","last_undegraded":"2024-04-24T01:43:21.811004+0000","last_fullsized":"2024-04-24T01:43:21.811004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:14.394175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.234782+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:44:48.234782+0000","last_peered":"2024-04-24T01:44:48.234782+0000","last_clean":"2024-04-24T01:44:48.234782+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:44:48.234782+0000","last_undegraded":"2024-04-24T01:44:48.234782+0000","last_fullsized":"2024-04-24T01:44:48.234782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:18.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345345+0000","last_change":"2024-04-24T01:42:42.779597+0000","last_active":"2024-04-24T01:45:50.345345+0000","last_peered":"2024-04-24T01:45:50.345345+0000","last_clean":"2024-04-24T01:45:50.345345+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:45:50.345345+0000","last_undegraded":"2024-04-24T01:45:50.345345+0000","last_fullsized":"2024-04-24T01:45:50.345345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:39.932797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.258347+0000","last_change":"2024-04-24T01:42:40.789710+0000","last_active":"2024-04-24T01:45:50.258347+0000","last_peered":"2024-04-24T01:45:50.258347+0000","last_clean":"2024-04-24T01:45:50.258347+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:45:50.258347+0000","last_undegraded":"2024-04-24T01:45:50.258347+0000","last_fullsized":"2024-04-24T01:45:50.258347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.900262+0000","last_change":"2024-04-24T01:42:44.778763+0000","last_active":"2024-04-24T01:44:46.900262+0000","last_peered":"2024-04-24T01:44:46.900262+0000","last_clean":"2024-04-24T01:44:46.900262+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:44:46.900262+0000","last_undegraded":"2024-04-24T01:44:46.900262+0000","last_fullsized":"2024-04-24T01:44:46.900262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:04.964034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672992+0000","last_change":"2024-04-24T01:42:46.782978+0000","last_active":"2024-04-24T01:45:49.672992+0000","last_peered":"2024-04-24T01:45:49.672992+0000","last_clean":"2024-04-24T01:45:49.672992+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:45:49.672992+0000","last_undegraded":"2024-04-24T01:45:49.672992+0000","last_fullsized":"2024-04-24T01:45:49.672992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:19.005767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863044+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:43:21.863044+0000","last_peered":"2024-04-24T01:43:21.863044+0000","last_clean":"2024-04-24T01:43:21.863044+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:43:21.863044+0000","last_undegraded":"2024-04-24T01:43:21.863044+0000","last_fullsized":"2024-04-24T01:43:21.863044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:02.008836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.237757+0000","last_change":"2024-04-24T01:42:50.800862+0000","last_active":"2024-04-24T01:44:48.237757+0000","last_peered":"2024-04-24T01:44:48.237757+0000","last_clean":"2024-04-24T01:44:48.237757+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:44:48.237757+0000","last_undegraded":"2024-04-24T01:44:48.237757+0000","last_fullsized":"2024-04-24T01:44:48.237757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:16:03.004170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088543+0000","last_change":"2024-04-24T01:42:42.791052+0000","last_active":"2024-04-24T01:44:56.088543+0000","last_peered":"2024-04-24T01:44:56.088543+0000","last_clean":"2024-04-24T01:44:56.088543+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:44:56.088543+0000","last_undegraded":"2024-04-24T01:44:56.088543+0000","last_fullsized":"2024-04-24T01:44:56.088543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:09.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.086702+0000","last_change":"2024-04-24T01:42:40.778401+0000","last_active":"2024-04-24T01:44:46.086702+0000","last_peered":"2024-04-24T01:44:46.086702+0000","last_clean":"2024-04-24T01:44:46.086702+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:44:46.086702+0000","last_undegraded":"2024-04-24T01:44:46.086702+0000","last_fullsized":"2024-04-24T01:44:46.086702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315993+0000","last_change":"2024-04-24T01:42:42.779808+0000","last_active":"2024-04-24T01:45:50.315993+0000","last_peered":"2024-04-24T01:45:50.315993+0000","last_clean":"2024-04-24T01:45:50.315993+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:45:50.315993+0000","last_undegraded":"2024-04-24T01:45:50.315993+0000","last_fullsized":"2024-04-24T01:45:50.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:39.808849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862090+0000","last_change":"2024-04-24T01:42:40.781020+0000","last_active":"2024-04-24T01:43:21.862090+0000","last_peered":"2024-04-24T01:43:21.862090+0000","last_clean":"2024-04-24T01:43:21.862090+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:43:21.862090+0000","last_undegraded":"2024-04-24T01:43:21.862090+0000","last_fullsized":"2024-04-24T01:43:21.862090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:11:49.303845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'21","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.051046+0000","last_change":"2024-04-24T01:42:42.782200+0000","last_active":"2024-04-24T01:45:50.051046+0000","last_peered":"2024-04-24T01:45:50.051046+0000","last_clean":"2024-04-24T01:45:50.051046+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:45:50.051046+0000","last_undegraded":"2024-04-24T01:45:50.051046+0000","last_fullsized":"2024-04-24T01:45:50.051046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:51.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.023917+0000","last_change":"2024-04-24T01:42:40.785740+0000","last_active":"2024-04-24T01:45:50.023917+0000","last_peered":"2024-04-24T01:45:50.023917+0000","last_clean":"2024-04-24T01:45:50.023917+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:45:50.023917+0000","last_undegraded":"2024-04-24T01:45:50.023917+0000","last_fullsized":"2024-04-24T01:45:50.023917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:06.241519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315979+0000","last_change":"2024-04-24T01:42:42.775754+0000","last_active":"2024-04-24T01:45:50.315979+0000","last_peered":"2024-04-24T01:45:50.315979+0000","last_clean":"2024-04-24T01:45:50.315979+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:45:50.315979+0000","last_undegraded":"2024-04-24T01:45:50.315979+0000","last_fullsized":"2024-04-24T01:45:50.315979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:14.133212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864641+0000","last_change":"2024-04-24T01:42:40.768297+0000","last_active":"2024-04-24T01:43:21.864641+0000","last_peered":"2024-04-24T01:43:21.864641+0000","last_clean":"2024-04-24T01:43:21.864641+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:43:21.864641+0000","last_undegraded":"2024-04-24T01:43:21.864641+0000","last_fullsized":"2024-04-24T01:43:21.864641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:41.931823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864431+0000","last_change":"2024-04-24T01:42:42.790746+0000","last_active":"2024-04-24T01:43:21.864431+0000","last_peered":"2024-04-24T01:43:21.864431+0000","last_clean":"2024-04-24T01:43:21.864431+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:43:21.864431+0000","last_undegraded":"2024-04-24T01:43:21.864431+0000","last_fullsized":"2024-04-24T01:43:21.864431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:23.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334072+0000","last_change":"2024-04-24T01:42:40.778267+0000","last_active":"2024-04-24T01:43:22.334072+0000","last_peered":"2024-04-24T01:43:22.334072+0000","last_clean":"2024-04-24T01:43:22.334072+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:43:22.334072+0000","last_undegraded":"2024-04-24T01:43:22.334072+0000","last_fullsized":"2024-04-24T01:43:22.334072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:54.513268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506919+0000","last_change":"2024-04-24T01:42:42.783600+0000","last_active":"2024-04-24T01:44:46.506919+0000","last_peered":"2024-04-24T01:44:46.506919+0000","last_clean":"2024-04-24T01:44:46.506919+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:44:46.506919+0000","last_undegraded":"2024-04-24T01:44:46.506919+0000","last_fullsized":"2024-04-24T01:44:46.506919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:54.263697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.438378+0000","last_change":"2024-04-24T01:42:40.792747+0000","last_active":"2024-04-24T01:43:23.438378+0000","last_peered":"2024-04-24T01:43:23.438378+0000","last_clean":"2024-04-24T01:43:23.438378+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:43:23.438378+0000","last_undegraded":"2024-04-24T01:43:23.438378+0000","last_fullsized":"2024-04-24T01:43:23.438378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.455490+0000","last_change":"2024-04-24T01:42:42.783541+0000","last_active":"2024-04-24T01:43:23.455490+0000","last_peered":"2024-04-24T01:43:23.455490+0000","last_clean":"2024-04-24T01:43:23.455490+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:43:23.455490+0000","last_undegraded":"2024-04-24T01:43:23.455490+0000","last_fullsized":"2024-04-24T01:43:23.455490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:29.669455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.496096+0000","last_change":"2024-04-24T01:42:40.784834+0000","last_active":"2024-04-24T01:44:46.496096+0000","last_peered":"2024-04-24T01:44:46.496096+0000","last_clean":"2024-04-24T01:44:46.496096+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:44:46.496096+0000","last_undegraded":"2024-04-24T01:44:46.496096+0000","last_fullsized":"2024-04-24T01:44:46.496096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654733+0000","last_change":"2024-04-24T01:42:42.784939+0000","last_active":"2024-04-24T01:44:49.654733+0000","last_peered":"2024-04-24T01:44:49.654733+0000","last_clean":"2024-04-24T01:44:49.654733+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:44:49.654733+0000","last_undegraded":"2024-04-24T01:44:49.654733+0000","last_fullsized":"2024-04-24T01:44:49.654733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.002401+0000","last_change":"2024-04-24T01:42:40.774338+0000","last_active":"2024-04-24T01:45:50.002401+0000","last_peered":"2024-04-24T01:45:50.002401+0000","last_clean":"2024-04-24T01:45:50.002401+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:45:50.002401+0000","last_undegraded":"2024-04-24T01:45:50.002401+0000","last_fullsized":"2024-04-24T01:45:50.002401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:47.446497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654753+0000","last_change":"2024-04-24T01:42:42.783518+0000","last_active":"2024-04-24T01:44:49.654753+0000","last_peered":"2024-04-24T01:44:49.654753+0000","last_clean":"2024-04-24T01:44:49.654753+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:44:49.654753+0000","last_undegraded":"2024-04-24T01:44:49.654753+0000","last_fullsized":"2024-04-24T01:44:49.654753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:48.893933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810266+0000","last_change":"2024-04-24T01:42:40.776220+0000","last_active":"2024-04-24T01:43:21.810266+0000","last_peered":"2024-04-24T01:43:21.810266+0000","last_clean":"2024-04-24T01:43:21.810266+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:43:21.810266+0000","last_undegraded":"2024-04-24T01:43:21.810266+0000","last_fullsized":"2024-04-24T01:43:21.810266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:52.166943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654997+0000","last_change":"2024-04-24T01:42:42.780704+0000","last_active":"2024-04-24T01:44:49.654997+0000","last_peered":"2024-04-24T01:44:49.654997+0000","last_clean":"2024-04-24T01:44:49.654997+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:44:49.654997+0000","last_undegraded":"2024-04-24T01:44:49.654997+0000","last_fullsized":"2024-04-24T01:44:49.654997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:19.467731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334617+0000","last_change":"2024-04-24T01:42:40.774379+0000","last_active":"2024-04-24T01:43:22.334617+0000","last_peered":"2024-04-24T01:43:22.334617+0000","last_clean":"2024-04-24T01:43:22.334617+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:43:22.334617+0000","last_undegraded":"2024-04-24T01:43:22.334617+0000","last_fullsized":"2024-04-24T01:43:22.334617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:56.807661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321950+0000","last_change":"2024-04-24T01:42:42.790910+0000","last_active":"2024-04-24T01:45:50.321950+0000","last_peered":"2024-04-24T01:45:50.321950+0000","last_clean":"2024-04-24T01:45:50.321950+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:45:50.321950+0000","last_undegraded":"2024-04-24T01:45:50.321950+0000","last_fullsized":"2024-04-24T01:45:50.321950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:52.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816518+0000","last_change":"2024-04-24T01:42:40.793467+0000","last_active":"2024-04-24T01:43:21.816518+0000","last_peered":"2024-04-24T01:43:21.816518+0000","last_clean":"2024-04-24T01:43:21.816518+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:43:21.816518+0000","last_undegraded":"2024-04-24T01:43:21.816518+0000","last_fullsized":"2024-04-24T01:43:21.816518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.019736+0000","last_change":"2024-04-24T01:42:42.781172+0000","last_active":"2024-04-24T01:44:06.019736+0000","last_peered":"2024-04-24T01:44:06.019736+0000","last_clean":"2024-04-24T01:44:06.019736+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:44:06.019736+0000","last_undegraded":"2024-04-24T01:44:06.019736+0000","last_fullsized":"2024-04-24T01:44:06.019736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:50.255990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815448+0000","last_change":"2024-04-24T01:42:40.771155+0000","last_active":"2024-04-24T01:43:21.815448+0000","last_peered":"2024-04-24T01:43:21.815448+0000","last_clean":"2024-04-24T01:43:21.815448+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:43:21.815448+0000","last_undegraded":"2024-04-24T01:43:21.815448+0000","last_fullsized":"2024-04-24T01:43:21.815448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816208+0000","last_change":"2024-04-24T01:42:42.782402+0000","last_active":"2024-04-24T01:43:21.816208+0000","last_peered":"2024-04-24T01:43:21.816208+0000","last_clean":"2024-04-24T01:43:21.816208+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:43:21.816208+0000","last_undegraded":"2024-04-24T01:43:21.816208+0000","last_fullsized":"2024-04-24T01:43:21.816208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:01.719700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811712+0000","last_change":"2024-04-24T01:42:40.785750+0000","last_active":"2024-04-24T01:43:21.811712+0000","last_peered":"2024-04-24T01:43:21.811712+0000","last_clean":"2024-04-24T01:43:21.811712+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:43:21.811712+0000","last_undegraded":"2024-04-24T01:43:21.811712+0000","last_fullsized":"2024-04-24T01:43:21.811712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:29.551602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'11","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.050515+0000","last_change":"2024-04-24T01:42:42.783870+0000","last_active":"2024-04-24T01:45:50.050515+0000","last_peered":"2024-04-24T01:45:50.050515+0000","last_clean":"2024-04-24T01:45:50.050515+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:45:50.050515+0000","last_undegraded":"2024-04-24T01:45:50.050515+0000","last_fullsized":"2024-04-24T01:45:50.050515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:19.254318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089090+0000","last_change":"2024-04-24T01:42:40.787075+0000","last_active":"2024-04-24T01:44:56.089090+0000","last_peered":"2024-04-24T01:44:56.089090+0000","last_clean":"2024-04-24T01:44:56.089090+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:44:56.089090+0000","last_undegraded":"2024-04-24T01:44:56.089090+0000","last_fullsized":"2024-04-24T01:44:56.089090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:11.008229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812646+0000","last_change":"2024-04-24T01:42:42.783035+0000","last_active":"2024-04-24T01:43:21.812646+0000","last_peered":"2024-04-24T01:43:21.812646+0000","last_clean":"2024-04-24T01:43:21.812646+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:43:21.812646+0000","last_undegraded":"2024-04-24T01:43:21.812646+0000","last_fullsized":"2024-04-24T01:43:21.812646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:34.220751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089213+0000","last_change":"2024-04-24T01:42:40.780277+0000","last_active":"2024-04-24T01:45:01.089213+0000","last_peered":"2024-04-24T01:45:01.089213+0000","last_clean":"2024-04-24T01:45:01.089213+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:45:01.089213+0000","last_undegraded":"2024-04-24T01:45:01.089213+0000","last_fullsized":"2024-04-24T01:45:01.089213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088282+0000","last_change":"2024-04-24T01:42:42.785135+0000","last_active":"2024-04-24T01:44:56.088282+0000","last_peered":"2024-04-24T01:44:56.088282+0000","last_clean":"2024-04-24T01:44:56.088282+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:44:56.088282+0000","last_undegraded":"2024-04-24T01:44:56.088282+0000","last_fullsized":"2024-04-24T01:44:56.088282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813648+0000","last_change":"2024-04-24T01:42:40.785768+0000","last_active":"2024-04-24T01:43:21.813648+0000","last_peered":"2024-04-24T01:43:21.813648+0000","last_clean":"2024-04-24T01:43:21.813648+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:43:21.813648+0000","last_undegraded":"2024-04-24T01:43:21.813648+0000","last_fullsized":"2024-04-24T01:43:21.813648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:41.422186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089710+0000","last_change":"2024-04-24T01:42:40.778631+0000","last_active":"2024-04-24T01:45:01.089710+0000","last_peered":"2024-04-24T01:45:01.089710+0000","last_clean":"2024-04-24T01:45:01.089710+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:45:01.089710+0000","last_undegraded":"2024-04-24T01:45:01.089710+0000","last_fullsized":"2024-04-24T01:45:01.089710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:55.030083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270563+0000","last_change":"2024-04-24T01:42:42.785218+0000","last_active":"2024-04-24T01:45:50.270563+0000","last_peered":"2024-04-24T01:45:50.270563+0000","last_clean":"2024-04-24T01:45:50.270563+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:45:50.270563+0000","last_undegraded":"2024-04-24T01:45:50.270563+0000","last_fullsized":"2024-04-24T01:45:50.270563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:11.578528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:04.084957+0000","last_change":"2024-04-24T01:42:40.781285+0000","last_active":"2024-04-24T01:45:04.084957+0000","last_peered":"2024-04-24T01:45:04.084957+0000","last_clean":"2024-04-24T01:45:04.084957+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:45:04.084957+0000","last_undegraded":"2024-04-24T01:45:04.084957+0000","last_fullsized":"2024-04-24T01:45:04.084957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.038340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345306+0000","last_change":"2024-04-24T01:42:42.785126+0000","last_active":"2024-04-24T01:45:50.345306+0000","last_peered":"2024-04-24T01:45:50.345306+0000","last_clean":"2024-04-24T01:45:50.345306+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:45:50.345306+0000","last_undegraded":"2024-04-24T01:45:50.345306+0000","last_fullsized":"2024-04-24T01:45:50.345306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1472,"ondisk_log_size":1472,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48096,"kb_used_data":12760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323744,"statfs":{"total":96636764160,"available":96587513856,"internally_reserved":0,"allocated":13066240,"data_stored":12741353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48928,"kb_used_data":13592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322912,"statfs":{"total":96636764160,"available":96586661888,"internally_reserved":0,"allocated":13918208,"data_stored":13644432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640301,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38712,"kb_used_data":3376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333128,"statfs":{"total":96636764160,"available":96597123072,"internally_reserved":0,"allocated":3457024,"data_stored":3161357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":10988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":11251712,"data_stored":10959103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2420736,"data_stored":2420736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:45:57.724 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T01:45:57.724 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:45:57.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.845+0000 7f70f407b640 1 Processor -- start 2024-04-24T01:45:57.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.845+0000 7f70f407b640 1 -- start start 2024-04-24T01:45:57.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.845+0000 7f70f407b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70ec127ce0 0x7f70ec1280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.845+0000 7f70f407b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ec127b00 con 0x7f70ec070100 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.845+0000 7f70f407b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f70ec0708e0 con 0x7f70ec127ce0 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.846+0000 7f70f1e17640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70ec127ce0 0x7f70ec1280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.846+0000 7f70f1616640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f70ec070100 0x7f70ec12b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35892/0 (socket says 172.21.15.107:35892) 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.846+0000 7f70f1616640 1 -- 172.21.15.107:0/288090234 learned_addr learned my addr 172.21.15.107:0/288090234 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.846+0000 7f70f1e17640 1 -- 172.21.15.107:0/288090234 >> v1:172.21.15.107:6789/0 conn(0x7f70ec070100 legacy=0x7f70ec12b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.846+0000 7f70f0e15640 1 -- 172.21.15.107:0/288090234 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547946515 0 0) 0x7f70dc001110 con 0x7f70ec070100 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.846+0000 7f70f1e17640 1 -- 172.21.15.107:0/288090234 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec098800 con 0x7f70ec127ce0 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f1e17640 1 --2- 172.21.15.107:0/288090234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec127ce0 0x7f70ec1280c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009720 tx=0x7f70e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847a7e41fa069883 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f0e15640 1 -- 172.21.15.107:0/288090234 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e80316d0 con 0x7f70ec127ce0 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f0e15640 1 -- 172.21.15.107:0/288090234 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8037070 con 0x7f70ec127ce0 2024-04-24T01:45:57.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f0e15640 1 -- 172.21.15.107:0/288090234 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e80319c0 con 0x7f70ec127ce0 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f407b640 1 -- 172.21.15.107:0/288090234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec127ce0 msgr2=0x7f70ec1280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f407b640 1 --2- 172.21.15.107:0/288090234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec127ce0 0x7f70ec1280c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009720 tx=0x7f70e802b840 comp rx=0 tx=0).stop 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f407b640 1 -- 172.21.15.107:0/288090234 shutdown_connections 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f407b640 1 --2- 172.21.15.107:0/288090234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec127ce0 0x7f70ec1280c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f407b640 1 -- 172.21.15.107:0/288090234 >> 172.21.15.107:0/288090234 conn(0x7f70ec099680 msgr2=0x7f70ec099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f407b640 1 -- 172.21.15.107:0/288090234 shutdown_connections 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.847+0000 7f70f407b640 1 -- 172.21.15.107:0/288090234 wait complete. 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.848+0000 7f70f407b640 1 Processor -- start 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.848+0000 7f70f407b640 1 -- start start 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.848+0000 7f70f407b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec070100 0x7f70ec122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.848+0000 7f70f407b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec128780 con 0x7f70ec070100 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70f1e17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec070100 0x7f70ec122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70f1e17640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec070100 0x7f70ec122bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47934/0 (socket says 172.21.15.107:47934) 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70f1e17640 1 -- 172.21.15.107:0/1227505678 learned_addr learned my addr 172.21.15.107:0/1227505678 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70f1e17640 1 -- 172.21.15.107:0/1227505678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec1258b0 con 0x7f70ec070100 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70f1e17640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec070100 0x7f70ec122bd0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009720 tx=0x7f70e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70e27fc640 1 -- 172.21.15.107:0/1227505678 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8004160 con 0x7f70ec070100 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70e27fc640 1 -- 172.21.15.107:0/1227505678 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8004320 con 0x7f70ec070100 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec06de50 con 0x7f70ec070100 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70e27fc640 1 -- 172.21.15.107:0/1227505678 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8032640 con 0x7f70ec070100 2024-04-24T01:45:57.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.849+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec06d420 con 0x7f70ec070100 2024-04-24T01:45:57.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.850+0000 7f70e27fc640 1 -- 172.21.15.107:0/1227505678 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f70e80327e0 con 0x7f70ec070100 2024-04-24T01:45:57.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.850+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec071cf0 con 0x7f70ec070100 2024-04-24T01:45:57.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.850+0000 7f70e27fc640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70d0038090 0x7f70d003a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:57.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.850+0000 7f70e27fc640 1 -- 172.21.15.107:0/1227505678 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f70e802f050 con 0x7f70ec070100 2024-04-24T01:45:57.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.851+0000 7f70f1616640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70d0038090 0x7f70d003a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:57.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.851+0000 7f70f1616640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70d0038090 0x7f70d003a550 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000c00 tx=0x7f70dc001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:57.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:57.855+0000 7f70e27fc640 1 -- 172.21.15.107:0/1227505678 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f70ec071cf0 con 0x7f70ec070100 2024-04-24T01:45:58.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.026+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70ec124740 con 0x7f70d0038090 2024-04-24T01:45:58.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.041+0000 7f70e27fc640 1 -- 172.21.15.107:0/1227505678 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665681 (secure 0 0 0) 0x7f70ec124740 con 0x7f70d0038090 2024-04-24T01:45:58.050 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:45:58.056 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:45:58.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70d0038090 msgr2=0x7f70d003a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:58.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70d0038090 0x7f70d003a550 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000c00 tx=0x7f70dc001310 comp rx=0 tx=0).stop 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec070100 msgr2=0x7f70ec122bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec070100 0x7f70ec122bd0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009720 tx=0x7f70e80046c0 comp rx=0 tx=0).stop 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 shutdown_connections 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70d0038090 0x7f70d003a550 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 --2- 172.21.15.107:0/1227505678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70ec070100 0x7f70ec122bd0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 >> 172.21.15.107:0/1227505678 conn(0x7f70ec099680 msgr2=0x7f70ec06e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 shutdown_connections 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.045+0000 7f70f407b640 1 -- 172.21.15.107:0/1227505678 wait complete. 2024-04-24T01:45:58.060 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-24T01:45:56.065867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":259,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5177,"num_read_kb":4722,"num_write":2296,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4673,"ondisk_log_size":4673,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186220,"kb_used_data":40716,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301140,"statfs":{"total":386547056640,"available":386356367360,"internally_reserved":0,"allocated":41693184,"data_stored":40506245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003703"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810312+0000","last_change":"2024-04-24T01:42:40.781437+0000","last_active":"2024-04-24T01:43:21.810312+0000","last_peered":"2024-04-24T01:43:21.810312+0000","last_clean":"2024-04-24T01:43:21.810312+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:43:21.810312+0000","last_undegraded":"2024-04-24T01:43:21.810312+0000","last_fullsized":"2024-04-24T01:43:21.810312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138190+0000","last_change":"2024-04-24T01:42:42.785371+0000","last_active":"2024-04-24T01:45:50.138190+0000","last_peered":"2024-04-24T01:45:50.138190+0000","last_clean":"2024-04-24T01:45:50.138190+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:45:50.138190+0000","last_undegraded":"2024-04-24T01:45:50.138190+0000","last_fullsized":"2024-04-24T01:45:50.138190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082623+0000","last_change":"2024-04-24T01:42:40.769679+0000","last_active":"2024-04-24T01:44:49.082623+0000","last_peered":"2024-04-24T01:44:49.082623+0000","last_clean":"2024-04-24T01:44:49.082623+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:44:49.082623+0000","last_undegraded":"2024-04-24T01:44:49.082623+0000","last_fullsized":"2024-04-24T01:44:49.082623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:45.687433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.044899+0000","last_change":"2024-04-24T01:42:42.780099+0000","last_active":"2024-04-24T01:45:50.044899+0000","last_peered":"2024-04-24T01:45:50.044899+0000","last_clean":"2024-04-24T01:45:50.044899+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:45:50.044899+0000","last_undegraded":"2024-04-24T01:45:50.044899+0000","last_fullsized":"2024-04-24T01:45:50.044899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:41.652689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814577+0000","last_change":"2024-04-24T01:42:40.787360+0000","last_active":"2024-04-24T01:43:21.814577+0000","last_peered":"2024-04-24T01:43:21.814577+0000","last_clean":"2024-04-24T01:43:21.814577+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:43:21.814577+0000","last_undegraded":"2024-04-24T01:43:21.814577+0000","last_fullsized":"2024-04-24T01:43:21.814577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:17.246961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315339+0000","last_change":"2024-04-24T01:42:42.777928+0000","last_active":"2024-04-24T01:45:50.315339+0000","last_peered":"2024-04-24T01:45:50.315339+0000","last_clean":"2024-04-24T01:45:50.315339+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:45:50.315339+0000","last_undegraded":"2024-04-24T01:45:50.315339+0000","last_fullsized":"2024-04-24T01:45:50.315339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:43.330594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808622+0000","last_change":"2024-04-24T01:42:40.777293+0000","last_active":"2024-04-24T01:43:21.808622+0000","last_peered":"2024-04-24T01:43:21.808622+0000","last_clean":"2024-04-24T01:43:21.808622+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:43:21.808622+0000","last_undegraded":"2024-04-24T01:43:21.808622+0000","last_fullsized":"2024-04-24T01:43:21.808622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812539+0000","last_change":"2024-04-24T01:42:42.782433+0000","last_active":"2024-04-24T01:43:21.812539+0000","last_peered":"2024-04-24T01:43:21.812539+0000","last_clean":"2024-04-24T01:43:21.812539+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:43:21.812539+0000","last_undegraded":"2024-04-24T01:43:21.812539+0000","last_fullsized":"2024-04-24T01:43:21.812539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:46.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.252337+0000","last_change":"2024-04-24T01:42:40.787185+0000","last_active":"2024-04-24T01:45:50.252337+0000","last_peered":"2024-04-24T01:45:50.252337+0000","last_clean":"2024-04-24T01:45:50.252337+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:45:50.252337+0000","last_undegraded":"2024-04-24T01:45:50.252337+0000","last_fullsized":"2024-04-24T01:45:50.252337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:54.284107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321632+0000","last_change":"2024-04-24T01:42:42.783384+0000","last_active":"2024-04-24T01:45:50.321632+0000","last_peered":"2024-04-24T01:45:50.321632+0000","last_clean":"2024-04-24T01:45:50.321632+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:45:50.321632+0000","last_undegraded":"2024-04-24T01:45:50.321632+0000","last_fullsized":"2024-04-24T01:45:50.321632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:43.429543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808027+0000","last_change":"2024-04-24T01:42:40.775908+0000","last_active":"2024-04-24T01:43:21.808027+0000","last_peered":"2024-04-24T01:43:21.808027+0000","last_clean":"2024-04-24T01:43:21.808027+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:43:21.808027+0000","last_undegraded":"2024-04-24T01:43:21.808027+0000","last_fullsized":"2024-04-24T01:43:21.808027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.800378+0000","last_change":"2024-04-24T01:43:21.820449+0000","last_active":"2024-04-24T01:44:05.800378+0000","last_peered":"2024-04-24T01:44:05.800378+0000","last_clean":"2024-04-24T01:44:05.800378+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:44:05.800378+0000","last_undegraded":"2024-04-24T01:44:05.800378+0000","last_fullsized":"2024-04-24T01:44:05.800378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:18.138123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812225+0000","last_change":"2024-04-24T01:42:40.785983+0000","last_active":"2024-04-24T01:43:21.812225+0000","last_peered":"2024-04-24T01:43:21.812225+0000","last_clean":"2024-04-24T01:43:21.812225+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:43:21.812225+0000","last_undegraded":"2024-04-24T01:43:21.812225+0000","last_fullsized":"2024-04-24T01:43:21.812225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:42.761936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270804+0000","last_change":"2024-04-24T01:42:42.788032+0000","last_active":"2024-04-24T01:45:50.270804+0000","last_peered":"2024-04-24T01:45:50.270804+0000","last_clean":"2024-04-24T01:45:50.270804+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:45:50.270804+0000","last_undegraded":"2024-04-24T01:45:50.270804+0000","last_fullsized":"2024-04-24T01:45:50.270804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862584+0000","last_change":"2024-04-24T01:42:40.778279+0000","last_active":"2024-04-24T01:43:21.862584+0000","last_peered":"2024-04-24T01:43:21.862584+0000","last_clean":"2024-04-24T01:43:21.862584+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:43:21.862584+0000","last_undegraded":"2024-04-24T01:43:21.862584+0000","last_fullsized":"2024-04-24T01:43:21.862584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:39.530334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138297+0000","last_change":"2024-04-24T01:42:42.789315+0000","last_active":"2024-04-24T01:45:50.138297+0000","last_peered":"2024-04-24T01:45:50.138297+0000","last_clean":"2024-04-24T01:45:50.138297+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:45:50.138297+0000","last_undegraded":"2024-04-24T01:45:50.138297+0000","last_fullsized":"2024-04-24T01:45:50.138297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270574+0000","last_change":"2024-04-24T01:42:42.779841+0000","last_active":"2024-04-24T01:45:50.270574+0000","last_peered":"2024-04-24T01:45:50.270574+0000","last_clean":"2024-04-24T01:45:50.270574+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:45:50.270574+0000","last_undegraded":"2024-04-24T01:45:50.270574+0000","last_fullsized":"2024-04-24T01:45:50.270574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:31.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817068+0000","last_change":"2024-04-24T01:42:40.791488+0000","last_active":"2024-04-24T01:43:21.817068+0000","last_peered":"2024-04-24T01:43:21.817068+0000","last_clean":"2024-04-24T01:43:21.817068+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:43:21.817068+0000","last_undegraded":"2024-04-24T01:43:21.817068+0000","last_fullsized":"2024-04-24T01:43:21.817068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315684+0000","last_change":"2024-04-24T01:42:42.782524+0000","last_active":"2024-04-24T01:45:50.315684+0000","last_peered":"2024-04-24T01:45:50.315684+0000","last_clean":"2024-04-24T01:45:50.315684+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:45:50.315684+0000","last_undegraded":"2024-04-24T01:45:50.315684+0000","last_fullsized":"2024-04-24T01:45:50.315684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:25.756967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811766+0000","last_change":"2024-04-24T01:42:40.784169+0000","last_active":"2024-04-24T01:43:21.811766+0000","last_peered":"2024-04-24T01:43:21.811766+0000","last_clean":"2024-04-24T01:43:21.811766+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:43:21.811766+0000","last_undegraded":"2024-04-24T01:43:21.811766+0000","last_fullsized":"2024-04-24T01:43:21.811766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353379+0000","last_change":"2024-04-24T01:42:42.783807+0000","last_active":"2024-04-24T01:45:50.353379+0000","last_peered":"2024-04-24T01:45:50.353379+0000","last_clean":"2024-04-24T01:45:50.353379+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:45:50.353379+0000","last_undegraded":"2024-04-24T01:45:50.353379+0000","last_fullsized":"2024-04-24T01:45:50.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:04.077606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090155+0000","last_change":"2024-04-24T01:42:40.792423+0000","last_active":"2024-04-24T01:45:06.090155+0000","last_peered":"2024-04-24T01:45:06.090155+0000","last_clean":"2024-04-24T01:45:06.090155+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:45:06.090155+0000","last_undegraded":"2024-04-24T01:45:06.090155+0000","last_fullsized":"2024-04-24T01:45:06.090155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654988+0000","last_change":"2024-04-24T01:42:42.790737+0000","last_active":"2024-04-24T01:44:49.654988+0000","last_peered":"2024-04-24T01:44:49.654988+0000","last_clean":"2024-04-24T01:44:49.654988+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:44:49.654988+0000","last_undegraded":"2024-04-24T01:44:49.654988+0000","last_fullsized":"2024-04-24T01:44:49.654988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:20.557905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.632047+0000","last_change":"2024-04-24T01:42:40.782750+0000","last_active":"2024-04-24T01:44:49.632047+0000","last_peered":"2024-04-24T01:44:49.632047+0000","last_clean":"2024-04-24T01:44:49.632047+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:44:49.632047+0000","last_undegraded":"2024-04-24T01:44:49.632047+0000","last_fullsized":"2024-04-24T01:44:49.632047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270479+0000","last_change":"2024-04-24T01:42:42.790992+0000","last_active":"2024-04-24T01:45:50.270479+0000","last_peered":"2024-04-24T01:45:50.270479+0000","last_clean":"2024-04-24T01:45:50.270479+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:45:50.270479+0000","last_undegraded":"2024-04-24T01:45:50.270479+0000","last_fullsized":"2024-04-24T01:45:50.270479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:12.881341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864678+0000","last_change":"2024-04-24T01:42:40.769585+0000","last_active":"2024-04-24T01:43:21.864678+0000","last_peered":"2024-04-24T01:43:21.864678+0000","last_clean":"2024-04-24T01:43:21.864678+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:43:21.864678+0000","last_undegraded":"2024-04-24T01:43:21.864678+0000","last_fullsized":"2024-04-24T01:43:21.864678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:33:56.281356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137384+0000","last_change":"2024-04-24T01:42:42.784217+0000","last_active":"2024-04-24T01:45:50.137384+0000","last_peered":"2024-04-24T01:45:50.137384+0000","last_clean":"2024-04-24T01:45:50.137384+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:45:50.137384+0000","last_undegraded":"2024-04-24T01:45:50.137384+0000","last_fullsized":"2024-04-24T01:45:50.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:21.185447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.340485+0000","last_change":"2024-04-24T01:42:40.786476+0000","last_active":"2024-04-24T01:45:50.340485+0000","last_peered":"2024-04-24T01:45:50.340485+0000","last_clean":"2024-04-24T01:45:50.340485+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:45:50.340485+0000","last_undegraded":"2024-04-24T01:45:50.340485+0000","last_fullsized":"2024-04-24T01:45:50.340485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:50.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.295799+0000","last_change":"2024-04-24T01:42:50.802941+0000","last_active":"2024-04-24T01:45:50.295799+0000","last_peered":"2024-04-24T01:45:50.295799+0000","last_clean":"2024-04-24T01:45:50.295799+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:45:50.295799+0000","last_undegraded":"2024-04-24T01:45:50.295799+0000","last_fullsized":"2024-04-24T01:45:50.295799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:19.486282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351833+0000","last_change":"2024-04-24T01:42:42.786160+0000","last_active":"2024-04-24T01:45:50.351833+0000","last_peered":"2024-04-24T01:45:50.351833+0000","last_clean":"2024-04-24T01:45:50.351833+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:45:50.351833+0000","last_undegraded":"2024-04-24T01:45:50.351833+0000","last_fullsized":"2024-04-24T01:45:50.351833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:05.195853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791802+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:36.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818082+0000","last_change":"2024-04-24T01:43:21.817222+0000","last_active":"2024-04-24T01:43:21.818082+0000","last_peered":"2024-04-24T01:43:21.818082+0000","last_clean":"2024-04-24T01:43:21.818082+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:43:21.818082+0000","last_undegraded":"2024-04-24T01:43:21.818082+0000","last_fullsized":"2024-04-24T01:43:21.818082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:34.889879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.217678+0000","last_change":"2024-04-24T01:42:46.785609+0000","last_active":"2024-04-24T01:44:48.217678+0000","last_peered":"2024-04-24T01:44:48.217678+0000","last_clean":"2024-04-24T01:44:48.217678+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:44:48.217678+0000","last_undegraded":"2024-04-24T01:44:48.217678+0000","last_fullsized":"2024-04-24T01:44:48.217678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:24.228056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816972+0000","last_change":"2024-04-24T01:42:48.793869+0000","last_active":"2024-04-24T01:43:21.816972+0000","last_peered":"2024-04-24T01:43:21.816972+0000","last_clean":"2024-04-24T01:43:21.816972+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:43:21.816972+0000","last_undegraded":"2024-04-24T01:43:21.816972+0000","last_fullsized":"2024-04-24T01:43:21.816972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:23.315540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.805565+0000","last_change":"2024-04-24T01:42:50.802222+0000","last_active":"2024-04-24T01:44:05.805565+0000","last_peered":"2024-04-24T01:44:05.805565+0000","last_clean":"2024-04-24T01:44:05.805565+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:44:05.805565+0000","last_undegraded":"2024-04-24T01:44:05.805565+0000","last_fullsized":"2024-04-24T01:44:05.805565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:26.157145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.020370+0000","last_change":"2024-04-24T01:42:42.784837+0000","last_active":"2024-04-24T01:44:06.020370+0000","last_peered":"2024-04-24T01:44:06.020370+0000","last_clean":"2024-04-24T01:44:06.020370+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:44:06.020370+0000","last_undegraded":"2024-04-24T01:44:06.020370+0000","last_fullsized":"2024-04-24T01:44:06.020370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:40.033902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.432410+0000","last_change":"2024-04-24T01:42:40.782079+0000","last_active":"2024-04-24T01:43:23.432410+0000","last_peered":"2024-04-24T01:43:23.432410+0000","last_clean":"2024-04-24T01:43:23.432410+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:43:23.432410+0000","last_undegraded":"2024-04-24T01:43:23.432410+0000","last_fullsized":"2024-04-24T01:43:23.432410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863552+0000","last_change":"2024-04-24T01:42:44.776066+0000","last_active":"2024-04-24T01:43:21.863552+0000","last_peered":"2024-04-24T01:43:21.863552+0000","last_clean":"2024-04-24T01:43:21.863552+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:43:21.863552+0000","last_undegraded":"2024-04-24T01:43:21.863552+0000","last_fullsized":"2024-04-24T01:43:21.863552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:21.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814388+0000","last_change":"2024-04-24T01:42:46.778609+0000","last_active":"2024-04-24T01:43:21.814388+0000","last_peered":"2024-04-24T01:43:21.814388+0000","last_clean":"2024-04-24T01:43:21.814388+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:43:21.814388+0000","last_undegraded":"2024-04-24T01:43:21.814388+0000","last_fullsized":"2024-04-24T01:43:21.814388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:18.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814658+0000","last_change":"2024-04-24T01:42:48.790498+0000","last_active":"2024-04-24T01:43:21.814658+0000","last_peered":"2024-04-24T01:43:21.814658+0000","last_clean":"2024-04-24T01:43:21.814658+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:43:21.814658+0000","last_undegraded":"2024-04-24T01:43:21.814658+0000","last_fullsized":"2024-04-24T01:43:21.814658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:35.394375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.749783+0000","last_change":"2024-04-24T01:42:50.793834+0000","last_active":"2024-04-24T01:45:49.749783+0000","last_peered":"2024-04-24T01:45:49.749783+0000","last_clean":"2024-04-24T01:45:49.749783+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:45:49.749783+0000","last_undegraded":"2024-04-24T01:45:49.749783+0000","last_fullsized":"2024-04-24T01:45:49.749783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:58.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'21","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351802+0000","last_change":"2024-04-24T01:42:42.777752+0000","last_active":"2024-04-24T01:45:50.351802+0000","last_peered":"2024-04-24T01:45:50.351802+0000","last_clean":"2024-04-24T01:45:50.351802+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:45:50.351802+0000","last_undegraded":"2024-04-24T01:45:50.351802+0000","last_fullsized":"2024-04-24T01:45:50.351802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:23.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.522600+0000","last_change":"2024-04-24T01:42:40.790240+0000","last_active":"2024-04-24T01:44:49.522600+0000","last_peered":"2024-04-24T01:44:49.522600+0000","last_clean":"2024-04-24T01:44:49.522600+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:44:49.522600+0000","last_undegraded":"2024-04-24T01:44:49.522600+0000","last_fullsized":"2024-04-24T01:44:49.522600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:25.852835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865041+0000","last_change":"2024-04-24T01:42:44.780561+0000","last_active":"2024-04-24T01:43:21.865041+0000","last_peered":"2024-04-24T01:43:21.865041+0000","last_clean":"2024-04-24T01:43:21.865041+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:43:21.865041+0000","last_undegraded":"2024-04-24T01:43:21.865041+0000","last_fullsized":"2024-04-24T01:43:21.865041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:25.708863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810210+0000","last_change":"2024-04-24T01:42:46.780855+0000","last_active":"2024-04-24T01:43:21.810210+0000","last_peered":"2024-04-24T01:43:21.810210+0000","last_clean":"2024-04-24T01:43:21.810210+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:43:21.810210+0000","last_undegraded":"2024-04-24T01:43:21.810210+0000","last_fullsized":"2024-04-24T01:43:21.810210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:13.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.455955+0000","last_change":"2024-04-24T01:42:48.789383+0000","last_active":"2024-04-24T01:45:50.455955+0000","last_peered":"2024-04-24T01:45:50.455955+0000","last_clean":"2024-04-24T01:45:50.455955+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:45:50.455955+0000","last_undegraded":"2024-04-24T01:45:50.455955+0000","last_fullsized":"2024-04-24T01:45:50.455955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:14.292086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.188045+0000","last_change":"2024-04-24T01:42:50.800444+0000","last_active":"2024-04-24T01:43:23.188045+0000","last_peered":"2024-04-24T01:43:23.188045+0000","last_clean":"2024-04-24T01:43:23.188045+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:43:23.188045+0000","last_undegraded":"2024-04-24T01:43:23.188045+0000","last_fullsized":"2024-04-24T01:43:23.188045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506203+0000","last_change":"2024-04-24T01:42:42.785246+0000","last_active":"2024-04-24T01:44:46.506203+0000","last_peered":"2024-04-24T01:44:46.506203+0000","last_clean":"2024-04-24T01:44:46.506203+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:44:46.506203+0000","last_undegraded":"2024-04-24T01:44:46.506203+0000","last_fullsized":"2024-04-24T01:44:46.506203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:37.621286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815603+0000","last_change":"2024-04-24T01:42:40.791168+0000","last_active":"2024-04-24T01:43:21.815603+0000","last_peered":"2024-04-24T01:43:21.815603+0000","last_clean":"2024-04-24T01:43:21.815603+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:43:21.815603+0000","last_undegraded":"2024-04-24T01:43:21.815603+0000","last_fullsized":"2024-04-24T01:43:21.815603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818755+0000","last_change":"2024-04-24T01:43:21.818140+0000","last_active":"2024-04-24T01:43:21.818755+0000","last_peered":"2024-04-24T01:43:21.818755+0000","last_clean":"2024-04-24T01:43:21.818755+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:43:21.818755+0000","last_undegraded":"2024-04-24T01:43:21.818755+0000","last_fullsized":"2024-04-24T01:43:21.818755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:00:16.051162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.212359+0000","last_change":"2024-04-24T01:42:46.784079+0000","last_active":"2024-04-24T01:44:48.212359+0000","last_peered":"2024-04-24T01:44:48.212359+0000","last_clean":"2024-04-24T01:44:48.212359+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:44:48.212359+0000","last_undegraded":"2024-04-24T01:44:48.212359+0000","last_fullsized":"2024-04-24T01:44:48.212359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:07:04.029756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.348346+0000","last_change":"2024-04-24T01:42:48.783790+0000","last_active":"2024-04-24T01:45:50.348346+0000","last_peered":"2024-04-24T01:45:50.348346+0000","last_clean":"2024-04-24T01:45:50.348346+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:45:50.348346+0000","last_undegraded":"2024-04-24T01:45:50.348346+0000","last_fullsized":"2024-04-24T01:45:50.348346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:09.325458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137974+0000","last_change":"2024-04-24T01:42:42.787100+0000","last_active":"2024-04-24T01:45:50.137974+0000","last_peered":"2024-04-24T01:45:50.137974+0000","last_clean":"2024-04-24T01:45:50.137974+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:45:50.137974+0000","last_undegraded":"2024-04-24T01:45:50.137974+0000","last_fullsized":"2024-04-24T01:45:50.137974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:02.956782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334280+0000","last_change":"2024-04-24T01:42:40.780599+0000","last_active":"2024-04-24T01:43:22.334280+0000","last_peered":"2024-04-24T01:43:22.334280+0000","last_clean":"2024-04-24T01:43:22.334280+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:43:22.334280+0000","last_undegraded":"2024-04-24T01:43:22.334280+0000","last_fullsized":"2024-04-24T01:43:22.334280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312638+0000","last_change":"2024-04-24T01:42:44.778111+0000","last_active":"2024-04-24T01:44:49.312638+0000","last_peered":"2024-04-24T01:44:49.312638+0000","last_clean":"2024-04-24T01:44:49.312638+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:44:49.312638+0000","last_undegraded":"2024-04-24T01:44:49.312638+0000","last_fullsized":"2024-04-24T01:44:49.312638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:33.157332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'46","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.221905+0000","last_change":"2024-04-24T01:42:46.779467+0000","last_active":"2024-04-24T01:44:48.221905+0000","last_peered":"2024-04-24T01:44:48.221905+0000","last_clean":"2024-04-24T01:44:48.221905+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:44:48.221905+0000","last_undegraded":"2024-04-24T01:44:48.221905+0000","last_fullsized":"2024-04-24T01:44:48.221905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:35.159479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864048+0000","last_change":"2024-04-24T01:42:48.784060+0000","last_active":"2024-04-24T01:43:21.864048+0000","last_peered":"2024-04-24T01:43:21.864048+0000","last_clean":"2024-04-24T01:43:21.864048+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:43:21.864048+0000","last_undegraded":"2024-04-24T01:43:21.864048+0000","last_fullsized":"2024-04-24T01:43:21.864048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:03.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.807187+0000","last_change":"2024-04-24T01:42:50.799924+0000","last_active":"2024-04-24T01:44:05.807187+0000","last_peered":"2024-04-24T01:44:05.807187+0000","last_clean":"2024-04-24T01:44:05.807187+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:44:05.807187+0000","last_undegraded":"2024-04-24T01:44:05.807187+0000","last_fullsized":"2024-04-24T01:44:05.807187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:09.299604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.017080+0000","last_change":"2024-04-24T01:42:42.781439+0000","last_active":"2024-04-24T01:44:06.017080+0000","last_peered":"2024-04-24T01:44:06.017080+0000","last_clean":"2024-04-24T01:44:06.017080+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:44:06.017080+0000","last_undegraded":"2024-04-24T01:44:06.017080+0000","last_fullsized":"2024-04-24T01:44:06.017080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:12.726720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811228+0000","last_change":"2024-04-24T01:42:40.777460+0000","last_active":"2024-04-24T01:43:21.811228+0000","last_peered":"2024-04-24T01:43:21.811228+0000","last_clean":"2024-04-24T01:43:21.811228+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:43:21.811228+0000","last_undegraded":"2024-04-24T01:43:21.811228+0000","last_fullsized":"2024-04-24T01:43:21.811228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:49.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862742+0000","last_change":"2024-04-24T01:42:44.775818+0000","last_active":"2024-04-24T01:43:21.862742+0000","last_peered":"2024-04-24T01:43:21.862742+0000","last_clean":"2024-04-24T01:43:21.862742+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:43:21.862742+0000","last_undegraded":"2024-04-24T01:43:21.862742+0000","last_fullsized":"2024-04-24T01:43:21.862742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:05.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.055415+0000","last_change":"2024-04-24T01:42:46.779918+0000","last_active":"2024-04-24T01:45:50.055415+0000","last_peered":"2024-04-24T01:45:50.055415+0000","last_clean":"2024-04-24T01:45:50.055415+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:45:50.055415+0000","last_undegraded":"2024-04-24T01:45:50.055415+0000","last_fullsized":"2024-04-24T01:45:50.055415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:59.779931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862428+0000","last_change":"2024-04-24T01:42:48.788792+0000","last_active":"2024-04-24T01:43:21.862428+0000","last_peered":"2024-04-24T01:43:21.862428+0000","last_clean":"2024-04-24T01:43:21.862428+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:43:21.862428+0000","last_undegraded":"2024-04-24T01:43:21.862428+0000","last_fullsized":"2024-04-24T01:43:21.862428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.253658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:00.287330+0000","last_change":"2024-04-24T01:42:50.797194+0000","last_active":"2024-04-24T01:44:00.287330+0000","last_peered":"2024-04-24T01:44:00.287330+0000","last_clean":"2024-04-24T01:44:00.287330+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:44:00.287330+0000","last_undegraded":"2024-04-24T01:44:00.287330+0000","last_fullsized":"2024-04-24T01:44:00.287330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:13.552621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.279399+0000","last_change":"2024-04-24T01:42:42.790042+0000","last_active":"2024-04-24T01:45:50.279399+0000","last_peered":"2024-04-24T01:45:50.279399+0000","last_clean":"2024-04-24T01:45:50.279399+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:45:50.279399+0000","last_undegraded":"2024-04-24T01:45:50.279399+0000","last_fullsized":"2024-04-24T01:45:50.279399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:06.040706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814459+0000","last_change":"2024-04-24T01:42:40.790278+0000","last_active":"2024-04-24T01:43:21.814459+0000","last_peered":"2024-04-24T01:43:21.814459+0000","last_clean":"2024-04-24T01:43:21.814459+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:43:21.814459+0000","last_undegraded":"2024-04-24T01:43:21.814459+0000","last_fullsized":"2024-04-24T01:43:21.814459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:52.256340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865715+0000","last_change":"2024-04-24T01:42:44.776056+0000","last_active":"2024-04-24T01:43:21.865715+0000","last_peered":"2024-04-24T01:43:21.865715+0000","last_clean":"2024-04-24T01:43:21.865715+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:43:21.865715+0000","last_undegraded":"2024-04-24T01:43:21.865715+0000","last_fullsized":"2024-04-24T01:43:21.865715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:41.981588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'50","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.223861+0000","last_change":"2024-04-24T01:42:46.778746+0000","last_active":"2024-04-24T01:44:48.223861+0000","last_peered":"2024-04-24T01:44:48.223861+0000","last_clean":"2024-04-24T01:44:48.223861+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:44:48.223861+0000","last_undegraded":"2024-04-24T01:44:48.223861+0000","last_fullsized":"2024-04-24T01:44:48.223861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:42:45.514004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.464970+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:45:50.464970+0000","last_peered":"2024-04-24T01:45:50.464970+0000","last_clean":"2024-04-24T01:45:50.464970+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:45:50.464970+0000","last_undegraded":"2024-04-24T01:45:50.464970+0000","last_fullsized":"2024-04-24T01:45:50.464970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:47.496571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.808097+0000","last_change":"2024-04-24T01:42:50.794892+0000","last_active":"2024-04-24T01:43:22.808097+0000","last_peered":"2024-04-24T01:43:22.808097+0000","last_clean":"2024-04-24T01:43:22.808097+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:43:22.808097+0000","last_undegraded":"2024-04-24T01:43:22.808097+0000","last_fullsized":"2024-04-24T01:43:22.808097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:09.754900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.453036+0000","last_change":"2024-04-24T01:42:42.778719+0000","last_active":"2024-04-24T01:43:23.453036+0000","last_peered":"2024-04-24T01:43:23.453036+0000","last_clean":"2024-04-24T01:43:23.453036+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:43:23.453036+0000","last_undegraded":"2024-04-24T01:43:23.453036+0000","last_fullsized":"2024-04-24T01:43:23.453036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:31.558960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811441+0000","last_change":"2024-04-24T01:42:40.776747+0000","last_active":"2024-04-24T01:43:21.811441+0000","last_peered":"2024-04-24T01:43:21.811441+0000","last_clean":"2024-04-24T01:43:21.811441+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:43:21.811441+0000","last_undegraded":"2024-04-24T01:43:21.811441+0000","last_fullsized":"2024-04-24T01:43:21.811441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:04.407692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862746+0000","last_change":"2024-04-24T01:42:44.775830+0000","last_active":"2024-04-24T01:43:21.862746+0000","last_peered":"2024-04-24T01:43:21.862746+0000","last_clean":"2024-04-24T01:43:21.862746+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:43:21.862746+0000","last_undegraded":"2024-04-24T01:43:21.862746+0000","last_fullsized":"2024-04-24T01:43:21.862746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:41.803290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.225733+0000","last_change":"2024-04-24T01:42:46.782288+0000","last_active":"2024-04-24T01:44:48.225733+0000","last_peered":"2024-04-24T01:44:48.225733+0000","last_clean":"2024-04-24T01:44:48.225733+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:44:48.225733+0000","last_undegraded":"2024-04-24T01:44:48.225733+0000","last_fullsized":"2024-04-24T01:44:48.225733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862182+0000","last_change":"2024-04-24T01:42:48.794747+0000","last_active":"2024-04-24T01:43:21.862182+0000","last_peered":"2024-04-24T01:43:21.862182+0000","last_clean":"2024-04-24T01:43:21.862182+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:43:21.862182+0000","last_undegraded":"2024-04-24T01:43:21.862182+0000","last_fullsized":"2024-04-24T01:43:21.862182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:37.208241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.442897+0000","last_change":"2024-04-24T01:42:50.802460+0000","last_active":"2024-04-24T01:45:50.442897+0000","last_peered":"2024-04-24T01:45:50.442897+0000","last_clean":"2024-04-24T01:45:50.442897+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:45:50.442897+0000","last_undegraded":"2024-04-24T01:45:50.442897+0000","last_fullsized":"2024-04-24T01:45:50.442897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:30.284232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315664+0000","last_change":"2024-04-24T01:42:42.783715+0000","last_active":"2024-04-24T01:45:50.315664+0000","last_peered":"2024-04-24T01:45:50.315664+0000","last_clean":"2024-04-24T01:45:50.315664+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:45:50.315664+0000","last_undegraded":"2024-04-24T01:45:50.315664+0000","last_fullsized":"2024-04-24T01:45:50.315664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:20.736658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863777+0000","last_change":"2024-04-24T01:42:40.780994+0000","last_active":"2024-04-24T01:43:21.863777+0000","last_peered":"2024-04-24T01:43:21.863777+0000","last_clean":"2024-04-24T01:43:21.863777+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:43:21.863777+0000","last_undegraded":"2024-04-24T01:43:21.863777+0000","last_fullsized":"2024-04-24T01:43:21.863777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:37.569542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809308+0000","last_change":"2024-04-24T01:42:44.778275+0000","last_active":"2024-04-24T01:43:21.809308+0000","last_peered":"2024-04-24T01:43:21.809308+0000","last_clean":"2024-04-24T01:43:21.809308+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:43:21.809308+0000","last_undegraded":"2024-04-24T01:43:21.809308+0000","last_fullsized":"2024-04-24T01:43:21.809308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.192699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.205713+0000","last_change":"2024-04-24T01:42:46.778607+0000","last_active":"2024-04-24T01:44:48.205713+0000","last_peered":"2024-04-24T01:44:48.205713+0000","last_clean":"2024-04-24T01:44:48.205713+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:44:48.205713+0000","last_undegraded":"2024-04-24T01:44:48.205713+0000","last_fullsized":"2024-04-24T01:44:48.205713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:23.477131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813319+0000","last_change":"2024-04-24T01:42:48.790228+0000","last_active":"2024-04-24T01:43:21.813319+0000","last_peered":"2024-04-24T01:43:21.813319+0000","last_clean":"2024-04-24T01:43:21.813319+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:43:21.813319+0000","last_undegraded":"2024-04-24T01:43:21.813319+0000","last_fullsized":"2024-04-24T01:43:21.813319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:17.814113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087985+0000","last_change":"2024-04-24T01:42:50.799183+0000","last_active":"2024-04-24T01:44:51.087985+0000","last_peered":"2024-04-24T01:44:51.087985+0000","last_clean":"2024-04-24T01:44:51.087985+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:44:51.087985+0000","last_undegraded":"2024-04-24T01:44:51.087985+0000","last_fullsized":"2024-04-24T01:44:51.087985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:14.732138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399594+0000","last_change":"2024-04-24T01:42:42.783267+0000","last_active":"2024-04-24T01:45:50.399594+0000","last_peered":"2024-04-24T01:45:50.399594+0000","last_clean":"2024-04-24T01:45:50.399594+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:45:50.399594+0000","last_undegraded":"2024-04-24T01:45:50.399594+0000","last_fullsized":"2024-04-24T01:45:50.399594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:41.395053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.441523+0000","last_change":"2024-04-24T01:42:40.790965+0000","last_active":"2024-04-24T01:43:23.441523+0000","last_peered":"2024-04-24T01:43:23.441523+0000","last_clean":"2024-04-24T01:43:23.441523+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:43:23.441523+0000","last_undegraded":"2024-04-24T01:43:23.441523+0000","last_fullsized":"2024-04-24T01:43:23.441523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:10.970016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863141+0000","last_change":"2024-04-24T01:42:44.776243+0000","last_active":"2024-04-24T01:43:21.863141+0000","last_peered":"2024-04-24T01:43:21.863141+0000","last_clean":"2024-04-24T01:43:21.863141+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:43:21.863141+0000","last_undegraded":"2024-04-24T01:43:21.863141+0000","last_fullsized":"2024-04-24T01:43:21.863141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:59.166147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.232605+0000","last_change":"2024-04-24T01:42:46.770097+0000","last_active":"2024-04-24T01:44:48.232605+0000","last_peered":"2024-04-24T01:44:48.232605+0000","last_clean":"2024-04-24T01:44:48.232605+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:44:48.232605+0000","last_undegraded":"2024-04-24T01:44:48.232605+0000","last_fullsized":"2024-04-24T01:44:48.232605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:06.966181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.446644+0000","last_change":"2024-04-24T01:42:48.794733+0000","last_active":"2024-04-24T01:45:50.446644+0000","last_peered":"2024-04-24T01:45:50.446644+0000","last_clean":"2024-04-24T01:45:50.446644+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:45:50.446644+0000","last_undegraded":"2024-04-24T01:45:50.446644+0000","last_fullsized":"2024-04-24T01:45:50.446644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:25.479779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084036+0000","last_change":"2024-04-24T01:42:50.793825+0000","last_active":"2024-04-24T01:44:59.084036+0000","last_peered":"2024-04-24T01:44:59.084036+0000","last_clean":"2024-04-24T01:44:59.084036+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:44:59.084036+0000","last_undegraded":"2024-04-24T01:44:59.084036+0000","last_fullsized":"2024-04-24T01:44:59.084036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:33.276602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270904+0000","last_change":"2024-04-24T01:42:42.790926+0000","last_active":"2024-04-24T01:45:50.270904+0000","last_peered":"2024-04-24T01:45:50.270904+0000","last_clean":"2024-04-24T01:45:50.270904+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:45:50.270904+0000","last_undegraded":"2024-04-24T01:45:50.270904+0000","last_fullsized":"2024-04-24T01:45:50.270904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812785+0000","last_change":"2024-04-24T01:42:40.789191+0000","last_active":"2024-04-24T01:43:21.812785+0000","last_peered":"2024-04-24T01:43:21.812785+0000","last_clean":"2024-04-24T01:43:21.812785+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:43:21.812785+0000","last_undegraded":"2024-04-24T01:43:21.812785+0000","last_fullsized":"2024-04-24T01:43:21.812785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:37.925439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312396+0000","last_change":"2024-04-24T01:42:44.776093+0000","last_active":"2024-04-24T01:44:49.312396+0000","last_peered":"2024-04-24T01:44:49.312396+0000","last_clean":"2024-04-24T01:44:49.312396+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:44:49.312396+0000","last_undegraded":"2024-04-24T01:44:49.312396+0000","last_fullsized":"2024-04-24T01:44:49.312396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:07.203105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812310+0000","last_change":"2024-04-24T01:42:46.782280+0000","last_active":"2024-04-24T01:43:21.812310+0000","last_peered":"2024-04-24T01:43:21.812310+0000","last_clean":"2024-04-24T01:43:21.812310+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:43:21.812310+0000","last_undegraded":"2024-04-24T01:43:21.812310+0000","last_fullsized":"2024-04-24T01:43:21.812310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:26.243203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.402880+0000","last_change":"2024-04-24T01:42:48.791028+0000","last_active":"2024-04-24T01:45:50.402880+0000","last_peered":"2024-04-24T01:45:50.402880+0000","last_clean":"2024-04-24T01:45:50.402880+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:45:50.402880+0000","last_undegraded":"2024-04-24T01:45:50.402880+0000","last_fullsized":"2024-04-24T01:45:50.402880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:02.110375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.318221+0000","last_change":"2024-04-24T01:42:50.796703+0000","last_active":"2024-04-24T01:45:50.318221+0000","last_peered":"2024-04-24T01:45:50.318221+0000","last_clean":"2024-04-24T01:45:50.318221+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:45:50.318221+0000","last_undegraded":"2024-04-24T01:45:50.318221+0000","last_fullsized":"2024-04-24T01:45:50.318221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:51.030865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353512+0000","last_change":"2024-04-24T01:42:42.791687+0000","last_active":"2024-04-24T01:45:50.353512+0000","last_peered":"2024-04-24T01:45:50.353512+0000","last_clean":"2024-04-24T01:45:50.353512+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:45:50.353512+0000","last_undegraded":"2024-04-24T01:45:50.353512+0000","last_fullsized":"2024-04-24T01:45:50.353512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:02:24.201055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.791074+0000","last_change":"2024-04-24T01:42:40.787611+0000","last_active":"2024-04-24T01:44:05.791074+0000","last_peered":"2024-04-24T01:44:05.791074+0000","last_clean":"2024-04-24T01:44:05.791074+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:44:05.791074+0000","last_undegraded":"2024-04-24T01:44:05.791074+0000","last_fullsized":"2024-04-24T01:44:05.791074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:04.033349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814496+0000","last_change":"2024-04-24T01:42:44.777294+0000","last_active":"2024-04-24T01:43:21.814496+0000","last_peered":"2024-04-24T01:43:21.814496+0000","last_clean":"2024-04-24T01:43:21.814496+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:43:21.814496+0000","last_undegraded":"2024-04-24T01:43:21.814496+0000","last_fullsized":"2024-04-24T01:43:21.814496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:11.779877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.218762+0000","last_change":"2024-04-24T01:42:46.779272+0000","last_active":"2024-04-24T01:44:48.218762+0000","last_peered":"2024-04-24T01:44:48.218762+0000","last_clean":"2024-04-24T01:44:48.218762+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:44:48.218762+0000","last_undegraded":"2024-04-24T01:44:48.218762+0000","last_fullsized":"2024-04-24T01:44:48.218762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:45.404452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810071+0000","last_change":"2024-04-24T01:42:48.790268+0000","last_active":"2024-04-24T01:43:21.810071+0000","last_peered":"2024-04-24T01:43:21.810071+0000","last_clean":"2024-04-24T01:43:21.810071+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:43:21.810071+0000","last_undegraded":"2024-04-24T01:43:21.810071+0000","last_fullsized":"2024-04-24T01:43:21.810071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:46.045950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.378677+0000","last_change":"2024-04-24T01:42:50.798885+0000","last_active":"2024-04-24T01:45:50.378677+0000","last_peered":"2024-04-24T01:45:50.378677+0000","last_clean":"2024-04-24T01:45:50.378677+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:45:50.378677+0000","last_undegraded":"2024-04-24T01:45:50.378677+0000","last_fullsized":"2024-04-24T01:45:50.378677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:18:00.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270588+0000","last_change":"2024-04-24T01:42:42.787563+0000","last_active":"2024-04-24T01:45:50.270588+0000","last_peered":"2024-04-24T01:45:50.270588+0000","last_clean":"2024-04-24T01:45:50.270588+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:45:50.270588+0000","last_undegraded":"2024-04-24T01:45:50.270588+0000","last_fullsized":"2024-04-24T01:45:50.270588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:54.554156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815596+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:43:21.815596+0000","last_peered":"2024-04-24T01:43:21.815596+0000","last_clean":"2024-04-24T01:43:21.815596+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:43:21.815596+0000","last_undegraded":"2024-04-24T01:43:21.815596+0000","last_fullsized":"2024-04-24T01:43:21.815596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:54.970096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812194+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:43:21.812194+0000","last_peered":"2024-04-24T01:43:21.812194+0000","last_clean":"2024-04-24T01:43:21.812194+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:43:21.812194+0000","last_undegraded":"2024-04-24T01:43:21.812194+0000","last_fullsized":"2024-04-24T01:43:21.812194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:50.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811274+0000","last_change":"2024-04-24T01:42:40.787192+0000","last_active":"2024-04-24T01:43:21.811274+0000","last_peered":"2024-04-24T01:43:21.811274+0000","last_clean":"2024-04-24T01:43:21.811274+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:43:21.811274+0000","last_undegraded":"2024-04-24T01:43:21.811274+0000","last_fullsized":"2024-04-24T01:43:21.811274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:51.864862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817451+0000","last_change":"2024-04-24T01:42:44.776026+0000","last_active":"2024-04-24T01:43:21.817451+0000","last_peered":"2024-04-24T01:43:21.817451+0000","last_clean":"2024-04-24T01:43:21.817451+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:43:21.817451+0000","last_undegraded":"2024-04-24T01:43:21.817451+0000","last_fullsized":"2024-04-24T01:43:21.817451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:43.659940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'82","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.230340+0000","last_change":"2024-04-24T01:42:46.785058+0000","last_active":"2024-04-24T01:44:48.230340+0000","last_peered":"2024-04-24T01:44:48.230340+0000","last_clean":"2024-04-24T01:44:48.230340+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:44:48.230340+0000","last_undegraded":"2024-04-24T01:44:48.230340+0000","last_fullsized":"2024-04-24T01:44:48.230340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:09.881326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864430+0000","last_change":"2024-04-24T01:42:48.793592+0000","last_active":"2024-04-24T01:43:21.864430+0000","last_peered":"2024-04-24T01:43:21.864430+0000","last_clean":"2024-04-24T01:43:21.864430+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:43:21.864430+0000","last_undegraded":"2024-04-24T01:43:21.864430+0000","last_fullsized":"2024-04-24T01:43:21.864430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:15.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.355879+0000","last_change":"2024-04-24T01:42:50.792016+0000","last_active":"2024-04-24T01:45:50.355879+0000","last_peered":"2024-04-24T01:45:50.355879+0000","last_clean":"2024-04-24T01:45:50.355879+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:45:50.355879+0000","last_undegraded":"2024-04-24T01:45:50.355879+0000","last_fullsized":"2024-04-24T01:45:50.355879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:14.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654646+0000","last_change":"2024-04-24T01:42:42.786097+0000","last_active":"2024-04-24T01:44:49.654646+0000","last_peered":"2024-04-24T01:44:49.654646+0000","last_clean":"2024-04-24T01:44:49.654646+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:44:49.654646+0000","last_undegraded":"2024-04-24T01:44:49.654646+0000","last_fullsized":"2024-04-24T01:44:49.654646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:44.030398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809847+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:43:21.809847+0000","last_peered":"2024-04-24T01:43:21.809847+0000","last_clean":"2024-04-24T01:43:21.809847+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:43:21.809847+0000","last_undegraded":"2024-04-24T01:43:21.809847+0000","last_fullsized":"2024-04-24T01:43:21.809847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:29.896910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862322+0000","last_change":"2024-04-24T01:42:40.781303+0000","last_active":"2024-04-24T01:43:21.862322+0000","last_peered":"2024-04-24T01:43:21.862322+0000","last_clean":"2024-04-24T01:43:21.862322+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:43:21.862322+0000","last_undegraded":"2024-04-24T01:43:21.862322+0000","last_fullsized":"2024-04-24T01:43:21.862322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:59.215704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814458+0000","last_change":"2024-04-24T01:42:44.777664+0000","last_active":"2024-04-24T01:43:21.814458+0000","last_peered":"2024-04-24T01:43:21.814458+0000","last_clean":"2024-04-24T01:43:21.814458+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:43:21.814458+0000","last_undegraded":"2024-04-24T01:43:21.814458+0000","last_fullsized":"2024-04-24T01:43:21.814458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:08.483048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853754+0000","last_change":"2024-04-24T01:42:46.782817+0000","last_active":"2024-04-24T01:45:49.853754+0000","last_peered":"2024-04-24T01:45:49.853754+0000","last_clean":"2024-04-24T01:45:49.853754+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:45:49.853754+0000","last_undegraded":"2024-04-24T01:45:49.853754+0000","last_fullsized":"2024-04-24T01:45:49.853754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:27.024858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812247+0000","last_change":"2024-04-24T01:42:48.789708+0000","last_active":"2024-04-24T01:43:21.812247+0000","last_peered":"2024-04-24T01:43:21.812247+0000","last_clean":"2024-04-24T01:43:21.812247+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:43:21.812247+0000","last_undegraded":"2024-04-24T01:43:21.812247+0000","last_fullsized":"2024-04-24T01:43:21.812247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:49.899834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.803771+0000","last_change":"2024-04-24T01:42:50.795739+0000","last_active":"2024-04-24T01:44:05.803771+0000","last_peered":"2024-04-24T01:44:05.803771+0000","last_clean":"2024-04-24T01:44:05.803771+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:44:05.803771+0000","last_undegraded":"2024-04-24T01:44:05.803771+0000","last_fullsized":"2024-04-24T01:44:05.803771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:11:53.190598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864709+0000","last_change":"2024-04-24T01:42:42.783605+0000","last_active":"2024-04-24T01:43:21.864709+0000","last_peered":"2024-04-24T01:43:21.864709+0000","last_clean":"2024-04-24T01:43:21.864709+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:43:21.864709+0000","last_undegraded":"2024-04-24T01:43:21.864709+0000","last_fullsized":"2024-04-24T01:43:21.864709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:05.066861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807726+0000","last_change":"2024-04-24T01:42:32.739720+0000","last_active":"2024-04-24T01:43:21.807726+0000","last_peered":"2024-04-24T01:43:21.807726+0000","last_clean":"2024-04-24T01:43:21.807726+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:43:21.807726+0000","last_undegraded":"2024-04-24T01:43:21.807726+0000","last_fullsized":"2024-04-24T01:43:21.807726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.270545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.255333+0000","last_change":"2024-04-24T01:42:40.769426+0000","last_active":"2024-04-24T01:45:50.255333+0000","last_peered":"2024-04-24T01:45:50.255333+0000","last_clean":"2024-04-24T01:45:50.255333+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:45:50.255333+0000","last_undegraded":"2024-04-24T01:45:50.255333+0000","last_fullsized":"2024-04-24T01:45:50.255333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:24.208037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811063+0000","last_change":"2024-04-24T01:42:44.768708+0000","last_active":"2024-04-24T01:43:21.811063+0000","last_peered":"2024-04-24T01:43:21.811063+0000","last_clean":"2024-04-24T01:43:21.811063+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:43:21.811063+0000","last_undegraded":"2024-04-24T01:43:21.811063+0000","last_fullsized":"2024-04-24T01:43:21.811063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:22.037850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853586+0000","last_change":"2024-04-24T01:42:46.780747+0000","last_active":"2024-04-24T01:45:49.853586+0000","last_peered":"2024-04-24T01:45:49.853586+0000","last_clean":"2024-04-24T01:45:49.853586+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:45:49.853586+0000","last_undegraded":"2024-04-24T01:45:49.853586+0000","last_fullsized":"2024-04-24T01:45:49.853586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:35.740405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863693+0000","last_change":"2024-04-24T01:42:48.793578+0000","last_active":"2024-04-24T01:43:21.863693+0000","last_peered":"2024-04-24T01:43:21.863693+0000","last_clean":"2024-04-24T01:43:21.863693+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:43:21.863693+0000","last_undegraded":"2024-04-24T01:43:21.863693+0000","last_fullsized":"2024-04-24T01:43:21.863693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:53.516063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810739+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:43:21.810739+0000","last_peered":"2024-04-24T01:43:21.810739+0000","last_clean":"2024-04-24T01:43:21.810739+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:43:21.810739+0000","last_undegraded":"2024-04-24T01:43:21.810739+0000","last_fullsized":"2024-04-24T01:43:21.810739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:35.532430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864702+0000","last_change":"2024-04-24T01:42:42.775667+0000","last_active":"2024-04-24T01:43:21.864702+0000","last_peered":"2024-04-24T01:43:21.864702+0000","last_clean":"2024-04-24T01:43:21.864702+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:43:21.864702+0000","last_undegraded":"2024-04-24T01:43:21.864702+0000","last_fullsized":"2024-04-24T01:43:21.864702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:37.338206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811072+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:43:21.811072+0000","last_peered":"2024-04-24T01:43:21.811072+0000","last_clean":"2024-04-24T01:43:21.811072+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:43:21.811072+0000","last_undegraded":"2024-04-24T01:43:21.811072+0000","last_fullsized":"2024-04-24T01:43:21.811072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:23.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.787552+0000","last_change":"2024-04-24T01:42:40.769234+0000","last_active":"2024-04-24T01:43:22.787552+0000","last_peered":"2024-04-24T01:43:22.787552+0000","last_clean":"2024-04-24T01:43:22.787552+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:43:22.787552+0000","last_undegraded":"2024-04-24T01:43:22.787552+0000","last_fullsized":"2024-04-24T01:43:22.787552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864632+0000","last_change":"2024-04-24T01:42:44.778281+0000","last_active":"2024-04-24T01:43:21.864632+0000","last_peered":"2024-04-24T01:43:21.864632+0000","last_clean":"2024-04-24T01:43:21.864632+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:43:21.864632+0000","last_undegraded":"2024-04-24T01:43:21.864632+0000","last_fullsized":"2024-04-24T01:43:21.864632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:36.551915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.667766+0000","last_change":"2024-04-24T01:42:46.783117+0000","last_active":"2024-04-24T01:45:49.667766+0000","last_peered":"2024-04-24T01:45:49.667766+0000","last_clean":"2024-04-24T01:45:49.667766+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:45:49.667766+0000","last_undegraded":"2024-04-24T01:45:49.667766+0000","last_fullsized":"2024-04-24T01:45:49.667766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:06.561328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813544+0000","last_change":"2024-04-24T01:42:48.789629+0000","last_active":"2024-04-24T01:43:21.813544+0000","last_peered":"2024-04-24T01:43:21.813544+0000","last_clean":"2024-04-24T01:43:21.813544+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:43:21.813544+0000","last_undegraded":"2024-04-24T01:43:21.813544+0000","last_fullsized":"2024-04-24T01:43:21.813544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:25.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.420833+0000","last_change":"2024-04-24T01:42:50.802434+0000","last_active":"2024-04-24T01:44:49.420833+0000","last_peered":"2024-04-24T01:44:49.420833+0000","last_clean":"2024-04-24T01:44:49.420833+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:44:49.420833+0000","last_undegraded":"2024-04-24T01:44:49.420833+0000","last_fullsized":"2024-04-24T01:44:49.420833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.519476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506812+0000","last_change":"2024-04-24T01:42:42.783375+0000","last_active":"2024-04-24T01:44:46.506812+0000","last_peered":"2024-04-24T01:44:46.506812+0000","last_clean":"2024-04-24T01:44:46.506812+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:44:46.506812+0000","last_undegraded":"2024-04-24T01:44:46.506812+0000","last_fullsized":"2024-04-24T01:44:46.506812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:53.032722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.496293+0000","last_change":"2024-04-24T01:42:40.774629+0000","last_active":"2024-04-24T01:44:49.496293+0000","last_peered":"2024-04-24T01:44:49.496293+0000","last_clean":"2024-04-24T01:44:49.496293+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:44:49.496293+0000","last_undegraded":"2024-04-24T01:44:49.496293+0000","last_fullsized":"2024-04-24T01:44:49.496293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863436+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:43:21.863436+0000","last_peered":"2024-04-24T01:43:21.863436+0000","last_clean":"2024-04-24T01:43:21.863436+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:43:21.863436+0000","last_undegraded":"2024-04-24T01:43:21.863436+0000","last_fullsized":"2024-04-24T01:43:21.863436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:38.785738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:31.093588+0000","last_change":"2024-04-24T01:43:21.814238+0000","last_active":"2024-04-24T01:45:31.093588+0000","last_peered":"2024-04-24T01:45:31.093588+0000","last_clean":"2024-04-24T01:45:31.093588+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:45:31.093588+0000","last_undegraded":"2024-04-24T01:45:31.093588+0000","last_fullsized":"2024-04-24T01:45:31.093588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:13.474511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'75","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082491+0000","last_change":"2024-04-24T01:42:46.779689+0000","last_active":"2024-04-24T01:44:49.082491+0000","last_peered":"2024-04-24T01:44:49.082491+0000","last_clean":"2024-04-24T01:44:49.082491+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:44:49.082491+0000","last_undegraded":"2024-04-24T01:44:49.082491+0000","last_fullsized":"2024-04-24T01:44:49.082491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:19.052361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":84,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808841+0000","last_change":"2024-04-24T01:42:48.792847+0000","last_active":"2024-04-24T01:43:21.808841+0000","last_peered":"2024-04-24T01:43:21.808841+0000","last_clean":"2024-04-24T01:43:21.808841+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:43:21.808841+0000","last_undegraded":"2024-04-24T01:43:21.808841+0000","last_fullsized":"2024-04-24T01:43:21.808841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:50.042446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.595124+0000","last_change":"2024-04-24T01:42:50.793302+0000","last_active":"2024-04-24T01:44:49.595124+0000","last_peered":"2024-04-24T01:44:49.595124+0000","last_clean":"2024-04-24T01:44:49.595124+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:44:49.595124+0000","last_undegraded":"2024-04-24T01:44:49.595124+0000","last_fullsized":"2024-04-24T01:44:49.595124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:08:15.582676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137934+0000","last_change":"2024-04-24T01:42:42.789819+0000","last_active":"2024-04-24T01:45:50.137934+0000","last_peered":"2024-04-24T01:45:50.137934+0000","last_clean":"2024-04-24T01:45:50.137934+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:45:50.137934+0000","last_undegraded":"2024-04-24T01:45:50.137934+0000","last_fullsized":"2024-04-24T01:45:50.137934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:13.290315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.435621+0000","last_change":"2024-04-24T01:42:40.778312+0000","last_active":"2024-04-24T01:43:23.435621+0000","last_peered":"2024-04-24T01:43:23.435621+0000","last_clean":"2024-04-24T01:43:23.435621+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:43:23.435621+0000","last_undegraded":"2024-04-24T01:43:23.435621+0000","last_fullsized":"2024-04-24T01:43:23.435621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:05.002271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813065+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:43:21.813065+0000","last_peered":"2024-04-24T01:43:21.813065+0000","last_clean":"2024-04-24T01:43:21.813065+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:43:21.813065+0000","last_undegraded":"2024-04-24T01:43:21.813065+0000","last_fullsized":"2024-04-24T01:43:21.813065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:28.855827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810966+0000","last_change":"2024-04-24T01:42:44.773194+0000","last_active":"2024-04-24T01:43:21.810966+0000","last_peered":"2024-04-24T01:43:21.810966+0000","last_clean":"2024-04-24T01:43:21.810966+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:43:21.810966+0000","last_undegraded":"2024-04-24T01:43:21.810966+0000","last_fullsized":"2024-04-24T01:43:21.810966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:31.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.021595+0000","last_change":"2024-04-24T01:42:46.780073+0000","last_active":"2024-04-24T01:44:06.021595+0000","last_peered":"2024-04-24T01:44:06.021595+0000","last_clean":"2024-04-24T01:44:06.021595+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:44:06.021595+0000","last_undegraded":"2024-04-24T01:44:06.021595+0000","last_fullsized":"2024-04-24T01:44:06.021595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:58.563555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853489+0000","last_change":"2024-04-24T01:42:48.794484+0000","last_active":"2024-04-24T01:45:49.853489+0000","last_peered":"2024-04-24T01:45:49.853489+0000","last_clean":"2024-04-24T01:45:49.853489+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:45:49.853489+0000","last_undegraded":"2024-04-24T01:45:49.853489+0000","last_fullsized":"2024-04-24T01:45:49.853489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:07.370372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813179+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:43:21.813179+0000","last_peered":"2024-04-24T01:43:21.813179+0000","last_clean":"2024-04-24T01:43:21.813179+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:43:21.813179+0000","last_undegraded":"2024-04-24T01:43:21.813179+0000","last_fullsized":"2024-04-24T01:43:21.813179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:33.848940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345353+0000","last_change":"2024-04-24T01:42:42.788049+0000","last_active":"2024-04-24T01:45:50.345353+0000","last_peered":"2024-04-24T01:45:50.345353+0000","last_clean":"2024-04-24T01:45:50.345353+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:45:50.345353+0000","last_undegraded":"2024-04-24T01:45:50.345353+0000","last_fullsized":"2024-04-24T01:45:50.345353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:57.647339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814304+0000","last_change":"2024-04-24T01:42:40.786621+0000","last_active":"2024-04-24T01:43:21.814304+0000","last_peered":"2024-04-24T01:43:21.814304+0000","last_clean":"2024-04-24T01:43:21.814304+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:43:21.814304+0000","last_undegraded":"2024-04-24T01:43:21.814304+0000","last_fullsized":"2024-04-24T01:43:21.814304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:23.749610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864853+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:43:21.864853+0000","last_peered":"2024-04-24T01:43:21.864853+0000","last_clean":"2024-04-24T01:43:21.864853+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:43:21.864853+0000","last_undegraded":"2024-04-24T01:43:21.864853+0000","last_fullsized":"2024-04-24T01:43:21.864853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:49.159738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813003+0000","last_change":"2024-04-24T01:42:44.777271+0000","last_active":"2024-04-24T01:43:21.813003+0000","last_peered":"2024-04-24T01:43:21.813003+0000","last_clean":"2024-04-24T01:43:21.813003+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:43:21.813003+0000","last_undegraded":"2024-04-24T01:43:21.813003+0000","last_fullsized":"2024-04-24T01:43:21.813003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.077015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088156+0000","last_change":"2024-04-24T01:42:46.782589+0000","last_active":"2024-04-24T01:44:51.088156+0000","last_peered":"2024-04-24T01:44:51.088156+0000","last_clean":"2024-04-24T01:44:51.088156+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:44:51.088156+0000","last_undegraded":"2024-04-24T01:44:51.088156+0000","last_fullsized":"2024-04-24T01:44:51.088156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:02.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.443476+0000","last_change":"2024-04-24T01:42:48.784318+0000","last_active":"2024-04-24T01:45:50.443476+0000","last_peered":"2024-04-24T01:45:50.443476+0000","last_clean":"2024-04-24T01:45:50.443476+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:45:50.443476+0000","last_undegraded":"2024-04-24T01:45:50.443476+0000","last_fullsized":"2024-04-24T01:45:50.443476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:27:07.076053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.140307+0000","last_change":"2024-04-24T01:42:50.802205+0000","last_active":"2024-04-24T01:45:50.140307+0000","last_peered":"2024-04-24T01:45:50.140307+0000","last_clean":"2024-04-24T01:45:50.140307+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:45:50.140307+0000","last_undegraded":"2024-04-24T01:45:50.140307+0000","last_fullsized":"2024-04-24T01:45:50.140307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:15.474464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144862+0000","last_change":"2024-04-24T01:42:42.788944+0000","last_active":"2024-04-24T01:45:50.144862+0000","last_peered":"2024-04-24T01:45:50.144862+0000","last_clean":"2024-04-24T01:45:50.144862+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:45:50.144862+0000","last_undegraded":"2024-04-24T01:45:50.144862+0000","last_fullsized":"2024-04-24T01:45:50.144862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:38.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816740+0000","last_change":"2024-04-24T01:42:40.788616+0000","last_active":"2024-04-24T01:43:21.816740+0000","last_peered":"2024-04-24T01:43:21.816740+0000","last_clean":"2024-04-24T01:43:21.816740+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:43:21.816740+0000","last_undegraded":"2024-04-24T01:43:21.816740+0000","last_fullsized":"2024-04-24T01:43:21.816740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814295+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:43:21.814295+0000","last_peered":"2024-04-24T01:43:21.814295+0000","last_clean":"2024-04-24T01:43:21.814295+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:43:21.814295+0000","last_undegraded":"2024-04-24T01:43:21.814295+0000","last_fullsized":"2024-04-24T01:43:21.814295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.254736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812231+0000","last_change":"2024-04-24T01:42:44.776836+0000","last_active":"2024-04-24T01:43:21.812231+0000","last_peered":"2024-04-24T01:43:21.812231+0000","last_clean":"2024-04-24T01:43:21.812231+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:43:21.812231+0000","last_undegraded":"2024-04-24T01:43:21.812231+0000","last_fullsized":"2024-04-24T01:43:21.812231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:52.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'89","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.216733+0000","last_change":"2024-04-24T01:42:46.781816+0000","last_active":"2024-04-24T01:44:48.216733+0000","last_peered":"2024-04-24T01:44:48.216733+0000","last_clean":"2024-04-24T01:44:48.216733+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:44:48.216733+0000","last_undegraded":"2024-04-24T01:44:48.216733+0000","last_fullsized":"2024-04-24T01:44:48.216733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:38.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863116+0000","last_change":"2024-04-24T01:42:48.791388+0000","last_active":"2024-04-24T01:43:21.863116+0000","last_peered":"2024-04-24T01:43:21.863116+0000","last_clean":"2024-04-24T01:43:21.863116+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:43:21.863116+0000","last_undegraded":"2024-04-24T01:43:21.863116+0000","last_fullsized":"2024-04-24T01:43:21.863116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:21.062631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810182+0000","last_change":"2024-04-24T01:42:50.791385+0000","last_active":"2024-04-24T01:43:21.810182+0000","last_peered":"2024-04-24T01:43:21.810182+0000","last_clean":"2024-04-24T01:43:21.810182+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:43:21.810182+0000","last_undegraded":"2024-04-24T01:43:21.810182+0000","last_fullsized":"2024-04-24T01:43:21.810182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:37.401350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809642+0000","last_change":"2024-04-24T01:42:50.800231+0000","last_active":"2024-04-24T01:43:21.809642+0000","last_peered":"2024-04-24T01:43:21.809642+0000","last_clean":"2024-04-24T01:43:21.809642+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:43:21.809642+0000","last_undegraded":"2024-04-24T01:43:21.809642+0000","last_fullsized":"2024-04-24T01:43:21.809642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:04.117350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809954+0000","last_change":"2024-04-24T01:42:42.791072+0000","last_active":"2024-04-24T01:43:21.809954+0000","last_peered":"2024-04-24T01:43:21.809954+0000","last_clean":"2024-04-24T01:43:21.809954+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:43:21.809954+0000","last_undegraded":"2024-04-24T01:43:21.809954+0000","last_fullsized":"2024-04-24T01:43:21.809954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:06.415050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811530+0000","last_change":"2024-04-24T01:42:40.776494+0000","last_active":"2024-04-24T01:43:21.811530+0000","last_peered":"2024-04-24T01:43:21.811530+0000","last_clean":"2024-04-24T01:43:21.811530+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:43:21.811530+0000","last_undegraded":"2024-04-24T01:43:21.811530+0000","last_fullsized":"2024-04-24T01:43:21.811530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:10.873984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817518+0000","last_change":"2024-04-24T01:42:44.776151+0000","last_active":"2024-04-24T01:43:21.817518+0000","last_peered":"2024-04-24T01:43:21.817518+0000","last_clean":"2024-04-24T01:43:21.817518+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:43:21.817518+0000","last_undegraded":"2024-04-24T01:43:21.817518+0000","last_fullsized":"2024-04-24T01:43:21.817518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:36.228002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.222877+0000","last_change":"2024-04-24T01:42:46.779944+0000","last_active":"2024-04-24T01:44:48.222877+0000","last_peered":"2024-04-24T01:44:48.222877+0000","last_clean":"2024-04-24T01:44:48.222877+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:44:48.222877+0000","last_undegraded":"2024-04-24T01:44:48.222877+0000","last_fullsized":"2024-04-24T01:44:48.222877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:37.615741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811011+0000","last_change":"2024-04-24T01:42:48.786495+0000","last_active":"2024-04-24T01:43:21.811011+0000","last_peered":"2024-04-24T01:43:21.811011+0000","last_clean":"2024-04-24T01:43:21.811011+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:43:21.811011+0000","last_undegraded":"2024-04-24T01:43:21.811011+0000","last_fullsized":"2024-04-24T01:43:21.811011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:20:25.150998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:47.901186+0000","last_change":"2024-04-24T01:42:50.802495+0000","last_active":"2024-04-24T01:44:47.901186+0000","last_peered":"2024-04-24T01:44:47.901186+0000","last_clean":"2024-04-24T01:44:47.901186+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:44:47.901186+0000","last_undegraded":"2024-04-24T01:44:47.901186+0000","last_fullsized":"2024-04-24T01:44:47.901186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:43.202204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506883+0000","last_change":"2024-04-24T01:42:42.781334+0000","last_active":"2024-04-24T01:44:46.506883+0000","last_peered":"2024-04-24T01:44:46.506883+0000","last_clean":"2024-04-24T01:44:46.506883+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:44:46.506883+0000","last_undegraded":"2024-04-24T01:44:46.506883+0000","last_fullsized":"2024-04-24T01:44:46.506883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:36.471270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.264145+0000","last_change":"2024-04-24T01:42:40.783014+0000","last_active":"2024-04-24T01:45:50.264145+0000","last_peered":"2024-04-24T01:45:50.264145+0000","last_clean":"2024-04-24T01:45:50.264145+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:45:50.264145+0000","last_undegraded":"2024-04-24T01:45:50.264145+0000","last_fullsized":"2024-04-24T01:45:50.264145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812848+0000","last_change":"2024-04-24T01:42:44.777503+0000","last_active":"2024-04-24T01:43:21.812848+0000","last_peered":"2024-04-24T01:43:21.812848+0000","last_clean":"2024-04-24T01:43:21.812848+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:43:21.812848+0000","last_undegraded":"2024-04-24T01:43:21.812848+0000","last_fullsized":"2024-04-24T01:43:21.812848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:19.310744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672156+0000","last_change":"2024-04-24T01:42:46.776129+0000","last_active":"2024-04-24T01:45:49.672156+0000","last_peered":"2024-04-24T01:45:49.672156+0000","last_clean":"2024-04-24T01:45:49.672156+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:45:49.672156+0000","last_undegraded":"2024-04-24T01:45:49.672156+0000","last_fullsized":"2024-04-24T01:45:49.672156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:06:55.737138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808083+0000","last_change":"2024-04-24T01:42:48.789269+0000","last_active":"2024-04-24T01:43:21.808083+0000","last_peered":"2024-04-24T01:43:21.808083+0000","last_clean":"2024-04-24T01:43:21.808083+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:43:21.808083+0000","last_undegraded":"2024-04-24T01:43:21.808083+0000","last_fullsized":"2024-04-24T01:43:21.808083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:23.719981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.020578+0000","last_change":"2024-04-24T01:42:50.793424+0000","last_active":"2024-04-24T01:43:24.020578+0000","last_peered":"2024-04-24T01:43:24.020578+0000","last_clean":"2024-04-24T01:43:24.020578+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:43:24.020578+0000","last_undegraded":"2024-04-24T01:43:24.020578+0000","last_fullsized":"2024-04-24T01:43:24.020578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:31.628249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345135+0000","last_change":"2024-04-24T01:42:42.790386+0000","last_active":"2024-04-24T01:45:50.345135+0000","last_peered":"2024-04-24T01:45:50.345135+0000","last_clean":"2024-04-24T01:45:50.345135+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:45:50.345135+0000","last_undegraded":"2024-04-24T01:45:50.345135+0000","last_fullsized":"2024-04-24T01:45:50.345135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:20.812984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811368+0000","last_change":"2024-04-24T01:42:40.777727+0000","last_active":"2024-04-24T01:43:21.811368+0000","last_peered":"2024-04-24T01:43:21.811368+0000","last_clean":"2024-04-24T01:43:21.811368+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:43:21.811368+0000","last_undegraded":"2024-04-24T01:43:21.811368+0000","last_fullsized":"2024-04-24T01:43:21.811368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807855+0000","last_change":"2024-04-24T01:42:44.779726+0000","last_active":"2024-04-24T01:43:21.807855+0000","last_peered":"2024-04-24T01:43:21.807855+0000","last_clean":"2024-04-24T01:43:21.807855+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:43:21.807855+0000","last_undegraded":"2024-04-24T01:43:21.807855+0000","last_fullsized":"2024-04-24T01:43:21.807855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:52.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.729900+0000","last_change":"2024-04-24T01:42:46.779267+0000","last_active":"2024-04-24T01:45:49.729900+0000","last_peered":"2024-04-24T01:45:49.729900+0000","last_clean":"2024-04-24T01:45:49.729900+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:45:49.729900+0000","last_undegraded":"2024-04-24T01:45:49.729900+0000","last_fullsized":"2024-04-24T01:45:49.729900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:12.649320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814064+0000","last_change":"2024-04-24T01:42:48.791281+0000","last_active":"2024-04-24T01:43:21.814064+0000","last_peered":"2024-04-24T01:43:21.814064+0000","last_clean":"2024-04-24T01:43:21.814064+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:43:21.814064+0000","last_undegraded":"2024-04-24T01:43:21.814064+0000","last_fullsized":"2024-04-24T01:43:21.814064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:56.691092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.450921+0000","last_change":"2024-04-24T01:42:50.801137+0000","last_active":"2024-04-24T01:43:23.450921+0000","last_peered":"2024-04-24T01:43:23.450921+0000","last_clean":"2024-04-24T01:43:23.450921+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:43:23.450921+0000","last_undegraded":"2024-04-24T01:43:23.450921+0000","last_fullsized":"2024-04-24T01:43:23.450921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:41.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.185393+0000","last_change":"2024-04-24T01:42:42.786306+0000","last_active":"2024-04-24T01:43:23.185393+0000","last_peered":"2024-04-24T01:43:23.185393+0000","last_clean":"2024-04-24T01:43:23.185393+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:43:23.185393+0000","last_undegraded":"2024-04-24T01:43:23.185393+0000","last_fullsized":"2024-04-24T01:43:23.185393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:24.062336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816678+0000","last_change":"2024-04-24T01:42:40.790215+0000","last_active":"2024-04-24T01:43:21.816678+0000","last_peered":"2024-04-24T01:43:21.816678+0000","last_clean":"2024-04-24T01:43:21.816678+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:43:21.816678+0000","last_undegraded":"2024-04-24T01:43:21.816678+0000","last_fullsized":"2024-04-24T01:43:21.816678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811343+0000","last_change":"2024-04-24T01:42:44.775854+0000","last_active":"2024-04-24T01:43:21.811343+0000","last_peered":"2024-04-24T01:43:21.811343+0000","last_clean":"2024-04-24T01:43:21.811343+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:43:21.811343+0000","last_undegraded":"2024-04-24T01:43:21.811343+0000","last_fullsized":"2024-04-24T01:43:21.811343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:58.105579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.207876+0000","last_change":"2024-04-24T01:42:46.777619+0000","last_active":"2024-04-24T01:44:48.207876+0000","last_peered":"2024-04-24T01:44:48.207876+0000","last_clean":"2024-04-24T01:44:48.207876+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:44:48.207876+0000","last_undegraded":"2024-04-24T01:44:48.207876+0000","last_fullsized":"2024-04-24T01:44:48.207876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:23.977698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809142+0000","last_change":"2024-04-24T01:42:48.783348+0000","last_active":"2024-04-24T01:43:21.809142+0000","last_peered":"2024-04-24T01:43:21.809142+0000","last_clean":"2024-04-24T01:43:21.809142+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:43:21.809142+0000","last_undegraded":"2024-04-24T01:43:21.809142+0000","last_fullsized":"2024-04-24T01:43:21.809142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:29.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345667+0000","last_change":"2024-04-24T01:43:21.862671+0000","last_active":"2024-04-24T01:45:50.345667+0000","last_peered":"2024-04-24T01:45:50.345667+0000","last_clean":"2024-04-24T01:45:50.345667+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:45:50.345667+0000","last_undegraded":"2024-04-24T01:45:50.345667+0000","last_fullsized":"2024-04-24T01:45:50.345667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:07.455442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.333865+0000","last_change":"2024-04-24T01:42:40.787886+0000","last_active":"2024-04-24T01:43:22.333865+0000","last_peered":"2024-04-24T01:43:22.333865+0000","last_clean":"2024-04-24T01:43:22.333865+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:43:22.333865+0000","last_undegraded":"2024-04-24T01:43:22.333865+0000","last_fullsized":"2024-04-24T01:43:22.333865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:56.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865914+0000","last_change":"2024-04-24T01:42:44.773584+0000","last_active":"2024-04-24T01:43:21.865914+0000","last_peered":"2024-04-24T01:43:21.865914+0000","last_clean":"2024-04-24T01:43:21.865914+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:43:21.865914+0000","last_undegraded":"2024-04-24T01:43:21.865914+0000","last_fullsized":"2024-04-24T01:43:21.865914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:23.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.229299+0000","last_change":"2024-04-24T01:42:46.777975+0000","last_active":"2024-04-24T01:44:48.229299+0000","last_peered":"2024-04-24T01:44:48.229299+0000","last_clean":"2024-04-24T01:44:48.229299+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:44:48.229299+0000","last_undegraded":"2024-04-24T01:44:48.229299+0000","last_fullsized":"2024-04-24T01:44:48.229299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:13.422542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808471+0000","last_change":"2024-04-24T01:42:48.782421+0000","last_active":"2024-04-24T01:43:21.808471+0000","last_peered":"2024-04-24T01:43:21.808471+0000","last_clean":"2024-04-24T01:43:21.808471+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:43:21.808471+0000","last_undegraded":"2024-04-24T01:43:21.808471+0000","last_fullsized":"2024-04-24T01:43:21.808471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:57.847015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.067180+0000","last_change":"2024-04-24T01:42:50.794926+0000","last_active":"2024-04-24T01:45:50.067180+0000","last_peered":"2024-04-24T01:45:50.067180+0000","last_clean":"2024-04-24T01:45:50.067180+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:45:50.067180+0000","last_undegraded":"2024-04-24T01:45:50.067180+0000","last_fullsized":"2024-04-24T01:45:50.067180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:45.839756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.014892+0000","last_change":"2024-04-24T01:42:42.783533+0000","last_active":"2024-04-24T01:43:24.014892+0000","last_peered":"2024-04-24T01:43:24.014892+0000","last_clean":"2024-04-24T01:43:24.014892+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:43:24.014892+0000","last_undegraded":"2024-04-24T01:43:24.014892+0000","last_fullsized":"2024-04-24T01:43:24.014892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:09.403789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815922+0000","last_change":"2024-04-24T01:42:40.788925+0000","last_active":"2024-04-24T01:43:21.815922+0000","last_peered":"2024-04-24T01:43:21.815922+0000","last_clean":"2024-04-24T01:43:21.815922+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:43:21.815922+0000","last_undegraded":"2024-04-24T01:43:21.815922+0000","last_fullsized":"2024-04-24T01:43:21.815922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810144+0000","last_change":"2024-04-24T01:42:44.774986+0000","last_active":"2024-04-24T01:43:21.810144+0000","last_peered":"2024-04-24T01:43:21.810144+0000","last_clean":"2024-04-24T01:43:21.810144+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:43:21.810144+0000","last_undegraded":"2024-04-24T01:43:21.810144+0000","last_fullsized":"2024-04-24T01:43:21.810144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:15.297566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.208815+0000","last_change":"2024-04-24T01:42:46.783203+0000","last_active":"2024-04-24T01:44:48.208815+0000","last_peered":"2024-04-24T01:44:48.208815+0000","last_clean":"2024-04-24T01:44:48.208815+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:44:48.208815+0000","last_undegraded":"2024-04-24T01:44:48.208815+0000","last_fullsized":"2024-04-24T01:44:48.208815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:26:21.983975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814006+0000","last_change":"2024-04-24T01:42:48.791647+0000","last_active":"2024-04-24T01:43:21.814006+0000","last_peered":"2024-04-24T01:43:21.814006+0000","last_clean":"2024-04-24T01:43:21.814006+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:43:21.814006+0000","last_undegraded":"2024-04-24T01:43:21.814006+0000","last_fullsized":"2024-04-24T01:43:21.814006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:07.292630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.304388+0000","last_change":"2024-04-24T01:42:50.797843+0000","last_active":"2024-04-24T01:45:50.304388+0000","last_peered":"2024-04-24T01:45:50.304388+0000","last_clean":"2024-04-24T01:45:50.304388+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:45:50.304388+0000","last_undegraded":"2024-04-24T01:45:50.304388+0000","last_fullsized":"2024-04-24T01:45:50.304388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:49.177816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814977+0000","last_change":"2024-04-24T01:42:42.786283+0000","last_active":"2024-04-24T01:43:21.814977+0000","last_peered":"2024-04-24T01:43:21.814977+0000","last_clean":"2024-04-24T01:43:21.814977+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:43:21.814977+0000","last_undegraded":"2024-04-24T01:43:21.814977+0000","last_fullsized":"2024-04-24T01:43:21.814977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:14.187364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.608549+0000","last_change":"2024-04-24T01:42:40.769690+0000","last_active":"2024-04-24T01:44:49.608549+0000","last_peered":"2024-04-24T01:44:49.608549+0000","last_clean":"2024-04-24T01:44:49.608549+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:44:49.608549+0000","last_undegraded":"2024-04-24T01:44:49.608549+0000","last_fullsized":"2024-04-24T01:44:49.608549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808700+0000","last_change":"2024-04-24T01:42:44.775092+0000","last_active":"2024-04-24T01:43:21.808700+0000","last_peered":"2024-04-24T01:43:21.808700+0000","last_clean":"2024-04-24T01:43:21.808700+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:43:21.808700+0000","last_undegraded":"2024-04-24T01:43:21.808700+0000","last_fullsized":"2024-04-24T01:43:21.808700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:22.743910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.226891+0000","last_change":"2024-04-24T01:42:46.777052+0000","last_active":"2024-04-24T01:44:48.226891+0000","last_peered":"2024-04-24T01:44:48.226891+0000","last_clean":"2024-04-24T01:44:48.226891+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:44:48.226891+0000","last_undegraded":"2024-04-24T01:44:48.226891+0000","last_fullsized":"2024-04-24T01:44:48.226891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:56.838568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864024+0000","last_change":"2024-04-24T01:42:48.783841+0000","last_active":"2024-04-24T01:43:21.864024+0000","last_peered":"2024-04-24T01:43:21.864024+0000","last_clean":"2024-04-24T01:43:21.864024+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:43:21.864024+0000","last_undegraded":"2024-04-24T01:43:21.864024+0000","last_fullsized":"2024-04-24T01:43:21.864024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:56:50.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.650746+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:44:49.650746+0000","last_peered":"2024-04-24T01:44:49.650746+0000","last_clean":"2024-04-24T01:44:49.650746+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:44:49.650746+0000","last_undegraded":"2024-04-24T01:44:49.650746+0000","last_fullsized":"2024-04-24T01:44:49.650746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:59.151288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315999+0000","last_change":"2024-04-24T01:42:42.776215+0000","last_active":"2024-04-24T01:45:50.315999+0000","last_peered":"2024-04-24T01:45:50.315999+0000","last_clean":"2024-04-24T01:45:50.315999+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:45:50.315999+0000","last_undegraded":"2024-04-24T01:45:50.315999+0000","last_fullsized":"2024-04-24T01:45:50.315999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:29.635969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791055+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:46.075375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816801+0000","last_change":"2024-04-24T01:42:44.775371+0000","last_active":"2024-04-24T01:43:21.816801+0000","last_peered":"2024-04-24T01:43:21.816801+0000","last_clean":"2024-04-24T01:43:21.816801+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:43:21.816801+0000","last_undegraded":"2024-04-24T01:43:21.816801+0000","last_fullsized":"2024-04-24T01:43:21.816801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:48.566887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813558+0000","last_change":"2024-04-24T01:42:46.785255+0000","last_active":"2024-04-24T01:43:21.813558+0000","last_peered":"2024-04-24T01:43:21.813558+0000","last_clean":"2024-04-24T01:43:21.813558+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:43:21.813558+0000","last_undegraded":"2024-04-24T01:43:21.813558+0000","last_fullsized":"2024-04-24T01:43:21.813558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:55.734489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.349973+0000","last_change":"2024-04-24T01:42:48.791368+0000","last_active":"2024-04-24T01:45:50.349973+0000","last_peered":"2024-04-24T01:45:50.349973+0000","last_clean":"2024-04-24T01:45:50.349973+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:45:50.349973+0000","last_undegraded":"2024-04-24T01:45:50.349973+0000","last_fullsized":"2024-04-24T01:45:50.349973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:36.125996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809311+0000","last_change":"2024-04-24T01:42:50.799047+0000","last_active":"2024-04-24T01:43:21.809311+0000","last_peered":"2024-04-24T01:43:21.809311+0000","last_clean":"2024-04-24T01:43:21.809311+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:43:21.809311+0000","last_undegraded":"2024-04-24T01:43:21.809311+0000","last_fullsized":"2024-04-24T01:43:21.809311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:48.985276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270565+0000","last_change":"2024-04-24T01:42:42.779703+0000","last_active":"2024-04-24T01:45:50.270565+0000","last_peered":"2024-04-24T01:45:50.270565+0000","last_clean":"2024-04-24T01:45:50.270565+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:45:50.270565+0000","last_undegraded":"2024-04-24T01:45:50.270565+0000","last_fullsized":"2024-04-24T01:45:50.270565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:48.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817526+0000","last_change":"2024-04-24T01:42:40.783048+0000","last_active":"2024-04-24T01:43:21.817526+0000","last_peered":"2024-04-24T01:43:21.817526+0000","last_clean":"2024-04-24T01:43:21.817526+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:43:21.817526+0000","last_undegraded":"2024-04-24T01:43:21.817526+0000","last_fullsized":"2024-04-24T01:43:21.817526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817275+0000","last_change":"2024-04-24T01:42:44.776357+0000","last_active":"2024-04-24T01:43:21.817275+0000","last_peered":"2024-04-24T01:43:21.817275+0000","last_clean":"2024-04-24T01:43:21.817275+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:43:21.817275+0000","last_undegraded":"2024-04-24T01:43:21.817275+0000","last_fullsized":"2024-04-24T01:43:21.817275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:59.654590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'63","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090843+0000","last_change":"2024-04-24T01:42:46.776292+0000","last_active":"2024-04-24T01:45:11.090843+0000","last_peered":"2024-04-24T01:45:11.090843+0000","last_clean":"2024-04-24T01:45:11.090843+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:45:11.090843+0000","last_undegraded":"2024-04-24T01:45:11.090843+0000","last_fullsized":"2024-04-24T01:45:11.090843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:34.123347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":76,"num_read_kb":63,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.861850+0000","last_change":"2024-04-24T01:42:48.788971+0000","last_active":"2024-04-24T01:43:21.861850+0000","last_peered":"2024-04-24T01:43:21.861850+0000","last_clean":"2024-04-24T01:43:21.861850+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:43:21.861850+0000","last_undegraded":"2024-04-24T01:43:21.861850+0000","last_fullsized":"2024-04-24T01:43:21.861850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:30:22.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817135+0000","last_change":"2024-04-24T01:42:50.796877+0000","last_active":"2024-04-24T01:43:21.817135+0000","last_peered":"2024-04-24T01:43:21.817135+0000","last_clean":"2024-04-24T01:43:21.817135+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:43:21.817135+0000","last_undegraded":"2024-04-24T01:43:21.817135+0000","last_fullsized":"2024-04-24T01:43:21.817135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:01:14.162912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345596+0000","last_change":"2024-04-24T01:42:42.779537+0000","last_active":"2024-04-24T01:45:50.345596+0000","last_peered":"2024-04-24T01:45:50.345596+0000","last_clean":"2024-04-24T01:45:50.345596+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:45:50.345596+0000","last_undegraded":"2024-04-24T01:45:50.345596+0000","last_fullsized":"2024-04-24T01:45:50.345596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:12.977374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.261154+0000","last_change":"2024-04-24T01:42:40.788381+0000","last_active":"2024-04-24T01:45:50.261154+0000","last_peered":"2024-04-24T01:45:50.261154+0000","last_clean":"2024-04-24T01:45:50.261154+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:45:50.261154+0000","last_undegraded":"2024-04-24T01:45:50.261154+0000","last_fullsized":"2024-04-24T01:45:50.261154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:10.719363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810382+0000","last_change":"2024-04-24T01:42:44.775775+0000","last_active":"2024-04-24T01:43:21.810382+0000","last_peered":"2024-04-24T01:43:21.810382+0000","last_clean":"2024-04-24T01:43:21.810382+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:43:21.810382+0000","last_undegraded":"2024-04-24T01:43:21.810382+0000","last_fullsized":"2024-04-24T01:43:21.810382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:06.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.200340+0000","last_change":"2024-04-24T01:42:46.777066+0000","last_active":"2024-04-24T01:44:48.200340+0000","last_peered":"2024-04-24T01:44:48.200340+0000","last_clean":"2024-04-24T01:44:48.200340+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:44:48.200340+0000","last_undegraded":"2024-04-24T01:44:48.200340+0000","last_fullsized":"2024-04-24T01:44:48.200340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:17.835974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810707+0000","last_change":"2024-04-24T01:42:48.785198+0000","last_active":"2024-04-24T01:43:21.810707+0000","last_peered":"2024-04-24T01:43:21.810707+0000","last_clean":"2024-04-24T01:43:21.810707+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:43:21.810707+0000","last_undegraded":"2024-04-24T01:43:21.810707+0000","last_fullsized":"2024-04-24T01:43:21.810707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:01.822047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.400789+0000","last_change":"2024-04-24T01:42:50.801689+0000","last_active":"2024-04-24T01:45:50.400789+0000","last_peered":"2024-04-24T01:45:50.400789+0000","last_clean":"2024-04-24T01:45:50.400789+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:45:50.400789+0000","last_undegraded":"2024-04-24T01:45:50.400789+0000","last_fullsized":"2024-04-24T01:45:50.400789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:45.044072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654504+0000","last_change":"2024-04-24T01:43:21.864360+0000","last_active":"2024-04-24T01:44:49.654504+0000","last_peered":"2024-04-24T01:44:49.654504+0000","last_clean":"2024-04-24T01:44:49.654504+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:44:49.654504+0000","last_undegraded":"2024-04-24T01:44:49.654504+0000","last_fullsized":"2024-04-24T01:44:49.654504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:52.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865009+0000","last_change":"2024-04-24T01:42:40.778077+0000","last_active":"2024-04-24T01:43:21.865009+0000","last_peered":"2024-04-24T01:43:21.865009+0000","last_clean":"2024-04-24T01:43:21.865009+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:43:21.865009+0000","last_undegraded":"2024-04-24T01:43:21.865009+0000","last_fullsized":"2024-04-24T01:43:21.865009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:51.699851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.302204+0000","last_change":"2024-04-24T01:42:44.778211+0000","last_active":"2024-04-24T01:44:49.302204+0000","last_peered":"2024-04-24T01:44:49.302204+0000","last_clean":"2024-04-24T01:44:49.302204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:44:49.302204+0000","last_undegraded":"2024-04-24T01:44:49.302204+0000","last_fullsized":"2024-04-24T01:44:49.302204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:36.446305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.224750+0000","last_change":"2024-04-24T01:42:46.782809+0000","last_active":"2024-04-24T01:44:48.224750+0000","last_peered":"2024-04-24T01:44:48.224750+0000","last_clean":"2024-04-24T01:44:48.224750+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:44:48.224750+0000","last_undegraded":"2024-04-24T01:44:48.224750+0000","last_fullsized":"2024-04-24T01:44:48.224750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:38.612473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811004+0000","last_change":"2024-04-24T01:42:48.793613+0000","last_active":"2024-04-24T01:43:21.811004+0000","last_peered":"2024-04-24T01:43:21.811004+0000","last_clean":"2024-04-24T01:43:21.811004+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:43:21.811004+0000","last_undegraded":"2024-04-24T01:43:21.811004+0000","last_fullsized":"2024-04-24T01:43:21.811004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:14.394175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.234782+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:44:48.234782+0000","last_peered":"2024-04-24T01:44:48.234782+0000","last_clean":"2024-04-24T01:44:48.234782+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:44:48.234782+0000","last_undegraded":"2024-04-24T01:44:48.234782+0000","last_fullsized":"2024-04-24T01:44:48.234782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:18.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345345+0000","last_change":"2024-04-24T01:42:42.779597+0000","last_active":"2024-04-24T01:45:50.345345+0000","last_peered":"2024-04-24T01:45:50.345345+0000","last_clean":"2024-04-24T01:45:50.345345+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:45:50.345345+0000","last_undegraded":"2024-04-24T01:45:50.345345+0000","last_fullsized":"2024-04-24T01:45:50.345345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:39.932797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.258347+0000","last_change":"2024-04-24T01:42:40.789710+0000","last_active":"2024-04-24T01:45:50.258347+0000","last_peered":"2024-04-24T01:45:50.258347+0000","last_clean":"2024-04-24T01:45:50.258347+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:45:50.258347+0000","last_undegraded":"2024-04-24T01:45:50.258347+0000","last_fullsized":"2024-04-24T01:45:50.258347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.900262+0000","last_change":"2024-04-24T01:42:44.778763+0000","last_active":"2024-04-24T01:44:46.900262+0000","last_peered":"2024-04-24T01:44:46.900262+0000","last_clean":"2024-04-24T01:44:46.900262+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:44:46.900262+0000","last_undegraded":"2024-04-24T01:44:46.900262+0000","last_fullsized":"2024-04-24T01:44:46.900262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:04.964034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672992+0000","last_change":"2024-04-24T01:42:46.782978+0000","last_active":"2024-04-24T01:45:49.672992+0000","last_peered":"2024-04-24T01:45:49.672992+0000","last_clean":"2024-04-24T01:45:49.672992+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:45:49.672992+0000","last_undegraded":"2024-04-24T01:45:49.672992+0000","last_fullsized":"2024-04-24T01:45:49.672992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:19.005767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863044+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:43:21.863044+0000","last_peered":"2024-04-24T01:43:21.863044+0000","last_clean":"2024-04-24T01:43:21.863044+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:43:21.863044+0000","last_undegraded":"2024-04-24T01:43:21.863044+0000","last_fullsized":"2024-04-24T01:43:21.863044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:02.008836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.237757+0000","last_change":"2024-04-24T01:42:50.800862+0000","last_active":"2024-04-24T01:44:48.237757+0000","last_peered":"2024-04-24T01:44:48.237757+0000","last_clean":"2024-04-24T01:44:48.237757+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:44:48.237757+0000","last_undegraded":"2024-04-24T01:44:48.237757+0000","last_fullsized":"2024-04-24T01:44:48.237757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:16:03.004170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088543+0000","last_change":"2024-04-24T01:42:42.791052+0000","last_active":"2024-04-24T01:44:56.088543+0000","last_peered":"2024-04-24T01:44:56.088543+0000","last_clean":"2024-04-24T01:44:56.088543+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:44:56.088543+0000","last_undegraded":"2024-04-24T01:44:56.088543+0000","last_fullsized":"2024-04-24T01:44:56.088543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:09.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.086702+0000","last_change":"2024-04-24T01:42:40.778401+0000","last_active":"2024-04-24T01:44:46.086702+0000","last_peered":"2024-04-24T01:44:46.086702+0000","last_clean":"2024-04-24T01:44:46.086702+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:44:46.086702+0000","last_undegraded":"2024-04-24T01:44:46.086702+0000","last_fullsized":"2024-04-24T01:44:46.086702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315993+0000","last_change":"2024-04-24T01:42:42.779808+0000","last_active":"2024-04-24T01:45:50.315993+0000","last_peered":"2024-04-24T01:45:50.315993+0000","last_clean":"2024-04-24T01:45:50.315993+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:45:50.315993+0000","last_undegraded":"2024-04-24T01:45:50.315993+0000","last_fullsized":"2024-04-24T01:45:50.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:39.808849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862090+0000","last_change":"2024-04-24T01:42:40.781020+0000","last_active":"2024-04-24T01:43:21.862090+0000","last_peered":"2024-04-24T01:43:21.862090+0000","last_clean":"2024-04-24T01:43:21.862090+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:43:21.862090+0000","last_undegraded":"2024-04-24T01:43:21.862090+0000","last_fullsized":"2024-04-24T01:43:21.862090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:11:49.303845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'21","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.051046+0000","last_change":"2024-04-24T01:42:42.782200+0000","last_active":"2024-04-24T01:45:50.051046+0000","last_peered":"2024-04-24T01:45:50.051046+0000","last_clean":"2024-04-24T01:45:50.051046+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:45:50.051046+0000","last_undegraded":"2024-04-24T01:45:50.051046+0000","last_fullsized":"2024-04-24T01:45:50.051046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:51.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.023917+0000","last_change":"2024-04-24T01:42:40.785740+0000","last_active":"2024-04-24T01:45:50.023917+0000","last_peered":"2024-04-24T01:45:50.023917+0000","last_clean":"2024-04-24T01:45:50.023917+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:45:50.023917+0000","last_undegraded":"2024-04-24T01:45:50.023917+0000","last_fullsized":"2024-04-24T01:45:50.023917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:06.241519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315979+0000","last_change":"2024-04-24T01:42:42.775754+0000","last_active":"2024-04-24T01:45:50.315979+0000","last_peered":"2024-04-24T01:45:50.315979+0000","last_clean":"2024-04-24T01:45:50.315979+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:45:50.315979+0000","last_undegraded":"2024-04-24T01:45:50.315979+0000","last_fullsized":"2024-04-24T01:45:50.315979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:14.133212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864641+0000","last_change":"2024-04-24T01:42:40.768297+0000","last_active":"2024-04-24T01:43:21.864641+0000","last_peered":"2024-04-24T01:43:21.864641+0000","last_clean":"2024-04-24T01:43:21.864641+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:43:21.864641+0000","last_undegraded":"2024-04-24T01:43:21.864641+0000","last_fullsized":"2024-04-24T01:43:21.864641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:41.931823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864431+0000","last_change":"2024-04-24T01:42:42.790746+0000","last_active":"2024-04-24T01:43:21.864431+0000","last_peered":"2024-04-24T01:43:21.864431+0000","last_clean":"2024-04-24T01:43:21.864431+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:43:21.864431+0000","last_undegraded":"2024-04-24T01:43:21.864431+0000","last_fullsized":"2024-04-24T01:43:21.864431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:23.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334072+0000","last_change":"2024-04-24T01:42:40.778267+0000","last_active":"2024-04-24T01:43:22.334072+0000","last_peered":"2024-04-24T01:43:22.334072+0000","last_clean":"2024-04-24T01:43:22.334072+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:43:22.334072+0000","last_undegraded":"2024-04-24T01:43:22.334072+0000","last_fullsized":"2024-04-24T01:43:22.334072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:54.513268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506919+0000","last_change":"2024-04-24T01:42:42.783600+0000","last_active":"2024-04-24T01:44:46.506919+0000","last_peered":"2024-04-24T01:44:46.506919+0000","last_clean":"2024-04-24T01:44:46.506919+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:44:46.506919+0000","last_undegraded":"2024-04-24T01:44:46.506919+0000","last_fullsized":"2024-04-24T01:44:46.506919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:54.263697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.438378+0000","last_change":"2024-04-24T01:42:40.792747+0000","last_active":"2024-04-24T01:43:23.438378+0000","last_peered":"2024-04-24T01:43:23.438378+0000","last_clean":"2024-04-24T01:43:23.438378+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:43:23.438378+0000","last_undegraded":"2024-04-24T01:43:23.438378+0000","last_fullsized":"2024-04-24T01:43:23.438378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.455490+0000","last_change":"2024-04-24T01:42:42.783541+0000","last_active":"2024-04-24T01:43:23.455490+0000","last_peered":"2024-04-24T01:43:23.455490+0000","last_clean":"2024-04-24T01:43:23.455490+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:43:23.455490+0000","last_undegraded":"2024-04-24T01:43:23.455490+0000","last_fullsized":"2024-04-24T01:43:23.455490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:29.669455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.496096+0000","last_change":"2024-04-24T01:42:40.784834+0000","last_active":"2024-04-24T01:44:46.496096+0000","last_peered":"2024-04-24T01:44:46.496096+0000","last_clean":"2024-04-24T01:44:46.496096+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:44:46.496096+0000","last_undegraded":"2024-04-24T01:44:46.496096+0000","last_fullsized":"2024-04-24T01:44:46.496096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654733+0000","last_change":"2024-04-24T01:42:42.784939+0000","last_active":"2024-04-24T01:44:49.654733+0000","last_peered":"2024-04-24T01:44:49.654733+0000","last_clean":"2024-04-24T01:44:49.654733+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:44:49.654733+0000","last_undegraded":"2024-04-24T01:44:49.654733+0000","last_fullsized":"2024-04-24T01:44:49.654733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.002401+0000","last_change":"2024-04-24T01:42:40.774338+0000","last_active":"2024-04-24T01:45:50.002401+0000","last_peered":"2024-04-24T01:45:50.002401+0000","last_clean":"2024-04-24T01:45:50.002401+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:45:50.002401+0000","last_undegraded":"2024-04-24T01:45:50.002401+0000","last_fullsized":"2024-04-24T01:45:50.002401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:47.446497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654753+0000","last_change":"2024-04-24T01:42:42.783518+0000","last_active":"2024-04-24T01:44:49.654753+0000","last_peered":"2024-04-24T01:44:49.654753+0000","last_clean":"2024-04-24T01:44:49.654753+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:44:49.654753+0000","last_undegraded":"2024-04-24T01:44:49.654753+0000","last_fullsized":"2024-04-24T01:44:49.654753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:48.893933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810266+0000","last_change":"2024-04-24T01:42:40.776220+0000","last_active":"2024-04-24T01:43:21.810266+0000","last_peered":"2024-04-24T01:43:21.810266+0000","last_clean":"2024-04-24T01:43:21.810266+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:43:21.810266+0000","last_undegraded":"2024-04-24T01:43:21.810266+0000","last_fullsized":"2024-04-24T01:43:21.810266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:52.166943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654997+0000","last_change":"2024-04-24T01:42:42.780704+0000","last_active":"2024-04-24T01:44:49.654997+0000","last_peered":"2024-04-24T01:44:49.654997+0000","last_clean":"2024-04-24T01:44:49.654997+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:44:49.654997+0000","last_undegraded":"2024-04-24T01:44:49.654997+0000","last_fullsized":"2024-04-24T01:44:49.654997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:19.467731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334617+0000","last_change":"2024-04-24T01:42:40.774379+0000","last_active":"2024-04-24T01:43:22.334617+0000","last_peered":"2024-04-24T01:43:22.334617+0000","last_clean":"2024-04-24T01:43:22.334617+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:43:22.334617+0000","last_undegraded":"2024-04-24T01:43:22.334617+0000","last_fullsized":"2024-04-24T01:43:22.334617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:56.807661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321950+0000","last_change":"2024-04-24T01:42:42.790910+0000","last_active":"2024-04-24T01:45:50.321950+0000","last_peered":"2024-04-24T01:45:50.321950+0000","last_clean":"2024-04-24T01:45:50.321950+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:45:50.321950+0000","last_undegraded":"2024-04-24T01:45:50.321950+0000","last_fullsized":"2024-04-24T01:45:50.321950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:52.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816518+0000","last_change":"2024-04-24T01:42:40.793467+0000","last_active":"2024-04-24T01:43:21.816518+0000","last_peered":"2024-04-24T01:43:21.816518+0000","last_clean":"2024-04-24T01:43:21.816518+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:43:21.816518+0000","last_undegraded":"2024-04-24T01:43:21.816518+0000","last_fullsized":"2024-04-24T01:43:21.816518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.019736+0000","last_change":"2024-04-24T01:42:42.781172+0000","last_active":"2024-04-24T01:44:06.019736+0000","last_peered":"2024-04-24T01:44:06.019736+0000","last_clean":"2024-04-24T01:44:06.019736+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:44:06.019736+0000","last_undegraded":"2024-04-24T01:44:06.019736+0000","last_fullsized":"2024-04-24T01:44:06.019736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:50.255990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815448+0000","last_change":"2024-04-24T01:42:40.771155+0000","last_active":"2024-04-24T01:43:21.815448+0000","last_peered":"2024-04-24T01:43:21.815448+0000","last_clean":"2024-04-24T01:43:21.815448+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:43:21.815448+0000","last_undegraded":"2024-04-24T01:43:21.815448+0000","last_fullsized":"2024-04-24T01:43:21.815448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816208+0000","last_change":"2024-04-24T01:42:42.782402+0000","last_active":"2024-04-24T01:43:21.816208+0000","last_peered":"2024-04-24T01:43:21.816208+0000","last_clean":"2024-04-24T01:43:21.816208+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:43:21.816208+0000","last_undegraded":"2024-04-24T01:43:21.816208+0000","last_fullsized":"2024-04-24T01:43:21.816208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:01.719700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811712+0000","last_change":"2024-04-24T01:42:40.785750+0000","last_active":"2024-04-24T01:43:21.811712+0000","last_peered":"2024-04-24T01:43:21.811712+0000","last_clean":"2024-04-24T01:43:21.811712+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:43:21.811712+0000","last_undegraded":"2024-04-24T01:43:21.811712+0000","last_fullsized":"2024-04-24T01:43:21.811712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:29.551602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'11","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.050515+0000","last_change":"2024-04-24T01:42:42.783870+0000","last_active":"2024-04-24T01:45:50.050515+0000","last_peered":"2024-04-24T01:45:50.050515+0000","last_clean":"2024-04-24T01:45:50.050515+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:45:50.050515+0000","last_undegraded":"2024-04-24T01:45:50.050515+0000","last_fullsized":"2024-04-24T01:45:50.050515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:19.254318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089090+0000","last_change":"2024-04-24T01:42:40.787075+0000","last_active":"2024-04-24T01:44:56.089090+0000","last_peered":"2024-04-24T01:44:56.089090+0000","last_clean":"2024-04-24T01:44:56.089090+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:44:56.089090+0000","last_undegraded":"2024-04-24T01:44:56.089090+0000","last_fullsized":"2024-04-24T01:44:56.089090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:11.008229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812646+0000","last_change":"2024-04-24T01:42:42.783035+0000","last_active":"2024-04-24T01:43:21.812646+0000","last_peered":"2024-04-24T01:43:21.812646+0000","last_clean":"2024-04-24T01:43:21.812646+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:43:21.812646+0000","last_undegraded":"2024-04-24T01:43:21.812646+0000","last_fullsized":"2024-04-24T01:43:21.812646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:34.220751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089213+0000","last_change":"2024-04-24T01:42:40.780277+0000","last_active":"2024-04-24T01:45:01.089213+0000","last_peered":"2024-04-24T01:45:01.089213+0000","last_clean":"2024-04-24T01:45:01.089213+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:45:01.089213+0000","last_undegraded":"2024-04-24T01:45:01.089213+0000","last_fullsized":"2024-04-24T01:45:01.089213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088282+0000","last_change":"2024-04-24T01:42:42.785135+0000","last_active":"2024-04-24T01:44:56.088282+0000","last_peered":"2024-04-24T01:44:56.088282+0000","last_clean":"2024-04-24T01:44:56.088282+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:44:56.088282+0000","last_undegraded":"2024-04-24T01:44:56.088282+0000","last_fullsized":"2024-04-24T01:44:56.088282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813648+0000","last_change":"2024-04-24T01:42:40.785768+0000","last_active":"2024-04-24T01:43:21.813648+0000","last_peered":"2024-04-24T01:43:21.813648+0000","last_clean":"2024-04-24T01:43:21.813648+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:43:21.813648+0000","last_undegraded":"2024-04-24T01:43:21.813648+0000","last_fullsized":"2024-04-24T01:43:21.813648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:41.422186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089710+0000","last_change":"2024-04-24T01:42:40.778631+0000","last_active":"2024-04-24T01:45:01.089710+0000","last_peered":"2024-04-24T01:45:01.089710+0000","last_clean":"2024-04-24T01:45:01.089710+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:45:01.089710+0000","last_undegraded":"2024-04-24T01:45:01.089710+0000","last_fullsized":"2024-04-24T01:45:01.089710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:55.030083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270563+0000","last_change":"2024-04-24T01:42:42.785218+0000","last_active":"2024-04-24T01:45:50.270563+0000","last_peered":"2024-04-24T01:45:50.270563+0000","last_clean":"2024-04-24T01:45:50.270563+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:45:50.270563+0000","last_undegraded":"2024-04-24T01:45:50.270563+0000","last_fullsized":"2024-04-24T01:45:50.270563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:11.578528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:04.084957+0000","last_change":"2024-04-24T01:42:40.781285+0000","last_active":"2024-04-24T01:45:04.084957+0000","last_peered":"2024-04-24T01:45:04.084957+0000","last_clean":"2024-04-24T01:45:04.084957+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:45:04.084957+0000","last_undegraded":"2024-04-24T01:45:04.084957+0000","last_fullsized":"2024-04-24T01:45:04.084957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.038340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345306+0000","last_change":"2024-04-24T01:42:42.785126+0000","last_active":"2024-04-24T01:45:50.345306+0000","last_peered":"2024-04-24T01:45:50.345306+0000","last_clean":"2024-04-24T01:45:50.345306+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:45:50.345306+0000","last_undegraded":"2024-04-24T01:45:50.345306+0000","last_fullsized":"2024-04-24T01:45:50.345306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1472,"ondisk_log_size":1472,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48096,"kb_used_data":12760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323744,"statfs":{"total":96636764160,"available":96587513856,"internally_reserved":0,"allocated":13066240,"data_stored":12741353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48928,"kb_used_data":13592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322912,"statfs":{"total":96636764160,"available":96586661888,"internally_reserved":0,"allocated":13918208,"data_stored":13644432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640301,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38712,"kb_used_data":3376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333128,"statfs":{"total":96636764160,"available":96597123072,"internally_reserved":0,"allocated":3457024,"data_stored":3161357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":10988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":11251712,"data_stored":10959103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2420736,"data_stored":2420736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:45:58.070 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:45:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.192+0000 7f8e08e9a640 1 Processor -- start 2024-04-24T01:45:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.193+0000 7f8e08e9a640 1 -- start start 2024-04-24T01:45:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.193+0000 7f8e08e9a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8e04096430 0x7f8e04096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.193+0000 7f8e08e9a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e04098800 con 0x7f8e04071090 2024-04-24T01:45:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.193+0000 7f8e08e9a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8e04071930 con 0x7f8e04096430 2024-04-24T01:45:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.193+0000 7f8e0259c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8e04096430 0x7f8e04096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.193+0000 7f8e01d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8e04071090 0x7f8e0406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35908/0 (socket says 172.21.15.107:35908) 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.193+0000 7f8e01d9b640 1 -- 172.21.15.107:0/2662442974 learned_addr learned my addr 172.21.15.107:0/2662442974 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.194+0000 7f8e0259c640 1 -- 172.21.15.107:0/2662442974 >> v1:172.21.15.107:6789/0 conn(0x7f8e04071090 legacy=0x7f8e0406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.194+0000 7f8e0159a640 1 -- 172.21.15.107:0/2662442974 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194270164 0 0) 0x7f8e04098800 con 0x7f8e04071090 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.194+0000 7f8e0259c640 1 -- 172.21.15.107:0/2662442974 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04071f50 con 0x7f8e04096430 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.194+0000 7f8e0259c640 1 --2- 172.21.15.107:0/2662442974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04096430 0x7f8e04096810 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009720 tx=0x7f8df802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de533d28dc76b51 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.194+0000 7f8e0159a640 1 -- 172.21.15.107:0/2662442974 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df80316d0 con 0x7f8e04096430 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.194+0000 7f8e0159a640 1 -- 172.21.15.107:0/2662442974 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df8037070 con 0x7f8e04096430 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.194+0000 7f8e0159a640 1 -- 172.21.15.107:0/2662442974 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df80319c0 con 0x7f8e04096430 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.195+0000 7f8e08e9a640 1 -- 172.21.15.107:0/2662442974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04096430 msgr2=0x7f8e04096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.195+0000 7f8e08e9a640 1 --2- 172.21.15.107:0/2662442974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04096430 0x7f8e04096810 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009720 tx=0x7f8df802b840 comp rx=0 tx=0).stop 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.195+0000 7f8e08e9a640 1 -- 172.21.15.107:0/2662442974 shutdown_connections 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.195+0000 7f8e08e9a640 1 --2- 172.21.15.107:0/2662442974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04096430 0x7f8e04096810 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:58.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.195+0000 7f8e08e9a640 1 -- 172.21.15.107:0/2662442974 >> 172.21.15.107:0/2662442974 conn(0x7f8e04099680 msgr2=0x7f8e04099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.195+0000 7f8e08e9a640 1 -- 172.21.15.107:0/2662442974 shutdown_connections 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.195+0000 7f8e08e9a640 1 -- 172.21.15.107:0/2662442974 wait complete. 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.196+0000 7f8e08e9a640 1 Processor -- start 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.196+0000 7f8e08e9a640 1 -- start start 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.196+0000 7f8e08e9a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04071090 0x7f8e04089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.196+0000 7f8e08e9a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04096d50 con 0x7f8e04071090 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.196+0000 7f8e0259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04071090 0x7f8e04089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.196+0000 7f8e0259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04071090 0x7f8e04089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47954/0 (socket says 172.21.15.107:47954) 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.196+0000 7f8e0259c640 1 -- 172.21.15.107:0/1468796853 learned_addr learned my addr 172.21.15.107:0/1468796853 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.197+0000 7f8e0259c640 1 -- 172.21.15.107:0/1468796853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e041261d0 con 0x7f8e04071090 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.197+0000 7f8e0259c640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04071090 0x7f8e04089f90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8df8034040 tx=0x7f8df80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.197+0000 7f8df2ffd640 1 -- 172.21.15.107:0/1468796853 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df8032770 con 0x7f8e04071090 2024-04-24T01:45:58.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.197+0000 7f8df2ffd640 1 -- 172.21.15.107:0/1468796853 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df8032910 con 0x7f8e04071090 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.197+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e04095eb0 con 0x7f8e04071090 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.197+0000 7f8df2ffd640 1 -- 172.21.15.107:0/1468796853 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df8032c30 con 0x7f8e04071090 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.197+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0408c230 con 0x7f8e04071090 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.198+0000 7f8df2ffd640 1 -- 172.21.15.107:0/1468796853 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8df804c060 con 0x7f8e04071090 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.198+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e04062da0 con 0x7f8e04071090 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.198+0000 7f8df2ffd640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8de4038060 0x7f8de403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.198+0000 7f8df2ffd640 1 -- 172.21.15.107:0/1468796853 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8df802f050 con 0x7f8e04071090 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.199+0000 7f8e01d9b640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8de4038060 0x7f8de403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.199+0000 7f8e01d9b640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8de4038060 0x7f8de403a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8df4000c00 tx=0x7f8df4007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:58.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.203+0000 7f8df2ffd640 1 -- 172.21.15.107:0/1468796853 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f8df8040070 con 0x7f8e04071090 2024-04-24T01:45:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.376+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e0408c4c0 con 0x7f8e04071090 2024-04-24T01:45:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.378+0000 7f8df2ffd640 1 -- 172.21.15.107:0/1468796853 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+20941 (secure 0 0 0) 0x7f8df803a380 con 0x7f8e04071090 2024-04-24T01:45:58.379 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:45:58.379 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":34,"fsid":"bbf4dd9c-0d50-4da0-921c-8b1690fa6e43","created":"2024-04-24T01:42:15.810458+0000","modified":"2024-04-24T01:43:21.804013+0000","last_up_change":"2024-04-24T01:42:25.691893+0000","last_in_change":"2024-04-24T01:42:16.924967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:42:26.034973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:42:31.407234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-24T01:42:38.765100+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-24T01:42:41.087926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-24T01:42:43.049671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-24T01:42:44.854181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-24T01:42:46.802385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-24T01:42:48.890270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3146761-e93e-4bdf-8311-10dc9fe86689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6801","nonce":2413654117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6803","nonce":2413654117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6807","nonce":2413654117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2413654117},{"type":"v1","addr":"172.21.15.107:6805","nonce":2413654117}]},"public_addr":"172.21.15.107:6801/2413654117","cluster_addr":"172.21.15.107:6803/2413654117","heartbeat_back_addr":"172.21.15.107:6807/2413654117","heartbeat_front_addr":"172.21.15.107:6805/2413654117","state":["exists","up"]},{"osd":1,"uuid":"3ec5b898-bc94-4ad2-85b6-6c809d5f9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6810","nonce":2417718615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6814","nonce":2417718615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6819","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6821","nonce":2417718615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2417718615},{"type":"v1","addr":"172.21.15.131:6817","nonce":2417718615}]},"public_addr":"172.21.15.131:6810/2417718615","cluster_addr":"172.21.15.131:6814/2417718615","heartbeat_back_addr":"172.21.15.131:6821/2417718615","heartbeat_front_addr":"172.21.15.131:6817/2417718615","state":["exists","up"]},{"osd":2,"uuid":"55fbd99e-62cc-471f-bc45-7c8afd7708d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6811","nonce":3673094383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6815","nonce":3673094383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6823","nonce":3673094383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3673094383},{"type":"v1","addr":"172.21.15.131:6820","nonce":3673094383}]},"public_addr":"172.21.15.131:6811/3673094383","cluster_addr":"172.21.15.131:6815/3673094383","heartbeat_back_addr":"172.21.15.131:6823/3673094383","heartbeat_front_addr":"172.21.15.131:6820/3673094383","state":["exists","up"]},{"osd":3,"uuid":"7d0b408a-aec1-4880-87b0-b1848ad9cbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6801","nonce":3849831825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6803","nonce":3849831825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6807","nonce":3849831825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3849831825},{"type":"v1","addr":"172.21.15.131:6805","nonce":3849831825}]},"public_addr":"172.21.15.131:6801/3849831825","cluster_addr":"172.21.15.131:6803/3849831825","heartbeat_back_addr":"172.21.15.131:6807/3849831825","heartbeat_front_addr":"172.21.15.131:6805/3849831825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:21.943591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.153669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.139045+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:42:22.228740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.15","mappings":[{"from":0,"to":2}]},{"pgid":"5.16","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:45:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8de4038060 msgr2=0x7f8de403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8de4038060 0x7f8de403a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8df4000c00 tx=0x7f8df4007910 comp rx=0 tx=0).stop 2024-04-24T01:45:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04071090 msgr2=0x7f8e04089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04071090 0x7f8e04089f90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8df8034040 tx=0x7f8df80046c0 comp rx=0 tx=0).stop 2024-04-24T01:45:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 shutdown_connections 2024-04-24T01:45:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8de4038060 0x7f8de403a520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 --2- 172.21.15.107:0/1468796853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e04071090 0x7f8e04089f90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 >> 172.21.15.107:0/1468796853 conn(0x7f8e04099680 msgr2=0x7f8e04128590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 shutdown_connections 2024-04-24T01:45:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:58.380+0000 7f8e08e9a640 1 -- 172.21.15.107:0/1468796853 wait complete. 2024-04-24T01:45:58.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-24T01:45:59.392 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T01:45:59.392 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:45:59.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de309d640 1 Processor -- start 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de309d640 1 -- start start 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de309d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ddc12e350 0x7f9ddc12e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de309d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc12f260 con 0x7f9ddc12ee20 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de309d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9ddc06db00 con 0x7f9ddc12e350 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de0e39640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ddc12e350 0x7f9ddc12e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9ddbfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9ddc12ee20 0x7f9ddc12ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35910/0 (socket says 172.21.15.107:35910) 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9ddbfff640 1 -- 172.21.15.107:0/4253093644 learned_addr learned my addr 172.21.15.107:0/4253093644 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de0e39640 1 -- 172.21.15.107:0/4253093644 >> v1:172.21.15.107:6789/0 conn(0x7f9ddc12ee20 legacy=0x7f9ddc12ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.503+0000 7f9de0e39640 1 -- 172.21.15.107:0/4253093644 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc093140 con 0x7f9ddc12e350 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.504+0000 7f9de0e39640 1 --2- 172.21.15.107:0/4253093644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc12e8e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009720 tx=0x7f9dd002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bfb49c36da1b01 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.504+0000 7f9ddb7fe640 1 -- 172.21.15.107:0/4253093644 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd00316d0 con 0x7f9ddc12e350 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.504+0000 7f9ddb7fe640 1 -- 172.21.15.107:0/4253093644 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd0037070 con 0x7f9ddc12e350 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.504+0000 7f9ddb7fe640 1 -- 172.21.15.107:0/4253093644 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd00319c0 con 0x7f9ddc12e350 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.505+0000 7f9de309d640 1 -- 172.21.15.107:0/4253093644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 msgr2=0x7f9ddc12e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.505+0000 7f9de309d640 1 --2- 172.21.15.107:0/4253093644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc12e8e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009720 tx=0x7f9dd002b840 comp rx=0 tx=0).stop 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.505+0000 7f9de309d640 1 -- 172.21.15.107:0/4253093644 shutdown_connections 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.505+0000 7f9de309d640 1 --2- 172.21.15.107:0/4253093644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc12e8e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.505+0000 7f9de309d640 1 -- 172.21.15.107:0/4253093644 >> 172.21.15.107:0/4253093644 conn(0x7f9ddc09fba0 msgr2=0x7f9ddc09ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.505+0000 7f9de309d640 1 -- 172.21.15.107:0/4253093644 shutdown_connections 2024-04-24T01:45:59.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.505+0000 7f9de309d640 1 -- 172.21.15.107:0/4253093644 wait complete. 2024-04-24T01:45:59.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.506+0000 7f9de309d640 1 Processor -- start 2024-04-24T01:45:59.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.506+0000 7f9de309d640 1 -- start start 2024-04-24T01:45:59.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.506+0000 7f9de309d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc1bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.506+0000 7f9de309d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc12b6e0 con 0x7f9ddc12e350 2024-04-24T01:45:59.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.506+0000 7f9de0e39640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc1bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.506+0000 7f9de0e39640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc1bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47966/0 (socket says 172.21.15.107:47966) 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.506+0000 7f9de0e39640 1 -- 172.21.15.107:0/381451855 learned_addr learned my addr 172.21.15.107:0/381451855 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.507+0000 7f9de0e39640 1 -- 172.21.15.107:0/381451855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc128180 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.507+0000 7f9de0e39640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc1bfc80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009720 tx=0x7f9dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.507+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd0032770 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.507+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd0032910 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.507+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd0032bf0 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.507+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc128a80 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.507+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc0706c0 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.508+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ddc062da0 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.508+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9dd004d3f0 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.508+0000 7f9dd97fa640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9dc0038060 0x7f9dc003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.508+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9dd002f050 con 0x7f9ddc12e350 2024-04-24T01:45:59.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.508+0000 7f9dd97fa640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9dc0044440 0x7f9dc00468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.508+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9dd004cec0 con 0x7f9dc0044440 2024-04-24T01:45:59.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.508+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9dd0074050 con 0x7f9ddc12e350 2024-04-24T01:45:59.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.509+0000 7f9de163a640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9dc0044440 0x7f9dc00468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.509+0000 7f9ddbfff640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9dc0038060 0x7f9dc003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.509+0000 7f9de163a640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9dc0044440 0x7f9dc00468e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.509+0000 7f9ddbfff640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9dc0038060 0x7f9dc003a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8007fd0 tx=0x7f9dc8007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.509+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== osd.0 v2:172.21.15.107:6800/2413654117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9dd004cec0 con 0x7f9dc0044440 2024-04-24T01:45:59.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.522+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 --> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9ddc12b4f0 con 0x7f9dc0044440 2024-04-24T01:45:59.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9dd97fa640 1 -- 172.21.15.107:0/381451855 <== osd.0 v2:172.21.15.107:6800/2413654117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9ddc12b4f0 con 0x7f9dc0044440 2024-04-24T01:45:59.524 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-24T01:45:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:45:59.524 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-24T01:45:59.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9dc0044440 msgr2=0x7f9dc00468e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9dc0044440 0x7f9dc00468e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9dc0038060 msgr2=0x7f9dc003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9dc0038060 0x7f9dc003a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8007fd0 tx=0x7f9dc8007ac0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 msgr2=0x7f9ddc1bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc1bfc80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009720 tx=0x7f9dd00046c0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 shutdown_connections 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:6800/2413654117,v1:172.21.15.107:6801/2413654117] conn(0x7f9dc0044440 0x7f9dc00468e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9dc0038060 0x7f9dc003a520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 --2- 172.21.15.107:0/381451855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ddc12e350 0x7f9ddc1bfc80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 >> 172.21.15.107:0/381451855 conn(0x7f9ddc09fba0 msgr2=0x7f9ddc12cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:59.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 shutdown_connections 2024-04-24T01:45:59.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.523+0000 7f9de309d640 1 -- 172.21.15.107:0/381451855 wait complete. 2024-04-24T01:45:59.535 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T01:45:59.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc564c38640 1 Processor -- start 2024-04-24T01:45:59.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc564c38640 1 -- start start 2024-04-24T01:45:59.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc564c38640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc560096430 0x7fc560096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc564c38640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc560098800 con 0x7fc560071090 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc564c38640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc560071930 con 0x7fc560096430 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc55e59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc560096430 0x7fc560096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc55dd9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc560071090 0x7fc56006d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35924/0 (socket says 172.21.15.107:35924) 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.632+0000 7fc55dd9b640 1 -- 172.21.15.107:0/1892421564 learned_addr learned my addr 172.21.15.107:0/1892421564 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.633+0000 7fc55e59c640 1 -- 172.21.15.107:0/1892421564 >> v1:172.21.15.107:6789/0 conn(0x7fc560071090 legacy=0x7fc56006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.633+0000 7fc55e59c640 1 -- 172.21.15.107:0/1892421564 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc560071f50 con 0x7fc560096430 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.633+0000 7fc55d59a640 1 -- 172.21.15.107:0/1892421564 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496247799 0 0) 0x7fc560098800 con 0x7fc560071090 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.633+0000 7fc55e59c640 1 --2- 172.21.15.107:0/1892421564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560096430 0x7fc560096810 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc548009720 tx=0x7fc54802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16350efb9234a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.633+0000 7fc55d59a640 1 -- 172.21.15.107:0/1892421564 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5480316d0 con 0x7fc560096430 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.633+0000 7fc55d59a640 1 -- 172.21.15.107:0/1892421564 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548037070 con 0x7fc560096430 2024-04-24T01:45:59.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc55d59a640 1 -- 172.21.15.107:0/1892421564 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5480319c0 con 0x7fc560096430 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc564c38640 1 -- 172.21.15.107:0/1892421564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560096430 msgr2=0x7fc560096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc564c38640 1 --2- 172.21.15.107:0/1892421564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560096430 0x7fc560096810 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc548009720 tx=0x7fc54802b840 comp rx=0 tx=0).stop 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc564c38640 1 -- 172.21.15.107:0/1892421564 shutdown_connections 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc564c38640 1 --2- 172.21.15.107:0/1892421564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560096430 0x7fc560096810 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc564c38640 1 -- 172.21.15.107:0/1892421564 >> 172.21.15.107:0/1892421564 conn(0x7fc560099680 msgr2=0x7fc560099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc564c38640 1 -- 172.21.15.107:0/1892421564 shutdown_connections 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.634+0000 7fc564c38640 1 -- 172.21.15.107:0/1892421564 wait complete. 2024-04-24T01:45:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.635+0000 7fc564c38640 1 Processor -- start 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.635+0000 7fc564c38640 1 -- start start 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.635+0000 7fc564c38640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560071090 0x7fc560089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.635+0000 7fc564c38640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc560096d50 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.635+0000 7fc55e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560071090 0x7fc560089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc55e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560071090 0x7fc560089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47988/0 (socket says 172.21.15.107:47988) 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc55e59c640 1 -- 172.21.15.107:0/608575725 learned_addr learned my addr 172.21.15.107:0/608575725 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc55e59c640 1 -- 172.21.15.107:0/608575725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56008b620 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc55e59c640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560071090 0x7fc560089f90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc548034040 tx=0x7fc5480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc556ffd640 1 -- 172.21.15.107:0/608575725 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc548032770 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc556ffd640 1 -- 172.21.15.107:0/608575725 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548032910 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc560126330 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc556ffd640 1 -- 172.21.15.107:0/608575725 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc548032c30 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.636+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56008c2b0 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.637+0000 7fc556ffd640 1 -- 172.21.15.107:0/608575725 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc54804c060 con 0x7fc560071090 2024-04-24T01:45:59.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.637+0000 7fc556ffd640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc540038060 0x7fc54003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.637+0000 7fc556ffd640 1 -- 172.21.15.107:0/608575725 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc54802f050 con 0x7fc560071090 2024-04-24T01:45:59.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.637+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56008c5a0 con 0x7fc560071090 2024-04-24T01:45:59.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.637+0000 7fc55dd9b640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc540038060 0x7fc54003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.638+0000 7fc55dd9b640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc540038060 0x7fc54003a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc550000c00 tx=0x7fc550007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.642+0000 7fc556ffd640 1 -- 172.21.15.107:0/608575725 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fc56008c5a0 con 0x7fc560071090 2024-04-24T01:45:59.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.813+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc560128fd0 con 0x7fc540038060 2024-04-24T01:45:59.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.815+0000 7fc556ffd640 1 -- 172.21.15.107:0/608575725 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc5500070d0 con 0x7fc540038060 2024-04-24T01:45:59.816 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T01:45:59.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc540038060 msgr2=0x7fc54003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc540038060 0x7fc54003a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc550000c00 tx=0x7fc550007910 comp rx=0 tx=0).stop 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560071090 msgr2=0x7fc560089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560071090 0x7fc560089f90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc548034040 tx=0x7fc5480046c0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 shutdown_connections 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc540038060 0x7fc54003a520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 --2- 172.21.15.107:0/608575725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc560071090 0x7fc560089f90 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 >> 172.21.15.107:0/608575725 conn(0x7fc560099680 msgr2=0x7fc5601284f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 shutdown_connections 2024-04-24T01:45:59.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.817+0000 7fc564c38640 1 -- 172.21.15.107:0/608575725 wait complete. 2024-04-24T01:45:59.828 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T01:45:59.829 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:45:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc68512e640 1 Processor -- start 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc68512e640 1 -- start start 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc68512e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc68012e2f0 0x7fc6801306e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc68512e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68006eac0 con 0x7fc68012b3d0 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc68512e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc68012af80 con 0x7fc68012e2f0 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc67ed9d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc68012b3d0 0x7fc68012b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35938/0 (socket says 172.21.15.107:35938) 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc67ed9d640 1 -- 172.21.15.107:0/3364709314 learned_addr learned my addr 172.21.15.107:0/3364709314 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc67e59c640 1 --2- 172.21.15.107:0/3364709314 >> v2:172.21.15.107:3300/0 conn(0x7fc68012e2f0 0x7fc6801306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc67dd9b640 1 -- 172.21.15.107:0/3364709314 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314630398 0 0) 0x7fc68006eac0 con 0x7fc68012b3d0 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc67dd9b640 1 -- 172.21.15.107:0/3364709314 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc668003520 con 0x7fc68012b3d0 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.927+0000 7fc67e59c640 1 -- 172.21.15.107:0/3364709314 >> v1:172.21.15.107:6789/0 conn(0x7fc68012b3d0 legacy=0x7fc68012b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.928+0000 7fc67e59c640 1 -- 172.21.15.107:0/3364709314 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68012b1b0 con 0x7fc68012e2f0 2024-04-24T01:45:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.928+0000 7fc67e59c640 1 --2- 172.21.15.107:0/3364709314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012e2f0 0x7fc6801306e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc674009720 tx=0x7fc67402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2e062472733514 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.928+0000 7fc67dd9b640 1 -- 172.21.15.107:0/3364709314 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6740316d0 con 0x7fc68012e2f0 2024-04-24T01:45:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.928+0000 7fc67dd9b640 1 -- 172.21.15.107:0/3364709314 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc674037070 con 0x7fc68012e2f0 2024-04-24T01:45:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.928+0000 7fc67dd9b640 1 -- 172.21.15.107:0/3364709314 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6740319c0 con 0x7fc68012e2f0 2024-04-24T01:45:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.929+0000 7fc68512e640 1 -- 172.21.15.107:0/3364709314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012e2f0 msgr2=0x7fc6801306e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.929+0000 7fc68512e640 1 --2- 172.21.15.107:0/3364709314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012e2f0 0x7fc6801306e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc674009720 tx=0x7fc67402b840 comp rx=0 tx=0).stop 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.929+0000 7fc68512e640 1 -- 172.21.15.107:0/3364709314 shutdown_connections 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.929+0000 7fc68512e640 1 --2- 172.21.15.107:0/3364709314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012e2f0 0x7fc6801306e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.929+0000 7fc68512e640 1 -- 172.21.15.107:0/3364709314 >> 172.21.15.107:0/3364709314 conn(0x7fc680099510 msgr2=0x7fc680099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.929+0000 7fc68512e640 1 -- 172.21.15.107:0/3364709314 shutdown_connections 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.929+0000 7fc68512e640 1 -- 172.21.15.107:0/3364709314 wait complete. 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.930+0000 7fc68512e640 1 Processor -- start 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.930+0000 7fc68512e640 1 -- start start 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.930+0000 7fc68512e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012b3d0 0x7fc6801207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.930+0000 7fc68512e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc680072480 con 0x7fc68012b3d0 2024-04-24T01:45:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.930+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012b3d0 0x7fc6801207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc67ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012b3d0 0x7fc6801207d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47998/0 (socket says 172.21.15.107:47998) 2024-04-24T01:45:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc67ed9d640 1 -- 172.21.15.107:0/2165440845 learned_addr learned my addr 172.21.15.107:0/2165440845 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:45:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc67ed9d640 1 -- 172.21.15.107:0/2165440845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68006f930 con 0x7fc68012b3d0 2024-04-24T01:45:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc67ed9d640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012b3d0 0x7fc6801207d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc67000c480 tx=0x7fc67000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc670017070 con 0x7fc68012b3d0 2024-04-24T01:45:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc670005c10 con 0x7fc68012b3d0 2024-04-24T01:45:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68006f350 con 0x7fc68012b3d0 2024-04-24T01:45:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc670007070 con 0x7fc68012b3d0 2024-04-24T01:45:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.931+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc680114e40 con 0x7fc68012b3d0 2024-04-24T01:45:59.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.932+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc68012aab0 con 0x7fc68012b3d0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.932+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc67001a070 con 0x7fc68012b3d0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.932+0000 7fc6677fe640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc66c038060 0x7fc66c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.932+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc67004ad80 con 0x7fc68012b3d0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.932+0000 7fc6677fe640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7fc66c044440 0x7fc66c0468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.932+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc66c046fb0 con 0x7fc66c044440 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.932+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc67004d430 con 0x7fc68012b3d0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.933+0000 7fc67e59c640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc66c038060 0x7fc66c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.933+0000 7fc67f59e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7fc66c044440 0x7fc66c0468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.933+0000 7fc67f59e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7fc66c044440 0x7fc66c0468e0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.933+0000 7fc67e59c640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc66c038060 0x7fc66c03a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc674009720 tx=0x7fc674008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:45:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.934+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== osd.1 v2:172.21.15.131:6808/2417718615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc66c046fb0 con 0x7fc66c044440 2024-04-24T01:45:59.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.947+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 --> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc680062da0 con 0x7fc66c044440 2024-04-24T01:45:59.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.947+0000 7fc6677fe640 1 -- 172.21.15.107:0/2165440845 <== osd.1 v2:172.21.15.131:6808/2417718615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc680062da0 con 0x7fc66c044440 2024-04-24T01:45:59.949 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-24T01:45:59.949 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:45:59.949 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-24T01:45:59.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7fc66c044440 msgr2=0x7fc66c0468e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7fc66c044440 0x7fc66c0468e0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc66c038060 msgr2=0x7fc66c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc66c038060 0x7fc66c03a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc674009720 tx=0x7fc674008030 comp rx=0 tx=0).stop 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012b3d0 msgr2=0x7fc6801207d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012b3d0 0x7fc6801207d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc67000c480 tx=0x7fc67000c940 comp rx=0 tx=0).stop 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 shutdown_connections 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6808/2417718615,v1:172.21.15.131:6810/2417718615] conn(0x7fc66c044440 0x7fc66c0468e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fc66c038060 0x7fc66c03a520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 --2- 172.21.15.107:0/2165440845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68012b3d0 0x7fc6801207d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 >> 172.21.15.107:0/2165440845 conn(0x7fc680099510 msgr2=0x7fc68009a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 shutdown_connections 2024-04-24T01:45:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:45:59.948+0000 7fc68512e640 1 -- 172.21.15.107:0/2165440845 wait complete. 2024-04-24T01:45:59.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c46ba640 1 Processor -- start 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c46ba640 1 -- start start 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c46ba640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70bc12dae0 0x7f70bc12fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c46ba640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70bc06f0f0 con 0x7f70bc06d690 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c46ba640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f70bc071a60 con 0x7f70bc12dae0 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c1c55640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70bc12dae0 0x7f70bc12fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c2456640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f70bc06d690 0x7f70bc06da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35948/0 (socket says 172.21.15.107:35948) 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.054+0000 7f70c2456640 1 -- 172.21.15.107:0/578704253 learned_addr learned my addr 172.21.15.107:0/578704253 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.055+0000 7f70c1c55640 1 -- 172.21.15.107:0/578704253 >> v1:172.21.15.107:6789/0 conn(0x7f70bc06d690 legacy=0x7f70bc06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.055+0000 7f70c1c55640 1 -- 172.21.15.107:0/578704253 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc06f8b0 con 0x7f70bc12dae0 2024-04-24T01:46:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.055+0000 7f70c1454640 1 -- 172.21.15.107:0/578704253 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820864829 0 0) 0x7f70bc06f0f0 con 0x7f70bc06d690 2024-04-24T01:46:00.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.055+0000 7f70c1c55640 1 --2- 172.21.15.107:0/578704253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc12dae0 0x7f70bc12fed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009720 tx=0x7f70ac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8a3603f79963d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c1454640 1 -- 172.21.15.107:0/578704253 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0316d0 con 0x7f70bc12dae0 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c1454640 1 -- 172.21.15.107:0/578704253 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ac037070 con 0x7f70bc12dae0 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c1454640 1 -- 172.21.15.107:0/578704253 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0319c0 con 0x7f70bc12dae0 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c46ba640 1 -- 172.21.15.107:0/578704253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc12dae0 msgr2=0x7f70bc12fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c46ba640 1 --2- 172.21.15.107:0/578704253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc12dae0 0x7f70bc12fed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009720 tx=0x7f70ac02b840 comp rx=0 tx=0).stop 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c46ba640 1 -- 172.21.15.107:0/578704253 shutdown_connections 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c46ba640 1 --2- 172.21.15.107:0/578704253 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc12dae0 0x7f70bc12fed0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c46ba640 1 -- 172.21.15.107:0/578704253 >> 172.21.15.107:0/578704253 conn(0x7f70bc099680 msgr2=0x7f70bc099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c46ba640 1 -- 172.21.15.107:0/578704253 shutdown_connections 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.056+0000 7f70c46ba640 1 -- 172.21.15.107:0/578704253 wait complete. 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.057+0000 7f70c46ba640 1 Processor -- start 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.057+0000 7f70c46ba640 1 -- start start 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.057+0000 7f70c46ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc06d690 0x7f70bc12c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.057+0000 7f70c46ba640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc06e180 con 0x7f70bc06d690 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.057+0000 7f70c2456640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc06d690 0x7f70bc12c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.057+0000 7f70c2456640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc06d690 0x7f70bc12c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48024/0 (socket says 172.21.15.107:48024) 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.057+0000 7f70c2456640 1 -- 172.21.15.107:0/2217256221 learned_addr learned my addr 172.21.15.107:0/2217256221 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.058+0000 7f70c2456640 1 -- 172.21.15.107:0/2217256221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc129780 con 0x7f70bc06d690 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.058+0000 7f70c2456640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc06d690 0x7f70bc12c8a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c370 tx=0x7f70b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.058+0000 7f70b2ffd640 1 -- 172.21.15.107:0/2217256221 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b8007410 con 0x7f70bc06d690 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.058+0000 7f70b2ffd640 1 -- 172.21.15.107:0/2217256221 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b80075d0 con 0x7f70bc06d690 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.058+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc0987e0 con 0x7f70bc06d690 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.058+0000 7f70b2ffd640 1 -- 172.21.15.107:0/2217256221 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b8004950 con 0x7f70bc06d690 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.058+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc129e60 con 0x7f70bc06d690 2024-04-24T01:46:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.059+0000 7f70b2ffd640 1 -- 172.21.15.107:0/2217256221 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f70b8011070 con 0x7f70bc06d690 2024-04-24T01:46:00.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.059+0000 7f70b2ffd640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a0038060 0x7f70a003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.059+0000 7f70b2ffd640 1 -- 172.21.15.107:0/2217256221 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f70b804b5e0 con 0x7f70bc06d690 2024-04-24T01:46:00.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.059+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc062da0 con 0x7f70bc06d690 2024-04-24T01:46:00.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.059+0000 7f70c1c55640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a0038060 0x7f70a003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.060+0000 7f70c1c55640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a0038060 0x7f70a003a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f70ac036000 tx=0x7f70ac008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.064+0000 7f70b2ffd640 1 -- 172.21.15.107:0/2217256221 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f70b801cbd0 con 0x7f70bc06d690 2024-04-24T01:46:00.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.234+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f70bc071660 con 0x7f70a0038060 2024-04-24T01:46:00.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.235+0000 7f70b2ffd640 1 -- 172.21.15.107:0/2217256221 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f70bc071660 con 0x7f70a0038060 2024-04-24T01:46:00.236 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a0038060 msgr2=0x7f70a003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a0038060 0x7f70a003a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f70ac036000 tx=0x7f70ac008030 comp rx=0 tx=0).stop 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc06d690 msgr2=0x7f70bc12c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc06d690 0x7f70bc12c8a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c370 tx=0x7f70b800c830 comp rx=0 tx=0).stop 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 shutdown_connections 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f70a0038060 0x7f70a003a520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 --2- 172.21.15.107:0/2217256221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70bc06d690 0x7f70bc12c8a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.236+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 >> 172.21.15.107:0/2217256221 conn(0x7f70bc099680 msgr2=0x7f70bc09a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.237+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 shutdown_connections 2024-04-24T01:46:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.237+0000 7f70c46ba640 1 -- 172.21.15.107:0/2217256221 wait complete. 2024-04-24T01:46:00.248 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T01:46:00.248 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:46:00.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.347+0000 7f5fa5edf640 1 Processor -- start 2024-04-24T01:46:00.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.347+0000 7f5fa5edf640 1 -- start start 2024-04-24T01:46:00.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5fa5edf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5fa012e2f0 0x7f5fa01306e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5fa5edf640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa006eac0 con 0x7f5fa012b3d0 2024-04-24T01:46:00.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5fa5edf640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa012af80 con 0x7f5fa012e2f0 2024-04-24T01:46:00.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5f9effd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5fa012e2f0 0x7f5fa01306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5f9f7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5fa012b3d0 0x7f5fa012b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35954/0 (socket says 172.21.15.107:35954) 2024-04-24T01:46:00.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5f9f7fe640 1 -- 172.21.15.107:0/1804834107 learned_addr learned my addr 172.21.15.107:0/1804834107 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:00.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5f9effd640 1 -- 172.21.15.107:0/1804834107 >> v1:172.21.15.107:6789/0 conn(0x7f5fa012b3d0 legacy=0x7f5fa012b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.348+0000 7f5f9effd640 1 -- 172.21.15.107:0/1804834107 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa012b1b0 con 0x7f5fa012e2f0 2024-04-24T01:46:00.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5f9effd640 1 --2- 172.21.15.107:0/1804834107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012e2f0 0x7f5fa01306e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009720 tx=0x7f5f9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a128a7bb6397df8d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5f9e7fc640 1 -- 172.21.15.107:0/1804834107 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940316d0 con 0x7f5fa012e2f0 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5f9e7fc640 1 -- 172.21.15.107:0/1804834107 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f94037070 con 0x7f5fa012e2f0 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5f9e7fc640 1 -- 172.21.15.107:0/1804834107 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940319c0 con 0x7f5fa012e2f0 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1804834107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012e2f0 msgr2=0x7f5fa01306e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1804834107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012e2f0 0x7f5fa01306e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009720 tx=0x7f5f9402b840 comp rx=0 tx=0).stop 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1804834107 shutdown_connections 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1804834107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012e2f0 0x7f5fa01306e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1804834107 >> 172.21.15.107:0/1804834107 conn(0x7f5fa0099510 msgr2=0x7f5fa0099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1804834107 shutdown_connections 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.349+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1804834107 wait complete. 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.350+0000 7f5fa5edf640 1 Processor -- start 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.350+0000 7f5fa5edf640 1 -- start start 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5fa5edf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012b3d0 0x7f5fa0112e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5fa5edf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa0072480 con 0x7f5fa012b3d0 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f9f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012b3d0 0x7f5fa0112e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f9f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012b3d0 0x7f5fa0112e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48038/0 (socket says 172.21.15.107:48038) 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f9f7fe640 1 -- 172.21.15.107:0/1324270566 learned_addr learned my addr 172.21.15.107:0/1324270566 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f9f7fe640 1 -- 172.21.15.107:0/1324270566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa0114b00 con 0x7f5fa012b3d0 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f9f7fe640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012b3d0 0x7f5fa0112e70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000c4a0 tx=0x7f5f9000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90017070 con 0x7f5fa012b3d0 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f90005c10 con 0x7f5fa012b3d0 2024-04-24T01:46:00.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa01142f0 con 0x7f5fa012b3d0 2024-04-24T01:46:00.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90007070 con 0x7f5fa012b3d0 2024-04-24T01:46:00.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.351+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa006f2c0 con 0x7f5fa012b3d0 2024-04-24T01:46:00.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.352+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5fa0062da0 con 0x7f5fa012b3d0 2024-04-24T01:46:00.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.352+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f9001a070 con 0x7f5fa012b3d0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.352+0000 7f5f87fff640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5f8c038060 0x7f5f8c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.352+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f5f9004acd0 con 0x7f5fa012b3d0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.353+0000 7f5f87fff640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5f8c0443e0 0x7f5f8c046880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.353+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f8c046f50 con 0x7f5f8c0443e0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.353+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5f9004d380 con 0x7f5fa012b3d0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.353+0000 7f5f9effd640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5f8c038060 0x7f5f8c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.353+0000 7f5f9ffff640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5f8c0443e0 0x7f5f8c046880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.353+0000 7f5f9ffff640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5f8c0443e0 0x7f5f8c046880 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.353+0000 7f5f9effd640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5f8c038060 0x7f5f8c03a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009720 tx=0x7f5f94008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.354+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== osd.2 v2:172.21.15.131:6809/3673094383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f8c046f50 con 0x7f5f8c0443e0 2024-04-24T01:46:00.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.367+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 --> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5fa012e2f0 con 0x7f5f8c0443e0 2024-04-24T01:46:00.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.367+0000 7f5f87fff640 1 -- 172.21.15.107:0/1324270566 <== osd.2 v2:172.21.15.131:6809/3673094383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5fa012e2f0 con 0x7f5f8c0443e0 2024-04-24T01:46:00.368 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-24T01:46:00.368 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:46:00.369 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-24T01:46:00.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5f8c0443e0 msgr2=0x7f5f8c046880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5f8c0443e0 0x7f5f8c046880 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5f8c038060 msgr2=0x7f5f8c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5f8c038060 0x7f5f8c03a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009720 tx=0x7f5f94008030 comp rx=0 tx=0).stop 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012b3d0 msgr2=0x7f5fa0112e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012b3d0 0x7f5fa0112e70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000c4a0 tx=0x7f5f9000c960 comp rx=0 tx=0).stop 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 shutdown_connections 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6809/3673094383,v1:172.21.15.131:6811/3673094383] conn(0x7f5f8c0443e0 0x7f5f8c046880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f5f8c038060 0x7f5f8c03a520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 --2- 172.21.15.107:0/1324270566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fa012b3d0 0x7f5fa0112e70 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 >> 172.21.15.107:0/1324270566 conn(0x7f5fa0099510 msgr2=0x7f5fa009a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 shutdown_connections 2024-04-24T01:46:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.368+0000 7f5fa5edf640 1 -- 172.21.15.107:0/1324270566 wait complete. 2024-04-24T01:46:00.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T01:46:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.474+0000 7f7dbb8c8640 1 Processor -- start 2024-04-24T01:46:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.474+0000 7f7dbb8c8640 1 -- start start 2024-04-24T01:46:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7dbb8c8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7db412f0a0 0x7f7db4133ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7dbb8c8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db406dde0 con 0x7f7db412e5b0 2024-04-24T01:46:00.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7dbb8c8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7db4070280 con 0x7f7db412f0a0 2024-04-24T01:46:00.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7db8e63640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7db412f0a0 0x7f7db4133ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7db9664640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7db412e5b0 0x7f7db412e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35960/0 (socket says 172.21.15.107:35960) 2024-04-24T01:46:00.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7db9664640 1 -- 172.21.15.107:0/2471043138 learned_addr learned my addr 172.21.15.107:0/2471043138 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:00.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7db8e63640 1 -- 172.21.15.107:0/2471043138 >> v1:172.21.15.107:6789/0 conn(0x7f7db412e5b0 legacy=0x7f7db412e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.475+0000 7f7db8e63640 1 -- 172.21.15.107:0/2471043138 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db406f6d0 con 0x7f7db412f0a0 2024-04-24T01:46:00.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.476+0000 7f7db8e63640 1 --2- 172.21.15.107:0/2471043138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412f0a0 0x7f7db4133ae0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009720 tx=0x7f7da402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c30142e003b26ed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.476+0000 7f7dabfff640 1 -- 172.21.15.107:0/2471043138 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da40316d0 con 0x7f7db412f0a0 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.476+0000 7f7dabfff640 1 -- 172.21.15.107:0/2471043138 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da4037070 con 0x7f7db412f0a0 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.476+0000 7f7dabfff640 1 -- 172.21.15.107:0/2471043138 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da40319c0 con 0x7f7db412f0a0 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.476+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/2471043138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412f0a0 msgr2=0x7f7db4133ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.476+0000 7f7dbb8c8640 1 --2- 172.21.15.107:0/2471043138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412f0a0 0x7f7db4133ae0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009720 tx=0x7f7da402b840 comp rx=0 tx=0).stop 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.477+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/2471043138 shutdown_connections 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.477+0000 7f7dbb8c8640 1 --2- 172.21.15.107:0/2471043138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412f0a0 0x7f7db4133ae0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.477+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/2471043138 >> 172.21.15.107:0/2471043138 conn(0x7f7db409c7f0 msgr2=0x7f7db409cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.477+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/2471043138 shutdown_connections 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.477+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/2471043138 wait complete. 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.477+0000 7f7dbb8c8640 1 Processor -- start 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.477+0000 7f7dbb8c8640 1 -- start start 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7dbb8c8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412e5b0 0x7f7db411b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7dbb8c8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7db409b860 con 0x7f7db412e5b0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7db9664640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412e5b0 0x7f7db411b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7db9664640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412e5b0 0x7f7db411b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48058/0 (socket says 172.21.15.107:48058) 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7db9664640 1 -- 172.21.15.107:0/241025247 learned_addr learned my addr 172.21.15.107:0/241025247 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7db9664640 1 -- 172.21.15.107:0/241025247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db4133800 con 0x7f7db412e5b0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7db9664640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412e5b0 0x7f7db411b090 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7db000cb20 tx=0x7f7db000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7da9ffb640 1 -- 172.21.15.107:0/241025247 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0017070 con 0x7f7db412e5b0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7da9ffb640 1 -- 172.21.15.107:0/241025247 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db000abf0 con 0x7f7db412e5b0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db411e250 con 0x7f7db412e5b0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.478+0000 7f7da9ffb640 1 -- 172.21.15.107:0/241025247 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0012400 con 0x7f7db412e5b0 2024-04-24T01:46:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.479+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db411dbc0 con 0x7f7db412e5b0 2024-04-24T01:46:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.479+0000 7f7da9ffb640 1 -- 172.21.15.107:0/241025247 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7db001a070 con 0x7f7db412e5b0 2024-04-24T01:46:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.479+0000 7f7da9ffb640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7d98038060 0x7f7d9803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.479+0000 7f7da9ffb640 1 -- 172.21.15.107:0/241025247 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f7db004b7b0 con 0x7f7db412e5b0 2024-04-24T01:46:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.480+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db411c9b0 con 0x7f7db412e5b0 2024-04-24T01:46:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.480+0000 7f7db8e63640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7d98038060 0x7f7d9803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.481+0000 7f7db8e63640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7d98038060 0x7f7d9803a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7da4036000 tx=0x7f7da4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.484+0000 7f7da9ffb640 1 -- 172.21.15.107:0/241025247 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f7db0012df0 con 0x7f7db412e5b0 2024-04-24T01:46:00.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.655+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f7db4062da0 con 0x7f7d98038060 2024-04-24T01:46:00.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.656+0000 7f7da9ffb640 1 -- 172.21.15.107:0/241025247 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7db4062da0 con 0x7f7d98038060 2024-04-24T01:46:00.657 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T01:46:00.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7d98038060 msgr2=0x7f7d9803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7d98038060 0x7f7d9803a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7da4036000 tx=0x7f7da4008030 comp rx=0 tx=0).stop 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412e5b0 msgr2=0x7f7db411b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412e5b0 0x7f7db411b090 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7db000cb20 tx=0x7f7db000a060 comp rx=0 tx=0).stop 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 shutdown_connections 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f7d98038060 0x7f7d9803a520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 --2- 172.21.15.107:0/241025247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db412e5b0 0x7f7db411b090 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 >> 172.21.15.107:0/241025247 conn(0x7f7db409c7f0 msgr2=0x7f7db4071210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 shutdown_connections 2024-04-24T01:46:00.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.658+0000 7f7dbb8c8640 1 -- 172.21.15.107:0/241025247 wait complete. 2024-04-24T01:46:00.670 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T01:46:00.670 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:46:00.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0bac6c8640 1 Processor -- start 2024-04-24T01:46:00.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0bac6c8640 1 -- start start 2024-04-24T01:46:00.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0bac6c8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ba412c3a0 0x7f0ba412c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0bac6c8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba412c1a0 con 0x7f0ba4113160 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0bac6c8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba406ffe0 con 0x7f0ba412c3a0 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0baa464640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ba412c3a0 0x7f0ba412c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0ba9c63640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0ba4113160 0x7f0ba406e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:51896/0 (socket says 172.21.15.107:51896) 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.769+0000 7f0ba9c63640 1 -- 172.21.15.107:0/1929328844 learned_addr learned my addr 172.21.15.107:0/1929328844 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.770+0000 7f0baa464640 1 -- 172.21.15.107:0/1929328844 >> v1:172.21.15.107:6789/0 conn(0x7f0ba4113160 legacy=0x7f0ba406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.770+0000 7f0baa464640 1 -- 172.21.15.107:0/1929328844 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba4072670 con 0x7f0ba412c3a0 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.770+0000 7f0ba9462640 1 -- 172.21.15.107:0/1929328844 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604152769 0 0) 0x7f0ba412c1a0 con 0x7f0ba4113160 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.770+0000 7f0baa464640 1 --2- 172.21.15.107:0/1929328844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba412c3a0 0x7f0ba412c780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009720 tx=0x7f0ba002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa87bbc1e0545f32 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0ba9462640 1 -- 172.21.15.107:0/1929328844 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00316d0 con 0x7f0ba412c3a0 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0ba9462640 1 -- 172.21.15.107:0/1929328844 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba0037070 con 0x7f0ba412c3a0 2024-04-24T01:46:00.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0ba9462640 1 -- 172.21.15.107:0/1929328844 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00319c0 con 0x7f0ba412c3a0 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0bac6c8640 1 -- 172.21.15.107:0/1929328844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba412c3a0 msgr2=0x7f0ba412c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/1929328844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba412c3a0 0x7f0ba412c780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009720 tx=0x7f0ba002b840 comp rx=0 tx=0).stop 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0bac6c8640 1 -- 172.21.15.107:0/1929328844 shutdown_connections 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/1929328844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba412c3a0 0x7f0ba412c780 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0bac6c8640 1 -- 172.21.15.107:0/1929328844 >> 172.21.15.107:0/1929328844 conn(0x7f0ba4099510 msgr2=0x7f0ba4099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0bac6c8640 1 -- 172.21.15.107:0/1929328844 shutdown_connections 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.771+0000 7f0bac6c8640 1 -- 172.21.15.107:0/1929328844 wait complete. 2024-04-24T01:46:00.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.772+0000 7f0bac6c8640 1 Processor -- start 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.772+0000 7f0bac6c8640 1 -- start start 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.772+0000 7f0bac6c8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba4113160 0x7f0ba4122310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.772+0000 7f0bac6c8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba412ce40 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.772+0000 7f0baa464640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba4113160 0x7f0ba4122310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.772+0000 7f0baa464640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba4113160 0x7f0ba4122310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44642/0 (socket says 172.21.15.107:44642) 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.772+0000 7f0baa464640 1 -- 172.21.15.107:0/3272711463 learned_addr learned my addr 172.21.15.107:0/3272711463 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.773+0000 7f0baa464640 1 -- 172.21.15.107:0/3272711463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba4115df0 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.773+0000 7f0baa464640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba4113160 0x7f0ba4122310 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009720 tx=0x7f0ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.773+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba0004160 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.773+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba0004320 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.773+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba4128fd0 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.773+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba0032640 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.773+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba4115430 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ba00327e0 con 0x7f0ba4113160 2024-04-24T01:46:00.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ba4062da0 con 0x7f0ba4113160 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0b9affd640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b88038060 0x7f0b8803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0ba002f050 con 0x7f0ba4113160 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0b9affd640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f0b880443e0 0x7f0b88046880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ba0044e70 con 0x7f0b880443e0 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ba00722a0 con 0x7f0ba4113160 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.774+0000 7f0ba9c63640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b88038060 0x7f0b8803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.775+0000 7f0baac65640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f0b880443e0 0x7f0b88046880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.775+0000 7f0baac65640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f0b880443e0 0x7f0b88046880 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.775+0000 7f0ba9c63640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b88038060 0x7f0b8803a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b94000c00 tx=0x7f0b94007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.776+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== osd.3 v2:172.21.15.131:6800/3849831825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ba0044e70 con 0x7f0b880443e0 2024-04-24T01:46:00.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.790+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 --> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0ba409b390 con 0x7f0b880443e0 2024-04-24T01:46:00.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0b9affd640 1 -- 172.21.15.107:0/3272711463 <== osd.3 v2:172.21.15.131:6800/3849831825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0b9c00ad10 con 0x7f0b880443e0 2024-04-24T01:46:00.792 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-24T01:46:00.792 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:46:00.792 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-24T01:46:00.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f0b880443e0 msgr2=0x7f0b88046880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f0b880443e0 0x7f0b88046880 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b88038060 msgr2=0x7f0b8803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b88038060 0x7f0b8803a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b94000c00 tx=0x7f0b94007910 comp rx=0 tx=0).stop 2024-04-24T01:46:00.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba4113160 msgr2=0x7f0ba4122310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba4113160 0x7f0ba4122310 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009720 tx=0x7f0ba00046c0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 shutdown_connections 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6800/3849831825,v1:172.21.15.131:6801/3849831825] conn(0x7f0b880443e0 0x7f0b88046880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f0b88038060 0x7f0b8803a520 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 --2- 172.21.15.107:0/3272711463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ba4113160 0x7f0ba4122310 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 >> 172.21.15.107:0/3272711463 conn(0x7f0ba4099510 msgr2=0x7f0ba412ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 shutdown_connections 2024-04-24T01:46:00.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.791+0000 7f0bac6c8640 1 -- 172.21.15.107:0/3272711463 wait complete. 2024-04-24T01:46:00.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T01:46:00.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.897+0000 7f9c5d5e6640 1 Processor -- start 2024-04-24T01:46:00.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.897+0000 7f9c5d5e6640 1 -- start start 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c5d5e6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c5806d690 0x7f9c5806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c5d5e6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5806f0f0 con 0x7f9c5806dfb0 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c5d5e6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9c58071a60 con 0x7f9c5806d690 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c56ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c5806d690 0x7f9c5806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c567fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9c5806dfb0 0x7f9c58070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:51898/0 (socket says 172.21.15.107:51898) 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c567fc640 1 -- 172.21.15.107:0/2954809288 learned_addr learned my addr 172.21.15.107:0/2954809288 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c56ffd640 1 -- 172.21.15.107:0/2954809288 >> v1:172.21.15.107:6789/0 conn(0x7f9c5806dfb0 legacy=0x7f9c58070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c56ffd640 1 -- 172.21.15.107:0/2954809288 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5806f8b0 con 0x7f9c5806d690 2024-04-24T01:46:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.898+0000 7f9c55ffb640 1 -- 172.21.15.107:0/2954809288 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899368222 0 0) 0x7f9c5806f0f0 con 0x7f9c5806dfb0 2024-04-24T01:46:00.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.899+0000 7f9c56ffd640 1 --2- 172.21.15.107:0/2954809288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c5806da70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00a8c0 tx=0x7f9c4c02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6568b299e6cc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.899+0000 7f9c55ffb640 1 -- 172.21.15.107:0/2954809288 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c4c03a070 con 0x7f9c5806d690 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.899+0000 7f9c55ffb640 1 -- 172.21.15.107:0/2954809288 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4c02da00 con 0x7f9c5806d690 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.899+0000 7f9c55ffb640 1 -- 172.21.15.107:0/2954809288 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c4c00b040 con 0x7f9c5806d690 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.900+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/2954809288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 msgr2=0x7f9c5806da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.900+0000 7f9c5d5e6640 1 --2- 172.21.15.107:0/2954809288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c5806da70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00a8c0 tx=0x7f9c4c02cd20 comp rx=0 tx=0).stop 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.900+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/2954809288 shutdown_connections 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.900+0000 7f9c5d5e6640 1 --2- 172.21.15.107:0/2954809288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c5806da70 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.900+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/2954809288 >> 172.21.15.107:0/2954809288 conn(0x7f9c58099680 msgr2=0x7f9c58099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.900+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/2954809288 shutdown_connections 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.900+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/2954809288 wait complete. 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c5d5e6640 1 Processor -- start 2024-04-24T01:46:00.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c5d5e6640 1 -- start start 2024-04-24T01:46:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c5d5e6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c581a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c5d5e6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58070050 con 0x7f9c5806d690 2024-04-24T01:46:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c56ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c581a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c56ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c581a6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44666/0 (socket says 172.21.15.107:44666) 2024-04-24T01:46:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c56ffd640 1 -- 172.21.15.107:0/3806324965 learned_addr learned my addr 172.21.15.107:0/3806324965 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c56ffd640 1 -- 172.21.15.107:0/3806324965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580956e0 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.901+0000 7f9c56ffd640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c581a6530 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00a8c0 tx=0x7f9c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.902+0000 7f9c3f7fe640 1 -- 172.21.15.107:0/3806324965 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c4c042020 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.902+0000 7f9c3f7fe640 1 -- 172.21.15.107:0/3806324965 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4c035bf0 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.902+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c581a8ed0 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.902+0000 7f9c3f7fe640 1 -- 172.21.15.107:0/3806324965 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c4c03a040 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.902+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581a6c50 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.903+0000 7f9c3f7fe640 1 -- 172.21.15.107:0/3806324965 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9c4c045020 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.903+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c58062da0 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.903+0000 7f9c3f7fe640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44038060 0x7f9c4403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.903+0000 7f9c3f7fe640 1 -- 172.21.15.107:0/3806324965 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9c4c06d6c0 con 0x7f9c5806d690 2024-04-24T01:46:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.903+0000 7f9c567fc640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44038060 0x7f9c4403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:00.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.904+0000 7f9c567fc640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44038060 0x7f9c4403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c48005880 tx=0x7f9c48007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:00.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:00.908+0000 7f9c3f7fe640 1 -- 172.21.15.107:0/3806324965 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9c4c04c030 con 0x7f9c5806d690 2024-04-24T01:46:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.081+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f9c581a84b0 con 0x7f9c44038060 2024-04-24T01:46:01.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.082+0000 7f9c3f7fe640 1 -- 172.21.15.107:0/3806324965 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9c480058d0 con 0x7f9c44038060 2024-04-24T01:46:01.083 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T01:46:01.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44038060 msgr2=0x7f9c4403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:01.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44038060 0x7f9c4403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c48005880 tx=0x7f9c48007970 comp rx=0 tx=0).stop 2024-04-24T01:46:01.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 msgr2=0x7f9c581a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:01.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c581a6530 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00a8c0 tx=0x7f9c4c0046c0 comp rx=0 tx=0).stop 2024-04-24T01:46:01.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 shutdown_connections 2024-04-24T01:46:01.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9c44038060 0x7f9c4403a520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:01.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 --2- 172.21.15.107:0/3806324965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c5806d690 0x7f9c581a6530 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:01.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 >> 172.21.15.107:0/3806324965 conn(0x7f9c58099680 msgr2=0x7f9c5808c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:01.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 shutdown_connections 2024-04-24T01:46:01.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.084+0000 7f9c5d5e6640 1 -- 172.21.15.107:0/3806324965 wait complete. 2024-04-24T01:46:01.095 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:46:01.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.189+0000 7fe4fd67b640 1 Processor -- start 2024-04-24T01:46:01.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.189+0000 7fe4fd67b640 1 -- start start 2024-04-24T01:46:01.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.189+0000 7fe4fd67b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe4f806f260 0x7fe4f806f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:01.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4fd67b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f806fff0 con 0x7fe4f806fb80 2024-04-24T01:46:01.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4fd67b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f8070bc0 con 0x7fe4f806f260 2024-04-24T01:46:01.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4f6ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe4f806f260 0x7fe4f806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:01.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4f67fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe4f806fb80 0x7fe4f812e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:51912/0 (socket says 172.21.15.107:51912) 2024-04-24T01:46:01.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4f67fc640 1 -- 172.21.15.107:0/2321556386 learned_addr learned my addr 172.21.15.107:0/2321556386 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:01.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4f6ffd640 1 -- 172.21.15.107:0/2321556386 >> v1:172.21.15.107:6789/0 conn(0x7fe4f806fb80 legacy=0x7fe4f812e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:01.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4f6ffd640 1 -- 172.21.15.107:0/2321556386 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f812ec50 con 0x7fe4f806f260 2024-04-24T01:46:01.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.190+0000 7fe4f5ffb640 1 -- 172.21.15.107:0/2321556386 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100559606 0 0) 0x7fe4f806fff0 con 0x7fe4f806fb80 2024-04-24T01:46:01.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4f6ffd640 1 --2- 172.21.15.107:0/2321556386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f806f640 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009720 tx=0x7fe4f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479908e401ca8df2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:01.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4f5ffb640 1 -- 172.21.15.107:0/2321556386 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f00316d0 con 0x7fe4f806f260 2024-04-24T01:46:01.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4f5ffb640 1 -- 172.21.15.107:0/2321556386 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f0037070 con 0x7fe4f806f260 2024-04-24T01:46:01.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4f5ffb640 1 -- 172.21.15.107:0/2321556386 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f00319c0 con 0x7fe4f806f260 2024-04-24T01:46:01.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4fd67b640 1 -- 172.21.15.107:0/2321556386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 msgr2=0x7fe4f806f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4fd67b640 1 --2- 172.21.15.107:0/2321556386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f806f640 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009720 tx=0x7fe4f002b840 comp rx=0 tx=0).stop 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4fd67b640 1 -- 172.21.15.107:0/2321556386 shutdown_connections 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4fd67b640 1 --2- 172.21.15.107:0/2321556386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f806f640 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4fd67b640 1 -- 172.21.15.107:0/2321556386 >> 172.21.15.107:0/2321556386 conn(0x7fe4f809e170 msgr2=0x7fe4f806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4fd67b640 1 -- 172.21.15.107:0/2321556386 shutdown_connections 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.191+0000 7fe4fd67b640 1 -- 172.21.15.107:0/2321556386 wait complete. 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.192+0000 7fe4fd67b640 1 Processor -- start 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.192+0000 7fe4fd67b640 1 -- start start 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4fd67b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f81bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4fd67b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f812f400 con 0x7fe4f806f260 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4f6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f81bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4f6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f81bfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44680/0 (socket says 172.21.15.107:44680) 2024-04-24T01:46:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4f6ffd640 1 -- 172.21.15.107:0/3229461058 learned_addr learned my addr 172.21.15.107:0/3229461058 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4f6ffd640 1 -- 172.21.15.107:0/3229461058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f812c5b0 con 0x7fe4f806f260 2024-04-24T01:46:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4f6ffd640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f81bfc50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009840 tx=0x7fe4f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4ef7fe640 1 -- 172.21.15.107:0/3229461058 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f00319b0 con 0x7fe4f806f260 2024-04-24T01:46:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4ef7fe640 1 -- 172.21.15.107:0/3229461058 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f0004030 con 0x7fe4f806f260 2024-04-24T01:46:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4ef7fe640 1 -- 172.21.15.107:0/3229461058 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f0004310 con 0x7fe4f806f260 2024-04-24T01:46:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f811b7a0 con 0x7fe4f806f260 2024-04-24T01:46:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.193+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f811bab0 con 0x7fe4f806f260 2024-04-24T01:46:01.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.194+0000 7fe4ef7fe640 1 -- 172.21.15.107:0/3229461058 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4f0003610 con 0x7fe4f806f260 2024-04-24T01:46:01.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.194+0000 7fe4ef7fe640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4d8038200 0x7fe4d803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:01.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.194+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f80a18a0 con 0x7fe4f806f260 2024-04-24T01:46:01.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.194+0000 7fe4ef7fe640 1 -- 172.21.15.107:0/3229461058 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe4f002f050 con 0x7fe4f806f260 2024-04-24T01:46:01.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.195+0000 7fe4f67fc640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4d8038200 0x7fe4d803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:01.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.195+0000 7fe4f67fc640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4d8038200 0x7fe4d803a6c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0000c00 tx=0x7fe4e0007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:01.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.199+0000 7fe4ef7fe640 1 -- 172.21.15.107:0/3229461058 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe4f80a18a0 con 0x7fe4f806f260 2024-04-24T01:46:01.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.368+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4f8062da0 con 0x7fe4d8038200 2024-04-24T01:46:01.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.384+0000 7fe4ef7fe640 1 -- 172.21.15.107:0/3229461058 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665649 (secure 0 0 0) 0x7fe4f8062da0 con 0x7fe4d8038200 2024-04-24T01:46:01.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:46:01.398 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4d8038200 msgr2=0x7fe4d803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4d8038200 0x7fe4d803a6c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0000c00 tx=0x7fe4e0007910 comp rx=0 tx=0).stop 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 msgr2=0x7fe4f81bfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f81bfc50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009840 tx=0x7fe4f00046c0 comp rx=0 tx=0).stop 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 shutdown_connections 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fe4d8038200 0x7fe4d803a6c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 --2- 172.21.15.107:0/3229461058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4f806f260 0x7fe4f81bfc50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 >> 172.21.15.107:0/3229461058 conn(0x7fe4f809e170 msgr2=0x7fe4f809e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 shutdown_connections 2024-04-24T01:46:01.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:01.388+0000 7fe4fd67b640 1 -- 172.21.15.107:0/3229461058 wait complete. 2024-04-24T01:46:01.402 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-04-24T01:46:00.067426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21578614,"num_objects":257,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":5221,"num_read_kb":4767,"num_write":2312,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4705,"ondisk_log_size":4705,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":175672,"kb_used_data":30164,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377311688,"statfs":{"total":386547056640,"available":386367168512,"internally_reserved":0,"allocated":30887936,"data_stored":29688029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20977512,"num_objects":7,"num_object_clones":0,"num_object_copies":19,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":497,"num_write":400,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004296"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810312+0000","last_change":"2024-04-24T01:42:40.781437+0000","last_active":"2024-04-24T01:43:21.810312+0000","last_peered":"2024-04-24T01:43:21.810312+0000","last_clean":"2024-04-24T01:43:21.810312+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:43:21.810312+0000","last_undegraded":"2024-04-24T01:43:21.810312+0000","last_fullsized":"2024-04-24T01:43:21.810312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138190+0000","last_change":"2024-04-24T01:42:42.785371+0000","last_active":"2024-04-24T01:45:50.138190+0000","last_peered":"2024-04-24T01:45:50.138190+0000","last_clean":"2024-04-24T01:45:50.138190+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:45:50.138190+0000","last_undegraded":"2024-04-24T01:45:50.138190+0000","last_fullsized":"2024-04-24T01:45:50.138190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.977231+0000","last_change":"2024-04-24T01:42:40.769679+0000","last_active":"2024-04-24T01:45:49.977231+0000","last_peered":"2024-04-24T01:45:49.977231+0000","last_clean":"2024-04-24T01:45:49.977231+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:45:49.977231+0000","last_undegraded":"2024-04-24T01:45:49.977231+0000","last_fullsized":"2024-04-24T01:45:49.977231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:45.687433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.044899+0000","last_change":"2024-04-24T01:42:42.780099+0000","last_active":"2024-04-24T01:45:50.044899+0000","last_peered":"2024-04-24T01:45:50.044899+0000","last_clean":"2024-04-24T01:45:50.044899+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:45:50.044899+0000","last_undegraded":"2024-04-24T01:45:50.044899+0000","last_fullsized":"2024-04-24T01:45:50.044899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:41.652689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814577+0000","last_change":"2024-04-24T01:42:40.787360+0000","last_active":"2024-04-24T01:43:21.814577+0000","last_peered":"2024-04-24T01:43:21.814577+0000","last_clean":"2024-04-24T01:43:21.814577+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:43:21.814577+0000","last_undegraded":"2024-04-24T01:43:21.814577+0000","last_fullsized":"2024-04-24T01:43:21.814577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:17.246961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315339+0000","last_change":"2024-04-24T01:42:42.777928+0000","last_active":"2024-04-24T01:45:50.315339+0000","last_peered":"2024-04-24T01:45:50.315339+0000","last_clean":"2024-04-24T01:45:50.315339+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:45:50.315339+0000","last_undegraded":"2024-04-24T01:45:50.315339+0000","last_fullsized":"2024-04-24T01:45:50.315339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:43.330594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808622+0000","last_change":"2024-04-24T01:42:40.777293+0000","last_active":"2024-04-24T01:43:21.808622+0000","last_peered":"2024-04-24T01:43:21.808622+0000","last_clean":"2024-04-24T01:43:21.808622+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:43:21.808622+0000","last_undegraded":"2024-04-24T01:43:21.808622+0000","last_fullsized":"2024-04-24T01:43:21.808622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812539+0000","last_change":"2024-04-24T01:42:42.782433+0000","last_active":"2024-04-24T01:43:21.812539+0000","last_peered":"2024-04-24T01:43:21.812539+0000","last_clean":"2024-04-24T01:43:21.812539+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:43:21.812539+0000","last_undegraded":"2024-04-24T01:43:21.812539+0000","last_fullsized":"2024-04-24T01:43:21.812539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:46.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.252337+0000","last_change":"2024-04-24T01:42:40.787185+0000","last_active":"2024-04-24T01:45:50.252337+0000","last_peered":"2024-04-24T01:45:50.252337+0000","last_clean":"2024-04-24T01:45:50.252337+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:45:50.252337+0000","last_undegraded":"2024-04-24T01:45:50.252337+0000","last_fullsized":"2024-04-24T01:45:50.252337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:54.284107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321632+0000","last_change":"2024-04-24T01:42:42.783384+0000","last_active":"2024-04-24T01:45:50.321632+0000","last_peered":"2024-04-24T01:45:50.321632+0000","last_clean":"2024-04-24T01:45:50.321632+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:45:50.321632+0000","last_undegraded":"2024-04-24T01:45:50.321632+0000","last_fullsized":"2024-04-24T01:45:50.321632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:43.429543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808027+0000","last_change":"2024-04-24T01:42:40.775908+0000","last_active":"2024-04-24T01:43:21.808027+0000","last_peered":"2024-04-24T01:43:21.808027+0000","last_clean":"2024-04-24T01:43:21.808027+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:43:21.808027+0000","last_undegraded":"2024-04-24T01:43:21.808027+0000","last_fullsized":"2024-04-24T01:43:21.808027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.800378+0000","last_change":"2024-04-24T01:43:21.820449+0000","last_active":"2024-04-24T01:44:05.800378+0000","last_peered":"2024-04-24T01:44:05.800378+0000","last_clean":"2024-04-24T01:44:05.800378+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:44:05.800378+0000","last_undegraded":"2024-04-24T01:44:05.800378+0000","last_fullsized":"2024-04-24T01:44:05.800378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:18.138123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812225+0000","last_change":"2024-04-24T01:42:40.785983+0000","last_active":"2024-04-24T01:43:21.812225+0000","last_peered":"2024-04-24T01:43:21.812225+0000","last_clean":"2024-04-24T01:43:21.812225+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:43:21.812225+0000","last_undegraded":"2024-04-24T01:43:21.812225+0000","last_fullsized":"2024-04-24T01:43:21.812225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:42.761936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270804+0000","last_change":"2024-04-24T01:42:42.788032+0000","last_active":"2024-04-24T01:45:50.270804+0000","last_peered":"2024-04-24T01:45:50.270804+0000","last_clean":"2024-04-24T01:45:50.270804+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:45:50.270804+0000","last_undegraded":"2024-04-24T01:45:50.270804+0000","last_fullsized":"2024-04-24T01:45:50.270804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862584+0000","last_change":"2024-04-24T01:42:40.778279+0000","last_active":"2024-04-24T01:43:21.862584+0000","last_peered":"2024-04-24T01:43:21.862584+0000","last_clean":"2024-04-24T01:43:21.862584+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:43:21.862584+0000","last_undegraded":"2024-04-24T01:43:21.862584+0000","last_fullsized":"2024-04-24T01:43:21.862584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:39.530334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.138297+0000","last_change":"2024-04-24T01:42:42.789315+0000","last_active":"2024-04-24T01:45:50.138297+0000","last_peered":"2024-04-24T01:45:50.138297+0000","last_clean":"2024-04-24T01:45:50.138297+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:45:50.138297+0000","last_undegraded":"2024-04-24T01:45:50.138297+0000","last_fullsized":"2024-04-24T01:45:50.138297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:53.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270574+0000","last_change":"2024-04-24T01:42:42.779841+0000","last_active":"2024-04-24T01:45:50.270574+0000","last_peered":"2024-04-24T01:45:50.270574+0000","last_clean":"2024-04-24T01:45:50.270574+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:45:50.270574+0000","last_undegraded":"2024-04-24T01:45:50.270574+0000","last_fullsized":"2024-04-24T01:45:50.270574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:31.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817068+0000","last_change":"2024-04-24T01:42:40.791488+0000","last_active":"2024-04-24T01:43:21.817068+0000","last_peered":"2024-04-24T01:43:21.817068+0000","last_clean":"2024-04-24T01:43:21.817068+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:43:21.817068+0000","last_undegraded":"2024-04-24T01:43:21.817068+0000","last_fullsized":"2024-04-24T01:43:21.817068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315684+0000","last_change":"2024-04-24T01:42:42.782524+0000","last_active":"2024-04-24T01:45:50.315684+0000","last_peered":"2024-04-24T01:45:50.315684+0000","last_clean":"2024-04-24T01:45:50.315684+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:45:50.315684+0000","last_undegraded":"2024-04-24T01:45:50.315684+0000","last_fullsized":"2024-04-24T01:45:50.315684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:25.756967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811766+0000","last_change":"2024-04-24T01:42:40.784169+0000","last_active":"2024-04-24T01:43:21.811766+0000","last_peered":"2024-04-24T01:43:21.811766+0000","last_clean":"2024-04-24T01:43:21.811766+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:43:21.811766+0000","last_undegraded":"2024-04-24T01:43:21.811766+0000","last_fullsized":"2024-04-24T01:43:21.811766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353379+0000","last_change":"2024-04-24T01:42:42.783807+0000","last_active":"2024-04-24T01:45:50.353379+0000","last_peered":"2024-04-24T01:45:50.353379+0000","last_clean":"2024-04-24T01:45:50.353379+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:45:50.353379+0000","last_undegraded":"2024-04-24T01:45:50.353379+0000","last_fullsized":"2024-04-24T01:45:50.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:04.077606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090155+0000","last_change":"2024-04-24T01:42:40.792423+0000","last_active":"2024-04-24T01:45:06.090155+0000","last_peered":"2024-04-24T01:45:06.090155+0000","last_clean":"2024-04-24T01:45:06.090155+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:45:06.090155+0000","last_undegraded":"2024-04-24T01:45:06.090155+0000","last_fullsized":"2024-04-24T01:45:06.090155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654988+0000","last_change":"2024-04-24T01:42:42.790737+0000","last_active":"2024-04-24T01:44:49.654988+0000","last_peered":"2024-04-24T01:44:49.654988+0000","last_clean":"2024-04-24T01:44:49.654988+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:44:49.654988+0000","last_undegraded":"2024-04-24T01:44:49.654988+0000","last_fullsized":"2024-04-24T01:44:49.654988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:20.557905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.632047+0000","last_change":"2024-04-24T01:42:40.782750+0000","last_active":"2024-04-24T01:44:49.632047+0000","last_peered":"2024-04-24T01:44:49.632047+0000","last_clean":"2024-04-24T01:44:49.632047+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:44:49.632047+0000","last_undegraded":"2024-04-24T01:44:49.632047+0000","last_fullsized":"2024-04-24T01:44:49.632047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270479+0000","last_change":"2024-04-24T01:42:42.790992+0000","last_active":"2024-04-24T01:45:50.270479+0000","last_peered":"2024-04-24T01:45:50.270479+0000","last_clean":"2024-04-24T01:45:50.270479+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:45:50.270479+0000","last_undegraded":"2024-04-24T01:45:50.270479+0000","last_fullsized":"2024-04-24T01:45:50.270479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:12.881341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864678+0000","last_change":"2024-04-24T01:42:40.769585+0000","last_active":"2024-04-24T01:43:21.864678+0000","last_peered":"2024-04-24T01:43:21.864678+0000","last_clean":"2024-04-24T01:43:21.864678+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:43:21.864678+0000","last_undegraded":"2024-04-24T01:43:21.864678+0000","last_fullsized":"2024-04-24T01:43:21.864678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:33:56.281356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137384+0000","last_change":"2024-04-24T01:42:42.784217+0000","last_active":"2024-04-24T01:45:50.137384+0000","last_peered":"2024-04-24T01:45:50.137384+0000","last_clean":"2024-04-24T01:45:50.137384+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:45:50.137384+0000","last_undegraded":"2024-04-24T01:45:50.137384+0000","last_fullsized":"2024-04-24T01:45:50.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:21.185447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.340485+0000","last_change":"2024-04-24T01:42:40.786476+0000","last_active":"2024-04-24T01:45:50.340485+0000","last_peered":"2024-04-24T01:45:50.340485+0000","last_clean":"2024-04-24T01:45:50.340485+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:45:50.340485+0000","last_undegraded":"2024-04-24T01:45:50.340485+0000","last_fullsized":"2024-04-24T01:45:50.340485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:50.655000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.295799+0000","last_change":"2024-04-24T01:42:50.802941+0000","last_active":"2024-04-24T01:45:50.295799+0000","last_peered":"2024-04-24T01:45:50.295799+0000","last_clean":"2024-04-24T01:45:50.295799+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:45:50.295799+0000","last_undegraded":"2024-04-24T01:45:50.295799+0000","last_fullsized":"2024-04-24T01:45:50.295799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:19.486282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351833+0000","last_change":"2024-04-24T01:42:42.786160+0000","last_active":"2024-04-24T01:45:50.351833+0000","last_peered":"2024-04-24T01:45:50.351833+0000","last_clean":"2024-04-24T01:45:50.351833+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:45:50.351833+0000","last_undegraded":"2024-04-24T01:45:50.351833+0000","last_fullsized":"2024-04-24T01:45:50.351833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:05.195853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791802+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:36.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818082+0000","last_change":"2024-04-24T01:43:21.817222+0000","last_active":"2024-04-24T01:43:21.818082+0000","last_peered":"2024-04-24T01:43:21.818082+0000","last_clean":"2024-04-24T01:43:21.818082+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:43:21.818082+0000","last_undegraded":"2024-04-24T01:43:21.818082+0000","last_fullsized":"2024-04-24T01:43:21.818082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:34.889879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.217678+0000","last_change":"2024-04-24T01:42:46.785609+0000","last_active":"2024-04-24T01:44:48.217678+0000","last_peered":"2024-04-24T01:44:48.217678+0000","last_clean":"2024-04-24T01:44:48.217678+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:44:48.217678+0000","last_undegraded":"2024-04-24T01:44:48.217678+0000","last_fullsized":"2024-04-24T01:44:48.217678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:24.228056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816972+0000","last_change":"2024-04-24T01:42:48.793869+0000","last_active":"2024-04-24T01:43:21.816972+0000","last_peered":"2024-04-24T01:43:21.816972+0000","last_clean":"2024-04-24T01:43:21.816972+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:43:21.816972+0000","last_undegraded":"2024-04-24T01:43:21.816972+0000","last_fullsized":"2024-04-24T01:43:21.816972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:23.315540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.805565+0000","last_change":"2024-04-24T01:42:50.802222+0000","last_active":"2024-04-24T01:44:05.805565+0000","last_peered":"2024-04-24T01:44:05.805565+0000","last_clean":"2024-04-24T01:44:05.805565+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:44:05.805565+0000","last_undegraded":"2024-04-24T01:44:05.805565+0000","last_fullsized":"2024-04-24T01:44:05.805565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:26.157145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.020370+0000","last_change":"2024-04-24T01:42:42.784837+0000","last_active":"2024-04-24T01:44:06.020370+0000","last_peered":"2024-04-24T01:44:06.020370+0000","last_clean":"2024-04-24T01:44:06.020370+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:44:06.020370+0000","last_undegraded":"2024-04-24T01:44:06.020370+0000","last_fullsized":"2024-04-24T01:44:06.020370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:40.033902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.432410+0000","last_change":"2024-04-24T01:42:40.782079+0000","last_active":"2024-04-24T01:43:23.432410+0000","last_peered":"2024-04-24T01:43:23.432410+0000","last_clean":"2024-04-24T01:43:23.432410+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:43:23.432410+0000","last_undegraded":"2024-04-24T01:43:23.432410+0000","last_fullsized":"2024-04-24T01:43:23.432410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863552+0000","last_change":"2024-04-24T01:42:44.776066+0000","last_active":"2024-04-24T01:43:21.863552+0000","last_peered":"2024-04-24T01:43:21.863552+0000","last_clean":"2024-04-24T01:43:21.863552+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:43:21.863552+0000","last_undegraded":"2024-04-24T01:43:21.863552+0000","last_fullsized":"2024-04-24T01:43:21.863552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:21.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814388+0000","last_change":"2024-04-24T01:42:46.778609+0000","last_active":"2024-04-24T01:43:21.814388+0000","last_peered":"2024-04-24T01:43:21.814388+0000","last_clean":"2024-04-24T01:43:21.814388+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:43:21.814388+0000","last_undegraded":"2024-04-24T01:43:21.814388+0000","last_fullsized":"2024-04-24T01:43:21.814388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:18.196763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814658+0000","last_change":"2024-04-24T01:42:48.790498+0000","last_active":"2024-04-24T01:43:21.814658+0000","last_peered":"2024-04-24T01:43:21.814658+0000","last_clean":"2024-04-24T01:43:21.814658+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:43:21.814658+0000","last_undegraded":"2024-04-24T01:43:21.814658+0000","last_fullsized":"2024-04-24T01:43:21.814658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:35.394375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.749783+0000","last_change":"2024-04-24T01:42:50.793834+0000","last_active":"2024-04-24T01:45:49.749783+0000","last_peered":"2024-04-24T01:45:49.749783+0000","last_clean":"2024-04-24T01:45:49.749783+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:45:49.749783+0000","last_undegraded":"2024-04-24T01:45:49.749783+0000","last_fullsized":"2024-04-24T01:45:49.749783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:58.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'21","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351802+0000","last_change":"2024-04-24T01:42:42.777752+0000","last_active":"2024-04-24T01:45:50.351802+0000","last_peered":"2024-04-24T01:45:50.351802+0000","last_clean":"2024-04-24T01:45:50.351802+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:45:50.351802+0000","last_undegraded":"2024-04-24T01:45:50.351802+0000","last_fullsized":"2024-04-24T01:45:50.351802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:23.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.522600+0000","last_change":"2024-04-24T01:42:40.790240+0000","last_active":"2024-04-24T01:44:49.522600+0000","last_peered":"2024-04-24T01:44:49.522600+0000","last_clean":"2024-04-24T01:44:49.522600+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:44:49.522600+0000","last_undegraded":"2024-04-24T01:44:49.522600+0000","last_fullsized":"2024-04-24T01:44:49.522600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:25.852835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865041+0000","last_change":"2024-04-24T01:42:44.780561+0000","last_active":"2024-04-24T01:43:21.865041+0000","last_peered":"2024-04-24T01:43:21.865041+0000","last_clean":"2024-04-24T01:43:21.865041+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:43:21.865041+0000","last_undegraded":"2024-04-24T01:43:21.865041+0000","last_fullsized":"2024-04-24T01:43:21.865041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:25.708863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810210+0000","last_change":"2024-04-24T01:42:46.780855+0000","last_active":"2024-04-24T01:43:21.810210+0000","last_peered":"2024-04-24T01:43:21.810210+0000","last_clean":"2024-04-24T01:43:21.810210+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:43:21.810210+0000","last_undegraded":"2024-04-24T01:43:21.810210+0000","last_fullsized":"2024-04-24T01:43:21.810210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:13.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.455955+0000","last_change":"2024-04-24T01:42:48.789383+0000","last_active":"2024-04-24T01:45:50.455955+0000","last_peered":"2024-04-24T01:45:50.455955+0000","last_clean":"2024-04-24T01:45:50.455955+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:45:50.455955+0000","last_undegraded":"2024-04-24T01:45:50.455955+0000","last_fullsized":"2024-04-24T01:45:50.455955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:14.292086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.188045+0000","last_change":"2024-04-24T01:42:50.800444+0000","last_active":"2024-04-24T01:43:23.188045+0000","last_peered":"2024-04-24T01:43:23.188045+0000","last_clean":"2024-04-24T01:43:23.188045+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:43:23.188045+0000","last_undegraded":"2024-04-24T01:43:23.188045+0000","last_fullsized":"2024-04-24T01:43:23.188045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.377346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506203+0000","last_change":"2024-04-24T01:42:42.785246+0000","last_active":"2024-04-24T01:44:46.506203+0000","last_peered":"2024-04-24T01:44:46.506203+0000","last_clean":"2024-04-24T01:44:46.506203+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:44:46.506203+0000","last_undegraded":"2024-04-24T01:44:46.506203+0000","last_fullsized":"2024-04-24T01:44:46.506203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:37.621286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815603+0000","last_change":"2024-04-24T01:42:40.791168+0000","last_active":"2024-04-24T01:43:21.815603+0000","last_peered":"2024-04-24T01:43:21.815603+0000","last_clean":"2024-04-24T01:43:21.815603+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:43:21.815603+0000","last_undegraded":"2024-04-24T01:43:21.815603+0000","last_fullsized":"2024-04-24T01:43:21.815603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.818755+0000","last_change":"2024-04-24T01:43:21.818140+0000","last_active":"2024-04-24T01:43:21.818755+0000","last_peered":"2024-04-24T01:43:21.818755+0000","last_clean":"2024-04-24T01:43:21.818755+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:43:21.818755+0000","last_undegraded":"2024-04-24T01:43:21.818755+0000","last_fullsized":"2024-04-24T01:43:21.818755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:00:16.051162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.212359+0000","last_change":"2024-04-24T01:42:46.784079+0000","last_active":"2024-04-24T01:44:48.212359+0000","last_peered":"2024-04-24T01:44:48.212359+0000","last_clean":"2024-04-24T01:44:48.212359+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:44:48.212359+0000","last_undegraded":"2024-04-24T01:44:48.212359+0000","last_fullsized":"2024-04-24T01:44:48.212359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:07:04.029756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.877004+0000","last_change":"2024-04-24T01:42:48.783790+0000","last_active":"2024-04-24T01:45:56.877004+0000","last_peered":"2024-04-24T01:45:56.877004+0000","last_clean":"2024-04-24T01:45:56.877004+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:45:56.877004+0000","last_undegraded":"2024-04-24T01:45:56.877004+0000","last_fullsized":"2024-04-24T01:45:56.877004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:09.325458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137974+0000","last_change":"2024-04-24T01:42:42.787100+0000","last_active":"2024-04-24T01:45:50.137974+0000","last_peered":"2024-04-24T01:45:50.137974+0000","last_clean":"2024-04-24T01:45:50.137974+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:45:50.137974+0000","last_undegraded":"2024-04-24T01:45:50.137974+0000","last_fullsized":"2024-04-24T01:45:50.137974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:02.956782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334280+0000","last_change":"2024-04-24T01:42:40.780599+0000","last_active":"2024-04-24T01:43:22.334280+0000","last_peered":"2024-04-24T01:43:22.334280+0000","last_clean":"2024-04-24T01:43:22.334280+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:43:22.334280+0000","last_undegraded":"2024-04-24T01:43:22.334280+0000","last_fullsized":"2024-04-24T01:43:22.334280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:39.782473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312638+0000","last_change":"2024-04-24T01:42:44.778111+0000","last_active":"2024-04-24T01:44:49.312638+0000","last_peered":"2024-04-24T01:44:49.312638+0000","last_clean":"2024-04-24T01:44:49.312638+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:44:49.312638+0000","last_undegraded":"2024-04-24T01:44:49.312638+0000","last_fullsized":"2024-04-24T01:44:49.312638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:33.157332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'46","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.221905+0000","last_change":"2024-04-24T01:42:46.779467+0000","last_active":"2024-04-24T01:44:48.221905+0000","last_peered":"2024-04-24T01:44:48.221905+0000","last_clean":"2024-04-24T01:44:48.221905+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:44:48.221905+0000","last_undegraded":"2024-04-24T01:44:48.221905+0000","last_fullsized":"2024-04-24T01:44:48.221905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:35.159479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864048+0000","last_change":"2024-04-24T01:42:48.784060+0000","last_active":"2024-04-24T01:43:21.864048+0000","last_peered":"2024-04-24T01:43:21.864048+0000","last_clean":"2024-04-24T01:43:21.864048+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:43:21.864048+0000","last_undegraded":"2024-04-24T01:43:21.864048+0000","last_fullsized":"2024-04-24T01:43:21.864048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:03.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.807187+0000","last_change":"2024-04-24T01:42:50.799924+0000","last_active":"2024-04-24T01:44:05.807187+0000","last_peered":"2024-04-24T01:44:05.807187+0000","last_clean":"2024-04-24T01:44:05.807187+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:44:05.807187+0000","last_undegraded":"2024-04-24T01:44:05.807187+0000","last_fullsized":"2024-04-24T01:44:05.807187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:09.299604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.017080+0000","last_change":"2024-04-24T01:42:42.781439+0000","last_active":"2024-04-24T01:44:06.017080+0000","last_peered":"2024-04-24T01:44:06.017080+0000","last_clean":"2024-04-24T01:44:06.017080+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:44:06.017080+0000","last_undegraded":"2024-04-24T01:44:06.017080+0000","last_fullsized":"2024-04-24T01:44:06.017080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:12.726720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811228+0000","last_change":"2024-04-24T01:42:40.777460+0000","last_active":"2024-04-24T01:43:21.811228+0000","last_peered":"2024-04-24T01:43:21.811228+0000","last_clean":"2024-04-24T01:43:21.811228+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:43:21.811228+0000","last_undegraded":"2024-04-24T01:43:21.811228+0000","last_fullsized":"2024-04-24T01:43:21.811228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:49.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862742+0000","last_change":"2024-04-24T01:42:44.775818+0000","last_active":"2024-04-24T01:43:21.862742+0000","last_peered":"2024-04-24T01:43:21.862742+0000","last_clean":"2024-04-24T01:43:21.862742+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:43:21.862742+0000","last_undegraded":"2024-04-24T01:43:21.862742+0000","last_fullsized":"2024-04-24T01:43:21.862742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:05.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.055415+0000","last_change":"2024-04-24T01:42:46.779918+0000","last_active":"2024-04-24T01:45:50.055415+0000","last_peered":"2024-04-24T01:45:50.055415+0000","last_clean":"2024-04-24T01:45:50.055415+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:45:50.055415+0000","last_undegraded":"2024-04-24T01:45:50.055415+0000","last_fullsized":"2024-04-24T01:45:50.055415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:59.779931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862428+0000","last_change":"2024-04-24T01:42:48.788792+0000","last_active":"2024-04-24T01:43:21.862428+0000","last_peered":"2024-04-24T01:43:21.862428+0000","last_clean":"2024-04-24T01:43:21.862428+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:43:21.862428+0000","last_undegraded":"2024-04-24T01:43:21.862428+0000","last_fullsized":"2024-04-24T01:43:21.862428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.253658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:00.287330+0000","last_change":"2024-04-24T01:42:50.797194+0000","last_active":"2024-04-24T01:44:00.287330+0000","last_peered":"2024-04-24T01:44:00.287330+0000","last_clean":"2024-04-24T01:44:00.287330+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:44:00.287330+0000","last_undegraded":"2024-04-24T01:44:00.287330+0000","last_fullsized":"2024-04-24T01:44:00.287330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:13.552621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.279399+0000","last_change":"2024-04-24T01:42:42.790042+0000","last_active":"2024-04-24T01:45:50.279399+0000","last_peered":"2024-04-24T01:45:50.279399+0000","last_clean":"2024-04-24T01:45:50.279399+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:45:50.279399+0000","last_undegraded":"2024-04-24T01:45:50.279399+0000","last_fullsized":"2024-04-24T01:45:50.279399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:06.040706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814459+0000","last_change":"2024-04-24T01:42:40.790278+0000","last_active":"2024-04-24T01:43:21.814459+0000","last_peered":"2024-04-24T01:43:21.814459+0000","last_clean":"2024-04-24T01:43:21.814459+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:43:21.814459+0000","last_undegraded":"2024-04-24T01:43:21.814459+0000","last_fullsized":"2024-04-24T01:43:21.814459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:52.256340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865715+0000","last_change":"2024-04-24T01:42:44.776056+0000","last_active":"2024-04-24T01:43:21.865715+0000","last_peered":"2024-04-24T01:43:21.865715+0000","last_clean":"2024-04-24T01:43:21.865715+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:43:21.865715+0000","last_undegraded":"2024-04-24T01:43:21.865715+0000","last_fullsized":"2024-04-24T01:43:21.865715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:41.981588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'50","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.223861+0000","last_change":"2024-04-24T01:42:46.778746+0000","last_active":"2024-04-24T01:44:48.223861+0000","last_peered":"2024-04-24T01:44:48.223861+0000","last_clean":"2024-04-24T01:44:48.223861+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:44:48.223861+0000","last_undegraded":"2024-04-24T01:44:48.223861+0000","last_fullsized":"2024-04-24T01:44:48.223861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:42:45.514004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":351,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.878216+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:45:56.878216+0000","last_peered":"2024-04-24T01:45:56.878216+0000","last_clean":"2024-04-24T01:45:56.878216+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:45:56.878216+0000","last_undegraded":"2024-04-24T01:45:56.878216+0000","last_fullsized":"2024-04-24T01:45:56.878216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:47.496571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.808097+0000","last_change":"2024-04-24T01:42:50.794892+0000","last_active":"2024-04-24T01:43:22.808097+0000","last_peered":"2024-04-24T01:43:22.808097+0000","last_clean":"2024-04-24T01:43:22.808097+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:43:22.808097+0000","last_undegraded":"2024-04-24T01:43:22.808097+0000","last_fullsized":"2024-04-24T01:43:22.808097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:09.754900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.453036+0000","last_change":"2024-04-24T01:42:42.778719+0000","last_active":"2024-04-24T01:43:23.453036+0000","last_peered":"2024-04-24T01:43:23.453036+0000","last_clean":"2024-04-24T01:43:23.453036+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:43:23.453036+0000","last_undegraded":"2024-04-24T01:43:23.453036+0000","last_fullsized":"2024-04-24T01:43:23.453036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:31.558960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811441+0000","last_change":"2024-04-24T01:42:40.776747+0000","last_active":"2024-04-24T01:43:21.811441+0000","last_peered":"2024-04-24T01:43:21.811441+0000","last_clean":"2024-04-24T01:43:21.811441+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:43:21.811441+0000","last_undegraded":"2024-04-24T01:43:21.811441+0000","last_fullsized":"2024-04-24T01:43:21.811441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:04.407692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862746+0000","last_change":"2024-04-24T01:42:44.775830+0000","last_active":"2024-04-24T01:43:21.862746+0000","last_peered":"2024-04-24T01:43:21.862746+0000","last_clean":"2024-04-24T01:43:21.862746+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:43:21.862746+0000","last_undegraded":"2024-04-24T01:43:21.862746+0000","last_fullsized":"2024-04-24T01:43:21.862746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:41.803290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.225733+0000","last_change":"2024-04-24T01:42:46.782288+0000","last_active":"2024-04-24T01:44:48.225733+0000","last_peered":"2024-04-24T01:44:48.225733+0000","last_clean":"2024-04-24T01:44:48.225733+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:44:48.225733+0000","last_undegraded":"2024-04-24T01:44:48.225733+0000","last_fullsized":"2024-04-24T01:44:48.225733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862182+0000","last_change":"2024-04-24T01:42:48.794747+0000","last_active":"2024-04-24T01:43:21.862182+0000","last_peered":"2024-04-24T01:43:21.862182+0000","last_clean":"2024-04-24T01:43:21.862182+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:43:21.862182+0000","last_undegraded":"2024-04-24T01:43:21.862182+0000","last_fullsized":"2024-04-24T01:43:21.862182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:37.208241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.442897+0000","last_change":"2024-04-24T01:42:50.802460+0000","last_active":"2024-04-24T01:45:50.442897+0000","last_peered":"2024-04-24T01:45:50.442897+0000","last_clean":"2024-04-24T01:45:50.442897+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:45:50.442897+0000","last_undegraded":"2024-04-24T01:45:50.442897+0000","last_fullsized":"2024-04-24T01:45:50.442897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:30.284232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315664+0000","last_change":"2024-04-24T01:42:42.783715+0000","last_active":"2024-04-24T01:45:50.315664+0000","last_peered":"2024-04-24T01:45:50.315664+0000","last_clean":"2024-04-24T01:45:50.315664+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:45:50.315664+0000","last_undegraded":"2024-04-24T01:45:50.315664+0000","last_fullsized":"2024-04-24T01:45:50.315664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:20.736658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863777+0000","last_change":"2024-04-24T01:42:40.780994+0000","last_active":"2024-04-24T01:43:21.863777+0000","last_peered":"2024-04-24T01:43:21.863777+0000","last_clean":"2024-04-24T01:43:21.863777+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:43:21.863777+0000","last_undegraded":"2024-04-24T01:43:21.863777+0000","last_fullsized":"2024-04-24T01:43:21.863777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:37.569542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809308+0000","last_change":"2024-04-24T01:42:44.778275+0000","last_active":"2024-04-24T01:43:21.809308+0000","last_peered":"2024-04-24T01:43:21.809308+0000","last_clean":"2024-04-24T01:43:21.809308+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:43:21.809308+0000","last_undegraded":"2024-04-24T01:43:21.809308+0000","last_fullsized":"2024-04-24T01:43:21.809308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.192699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.205713+0000","last_change":"2024-04-24T01:42:46.778607+0000","last_active":"2024-04-24T01:44:48.205713+0000","last_peered":"2024-04-24T01:44:48.205713+0000","last_clean":"2024-04-24T01:44:48.205713+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:44:48.205713+0000","last_undegraded":"2024-04-24T01:44:48.205713+0000","last_fullsized":"2024-04-24T01:44:48.205713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:23.477131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813319+0000","last_change":"2024-04-24T01:42:48.790228+0000","last_active":"2024-04-24T01:43:21.813319+0000","last_peered":"2024-04-24T01:43:21.813319+0000","last_clean":"2024-04-24T01:43:21.813319+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:43:21.813319+0000","last_undegraded":"2024-04-24T01:43:21.813319+0000","last_fullsized":"2024-04-24T01:43:21.813319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:17.814113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087985+0000","last_change":"2024-04-24T01:42:50.799183+0000","last_active":"2024-04-24T01:44:51.087985+0000","last_peered":"2024-04-24T01:44:51.087985+0000","last_clean":"2024-04-24T01:44:51.087985+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:44:51.087985+0000","last_undegraded":"2024-04-24T01:44:51.087985+0000","last_fullsized":"2024-04-24T01:44:51.087985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:14.732138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399594+0000","last_change":"2024-04-24T01:42:42.783267+0000","last_active":"2024-04-24T01:45:50.399594+0000","last_peered":"2024-04-24T01:45:50.399594+0000","last_clean":"2024-04-24T01:45:50.399594+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:45:50.399594+0000","last_undegraded":"2024-04-24T01:45:50.399594+0000","last_fullsized":"2024-04-24T01:45:50.399594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:41.395053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.441523+0000","last_change":"2024-04-24T01:42:40.790965+0000","last_active":"2024-04-24T01:43:23.441523+0000","last_peered":"2024-04-24T01:43:23.441523+0000","last_clean":"2024-04-24T01:43:23.441523+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:43:23.441523+0000","last_undegraded":"2024-04-24T01:43:23.441523+0000","last_fullsized":"2024-04-24T01:43:23.441523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:10.970016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863141+0000","last_change":"2024-04-24T01:42:44.776243+0000","last_active":"2024-04-24T01:43:21.863141+0000","last_peered":"2024-04-24T01:43:21.863141+0000","last_clean":"2024-04-24T01:43:21.863141+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:43:21.863141+0000","last_undegraded":"2024-04-24T01:43:21.863141+0000","last_fullsized":"2024-04-24T01:43:21.863141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:59.166147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.232605+0000","last_change":"2024-04-24T01:42:46.770097+0000","last_active":"2024-04-24T01:44:48.232605+0000","last_peered":"2024-04-24T01:44:48.232605+0000","last_clean":"2024-04-24T01:44:48.232605+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:44:48.232605+0000","last_undegraded":"2024-04-24T01:44:48.232605+0000","last_fullsized":"2024-04-24T01:44:48.232605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:06.966181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.446644+0000","last_change":"2024-04-24T01:42:48.794733+0000","last_active":"2024-04-24T01:45:50.446644+0000","last_peered":"2024-04-24T01:45:50.446644+0000","last_clean":"2024-04-24T01:45:50.446644+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:45:50.446644+0000","last_undegraded":"2024-04-24T01:45:50.446644+0000","last_fullsized":"2024-04-24T01:45:50.446644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:25.479779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084036+0000","last_change":"2024-04-24T01:42:50.793825+0000","last_active":"2024-04-24T01:44:59.084036+0000","last_peered":"2024-04-24T01:44:59.084036+0000","last_clean":"2024-04-24T01:44:59.084036+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:44:59.084036+0000","last_undegraded":"2024-04-24T01:44:59.084036+0000","last_fullsized":"2024-04-24T01:44:59.084036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:33.276602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270904+0000","last_change":"2024-04-24T01:42:42.790926+0000","last_active":"2024-04-24T01:45:50.270904+0000","last_peered":"2024-04-24T01:45:50.270904+0000","last_clean":"2024-04-24T01:45:50.270904+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:45:50.270904+0000","last_undegraded":"2024-04-24T01:45:50.270904+0000","last_fullsized":"2024-04-24T01:45:50.270904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812785+0000","last_change":"2024-04-24T01:42:40.789191+0000","last_active":"2024-04-24T01:43:21.812785+0000","last_peered":"2024-04-24T01:43:21.812785+0000","last_clean":"2024-04-24T01:43:21.812785+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:43:21.812785+0000","last_undegraded":"2024-04-24T01:43:21.812785+0000","last_fullsized":"2024-04-24T01:43:21.812785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:37.925439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.312396+0000","last_change":"2024-04-24T01:42:44.776093+0000","last_active":"2024-04-24T01:44:49.312396+0000","last_peered":"2024-04-24T01:44:49.312396+0000","last_clean":"2024-04-24T01:44:49.312396+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:44:49.312396+0000","last_undegraded":"2024-04-24T01:44:49.312396+0000","last_fullsized":"2024-04-24T01:44:49.312396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:07.203105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812310+0000","last_change":"2024-04-24T01:42:46.782280+0000","last_active":"2024-04-24T01:43:21.812310+0000","last_peered":"2024-04-24T01:43:21.812310+0000","last_clean":"2024-04-24T01:43:21.812310+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:43:21.812310+0000","last_undegraded":"2024-04-24T01:43:21.812310+0000","last_fullsized":"2024-04-24T01:43:21.812310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:26.243203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.402880+0000","last_change":"2024-04-24T01:42:48.791028+0000","last_active":"2024-04-24T01:45:50.402880+0000","last_peered":"2024-04-24T01:45:50.402880+0000","last_clean":"2024-04-24T01:45:50.402880+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:45:50.402880+0000","last_undegraded":"2024-04-24T01:45:50.402880+0000","last_fullsized":"2024-04-24T01:45:50.402880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:02.110375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.318221+0000","last_change":"2024-04-24T01:42:50.796703+0000","last_active":"2024-04-24T01:45:50.318221+0000","last_peered":"2024-04-24T01:45:50.318221+0000","last_clean":"2024-04-24T01:45:50.318221+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:45:50.318221+0000","last_undegraded":"2024-04-24T01:45:50.318221+0000","last_fullsized":"2024-04-24T01:45:50.318221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:51.030865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353512+0000","last_change":"2024-04-24T01:42:42.791687+0000","last_active":"2024-04-24T01:45:50.353512+0000","last_peered":"2024-04-24T01:45:50.353512+0000","last_clean":"2024-04-24T01:45:50.353512+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:45:50.353512+0000","last_undegraded":"2024-04-24T01:45:50.353512+0000","last_fullsized":"2024-04-24T01:45:50.353512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:02:24.201055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.791074+0000","last_change":"2024-04-24T01:42:40.787611+0000","last_active":"2024-04-24T01:44:05.791074+0000","last_peered":"2024-04-24T01:44:05.791074+0000","last_clean":"2024-04-24T01:44:05.791074+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:44:05.791074+0000","last_undegraded":"2024-04-24T01:44:05.791074+0000","last_fullsized":"2024-04-24T01:44:05.791074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:04.033349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814496+0000","last_change":"2024-04-24T01:42:44.777294+0000","last_active":"2024-04-24T01:43:21.814496+0000","last_peered":"2024-04-24T01:43:21.814496+0000","last_clean":"2024-04-24T01:43:21.814496+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:43:21.814496+0000","last_undegraded":"2024-04-24T01:43:21.814496+0000","last_fullsized":"2024-04-24T01:43:21.814496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:11.779877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.218762+0000","last_change":"2024-04-24T01:42:46.779272+0000","last_active":"2024-04-24T01:44:48.218762+0000","last_peered":"2024-04-24T01:44:48.218762+0000","last_clean":"2024-04-24T01:44:48.218762+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:44:48.218762+0000","last_undegraded":"2024-04-24T01:44:48.218762+0000","last_fullsized":"2024-04-24T01:44:48.218762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:45.404452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810071+0000","last_change":"2024-04-24T01:42:48.790268+0000","last_active":"2024-04-24T01:43:21.810071+0000","last_peered":"2024-04-24T01:43:21.810071+0000","last_clean":"2024-04-24T01:43:21.810071+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:43:21.810071+0000","last_undegraded":"2024-04-24T01:43:21.810071+0000","last_fullsized":"2024-04-24T01:43:21.810071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:46.045950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.378677+0000","last_change":"2024-04-24T01:42:50.798885+0000","last_active":"2024-04-24T01:45:50.378677+0000","last_peered":"2024-04-24T01:45:50.378677+0000","last_clean":"2024-04-24T01:45:50.378677+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:45:50.378677+0000","last_undegraded":"2024-04-24T01:45:50.378677+0000","last_fullsized":"2024-04-24T01:45:50.378677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:18:00.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270588+0000","last_change":"2024-04-24T01:42:42.787563+0000","last_active":"2024-04-24T01:45:50.270588+0000","last_peered":"2024-04-24T01:45:50.270588+0000","last_clean":"2024-04-24T01:45:50.270588+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:45:50.270588+0000","last_undegraded":"2024-04-24T01:45:50.270588+0000","last_fullsized":"2024-04-24T01:45:50.270588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:54.554156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815596+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:43:21.815596+0000","last_peered":"2024-04-24T01:43:21.815596+0000","last_clean":"2024-04-24T01:43:21.815596+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:43:21.815596+0000","last_undegraded":"2024-04-24T01:43:21.815596+0000","last_fullsized":"2024-04-24T01:43:21.815596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:54.970096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812194+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:43:21.812194+0000","last_peered":"2024-04-24T01:43:21.812194+0000","last_clean":"2024-04-24T01:43:21.812194+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:43:21.812194+0000","last_undegraded":"2024-04-24T01:43:21.812194+0000","last_fullsized":"2024-04-24T01:43:21.812194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:50.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811274+0000","last_change":"2024-04-24T01:42:40.787192+0000","last_active":"2024-04-24T01:43:21.811274+0000","last_peered":"2024-04-24T01:43:21.811274+0000","last_clean":"2024-04-24T01:43:21.811274+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:43:21.811274+0000","last_undegraded":"2024-04-24T01:43:21.811274+0000","last_fullsized":"2024-04-24T01:43:21.811274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:51.864862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817451+0000","last_change":"2024-04-24T01:42:44.776026+0000","last_active":"2024-04-24T01:43:21.817451+0000","last_peered":"2024-04-24T01:43:21.817451+0000","last_clean":"2024-04-24T01:43:21.817451+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:43:21.817451+0000","last_undegraded":"2024-04-24T01:43:21.817451+0000","last_fullsized":"2024-04-24T01:43:21.817451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:43.659940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'82","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.230340+0000","last_change":"2024-04-24T01:42:46.785058+0000","last_active":"2024-04-24T01:44:48.230340+0000","last_peered":"2024-04-24T01:44:48.230340+0000","last_clean":"2024-04-24T01:44:48.230340+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:44:48.230340+0000","last_undegraded":"2024-04-24T01:44:48.230340+0000","last_fullsized":"2024-04-24T01:44:48.230340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:09.881326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864430+0000","last_change":"2024-04-24T01:42:48.793592+0000","last_active":"2024-04-24T01:43:21.864430+0000","last_peered":"2024-04-24T01:43:21.864430+0000","last_clean":"2024-04-24T01:43:21.864430+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:43:21.864430+0000","last_undegraded":"2024-04-24T01:43:21.864430+0000","last_fullsized":"2024-04-24T01:43:21.864430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:15.464680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.355879+0000","last_change":"2024-04-24T01:42:50.792016+0000","last_active":"2024-04-24T01:45:50.355879+0000","last_peered":"2024-04-24T01:45:50.355879+0000","last_clean":"2024-04-24T01:45:50.355879+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:45:50.355879+0000","last_undegraded":"2024-04-24T01:45:50.355879+0000","last_fullsized":"2024-04-24T01:45:50.355879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:14.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654646+0000","last_change":"2024-04-24T01:42:42.786097+0000","last_active":"2024-04-24T01:44:49.654646+0000","last_peered":"2024-04-24T01:44:49.654646+0000","last_clean":"2024-04-24T01:44:49.654646+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:44:49.654646+0000","last_undegraded":"2024-04-24T01:44:49.654646+0000","last_fullsized":"2024-04-24T01:44:49.654646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:44.030398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809847+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:43:21.809847+0000","last_peered":"2024-04-24T01:43:21.809847+0000","last_clean":"2024-04-24T01:43:21.809847+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:43:21.809847+0000","last_undegraded":"2024-04-24T01:43:21.809847+0000","last_fullsized":"2024-04-24T01:43:21.809847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:29.896910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862322+0000","last_change":"2024-04-24T01:42:40.781303+0000","last_active":"2024-04-24T01:43:21.862322+0000","last_peered":"2024-04-24T01:43:21.862322+0000","last_clean":"2024-04-24T01:43:21.862322+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:43:21.862322+0000","last_undegraded":"2024-04-24T01:43:21.862322+0000","last_fullsized":"2024-04-24T01:43:21.862322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:59.215704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814458+0000","last_change":"2024-04-24T01:42:44.777664+0000","last_active":"2024-04-24T01:43:21.814458+0000","last_peered":"2024-04-24T01:43:21.814458+0000","last_clean":"2024-04-24T01:43:21.814458+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:43:21.814458+0000","last_undegraded":"2024-04-24T01:43:21.814458+0000","last_fullsized":"2024-04-24T01:43:21.814458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:08.483048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853754+0000","last_change":"2024-04-24T01:42:46.782817+0000","last_active":"2024-04-24T01:45:49.853754+0000","last_peered":"2024-04-24T01:45:49.853754+0000","last_clean":"2024-04-24T01:45:49.853754+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:45:49.853754+0000","last_undegraded":"2024-04-24T01:45:49.853754+0000","last_fullsized":"2024-04-24T01:45:49.853754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:27.024858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812247+0000","last_change":"2024-04-24T01:42:48.789708+0000","last_active":"2024-04-24T01:43:21.812247+0000","last_peered":"2024-04-24T01:43:21.812247+0000","last_clean":"2024-04-24T01:43:21.812247+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:43:21.812247+0000","last_undegraded":"2024-04-24T01:43:21.812247+0000","last_fullsized":"2024-04-24T01:43:21.812247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:49.899834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:05.803771+0000","last_change":"2024-04-24T01:42:50.795739+0000","last_active":"2024-04-24T01:44:05.803771+0000","last_peered":"2024-04-24T01:44:05.803771+0000","last_clean":"2024-04-24T01:44:05.803771+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:44:05.803771+0000","last_undegraded":"2024-04-24T01:44:05.803771+0000","last_fullsized":"2024-04-24T01:44:05.803771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:11:53.190598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864709+0000","last_change":"2024-04-24T01:42:42.783605+0000","last_active":"2024-04-24T01:43:21.864709+0000","last_peered":"2024-04-24T01:43:21.864709+0000","last_clean":"2024-04-24T01:43:21.864709+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:43:21.864709+0000","last_undegraded":"2024-04-24T01:43:21.864709+0000","last_fullsized":"2024-04-24T01:43:21.864709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:05.066861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807726+0000","last_change":"2024-04-24T01:42:32.739720+0000","last_active":"2024-04-24T01:43:21.807726+0000","last_peered":"2024-04-24T01:43:21.807726+0000","last_clean":"2024-04-24T01:43:21.807726+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:43:21.807726+0000","last_undegraded":"2024-04-24T01:43:21.807726+0000","last_fullsized":"2024-04-24T01:43:21.807726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.270545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.255333+0000","last_change":"2024-04-24T01:42:40.769426+0000","last_active":"2024-04-24T01:45:50.255333+0000","last_peered":"2024-04-24T01:45:50.255333+0000","last_clean":"2024-04-24T01:45:50.255333+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:45:50.255333+0000","last_undegraded":"2024-04-24T01:45:50.255333+0000","last_fullsized":"2024-04-24T01:45:50.255333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:24.208037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811063+0000","last_change":"2024-04-24T01:42:44.768708+0000","last_active":"2024-04-24T01:43:21.811063+0000","last_peered":"2024-04-24T01:43:21.811063+0000","last_clean":"2024-04-24T01:43:21.811063+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:43:21.811063+0000","last_undegraded":"2024-04-24T01:43:21.811063+0000","last_fullsized":"2024-04-24T01:43:21.811063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:22.037850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853586+0000","last_change":"2024-04-24T01:42:46.780747+0000","last_active":"2024-04-24T01:45:49.853586+0000","last_peered":"2024-04-24T01:45:49.853586+0000","last_clean":"2024-04-24T01:45:49.853586+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:45:49.853586+0000","last_undegraded":"2024-04-24T01:45:49.853586+0000","last_fullsized":"2024-04-24T01:45:49.853586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:35.740405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863693+0000","last_change":"2024-04-24T01:42:48.793578+0000","last_active":"2024-04-24T01:43:21.863693+0000","last_peered":"2024-04-24T01:43:21.863693+0000","last_clean":"2024-04-24T01:43:21.863693+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:43:21.863693+0000","last_undegraded":"2024-04-24T01:43:21.863693+0000","last_fullsized":"2024-04-24T01:43:21.863693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:53.516063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810739+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:43:21.810739+0000","last_peered":"2024-04-24T01:43:21.810739+0000","last_clean":"2024-04-24T01:43:21.810739+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:43:21.810739+0000","last_undegraded":"2024-04-24T01:43:21.810739+0000","last_fullsized":"2024-04-24T01:43:21.810739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:35.532430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864702+0000","last_change":"2024-04-24T01:42:42.775667+0000","last_active":"2024-04-24T01:43:21.864702+0000","last_peered":"2024-04-24T01:43:21.864702+0000","last_clean":"2024-04-24T01:43:21.864702+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:43:21.864702+0000","last_undegraded":"2024-04-24T01:43:21.864702+0000","last_fullsized":"2024-04-24T01:43:21.864702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:37.338206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811072+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:43:21.811072+0000","last_peered":"2024-04-24T01:43:21.811072+0000","last_clean":"2024-04-24T01:43:21.811072+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:43:21.811072+0000","last_undegraded":"2024-04-24T01:43:21.811072+0000","last_fullsized":"2024-04-24T01:43:21.811072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:23.825863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.787552+0000","last_change":"2024-04-24T01:42:40.769234+0000","last_active":"2024-04-24T01:43:22.787552+0000","last_peered":"2024-04-24T01:43:22.787552+0000","last_clean":"2024-04-24T01:43:22.787552+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:43:22.787552+0000","last_undegraded":"2024-04-24T01:43:22.787552+0000","last_fullsized":"2024-04-24T01:43:22.787552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864632+0000","last_change":"2024-04-24T01:42:44.778281+0000","last_active":"2024-04-24T01:43:21.864632+0000","last_peered":"2024-04-24T01:43:21.864632+0000","last_clean":"2024-04-24T01:43:21.864632+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:43:21.864632+0000","last_undegraded":"2024-04-24T01:43:21.864632+0000","last_fullsized":"2024-04-24T01:43:21.864632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:36.551915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.667766+0000","last_change":"2024-04-24T01:42:46.783117+0000","last_active":"2024-04-24T01:45:49.667766+0000","last_peered":"2024-04-24T01:45:49.667766+0000","last_clean":"2024-04-24T01:45:49.667766+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:45:49.667766+0000","last_undegraded":"2024-04-24T01:45:49.667766+0000","last_fullsized":"2024-04-24T01:45:49.667766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:06.561328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813544+0000","last_change":"2024-04-24T01:42:48.789629+0000","last_active":"2024-04-24T01:43:21.813544+0000","last_peered":"2024-04-24T01:43:21.813544+0000","last_clean":"2024-04-24T01:43:21.813544+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:43:21.813544+0000","last_undegraded":"2024-04-24T01:43:21.813544+0000","last_fullsized":"2024-04-24T01:43:21.813544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:25.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.420833+0000","last_change":"2024-04-24T01:42:50.802434+0000","last_active":"2024-04-24T01:44:49.420833+0000","last_peered":"2024-04-24T01:44:49.420833+0000","last_clean":"2024-04-24T01:44:49.420833+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:44:49.420833+0000","last_undegraded":"2024-04-24T01:44:49.420833+0000","last_fullsized":"2024-04-24T01:44:49.420833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.519476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506812+0000","last_change":"2024-04-24T01:42:42.783375+0000","last_active":"2024-04-24T01:44:46.506812+0000","last_peered":"2024-04-24T01:44:46.506812+0000","last_clean":"2024-04-24T01:44:46.506812+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:44:46.506812+0000","last_undegraded":"2024-04-24T01:44:46.506812+0000","last_fullsized":"2024-04-24T01:44:46.506812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:53.032722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.496293+0000","last_change":"2024-04-24T01:42:40.774629+0000","last_active":"2024-04-24T01:44:49.496293+0000","last_peered":"2024-04-24T01:44:49.496293+0000","last_clean":"2024-04-24T01:44:49.496293+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:44:49.496293+0000","last_undegraded":"2024-04-24T01:44:49.496293+0000","last_fullsized":"2024-04-24T01:44:49.496293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:18:39.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863436+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:43:21.863436+0000","last_peered":"2024-04-24T01:43:21.863436+0000","last_clean":"2024-04-24T01:43:21.863436+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:43:21.863436+0000","last_undegraded":"2024-04-24T01:43:21.863436+0000","last_fullsized":"2024-04-24T01:43:21.863436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:38.785738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:31.093588+0000","last_change":"2024-04-24T01:43:21.814238+0000","last_active":"2024-04-24T01:45:31.093588+0000","last_peered":"2024-04-24T01:45:31.093588+0000","last_clean":"2024-04-24T01:45:31.093588+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:45:31.093588+0000","last_undegraded":"2024-04-24T01:45:31.093588+0000","last_fullsized":"2024-04-24T01:45:31.093588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:13.474511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'81","reported_seq":160,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:57.005937+0000","last_change":"2024-04-24T01:42:46.779689+0000","last_active":"2024-04-24T01:45:57.005937+0000","last_peered":"2024-04-24T01:45:57.005937+0000","last_clean":"2024-04-24T01:45:57.005937+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:45:57.005937+0000","last_undegraded":"2024-04-24T01:45:57.005937+0000","last_fullsized":"2024-04-24T01:45:57.005937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:19.052361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":99,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808841+0000","last_change":"2024-04-24T01:42:48.792847+0000","last_active":"2024-04-24T01:43:21.808841+0000","last_peered":"2024-04-24T01:43:21.808841+0000","last_clean":"2024-04-24T01:43:21.808841+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:43:21.808841+0000","last_undegraded":"2024-04-24T01:43:21.808841+0000","last_fullsized":"2024-04-24T01:43:21.808841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:50.042446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.595124+0000","last_change":"2024-04-24T01:42:50.793302+0000","last_active":"2024-04-24T01:44:49.595124+0000","last_peered":"2024-04-24T01:44:49.595124+0000","last_clean":"2024-04-24T01:44:49.595124+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:44:49.595124+0000","last_undegraded":"2024-04-24T01:44:49.595124+0000","last_fullsized":"2024-04-24T01:44:49.595124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:08:15.582676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.137934+0000","last_change":"2024-04-24T01:42:42.789819+0000","last_active":"2024-04-24T01:45:50.137934+0000","last_peered":"2024-04-24T01:45:50.137934+0000","last_clean":"2024-04-24T01:45:50.137934+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:45:50.137934+0000","last_undegraded":"2024-04-24T01:45:50.137934+0000","last_fullsized":"2024-04-24T01:45:50.137934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:13.290315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.435621+0000","last_change":"2024-04-24T01:42:40.778312+0000","last_active":"2024-04-24T01:43:23.435621+0000","last_peered":"2024-04-24T01:43:23.435621+0000","last_clean":"2024-04-24T01:43:23.435621+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:43:23.435621+0000","last_undegraded":"2024-04-24T01:43:23.435621+0000","last_fullsized":"2024-04-24T01:43:23.435621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:05.002271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813065+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:43:21.813065+0000","last_peered":"2024-04-24T01:43:21.813065+0000","last_clean":"2024-04-24T01:43:21.813065+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:43:21.813065+0000","last_undegraded":"2024-04-24T01:43:21.813065+0000","last_fullsized":"2024-04-24T01:43:21.813065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:28.855827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810966+0000","last_change":"2024-04-24T01:42:44.773194+0000","last_active":"2024-04-24T01:43:21.810966+0000","last_peered":"2024-04-24T01:43:21.810966+0000","last_clean":"2024-04-24T01:43:21.810966+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:43:21.810966+0000","last_undegraded":"2024-04-24T01:43:21.810966+0000","last_fullsized":"2024-04-24T01:43:21.810966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:31.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.021595+0000","last_change":"2024-04-24T01:42:46.780073+0000","last_active":"2024-04-24T01:44:06.021595+0000","last_peered":"2024-04-24T01:44:06.021595+0000","last_clean":"2024-04-24T01:44:06.021595+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:44:06.021595+0000","last_undegraded":"2024-04-24T01:44:06.021595+0000","last_fullsized":"2024-04-24T01:44:06.021595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:36:58.563555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.853489+0000","last_change":"2024-04-24T01:42:48.794484+0000","last_active":"2024-04-24T01:45:49.853489+0000","last_peered":"2024-04-24T01:45:49.853489+0000","last_clean":"2024-04-24T01:45:49.853489+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:45:49.853489+0000","last_undegraded":"2024-04-24T01:45:49.853489+0000","last_fullsized":"2024-04-24T01:45:49.853489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:07.370372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813179+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:43:21.813179+0000","last_peered":"2024-04-24T01:43:21.813179+0000","last_clean":"2024-04-24T01:43:21.813179+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:43:21.813179+0000","last_undegraded":"2024-04-24T01:43:21.813179+0000","last_fullsized":"2024-04-24T01:43:21.813179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:33.848940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345353+0000","last_change":"2024-04-24T01:42:42.788049+0000","last_active":"2024-04-24T01:45:50.345353+0000","last_peered":"2024-04-24T01:45:50.345353+0000","last_clean":"2024-04-24T01:45:50.345353+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:45:50.345353+0000","last_undegraded":"2024-04-24T01:45:50.345353+0000","last_fullsized":"2024-04-24T01:45:50.345353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:57.647339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814304+0000","last_change":"2024-04-24T01:42:40.786621+0000","last_active":"2024-04-24T01:43:21.814304+0000","last_peered":"2024-04-24T01:43:21.814304+0000","last_clean":"2024-04-24T01:43:21.814304+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:43:21.814304+0000","last_undegraded":"2024-04-24T01:43:21.814304+0000","last_fullsized":"2024-04-24T01:43:21.814304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:23.749610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864853+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:43:21.864853+0000","last_peered":"2024-04-24T01:43:21.864853+0000","last_clean":"2024-04-24T01:43:21.864853+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:43:21.864853+0000","last_undegraded":"2024-04-24T01:43:21.864853+0000","last_fullsized":"2024-04-24T01:43:21.864853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:49.159738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813003+0000","last_change":"2024-04-24T01:42:44.777271+0000","last_active":"2024-04-24T01:43:21.813003+0000","last_peered":"2024-04-24T01:43:21.813003+0000","last_clean":"2024-04-24T01:43:21.813003+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:43:21.813003+0000","last_undegraded":"2024-04-24T01:43:21.813003+0000","last_fullsized":"2024-04-24T01:43:21.813003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.077015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088156+0000","last_change":"2024-04-24T01:42:46.782589+0000","last_active":"2024-04-24T01:44:51.088156+0000","last_peered":"2024-04-24T01:44:51.088156+0000","last_clean":"2024-04-24T01:44:51.088156+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:44:51.088156+0000","last_undegraded":"2024-04-24T01:44:51.088156+0000","last_fullsized":"2024-04-24T01:44:51.088156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:02.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.875602+0000","last_change":"2024-04-24T01:42:48.784318+0000","last_active":"2024-04-24T01:45:56.875602+0000","last_peered":"2024-04-24T01:45:56.875602+0000","last_clean":"2024-04-24T01:45:56.875602+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:45:56.875602+0000","last_undegraded":"2024-04-24T01:45:56.875602+0000","last_fullsized":"2024-04-24T01:45:56.875602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:27:07.076053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.140307+0000","last_change":"2024-04-24T01:42:50.802205+0000","last_active":"2024-04-24T01:45:50.140307+0000","last_peered":"2024-04-24T01:45:50.140307+0000","last_clean":"2024-04-24T01:45:50.140307+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:45:50.140307+0000","last_undegraded":"2024-04-24T01:45:50.140307+0000","last_fullsized":"2024-04-24T01:45:50.140307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:15.474464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144862+0000","last_change":"2024-04-24T01:42:42.788944+0000","last_active":"2024-04-24T01:45:50.144862+0000","last_peered":"2024-04-24T01:45:50.144862+0000","last_clean":"2024-04-24T01:45:50.144862+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:45:50.144862+0000","last_undegraded":"2024-04-24T01:45:50.144862+0000","last_fullsized":"2024-04-24T01:45:50.144862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:38.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816740+0000","last_change":"2024-04-24T01:42:40.788616+0000","last_active":"2024-04-24T01:43:21.816740+0000","last_peered":"2024-04-24T01:43:21.816740+0000","last_clean":"2024-04-24T01:43:21.816740+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:43:21.816740+0000","last_undegraded":"2024-04-24T01:43:21.816740+0000","last_fullsized":"2024-04-24T01:43:21.816740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:14.600350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814295+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:43:21.814295+0000","last_peered":"2024-04-24T01:43:21.814295+0000","last_clean":"2024-04-24T01:43:21.814295+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:43:21.814295+0000","last_undegraded":"2024-04-24T01:43:21.814295+0000","last_fullsized":"2024-04-24T01:43:21.814295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.254736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812231+0000","last_change":"2024-04-24T01:42:44.776836+0000","last_active":"2024-04-24T01:43:21.812231+0000","last_peered":"2024-04-24T01:43:21.812231+0000","last_clean":"2024-04-24T01:43:21.812231+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:43:21.812231+0000","last_undegraded":"2024-04-24T01:43:21.812231+0000","last_fullsized":"2024-04-24T01:43:21.812231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:52.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'89","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.216733+0000","last_change":"2024-04-24T01:42:46.781816+0000","last_active":"2024-04-24T01:44:48.216733+0000","last_peered":"2024-04-24T01:44:48.216733+0000","last_clean":"2024-04-24T01:44:48.216733+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:44:48.216733+0000","last_undegraded":"2024-04-24T01:44:48.216733+0000","last_fullsized":"2024-04-24T01:44:48.216733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:38.448452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863116+0000","last_change":"2024-04-24T01:42:48.791388+0000","last_active":"2024-04-24T01:43:21.863116+0000","last_peered":"2024-04-24T01:43:21.863116+0000","last_clean":"2024-04-24T01:43:21.863116+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:43:21.863116+0000","last_undegraded":"2024-04-24T01:43:21.863116+0000","last_fullsized":"2024-04-24T01:43:21.863116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:21.062631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810182+0000","last_change":"2024-04-24T01:42:50.791385+0000","last_active":"2024-04-24T01:43:21.810182+0000","last_peered":"2024-04-24T01:43:21.810182+0000","last_clean":"2024-04-24T01:43:21.810182+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:43:21.810182+0000","last_undegraded":"2024-04-24T01:43:21.810182+0000","last_fullsized":"2024-04-24T01:43:21.810182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:37.401350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809642+0000","last_change":"2024-04-24T01:42:50.800231+0000","last_active":"2024-04-24T01:43:21.809642+0000","last_peered":"2024-04-24T01:43:21.809642+0000","last_clean":"2024-04-24T01:43:21.809642+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:43:21.809642+0000","last_undegraded":"2024-04-24T01:43:21.809642+0000","last_fullsized":"2024-04-24T01:43:21.809642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:04.117350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809954+0000","last_change":"2024-04-24T01:42:42.791072+0000","last_active":"2024-04-24T01:43:21.809954+0000","last_peered":"2024-04-24T01:43:21.809954+0000","last_clean":"2024-04-24T01:43:21.809954+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:43:21.809954+0000","last_undegraded":"2024-04-24T01:43:21.809954+0000","last_fullsized":"2024-04-24T01:43:21.809954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:06.415050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811530+0000","last_change":"2024-04-24T01:42:40.776494+0000","last_active":"2024-04-24T01:43:21.811530+0000","last_peered":"2024-04-24T01:43:21.811530+0000","last_clean":"2024-04-24T01:43:21.811530+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:43:21.811530+0000","last_undegraded":"2024-04-24T01:43:21.811530+0000","last_fullsized":"2024-04-24T01:43:21.811530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:10.873984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817518+0000","last_change":"2024-04-24T01:42:44.776151+0000","last_active":"2024-04-24T01:43:21.817518+0000","last_peered":"2024-04-24T01:43:21.817518+0000","last_clean":"2024-04-24T01:43:21.817518+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:43:21.817518+0000","last_undegraded":"2024-04-24T01:43:21.817518+0000","last_fullsized":"2024-04-24T01:43:21.817518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:36.228002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.222877+0000","last_change":"2024-04-24T01:42:46.779944+0000","last_active":"2024-04-24T01:44:48.222877+0000","last_peered":"2024-04-24T01:44:48.222877+0000","last_clean":"2024-04-24T01:44:48.222877+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:44:48.222877+0000","last_undegraded":"2024-04-24T01:44:48.222877+0000","last_fullsized":"2024-04-24T01:44:48.222877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:37.615741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811011+0000","last_change":"2024-04-24T01:42:48.786495+0000","last_active":"2024-04-24T01:43:21.811011+0000","last_peered":"2024-04-24T01:43:21.811011+0000","last_clean":"2024-04-24T01:43:21.811011+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:43:21.811011+0000","last_undegraded":"2024-04-24T01:43:21.811011+0000","last_fullsized":"2024-04-24T01:43:21.811011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:20:25.150998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:47.901186+0000","last_change":"2024-04-24T01:42:50.802495+0000","last_active":"2024-04-24T01:44:47.901186+0000","last_peered":"2024-04-24T01:44:47.901186+0000","last_clean":"2024-04-24T01:44:47.901186+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:44:47.901186+0000","last_undegraded":"2024-04-24T01:44:47.901186+0000","last_fullsized":"2024-04-24T01:44:47.901186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:43.202204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506883+0000","last_change":"2024-04-24T01:42:42.781334+0000","last_active":"2024-04-24T01:44:46.506883+0000","last_peered":"2024-04-24T01:44:46.506883+0000","last_clean":"2024-04-24T01:44:46.506883+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:44:46.506883+0000","last_undegraded":"2024-04-24T01:44:46.506883+0000","last_fullsized":"2024-04-24T01:44:46.506883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:36.471270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.264145+0000","last_change":"2024-04-24T01:42:40.783014+0000","last_active":"2024-04-24T01:45:50.264145+0000","last_peered":"2024-04-24T01:45:50.264145+0000","last_clean":"2024-04-24T01:45:50.264145+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:45:50.264145+0000","last_undegraded":"2024-04-24T01:45:50.264145+0000","last_fullsized":"2024-04-24T01:45:50.264145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:23:57.252371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812848+0000","last_change":"2024-04-24T01:42:44.777503+0000","last_active":"2024-04-24T01:43:21.812848+0000","last_peered":"2024-04-24T01:43:21.812848+0000","last_clean":"2024-04-24T01:43:21.812848+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:43:21.812848+0000","last_undegraded":"2024-04-24T01:43:21.812848+0000","last_fullsized":"2024-04-24T01:43:21.812848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:19.310744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672156+0000","last_change":"2024-04-24T01:42:46.776129+0000","last_active":"2024-04-24T01:45:49.672156+0000","last_peered":"2024-04-24T01:45:49.672156+0000","last_clean":"2024-04-24T01:45:49.672156+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:45:49.672156+0000","last_undegraded":"2024-04-24T01:45:49.672156+0000","last_fullsized":"2024-04-24T01:45:49.672156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:06:55.737138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808083+0000","last_change":"2024-04-24T01:42:48.789269+0000","last_active":"2024-04-24T01:43:21.808083+0000","last_peered":"2024-04-24T01:43:21.808083+0000","last_clean":"2024-04-24T01:43:21.808083+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:43:21.808083+0000","last_undegraded":"2024-04-24T01:43:21.808083+0000","last_fullsized":"2024-04-24T01:43:21.808083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:23.719981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.020578+0000","last_change":"2024-04-24T01:42:50.793424+0000","last_active":"2024-04-24T01:43:24.020578+0000","last_peered":"2024-04-24T01:43:24.020578+0000","last_clean":"2024-04-24T01:43:24.020578+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:43:24.020578+0000","last_undegraded":"2024-04-24T01:43:24.020578+0000","last_fullsized":"2024-04-24T01:43:24.020578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:31.628249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345135+0000","last_change":"2024-04-24T01:42:42.790386+0000","last_active":"2024-04-24T01:45:50.345135+0000","last_peered":"2024-04-24T01:45:50.345135+0000","last_clean":"2024-04-24T01:45:50.345135+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:45:50.345135+0000","last_undegraded":"2024-04-24T01:45:50.345135+0000","last_fullsized":"2024-04-24T01:45:50.345135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:20.812984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811368+0000","last_change":"2024-04-24T01:42:40.777727+0000","last_active":"2024-04-24T01:43:21.811368+0000","last_peered":"2024-04-24T01:43:21.811368+0000","last_clean":"2024-04-24T01:43:21.811368+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:43:21.811368+0000","last_undegraded":"2024-04-24T01:43:21.811368+0000","last_fullsized":"2024-04-24T01:43:21.811368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:46.570707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.807855+0000","last_change":"2024-04-24T01:42:44.779726+0000","last_active":"2024-04-24T01:43:21.807855+0000","last_peered":"2024-04-24T01:43:21.807855+0000","last_clean":"2024-04-24T01:43:21.807855+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:43:21.807855+0000","last_undegraded":"2024-04-24T01:43:21.807855+0000","last_fullsized":"2024-04-24T01:43:21.807855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:52.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.999178+0000","last_change":"2024-04-24T01:42:46.779267+0000","last_active":"2024-04-24T01:45:56.999178+0000","last_peered":"2024-04-24T01:45:56.999178+0000","last_clean":"2024-04-24T01:45:56.999178+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:45:56.999178+0000","last_undegraded":"2024-04-24T01:45:56.999178+0000","last_fullsized":"2024-04-24T01:45:56.999178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:12.649320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814064+0000","last_change":"2024-04-24T01:42:48.791281+0000","last_active":"2024-04-24T01:43:21.814064+0000","last_peered":"2024-04-24T01:43:21.814064+0000","last_clean":"2024-04-24T01:43:21.814064+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:43:21.814064+0000","last_undegraded":"2024-04-24T01:43:21.814064+0000","last_fullsized":"2024-04-24T01:43:21.814064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:20:56.691092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.450921+0000","last_change":"2024-04-24T01:42:50.801137+0000","last_active":"2024-04-24T01:43:23.450921+0000","last_peered":"2024-04-24T01:43:23.450921+0000","last_clean":"2024-04-24T01:43:23.450921+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:43:23.450921+0000","last_undegraded":"2024-04-24T01:43:23.450921+0000","last_fullsized":"2024-04-24T01:43:23.450921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:41.458884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.185393+0000","last_change":"2024-04-24T01:42:42.786306+0000","last_active":"2024-04-24T01:43:23.185393+0000","last_peered":"2024-04-24T01:43:23.185393+0000","last_clean":"2024-04-24T01:43:23.185393+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:43:23.185393+0000","last_undegraded":"2024-04-24T01:43:23.185393+0000","last_fullsized":"2024-04-24T01:43:23.185393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:24.062336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816678+0000","last_change":"2024-04-24T01:42:40.790215+0000","last_active":"2024-04-24T01:43:21.816678+0000","last_peered":"2024-04-24T01:43:21.816678+0000","last_clean":"2024-04-24T01:43:21.816678+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:43:21.816678+0000","last_undegraded":"2024-04-24T01:43:21.816678+0000","last_fullsized":"2024-04-24T01:43:21.816678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:05.126379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811343+0000","last_change":"2024-04-24T01:42:44.775854+0000","last_active":"2024-04-24T01:43:21.811343+0000","last_peered":"2024-04-24T01:43:21.811343+0000","last_clean":"2024-04-24T01:43:21.811343+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:43:21.811343+0000","last_undegraded":"2024-04-24T01:43:21.811343+0000","last_fullsized":"2024-04-24T01:43:21.811343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:58.105579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.207876+0000","last_change":"2024-04-24T01:42:46.777619+0000","last_active":"2024-04-24T01:44:48.207876+0000","last_peered":"2024-04-24T01:44:48.207876+0000","last_clean":"2024-04-24T01:44:48.207876+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:44:48.207876+0000","last_undegraded":"2024-04-24T01:44:48.207876+0000","last_fullsized":"2024-04-24T01:44:48.207876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:23.977698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809142+0000","last_change":"2024-04-24T01:42:48.783348+0000","last_active":"2024-04-24T01:43:21.809142+0000","last_peered":"2024-04-24T01:43:21.809142+0000","last_clean":"2024-04-24T01:43:21.809142+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:43:21.809142+0000","last_undegraded":"2024-04-24T01:43:21.809142+0000","last_fullsized":"2024-04-24T01:43:21.809142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:29.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345667+0000","last_change":"2024-04-24T01:43:21.862671+0000","last_active":"2024-04-24T01:45:50.345667+0000","last_peered":"2024-04-24T01:45:50.345667+0000","last_clean":"2024-04-24T01:45:50.345667+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:45:50.345667+0000","last_undegraded":"2024-04-24T01:45:50.345667+0000","last_fullsized":"2024-04-24T01:45:50.345667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:07.455442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.333865+0000","last_change":"2024-04-24T01:42:40.787886+0000","last_active":"2024-04-24T01:43:22.333865+0000","last_peered":"2024-04-24T01:43:22.333865+0000","last_clean":"2024-04-24T01:43:22.333865+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:43:22.333865+0000","last_undegraded":"2024-04-24T01:43:22.333865+0000","last_fullsized":"2024-04-24T01:43:22.333865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:56.282172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865914+0000","last_change":"2024-04-24T01:42:44.773584+0000","last_active":"2024-04-24T01:43:21.865914+0000","last_peered":"2024-04-24T01:43:21.865914+0000","last_clean":"2024-04-24T01:43:21.865914+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:43:21.865914+0000","last_undegraded":"2024-04-24T01:43:21.865914+0000","last_fullsized":"2024-04-24T01:43:21.865914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:23.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.986083+0000","last_change":"2024-04-24T01:42:46.777975+0000","last_active":"2024-04-24T01:45:56.986083+0000","last_peered":"2024-04-24T01:45:56.986083+0000","last_clean":"2024-04-24T01:45:56.986083+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:45:56.986083+0000","last_undegraded":"2024-04-24T01:45:56.986083+0000","last_fullsized":"2024-04-24T01:45:56.986083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:13.422542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808471+0000","last_change":"2024-04-24T01:42:48.782421+0000","last_active":"2024-04-24T01:43:21.808471+0000","last_peered":"2024-04-24T01:43:21.808471+0000","last_clean":"2024-04-24T01:43:21.808471+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:43:21.808471+0000","last_undegraded":"2024-04-24T01:43:21.808471+0000","last_fullsized":"2024-04-24T01:43:21.808471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:57.847015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.067180+0000","last_change":"2024-04-24T01:42:50.794926+0000","last_active":"2024-04-24T01:45:50.067180+0000","last_peered":"2024-04-24T01:45:50.067180+0000","last_clean":"2024-04-24T01:45:50.067180+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:45:50.067180+0000","last_undegraded":"2024-04-24T01:45:50.067180+0000","last_fullsized":"2024-04-24T01:45:50.067180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:45.839756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:24.014892+0000","last_change":"2024-04-24T01:42:42.783533+0000","last_active":"2024-04-24T01:43:24.014892+0000","last_peered":"2024-04-24T01:43:24.014892+0000","last_clean":"2024-04-24T01:43:24.014892+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:43:24.014892+0000","last_undegraded":"2024-04-24T01:43:24.014892+0000","last_fullsized":"2024-04-24T01:43:24.014892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:09.403789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815922+0000","last_change":"2024-04-24T01:42:40.788925+0000","last_active":"2024-04-24T01:43:21.815922+0000","last_peered":"2024-04-24T01:43:21.815922+0000","last_clean":"2024-04-24T01:43:21.815922+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:43:21.815922+0000","last_undegraded":"2024-04-24T01:43:21.815922+0000","last_fullsized":"2024-04-24T01:43:21.815922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:14.287408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810144+0000","last_change":"2024-04-24T01:42:44.774986+0000","last_active":"2024-04-24T01:43:21.810144+0000","last_peered":"2024-04-24T01:43:21.810144+0000","last_clean":"2024-04-24T01:43:21.810144+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:43:21.810144+0000","last_undegraded":"2024-04-24T01:43:21.810144+0000","last_fullsized":"2024-04-24T01:43:21.810144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:15.297566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.208815+0000","last_change":"2024-04-24T01:42:46.783203+0000","last_active":"2024-04-24T01:44:48.208815+0000","last_peered":"2024-04-24T01:44:48.208815+0000","last_clean":"2024-04-24T01:44:48.208815+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:44:48.208815+0000","last_undegraded":"2024-04-24T01:44:48.208815+0000","last_fullsized":"2024-04-24T01:44:48.208815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:26:21.983975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814006+0000","last_change":"2024-04-24T01:42:48.791647+0000","last_active":"2024-04-24T01:43:21.814006+0000","last_peered":"2024-04-24T01:43:21.814006+0000","last_clean":"2024-04-24T01:43:21.814006+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:43:21.814006+0000","last_undegraded":"2024-04-24T01:43:21.814006+0000","last_fullsized":"2024-04-24T01:43:21.814006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:07.292630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.304388+0000","last_change":"2024-04-24T01:42:50.797843+0000","last_active":"2024-04-24T01:45:50.304388+0000","last_peered":"2024-04-24T01:45:50.304388+0000","last_clean":"2024-04-24T01:45:50.304388+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:45:50.304388+0000","last_undegraded":"2024-04-24T01:45:50.304388+0000","last_fullsized":"2024-04-24T01:45:50.304388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:49.177816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.814977+0000","last_change":"2024-04-24T01:42:42.786283+0000","last_active":"2024-04-24T01:43:21.814977+0000","last_peered":"2024-04-24T01:43:21.814977+0000","last_clean":"2024-04-24T01:43:21.814977+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:43:21.814977+0000","last_undegraded":"2024-04-24T01:43:21.814977+0000","last_fullsized":"2024-04-24T01:43:21.814977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:14.187364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.608549+0000","last_change":"2024-04-24T01:42:40.769690+0000","last_active":"2024-04-24T01:44:49.608549+0000","last_peered":"2024-04-24T01:44:49.608549+0000","last_clean":"2024-04-24T01:44:49.608549+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:44:49.608549+0000","last_undegraded":"2024-04-24T01:44:49.608549+0000","last_fullsized":"2024-04-24T01:44:49.608549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.808700+0000","last_change":"2024-04-24T01:42:44.775092+0000","last_active":"2024-04-24T01:43:21.808700+0000","last_peered":"2024-04-24T01:43:21.808700+0000","last_clean":"2024-04-24T01:43:21.808700+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:43:21.808700+0000","last_undegraded":"2024-04-24T01:43:21.808700+0000","last_fullsized":"2024-04-24T01:43:21.808700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:22.743910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.936277+0000","last_change":"2024-04-24T01:42:46.777052+0000","last_active":"2024-04-24T01:45:56.936277+0000","last_peered":"2024-04-24T01:45:56.936277+0000","last_clean":"2024-04-24T01:45:56.936277+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:45:56.936277+0000","last_undegraded":"2024-04-24T01:45:56.936277+0000","last_fullsized":"2024-04-24T01:45:56.936277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:56.838568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864024+0000","last_change":"2024-04-24T01:42:48.783841+0000","last_active":"2024-04-24T01:43:21.864024+0000","last_peered":"2024-04-24T01:43:21.864024+0000","last_clean":"2024-04-24T01:43:21.864024+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:43:21.864024+0000","last_undegraded":"2024-04-24T01:43:21.864024+0000","last_fullsized":"2024-04-24T01:43:21.864024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:56:50.471892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.650746+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:44:49.650746+0000","last_peered":"2024-04-24T01:44:49.650746+0000","last_clean":"2024-04-24T01:44:49.650746+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:44:49.650746+0000","last_undegraded":"2024-04-24T01:44:49.650746+0000","last_fullsized":"2024-04-24T01:44:49.650746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:59.151288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315999+0000","last_change":"2024-04-24T01:42:42.776215+0000","last_active":"2024-04-24T01:45:50.315999+0000","last_peered":"2024-04-24T01:45:50.315999+0000","last_clean":"2024-04-24T01:45:50.315999+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:45:50.315999+0000","last_undegraded":"2024-04-24T01:45:50.315999+0000","last_fullsized":"2024-04-24T01:45:50.315999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:29.635969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811880+0000","last_change":"2024-04-24T01:42:40.791055+0000","last_active":"2024-04-24T01:43:21.811880+0000","last_peered":"2024-04-24T01:43:21.811880+0000","last_clean":"2024-04-24T01:43:21.811880+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:43:21.811880+0000","last_undegraded":"2024-04-24T01:43:21.811880+0000","last_fullsized":"2024-04-24T01:43:21.811880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:46.075375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816801+0000","last_change":"2024-04-24T01:42:44.775371+0000","last_active":"2024-04-24T01:43:21.816801+0000","last_peered":"2024-04-24T01:43:21.816801+0000","last_clean":"2024-04-24T01:43:21.816801+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:43:21.816801+0000","last_undegraded":"2024-04-24T01:43:21.816801+0000","last_fullsized":"2024-04-24T01:43:21.816801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:48.566887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813558+0000","last_change":"2024-04-24T01:42:46.785255+0000","last_active":"2024-04-24T01:43:21.813558+0000","last_peered":"2024-04-24T01:43:21.813558+0000","last_clean":"2024-04-24T01:43:21.813558+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:43:21.813558+0000","last_undegraded":"2024-04-24T01:43:21.813558+0000","last_fullsized":"2024-04-24T01:43:21.813558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:55.734489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.349973+0000","last_change":"2024-04-24T01:42:48.791368+0000","last_active":"2024-04-24T01:45:50.349973+0000","last_peered":"2024-04-24T01:45:50.349973+0000","last_clean":"2024-04-24T01:45:50.349973+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:45:50.349973+0000","last_undegraded":"2024-04-24T01:45:50.349973+0000","last_fullsized":"2024-04-24T01:45:50.349973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:36.125996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.809311+0000","last_change":"2024-04-24T01:42:50.799047+0000","last_active":"2024-04-24T01:43:21.809311+0000","last_peered":"2024-04-24T01:43:21.809311+0000","last_clean":"2024-04-24T01:43:21.809311+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:43:21.809311+0000","last_undegraded":"2024-04-24T01:43:21.809311+0000","last_fullsized":"2024-04-24T01:43:21.809311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:48.985276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270565+0000","last_change":"2024-04-24T01:42:42.779703+0000","last_active":"2024-04-24T01:45:50.270565+0000","last_peered":"2024-04-24T01:45:50.270565+0000","last_clean":"2024-04-24T01:45:50.270565+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:45:50.270565+0000","last_undegraded":"2024-04-24T01:45:50.270565+0000","last_fullsized":"2024-04-24T01:45:50.270565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:48.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817526+0000","last_change":"2024-04-24T01:42:40.783048+0000","last_active":"2024-04-24T01:43:21.817526+0000","last_peered":"2024-04-24T01:43:21.817526+0000","last_clean":"2024-04-24T01:43:21.817526+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:43:21.817526+0000","last_undegraded":"2024-04-24T01:43:21.817526+0000","last_fullsized":"2024-04-24T01:43:21.817526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:35.111795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817275+0000","last_change":"2024-04-24T01:42:44.776357+0000","last_active":"2024-04-24T01:43:21.817275+0000","last_peered":"2024-04-24T01:43:21.817275+0000","last_clean":"2024-04-24T01:43:21.817275+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:43:21.817275+0000","last_undegraded":"2024-04-24T01:43:21.817275+0000","last_fullsized":"2024-04-24T01:43:21.817275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:59.654590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'63","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090843+0000","last_change":"2024-04-24T01:42:46.776292+0000","last_active":"2024-04-24T01:45:11.090843+0000","last_peered":"2024-04-24T01:45:11.090843+0000","last_clean":"2024-04-24T01:45:11.090843+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:45:11.090843+0000","last_undegraded":"2024-04-24T01:45:11.090843+0000","last_fullsized":"2024-04-24T01:45:11.090843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:34.123347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":76,"num_read_kb":63,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.861850+0000","last_change":"2024-04-24T01:42:48.788971+0000","last_active":"2024-04-24T01:43:21.861850+0000","last_peered":"2024-04-24T01:43:21.861850+0000","last_clean":"2024-04-24T01:43:21.861850+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:43:21.861850+0000","last_undegraded":"2024-04-24T01:43:21.861850+0000","last_fullsized":"2024-04-24T01:43:21.861850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:30:22.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.817135+0000","last_change":"2024-04-24T01:42:50.796877+0000","last_active":"2024-04-24T01:43:21.817135+0000","last_peered":"2024-04-24T01:43:21.817135+0000","last_clean":"2024-04-24T01:43:21.817135+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:43:21.817135+0000","last_undegraded":"2024-04-24T01:43:21.817135+0000","last_fullsized":"2024-04-24T01:43:21.817135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:01:14.162912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345596+0000","last_change":"2024-04-24T01:42:42.779537+0000","last_active":"2024-04-24T01:45:50.345596+0000","last_peered":"2024-04-24T01:45:50.345596+0000","last_clean":"2024-04-24T01:45:50.345596+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:45:50.345596+0000","last_undegraded":"2024-04-24T01:45:50.345596+0000","last_fullsized":"2024-04-24T01:45:50.345596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:12.977374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.261154+0000","last_change":"2024-04-24T01:42:40.788381+0000","last_active":"2024-04-24T01:45:50.261154+0000","last_peered":"2024-04-24T01:45:50.261154+0000","last_clean":"2024-04-24T01:45:50.261154+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:45:50.261154+0000","last_undegraded":"2024-04-24T01:45:50.261154+0000","last_fullsized":"2024-04-24T01:45:50.261154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:10.719363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810382+0000","last_change":"2024-04-24T01:42:44.775775+0000","last_active":"2024-04-24T01:43:21.810382+0000","last_peered":"2024-04-24T01:43:21.810382+0000","last_clean":"2024-04-24T01:43:21.810382+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:43:21.810382+0000","last_undegraded":"2024-04-24T01:43:21.810382+0000","last_fullsized":"2024-04-24T01:43:21.810382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:06.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'40","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.967272+0000","last_change":"2024-04-24T01:42:46.777066+0000","last_active":"2024-04-24T01:45:56.967272+0000","last_peered":"2024-04-24T01:45:56.967272+0000","last_clean":"2024-04-24T01:45:56.967272+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:45:56.967272+0000","last_undegraded":"2024-04-24T01:45:56.967272+0000","last_fullsized":"2024-04-24T01:45:56.967272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:17.835974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810707+0000","last_change":"2024-04-24T01:42:48.785198+0000","last_active":"2024-04-24T01:43:21.810707+0000","last_peered":"2024-04-24T01:43:21.810707+0000","last_clean":"2024-04-24T01:43:21.810707+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:43:21.810707+0000","last_undegraded":"2024-04-24T01:43:21.810707+0000","last_fullsized":"2024-04-24T01:43:21.810707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:01.822047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.400789+0000","last_change":"2024-04-24T01:42:50.801689+0000","last_active":"2024-04-24T01:45:50.400789+0000","last_peered":"2024-04-24T01:45:50.400789+0000","last_clean":"2024-04-24T01:45:50.400789+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:45:50.400789+0000","last_undegraded":"2024-04-24T01:45:50.400789+0000","last_fullsized":"2024-04-24T01:45:50.400789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:45.044072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654504+0000","last_change":"2024-04-24T01:43:21.864360+0000","last_active":"2024-04-24T01:44:49.654504+0000","last_peered":"2024-04-24T01:44:49.654504+0000","last_clean":"2024-04-24T01:44:49.654504+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:44:49.654504+0000","last_undegraded":"2024-04-24T01:44:49.654504+0000","last_fullsized":"2024-04-24T01:44:49.654504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:52.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.865009+0000","last_change":"2024-04-24T01:42:40.778077+0000","last_active":"2024-04-24T01:43:21.865009+0000","last_peered":"2024-04-24T01:43:21.865009+0000","last_clean":"2024-04-24T01:43:21.865009+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:43:21.865009+0000","last_undegraded":"2024-04-24T01:43:21.865009+0000","last_fullsized":"2024-04-24T01:43:21.865009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:51.699851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.302204+0000","last_change":"2024-04-24T01:42:44.778211+0000","last_active":"2024-04-24T01:44:49.302204+0000","last_peered":"2024-04-24T01:44:49.302204+0000","last_clean":"2024-04-24T01:44:49.302204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:44:49.302204+0000","last_undegraded":"2024-04-24T01:44:49.302204+0000","last_fullsized":"2024-04-24T01:44:49.302204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:36.446305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.224750+0000","last_change":"2024-04-24T01:42:46.782809+0000","last_active":"2024-04-24T01:44:48.224750+0000","last_peered":"2024-04-24T01:44:48.224750+0000","last_clean":"2024-04-24T01:44:48.224750+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:44:48.224750+0000","last_undegraded":"2024-04-24T01:44:48.224750+0000","last_fullsized":"2024-04-24T01:44:48.224750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:38.612473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811004+0000","last_change":"2024-04-24T01:42:48.793613+0000","last_active":"2024-04-24T01:43:21.811004+0000","last_peered":"2024-04-24T01:43:21.811004+0000","last_clean":"2024-04-24T01:43:21.811004+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:43:21.811004+0000","last_undegraded":"2024-04-24T01:43:21.811004+0000","last_fullsized":"2024-04-24T01:43:21.811004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:14.394175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.234782+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:44:48.234782+0000","last_peered":"2024-04-24T01:44:48.234782+0000","last_clean":"2024-04-24T01:44:48.234782+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:44:48.234782+0000","last_undegraded":"2024-04-24T01:44:48.234782+0000","last_fullsized":"2024-04-24T01:44:48.234782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:18.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345345+0000","last_change":"2024-04-24T01:42:42.779597+0000","last_active":"2024-04-24T01:45:50.345345+0000","last_peered":"2024-04-24T01:45:50.345345+0000","last_clean":"2024-04-24T01:45:50.345345+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:45:50.345345+0000","last_undegraded":"2024-04-24T01:45:50.345345+0000","last_fullsized":"2024-04-24T01:45:50.345345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:39.932797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.258347+0000","last_change":"2024-04-24T01:42:40.789710+0000","last_active":"2024-04-24T01:45:50.258347+0000","last_peered":"2024-04-24T01:45:50.258347+0000","last_clean":"2024-04-24T01:45:50.258347+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:45:50.258347+0000","last_undegraded":"2024-04-24T01:45:50.258347+0000","last_fullsized":"2024-04-24T01:45:50.258347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.900262+0000","last_change":"2024-04-24T01:42:44.778763+0000","last_active":"2024-04-24T01:44:46.900262+0000","last_peered":"2024-04-24T01:44:46.900262+0000","last_clean":"2024-04-24T01:44:46.900262+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:44:46.900262+0000","last_undegraded":"2024-04-24T01:44:46.900262+0000","last_fullsized":"2024-04-24T01:44:46.900262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:04.964034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.672992+0000","last_change":"2024-04-24T01:42:46.782978+0000","last_active":"2024-04-24T01:45:49.672992+0000","last_peered":"2024-04-24T01:45:49.672992+0000","last_clean":"2024-04-24T01:45:49.672992+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:45:49.672992+0000","last_undegraded":"2024-04-24T01:45:49.672992+0000","last_fullsized":"2024-04-24T01:45:49.672992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:19.005767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.863044+0000","last_change":"2024-04-24T01:42:48.788973+0000","last_active":"2024-04-24T01:43:21.863044+0000","last_peered":"2024-04-24T01:43:21.863044+0000","last_clean":"2024-04-24T01:43:21.863044+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:43:21.863044+0000","last_undegraded":"2024-04-24T01:43:21.863044+0000","last_fullsized":"2024-04-24T01:43:21.863044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:02.008836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:48.237757+0000","last_change":"2024-04-24T01:42:50.800862+0000","last_active":"2024-04-24T01:44:48.237757+0000","last_peered":"2024-04-24T01:44:48.237757+0000","last_clean":"2024-04-24T01:44:48.237757+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:44:48.237757+0000","last_undegraded":"2024-04-24T01:44:48.237757+0000","last_fullsized":"2024-04-24T01:44:48.237757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:16:03.004170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088543+0000","last_change":"2024-04-24T01:42:42.791052+0000","last_active":"2024-04-24T01:44:56.088543+0000","last_peered":"2024-04-24T01:44:56.088543+0000","last_clean":"2024-04-24T01:44:56.088543+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:44:56.088543+0000","last_undegraded":"2024-04-24T01:44:56.088543+0000","last_fullsized":"2024-04-24T01:44:56.088543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:09.570635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.086702+0000","last_change":"2024-04-24T01:42:40.778401+0000","last_active":"2024-04-24T01:44:46.086702+0000","last_peered":"2024-04-24T01:44:46.086702+0000","last_clean":"2024-04-24T01:44:46.086702+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:44:46.086702+0000","last_undegraded":"2024-04-24T01:44:46.086702+0000","last_fullsized":"2024-04-24T01:44:46.086702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:27.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315993+0000","last_change":"2024-04-24T01:42:42.779808+0000","last_active":"2024-04-24T01:45:50.315993+0000","last_peered":"2024-04-24T01:45:50.315993+0000","last_clean":"2024-04-24T01:45:50.315993+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:45:50.315993+0000","last_undegraded":"2024-04-24T01:45:50.315993+0000","last_fullsized":"2024-04-24T01:45:50.315993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:39.808849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.862090+0000","last_change":"2024-04-24T01:42:40.781020+0000","last_active":"2024-04-24T01:43:21.862090+0000","last_peered":"2024-04-24T01:43:21.862090+0000","last_clean":"2024-04-24T01:43:21.862090+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:43:21.862090+0000","last_undegraded":"2024-04-24T01:43:21.862090+0000","last_fullsized":"2024-04-24T01:43:21.862090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:11:49.303845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'21","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.051046+0000","last_change":"2024-04-24T01:42:42.782200+0000","last_active":"2024-04-24T01:45:50.051046+0000","last_peered":"2024-04-24T01:45:50.051046+0000","last_clean":"2024-04-24T01:45:50.051046+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:45:50.051046+0000","last_undegraded":"2024-04-24T01:45:50.051046+0000","last_fullsized":"2024-04-24T01:45:50.051046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:51.834967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.023917+0000","last_change":"2024-04-24T01:42:40.785740+0000","last_active":"2024-04-24T01:45:50.023917+0000","last_peered":"2024-04-24T01:45:50.023917+0000","last_clean":"2024-04-24T01:45:50.023917+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:45:50.023917+0000","last_undegraded":"2024-04-24T01:45:50.023917+0000","last_fullsized":"2024-04-24T01:45:50.023917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:06.241519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.315979+0000","last_change":"2024-04-24T01:42:42.775754+0000","last_active":"2024-04-24T01:45:50.315979+0000","last_peered":"2024-04-24T01:45:50.315979+0000","last_clean":"2024-04-24T01:45:50.315979+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:45:50.315979+0000","last_undegraded":"2024-04-24T01:45:50.315979+0000","last_fullsized":"2024-04-24T01:45:50.315979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:14.133212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864641+0000","last_change":"2024-04-24T01:42:40.768297+0000","last_active":"2024-04-24T01:43:21.864641+0000","last_peered":"2024-04-24T01:43:21.864641+0000","last_clean":"2024-04-24T01:43:21.864641+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:43:21.864641+0000","last_undegraded":"2024-04-24T01:43:21.864641+0000","last_fullsized":"2024-04-24T01:43:21.864641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:41.931823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.864431+0000","last_change":"2024-04-24T01:42:42.790746+0000","last_active":"2024-04-24T01:43:21.864431+0000","last_peered":"2024-04-24T01:43:21.864431+0000","last_clean":"2024-04-24T01:43:21.864431+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:43:21.864431+0000","last_undegraded":"2024-04-24T01:43:21.864431+0000","last_fullsized":"2024-04-24T01:43:21.864431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:23.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334072+0000","last_change":"2024-04-24T01:42:40.778267+0000","last_active":"2024-04-24T01:43:22.334072+0000","last_peered":"2024-04-24T01:43:22.334072+0000","last_clean":"2024-04-24T01:43:22.334072+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:43:22.334072+0000","last_undegraded":"2024-04-24T01:43:22.334072+0000","last_fullsized":"2024-04-24T01:43:22.334072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:54.513268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.506919+0000","last_change":"2024-04-24T01:42:42.783600+0000","last_active":"2024-04-24T01:44:46.506919+0000","last_peered":"2024-04-24T01:44:46.506919+0000","last_clean":"2024-04-24T01:44:46.506919+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:44:46.506919+0000","last_undegraded":"2024-04-24T01:44:46.506919+0000","last_fullsized":"2024-04-24T01:44:46.506919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:54.263697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.438378+0000","last_change":"2024-04-24T01:42:40.792747+0000","last_active":"2024-04-24T01:43:23.438378+0000","last_peered":"2024-04-24T01:43:23.438378+0000","last_clean":"2024-04-24T01:43:23.438378+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:43:23.438378+0000","last_undegraded":"2024-04-24T01:43:23.438378+0000","last_fullsized":"2024-04-24T01:43:23.438378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:23.455490+0000","last_change":"2024-04-24T01:42:42.783541+0000","last_active":"2024-04-24T01:43:23.455490+0000","last_peered":"2024-04-24T01:43:23.455490+0000","last_clean":"2024-04-24T01:43:23.455490+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:43:23.455490+0000","last_undegraded":"2024-04-24T01:43:23.455490+0000","last_fullsized":"2024-04-24T01:43:23.455490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:29.669455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.496096+0000","last_change":"2024-04-24T01:42:40.784834+0000","last_active":"2024-04-24T01:44:46.496096+0000","last_peered":"2024-04-24T01:44:46.496096+0000","last_clean":"2024-04-24T01:44:46.496096+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:44:46.496096+0000","last_undegraded":"2024-04-24T01:44:46.496096+0000","last_fullsized":"2024-04-24T01:44:46.496096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:22.209642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654733+0000","last_change":"2024-04-24T01:42:42.784939+0000","last_active":"2024-04-24T01:44:49.654733+0000","last_peered":"2024-04-24T01:44:49.654733+0000","last_clean":"2024-04-24T01:44:49.654733+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:44:49.654733+0000","last_undegraded":"2024-04-24T01:44:49.654733+0000","last_fullsized":"2024-04-24T01:44:49.654733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:13.015586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.002401+0000","last_change":"2024-04-24T01:42:40.774338+0000","last_active":"2024-04-24T01:45:50.002401+0000","last_peered":"2024-04-24T01:45:50.002401+0000","last_clean":"2024-04-24T01:45:50.002401+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:45:50.002401+0000","last_undegraded":"2024-04-24T01:45:50.002401+0000","last_fullsized":"2024-04-24T01:45:50.002401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:47.446497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654753+0000","last_change":"2024-04-24T01:42:42.783518+0000","last_active":"2024-04-24T01:44:49.654753+0000","last_peered":"2024-04-24T01:44:49.654753+0000","last_clean":"2024-04-24T01:44:49.654753+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:44:49.654753+0000","last_undegraded":"2024-04-24T01:44:49.654753+0000","last_fullsized":"2024-04-24T01:44:49.654753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:48.893933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.810266+0000","last_change":"2024-04-24T01:42:40.776220+0000","last_active":"2024-04-24T01:43:21.810266+0000","last_peered":"2024-04-24T01:43:21.810266+0000","last_clean":"2024-04-24T01:43:21.810266+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:43:21.810266+0000","last_undegraded":"2024-04-24T01:43:21.810266+0000","last_fullsized":"2024-04-24T01:43:21.810266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:52.166943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.654997+0000","last_change":"2024-04-24T01:42:42.780704+0000","last_active":"2024-04-24T01:44:49.654997+0000","last_peered":"2024-04-24T01:44:49.654997+0000","last_clean":"2024-04-24T01:44:49.654997+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:44:49.654997+0000","last_undegraded":"2024-04-24T01:44:49.654997+0000","last_fullsized":"2024-04-24T01:44:49.654997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:19.467731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:22.334617+0000","last_change":"2024-04-24T01:42:40.774379+0000","last_active":"2024-04-24T01:43:22.334617+0000","last_peered":"2024-04-24T01:43:22.334617+0000","last_clean":"2024-04-24T01:43:22.334617+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:43:22.334617+0000","last_undegraded":"2024-04-24T01:43:22.334617+0000","last_fullsized":"2024-04-24T01:43:22.334617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:56.807661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321950+0000","last_change":"2024-04-24T01:42:42.790910+0000","last_active":"2024-04-24T01:45:50.321950+0000","last_peered":"2024-04-24T01:45:50.321950+0000","last_clean":"2024-04-24T01:45:50.321950+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:45:50.321950+0000","last_undegraded":"2024-04-24T01:45:50.321950+0000","last_fullsized":"2024-04-24T01:45:50.321950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:52.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816518+0000","last_change":"2024-04-24T01:42:40.793467+0000","last_active":"2024-04-24T01:43:21.816518+0000","last_peered":"2024-04-24T01:43:21.816518+0000","last_clean":"2024-04-24T01:43:21.816518+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:43:21.816518+0000","last_undegraded":"2024-04-24T01:43:21.816518+0000","last_fullsized":"2024-04-24T01:43:21.816518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:04.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:06.019736+0000","last_change":"2024-04-24T01:42:42.781172+0000","last_active":"2024-04-24T01:44:06.019736+0000","last_peered":"2024-04-24T01:44:06.019736+0000","last_clean":"2024-04-24T01:44:06.019736+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:44:06.019736+0000","last_undegraded":"2024-04-24T01:44:06.019736+0000","last_fullsized":"2024-04-24T01:44:06.019736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:50.255990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.815448+0000","last_change":"2024-04-24T01:42:40.771155+0000","last_active":"2024-04-24T01:43:21.815448+0000","last_peered":"2024-04-24T01:43:21.815448+0000","last_clean":"2024-04-24T01:43:21.815448+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:43:21.815448+0000","last_undegraded":"2024-04-24T01:43:21.815448+0000","last_fullsized":"2024-04-24T01:43:21.815448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:57.416836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.816208+0000","last_change":"2024-04-24T01:42:42.782402+0000","last_active":"2024-04-24T01:43:21.816208+0000","last_peered":"2024-04-24T01:43:21.816208+0000","last_clean":"2024-04-24T01:43:21.816208+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:43:21.816208+0000","last_undegraded":"2024-04-24T01:43:21.816208+0000","last_fullsized":"2024-04-24T01:43:21.816208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:01.719700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.811712+0000","last_change":"2024-04-24T01:42:40.785750+0000","last_active":"2024-04-24T01:43:21.811712+0000","last_peered":"2024-04-24T01:43:21.811712+0000","last_clean":"2024-04-24T01:43:21.811712+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:43:21.811712+0000","last_undegraded":"2024-04-24T01:43:21.811712+0000","last_fullsized":"2024-04-24T01:43:21.811712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:29.551602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'11","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.050515+0000","last_change":"2024-04-24T01:42:42.783870+0000","last_active":"2024-04-24T01:45:50.050515+0000","last_peered":"2024-04-24T01:45:50.050515+0000","last_clean":"2024-04-24T01:45:50.050515+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:45:50.050515+0000","last_undegraded":"2024-04-24T01:45:50.050515+0000","last_fullsized":"2024-04-24T01:45:50.050515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:19.254318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089090+0000","last_change":"2024-04-24T01:42:40.787075+0000","last_active":"2024-04-24T01:44:56.089090+0000","last_peered":"2024-04-24T01:44:56.089090+0000","last_clean":"2024-04-24T01:44:56.089090+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:44:56.089090+0000","last_undegraded":"2024-04-24T01:44:56.089090+0000","last_fullsized":"2024-04-24T01:44:56.089090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:11.008229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.812646+0000","last_change":"2024-04-24T01:42:42.783035+0000","last_active":"2024-04-24T01:43:21.812646+0000","last_peered":"2024-04-24T01:43:21.812646+0000","last_clean":"2024-04-24T01:43:21.812646+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:43:21.812646+0000","last_undegraded":"2024-04-24T01:43:21.812646+0000","last_fullsized":"2024-04-24T01:43:21.812646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:34.220751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089213+0000","last_change":"2024-04-24T01:42:40.780277+0000","last_active":"2024-04-24T01:45:01.089213+0000","last_peered":"2024-04-24T01:45:01.089213+0000","last_clean":"2024-04-24T01:45:01.089213+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:45:01.089213+0000","last_undegraded":"2024-04-24T01:45:01.089213+0000","last_fullsized":"2024-04-24T01:45:01.089213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:52:21.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088282+0000","last_change":"2024-04-24T01:42:42.785135+0000","last_active":"2024-04-24T01:44:56.088282+0000","last_peered":"2024-04-24T01:44:56.088282+0000","last_clean":"2024-04-24T01:44:56.088282+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:44:56.088282+0000","last_undegraded":"2024-04-24T01:44:56.088282+0000","last_fullsized":"2024-04-24T01:44:56.088282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:08.248876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:43:21.813648+0000","last_change":"2024-04-24T01:42:40.785768+0000","last_active":"2024-04-24T01:43:21.813648+0000","last_peered":"2024-04-24T01:43:21.813648+0000","last_clean":"2024-04-24T01:43:21.813648+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:43:21.813648+0000","last_undegraded":"2024-04-24T01:43:21.813648+0000","last_fullsized":"2024-04-24T01:43:21.813648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:41.422186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089710+0000","last_change":"2024-04-24T01:42:40.778631+0000","last_active":"2024-04-24T01:45:01.089710+0000","last_peered":"2024-04-24T01:45:01.089710+0000","last_clean":"2024-04-24T01:45:01.089710+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:45:01.089710+0000","last_undegraded":"2024-04-24T01:45:01.089710+0000","last_fullsized":"2024-04-24T01:45:01.089710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:55.030083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.270563+0000","last_change":"2024-04-24T01:42:42.785218+0000","last_active":"2024-04-24T01:45:50.270563+0000","last_peered":"2024-04-24T01:45:50.270563+0000","last_clean":"2024-04-24T01:45:50.270563+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:45:50.270563+0000","last_undegraded":"2024-04-24T01:45:50.270563+0000","last_fullsized":"2024-04-24T01:45:50.270563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:11.578528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.964244+0000","last_change":"2024-04-24T01:42:40.781285+0000","last_active":"2024-04-24T01:45:49.964244+0000","last_peered":"2024-04-24T01:45:49.964244+0000","last_clean":"2024-04-24T01:45:49.964244+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:45:49.964244+0000","last_undegraded":"2024-04-24T01:45:49.964244+0000","last_fullsized":"2024-04-24T01:45:49.964244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.038340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.345306+0000","last_change":"2024-04-24T01:42:42.785126+0000","last_active":"2024-04-24T01:45:50.345306+0000","last_peered":"2024-04-24T01:45:50.345306+0000","last_clean":"2024-04-24T01:45:50.345306+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:45:50.345306+0000","last_undegraded":"2024-04-24T01:45:50.345306+0000","last_fullsized":"2024-04-24T01:45:50.345306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1732,"num_read_kb":1489,"num_write":737,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1493,"ondisk_log_size":1493,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":87,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":27910144,"data_stored":27910144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640302,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48100,"kb_used_data":12764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323740,"statfs":{"total":96636764160,"available":96587509760,"internally_reserved":0,"allocated":13070336,"data_stored":12733993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48928,"kb_used_data":13592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322912,"statfs":{"total":96636764160,"available":96586661888,"internally_reserved":0,"allocated":13918208,"data_stored":13644432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38716,"kb_used_data":3380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333124,"statfs":{"total":96636764160,"available":96597118976,"internally_reserved":0,"allocated":3461120,"data_stored":3161556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39928,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331912,"statfs":{"total":96636764160,"available":96595877888,"internally_reserved":0,"allocated":438272,"data_stored":148048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2420736,"data_stored":2420736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:46:01.412 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.413 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.414 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.415 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.416 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.417 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.418 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.419 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.420 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.421 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.422 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.423 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T01:42:26.693124+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.424 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.425 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.426 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.427 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.428 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.429 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.430 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.431 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.432 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.433 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.434 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.435 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.436 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.437 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.438 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.439 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.440 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.441 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.442 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.442 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.442 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.442 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:01.442 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:46:21.444 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:46:21.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.553+0000 7f428d928640 1 Processor -- start 2024-04-24T01:46:21.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.553+0000 7f428d928640 1 -- start start 2024-04-24T01:46:21.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f428d928640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f428806fd50 0x7f4288133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:21.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f428d928640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4288133da0 con 0x7f428806f260 2024-04-24T01:46:21.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f428d928640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4288070bc0 con 0x7f428806fd50 2024-04-24T01:46:21.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f42867fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f428806fd50 0x7f4288133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:21.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f4286ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f428806f260 0x7f428806f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:54190/0 (socket says 172.21.15.107:54190) 2024-04-24T01:46:21.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f4286ffd640 1 -- 172.21.15.107:0/1031200907 learned_addr learned my addr 172.21.15.107:0/1031200907 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:21.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f42867fc640 1 -- 172.21.15.107:0/1031200907 >> v1:172.21.15.107:6789/0 conn(0x7f428806f260 legacy=0x7f428806f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:21.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f42867fc640 1 -- 172.21.15.107:0/1031200907 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4288134f80 con 0x7f428806fd50 2024-04-24T01:46:21.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.554+0000 7f4285ffb640 1 -- 172.21.15.107:0/1031200907 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663382886 0 0) 0x7f4288133da0 con 0x7f428806f260 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f42867fc640 1 --2- 172.21.15.107:0/1031200907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806fd50 0x7f4288133860 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f427c009720 tx=0x7f427c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efe67a404943908 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f4285ffb640 1 -- 172.21.15.107:0/1031200907 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c0316d0 con 0x7f428806fd50 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f4285ffb640 1 -- 172.21.15.107:0/1031200907 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427c037070 con 0x7f428806fd50 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f4285ffb640 1 -- 172.21.15.107:0/1031200907 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c0319c0 con 0x7f428806fd50 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f428d928640 1 -- 172.21.15.107:0/1031200907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806fd50 msgr2=0x7f4288133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f428d928640 1 --2- 172.21.15.107:0/1031200907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806fd50 0x7f4288133860 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f427c009720 tx=0x7f427c02b840 comp rx=0 tx=0).stop 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f428d928640 1 -- 172.21.15.107:0/1031200907 shutdown_connections 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f428d928640 1 --2- 172.21.15.107:0/1031200907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806fd50 0x7f4288133860 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.555+0000 7f428d928640 1 -- 172.21.15.107:0/1031200907 >> 172.21.15.107:0/1031200907 conn(0x7f428809e170 msgr2=0x7f428806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.556+0000 7f428d928640 1 -- 172.21.15.107:0/1031200907 shutdown_connections 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.556+0000 7f428d928640 1 -- 172.21.15.107:0/1031200907 wait complete. 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.556+0000 7f428d928640 1 Processor -- start 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f428d928640 1 -- start start 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f428d928640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806f260 0x7f4288124320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f428d928640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4288134300 con 0x7f428806f260 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f4286ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806f260 0x7f4288124320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f4286ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806f260 0x7f4288124320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58650/0 (socket says 172.21.15.107:58650) 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f4286ffd640 1 -- 172.21.15.107:0/54744248 learned_addr learned my addr 172.21.15.107:0/54744248 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f4286ffd640 1 -- 172.21.15.107:0/54744248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4288130bf0 con 0x7f428806f260 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f4286ffd640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806f260 0x7f4288124320 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f427800c840 tx=0x7f427800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f426ffff640 1 -- 172.21.15.107:0/54744248 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4278018070 con 0x7f428806f260 2024-04-24T01:46:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f426ffff640 1 -- 172.21.15.107:0/54744248 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427800a660 con 0x7f428806f260 2024-04-24T01:46:21.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.557+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42881333a0 con 0x7f428806f260 2024-04-24T01:46:21.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.558+0000 7f426ffff640 1 -- 172.21.15.107:0/54744248 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427800a980 con 0x7f428806f260 2024-04-24T01:46:21.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.558+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42881315d0 con 0x7f428806f260 2024-04-24T01:46:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.559+0000 7f426ffff640 1 -- 172.21.15.107:0/54744248 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f427801b070 con 0x7f428806f260 2024-04-24T01:46:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.559+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42880a18a0 con 0x7f428806f260 2024-04-24T01:46:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.559+0000 7f426ffff640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4274038060 0x7f427403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.559+0000 7f426ffff640 1 -- 172.21.15.107:0/54744248 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f427804b120 con 0x7f428806f260 2024-04-24T01:46:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.559+0000 7f42867fc640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4274038060 0x7f427403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.560+0000 7f42867fc640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4274038060 0x7f427403a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f427c009720 tx=0x7f427c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:21.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.563+0000 7f426ffff640 1 -- 172.21.15.107:0/54744248 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f42880a18a0 con 0x7f428806f260 2024-04-24T01:46:21.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.732+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4288062da0 con 0x7f4274038060 2024-04-24T01:46:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.747+0000 7f426ffff640 1 -- 172.21.15.107:0/54744248 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658340 (secure 0 0 0) 0x7f4288062da0 con 0x7f4274038060 2024-04-24T01:46:21.754 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:46:21.760 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4274038060 msgr2=0x7f427403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4274038060 0x7f427403a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f427c009720 tx=0x7f427c008030 comp rx=0 tx=0).stop 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806f260 msgr2=0x7f4288124320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806f260 0x7f4288124320 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f427800c840 tx=0x7f427800cd00 comp rx=0 tx=0).stop 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 shutdown_connections 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f4274038060 0x7f427403a520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 --2- 172.21.15.107:0/54744248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428806f260 0x7f4288124320 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 >> 172.21.15.107:0/54744248 conn(0x7f428809e170 msgr2=0x7f428809e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 shutdown_connections 2024-04-24T01:46:21.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:21.752+0000 7f428d928640 1 -- 172.21.15.107:0/54744248 wait complete. 2024-04-24T01:46:21.764 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-04-24T01:46:20.073790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5393,"num_read_kb":4942,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4946,"ondisk_log_size":4946,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156728,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330632,"statfs":{"total":386547056640,"available":386386567168,"internally_reserved":0,"allocated":2973696,"data_stored":1776174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004030"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.086885+0000","last_change":"2024-04-24T01:42:40.781437+0000","last_active":"2024-04-24T01:44:46.086885+0000","last_peered":"2024-04-24T01:44:46.086885+0000","last_clean":"2024-04-24T01:44:46.086885+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:44:46.086885+0000","last_undegraded":"2024-04-24T01:44:46.086885+0000","last_fullsized":"2024-04-24T01:44:46.086885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144766+0000","last_change":"2024-04-24T01:42:42.785371+0000","last_active":"2024-04-24T01:45:50.144766+0000","last_peered":"2024-04-24T01:45:50.144766+0000","last_clean":"2024-04-24T01:45:50.144766+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:45:50.144766+0000","last_undegraded":"2024-04-24T01:45:50.144766+0000","last_fullsized":"2024-04-24T01:45:50.144766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.959718+0000","last_change":"2024-04-24T01:42:40.769679+0000","last_active":"2024-04-24T01:45:56.959718+0000","last_peered":"2024-04-24T01:45:56.959718+0000","last_clean":"2024-04-24T01:45:56.959718+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:45:56.959718+0000","last_undegraded":"2024-04-24T01:45:56.959718+0000","last_fullsized":"2024-04-24T01:45:56.959718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.050907+0000","last_change":"2024-04-24T01:42:42.780099+0000","last_active":"2024-04-24T01:45:50.050907+0000","last_peered":"2024-04-24T01:45:50.050907+0000","last_clean":"2024-04-24T01:45:50.050907+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:45:50.050907+0000","last_undegraded":"2024-04-24T01:45:50.050907+0000","last_fullsized":"2024-04-24T01:45:50.050907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.087469+0000","last_change":"2024-04-24T01:42:40.787360+0000","last_active":"2024-04-24T01:44:46.087469+0000","last_peered":"2024-04-24T01:44:46.087469+0000","last_clean":"2024-04-24T01:44:46.087469+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:44:46.087469+0000","last_undegraded":"2024-04-24T01:44:46.087469+0000","last_fullsized":"2024-04-24T01:44:46.087469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321947+0000","last_change":"2024-04-24T01:42:42.777928+0000","last_active":"2024-04-24T01:45:50.321947+0000","last_peered":"2024-04-24T01:45:50.321947+0000","last_clean":"2024-04-24T01:45:50.321947+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:45:50.321947+0000","last_undegraded":"2024-04-24T01:45:50.321947+0000","last_fullsized":"2024-04-24T01:45:50.321947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:41.086110+0000","last_change":"2024-04-24T01:42:40.777293+0000","last_active":"2024-04-24T01:44:41.086110+0000","last_peered":"2024-04-24T01:44:41.086110+0000","last_clean":"2024-04-24T01:44:41.086110+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:44:41.086110+0000","last_undegraded":"2024-04-24T01:44:41.086110+0000","last_fullsized":"2024-04-24T01:44:41.086110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.092334+0000","last_change":"2024-04-24T01:42:42.782433+0000","last_active":"2024-04-24T01:45:16.092334+0000","last_peered":"2024-04-24T01:45:16.092334+0000","last_clean":"2024-04-24T01:45:16.092334+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:45:16.092334+0000","last_undegraded":"2024-04-24T01:45:16.092334+0000","last_fullsized":"2024-04-24T01:45:16.092334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.254982+0000","last_change":"2024-04-24T01:42:40.787185+0000","last_active":"2024-04-24T01:45:50.254982+0000","last_peered":"2024-04-24T01:45:50.254982+0000","last_clean":"2024-04-24T01:45:50.254982+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:45:50.254982+0000","last_undegraded":"2024-04-24T01:45:50.254982+0000","last_fullsized":"2024-04-24T01:45:50.254982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399460+0000","last_change":"2024-04-24T01:42:42.783384+0000","last_active":"2024-04-24T01:45:50.399460+0000","last_peered":"2024-04-24T01:45:50.399460+0000","last_clean":"2024-04-24T01:45:50.399460+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:45:50.399460+0000","last_undegraded":"2024-04-24T01:45:50.399460+0000","last_fullsized":"2024-04-24T01:45:50.399460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090710+0000","last_change":"2024-04-24T01:42:40.775908+0000","last_active":"2024-04-24T01:45:11.090710+0000","last_peered":"2024-04-24T01:45:11.090710+0000","last_clean":"2024-04-24T01:45:11.090710+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:45:11.090710+0000","last_undegraded":"2024-04-24T01:45:11.090710+0000","last_fullsized":"2024-04-24T01:45:11.090710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:31.093636+0000","last_change":"2024-04-24T01:43:21.820449+0000","last_active":"2024-04-24T01:45:31.093636+0000","last_peered":"2024-04-24T01:45:31.093636+0000","last_clean":"2024-04-24T01:45:31.093636+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:45:31.093636+0000","last_undegraded":"2024-04-24T01:45:31.093636+0000","last_fullsized":"2024-04-24T01:45:31.093636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091348+0000","last_change":"2024-04-24T01:42:40.785983+0000","last_active":"2024-04-24T01:45:11.091348+0000","last_peered":"2024-04-24T01:45:11.091348+0000","last_clean":"2024-04-24T01:45:11.091348+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:45:11.091348+0000","last_undegraded":"2024-04-24T01:45:11.091348+0000","last_fullsized":"2024-04-24T01:45:11.091348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.279281+0000","last_change":"2024-04-24T01:42:42.788032+0000","last_active":"2024-04-24T01:45:50.279281+0000","last_peered":"2024-04-24T01:45:50.279281+0000","last_clean":"2024-04-24T01:45:50.279281+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:45:50.279281+0000","last_undegraded":"2024-04-24T01:45:50.279281+0000","last_fullsized":"2024-04-24T01:45:50.279281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:14.086542+0000","last_change":"2024-04-24T01:42:40.778279+0000","last_active":"2024-04-24T01:45:14.086542+0000","last_peered":"2024-04-24T01:45:14.086542+0000","last_clean":"2024-04-24T01:45:14.086542+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:45:14.086542+0000","last_undegraded":"2024-04-24T01:45:14.086542+0000","last_fullsized":"2024-04-24T01:45:14.086542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144314+0000","last_change":"2024-04-24T01:42:42.789315+0000","last_active":"2024-04-24T01:45:50.144314+0000","last_peered":"2024-04-24T01:45:50.144314+0000","last_clean":"2024-04-24T01:45:50.144314+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:45:50.144314+0000","last_undegraded":"2024-04-24T01:45:50.144314+0000","last_fullsized":"2024-04-24T01:45:50.144314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.279425+0000","last_change":"2024-04-24T01:42:42.779841+0000","last_active":"2024-04-24T01:45:50.279425+0000","last_peered":"2024-04-24T01:45:50.279425+0000","last_clean":"2024-04-24T01:45:50.279425+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:45:50.279425+0000","last_undegraded":"2024-04-24T01:45:50.279425+0000","last_fullsized":"2024-04-24T01:45:50.279425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090220+0000","last_change":"2024-04-24T01:42:40.791488+0000","last_active":"2024-04-24T01:45:06.090220+0000","last_peered":"2024-04-24T01:45:06.090220+0000","last_clean":"2024-04-24T01:45:06.090220+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:45:06.090220+0000","last_undegraded":"2024-04-24T01:45:06.090220+0000","last_fullsized":"2024-04-24T01:45:06.090220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.324507+0000","last_change":"2024-04-24T01:42:42.782524+0000","last_active":"2024-04-24T01:45:50.324507+0000","last_peered":"2024-04-24T01:45:50.324507+0000","last_clean":"2024-04-24T01:45:50.324507+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:45:50.324507+0000","last_undegraded":"2024-04-24T01:45:50.324507+0000","last_fullsized":"2024-04-24T01:45:50.324507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090023+0000","last_change":"2024-04-24T01:42:40.784169+0000","last_active":"2024-04-24T01:45:06.090023+0000","last_peered":"2024-04-24T01:45:06.090023+0000","last_clean":"2024-04-24T01:45:06.090023+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:45:06.090023+0000","last_undegraded":"2024-04-24T01:45:06.090023+0000","last_fullsized":"2024-04-24T01:45:06.090023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399440+0000","last_change":"2024-04-24T01:42:42.783807+0000","last_active":"2024-04-24T01:45:50.399440+0000","last_peered":"2024-04-24T01:45:50.399440+0000","last_clean":"2024-04-24T01:45:50.399440+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:45:50.399440+0000","last_undegraded":"2024-04-24T01:45:50.399440+0000","last_fullsized":"2024-04-24T01:45:50.399440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.960530+0000","last_change":"2024-04-24T01:42:40.792423+0000","last_active":"2024-04-24T01:45:56.960530+0000","last_peered":"2024-04-24T01:45:56.960530+0000","last_clean":"2024-04-24T01:45:56.960530+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:45:56.960530+0000","last_undegraded":"2024-04-24T01:45:56.960530+0000","last_fullsized":"2024-04-24T01:45:56.960530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:09.085695+0000","last_change":"2024-04-24T01:42:42.790737+0000","last_active":"2024-04-24T01:45:09.085695+0000","last_peered":"2024-04-24T01:45:09.085695+0000","last_clean":"2024-04-24T01:45:09.085695+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:45:09.085695+0000","last_undegraded":"2024-04-24T01:45:09.085695+0000","last_fullsized":"2024-04-24T01:45:09.085695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090116+0000","last_change":"2024-04-24T01:42:40.782750+0000","last_active":"2024-04-24T01:45:06.090116+0000","last_peered":"2024-04-24T01:45:06.090116+0000","last_clean":"2024-04-24T01:45:06.090116+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:45:06.090116+0000","last_undegraded":"2024-04-24T01:45:06.090116+0000","last_fullsized":"2024-04-24T01:45:06.090116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.277100+0000","last_change":"2024-04-24T01:42:42.790992+0000","last_active":"2024-04-24T01:45:50.277100+0000","last_peered":"2024-04-24T01:45:50.277100+0000","last_clean":"2024-04-24T01:45:50.277100+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:45:50.277100+0000","last_undegraded":"2024-04-24T01:45:50.277100+0000","last_fullsized":"2024-04-24T01:45:50.277100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:09.085684+0000","last_change":"2024-04-24T01:42:40.769585+0000","last_active":"2024-04-24T01:45:09.085684+0000","last_peered":"2024-04-24T01:45:09.085684+0000","last_clean":"2024-04-24T01:45:09.085684+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:45:09.085684+0000","last_undegraded":"2024-04-24T01:45:09.085684+0000","last_fullsized":"2024-04-24T01:45:09.085684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144883+0000","last_change":"2024-04-24T01:42:42.784217+0000","last_active":"2024-04-24T01:45:50.144883+0000","last_peered":"2024-04-24T01:45:50.144883+0000","last_clean":"2024-04-24T01:45:50.144883+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:45:50.144883+0000","last_undegraded":"2024-04-24T01:45:50.144883+0000","last_fullsized":"2024-04-24T01:45:50.144883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.342835+0000","last_change":"2024-04-24T01:42:40.786476+0000","last_active":"2024-04-24T01:45:50.342835+0000","last_peered":"2024-04-24T01:45:50.342835+0000","last_clean":"2024-04-24T01:45:50.342835+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:45:50.342835+0000","last_undegraded":"2024-04-24T01:45:50.342835+0000","last_fullsized":"2024-04-24T01:45:50.342835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.362100+0000","last_change":"2024-04-24T01:42:50.802941+0000","last_active":"2024-04-24T01:45:50.362100+0000","last_peered":"2024-04-24T01:45:50.362100+0000","last_clean":"2024-04-24T01:45:50.362100+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:45:50.362100+0000","last_undegraded":"2024-04-24T01:45:50.362100+0000","last_fullsized":"2024-04-24T01:45:50.362100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.352036+0000","last_change":"2024-04-24T01:42:42.786160+0000","last_active":"2024-04-24T01:45:50.352036+0000","last_peered":"2024-04-24T01:45:50.352036+0000","last_clean":"2024-04-24T01:45:50.352036+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:45:50.352036+0000","last_undegraded":"2024-04-24T01:45:50.352036+0000","last_fullsized":"2024-04-24T01:45:50.352036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089818+0000","last_change":"2024-04-24T01:42:40.791802+0000","last_active":"2024-04-24T01:45:01.089818+0000","last_peered":"2024-04-24T01:45:01.089818+0000","last_clean":"2024-04-24T01:45:01.089818+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:45:01.089818+0000","last_undegraded":"2024-04-24T01:45:01.089818+0000","last_fullsized":"2024-04-24T01:45:01.089818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.152740+0000","last_change":"2024-04-24T01:46:01.152762+0000","last_active":"2024-04-24T01:46:01.152740+0000","last_peered":"2024-04-24T01:46:01.152740+0000","last_clean":"2024-04-24T01:46:01.152740+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:46:01.152740+0000","last_undegraded":"2024-04-24T01:46:01.152740+0000","last_fullsized":"2024-04-24T01:46:01.152740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.152654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:54.458451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:57.019502+0000","last_change":"2024-04-24T01:42:46.785609+0000","last_active":"2024-04-24T01:45:57.019502+0000","last_peered":"2024-04-24T01:45:57.019502+0000","last_clean":"2024-04-24T01:45:57.019502+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:45:57.019502+0000","last_undegraded":"2024-04-24T01:45:57.019502+0000","last_fullsized":"2024-04-24T01:45:57.019502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091903+0000","last_change":"2024-04-24T01:42:48.793869+0000","last_active":"2024-04-24T01:45:16.091903+0000","last_peered":"2024-04-24T01:45:16.091903+0000","last_clean":"2024-04-24T01:45:16.091903+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:45:16.091903+0000","last_undegraded":"2024-04-24T01:45:16.091903+0000","last_fullsized":"2024-04-24T01:45:16.091903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091724+0000","last_change":"2024-04-24T01:42:50.802222+0000","last_active":"2024-04-24T01:45:16.091724+0000","last_peered":"2024-04-24T01:45:16.091724+0000","last_clean":"2024-04-24T01:45:16.091724+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:45:16.091724+0000","last_undegraded":"2024-04-24T01:45:16.091724+0000","last_fullsized":"2024-04-24T01:45:16.091724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091484+0000","last_change":"2024-04-24T01:42:42.784837+0000","last_active":"2024-04-24T01:45:11.091484+0000","last_peered":"2024-04-24T01:45:11.091484+0000","last_clean":"2024-04-24T01:45:11.091484+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:45:11.091484+0000","last_undegraded":"2024-04-24T01:45:11.091484+0000","last_fullsized":"2024-04-24T01:45:11.091484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089071+0000","last_change":"2024-04-24T01:42:40.782079+0000","last_active":"2024-04-24T01:45:01.089071+0000","last_peered":"2024-04-24T01:45:01.089071+0000","last_clean":"2024-04-24T01:45:01.089071+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:45:01.089071+0000","last_undegraded":"2024-04-24T01:45:01.089071+0000","last_fullsized":"2024-04-24T01:45:01.089071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:04.085029+0000","last_change":"2024-04-24T01:42:44.776066+0000","last_active":"2024-04-24T01:45:04.085029+0000","last_peered":"2024-04-24T01:45:04.085029+0000","last_clean":"2024-04-24T01:45:04.085029+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:45:04.085029+0000","last_undegraded":"2024-04-24T01:45:04.085029+0000","last_fullsized":"2024-04-24T01:45:04.085029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.489009+0000","last_change":"2024-04-24T01:46:03.489046+0000","last_active":"2024-04-24T01:46:03.489009+0000","last_peered":"2024-04-24T01:46:03.489009+0000","last_clean":"2024-04-24T01:46:03.489009+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:46:03.489009+0000","last_undegraded":"2024-04-24T01:46:03.489009+0000","last_fullsized":"2024-04-24T01:46:03.489009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.488913+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:54.619923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.532812+0000","last_change":"2024-04-24T01:46:04.532851+0000","last_active":"2024-04-24T01:46:04.532812+0000","last_peered":"2024-04-24T01:46:04.532812+0000","last_clean":"2024-04-24T01:46:04.532812+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:46:04.532812+0000","last_undegraded":"2024-04-24T01:46:04.532812+0000","last_fullsized":"2024-04-24T01:46:04.532812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.532716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:21.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.048282+0000","last_change":"2024-04-24T01:42:50.793834+0000","last_active":"2024-04-24T01:45:50.048282+0000","last_peered":"2024-04-24T01:45:50.048282+0000","last_clean":"2024-04-24T01:45:50.048282+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:45:50.048282+0000","last_undegraded":"2024-04-24T01:45:50.048282+0000","last_fullsized":"2024-04-24T01:45:50.048282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'21","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.397912+0000","last_change":"2024-04-24T01:42:42.777752+0000","last_active":"2024-04-24T01:45:50.397912+0000","last_peered":"2024-04-24T01:45:50.397912+0000","last_clean":"2024-04-24T01:45:50.397912+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:45:50.397912+0000","last_undegraded":"2024-04-24T01:45:50.397912+0000","last_fullsized":"2024-04-24T01:45:50.397912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089744+0000","last_change":"2024-04-24T01:42:40.790240+0000","last_active":"2024-04-24T01:45:01.089744+0000","last_peered":"2024-04-24T01:45:01.089744+0000","last_clean":"2024-04-24T01:45:01.089744+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:45:01.089744+0000","last_undegraded":"2024-04-24T01:45:01.089744+0000","last_fullsized":"2024-04-24T01:45:01.089744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.183355+0000","last_change":"2024-04-24T01:46:15.183378+0000","last_active":"2024-04-24T01:46:15.183355+0000","last_peered":"2024-04-24T01:46:15.183355+0000","last_clean":"2024-04-24T01:46:15.183355+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:46:15.183355+0000","last_undegraded":"2024-04-24T01:46:15.183355+0000","last_fullsized":"2024-04-24T01:46:15.183355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.183254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:00.909604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.849954+0000","last_change":"2024-04-24T01:46:08.849993+0000","last_active":"2024-04-24T01:46:08.849954+0000","last_peered":"2024-04-24T01:46:08.849954+0000","last_clean":"2024-04-24T01:46:08.849954+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:46:08.849954+0000","last_undegraded":"2024-04-24T01:46:08.849954+0000","last_fullsized":"2024-04-24T01:46:08.849954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.849869+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:59.980879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":389,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:57.030903+0000","last_change":"2024-04-24T01:42:48.789383+0000","last_active":"2024-04-24T01:45:57.030903+0000","last_peered":"2024-04-24T01:45:57.030903+0000","last_clean":"2024-04-24T01:45:57.030903+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:45:57.030903+0000","last_undegraded":"2024-04-24T01:45:57.030903+0000","last_fullsized":"2024-04-24T01:45:57.030903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:21.092323+0000","last_change":"2024-04-24T01:42:50.800444+0000","last_active":"2024-04-24T01:45:21.092323+0000","last_peered":"2024-04-24T01:45:21.092323+0000","last_clean":"2024-04-24T01:45:21.092323+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:45:21.092323+0000","last_undegraded":"2024-04-24T01:45:21.092323+0000","last_fullsized":"2024-04-24T01:45:21.092323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:09.085788+0000","last_change":"2024-04-24T01:42:42.785246+0000","last_active":"2024-04-24T01:45:09.085788+0000","last_peered":"2024-04-24T01:45:09.085788+0000","last_clean":"2024-04-24T01:45:09.085788+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:45:09.085788+0000","last_undegraded":"2024-04-24T01:45:09.085788+0000","last_fullsized":"2024-04-24T01:45:09.085788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089112+0000","last_change":"2024-04-24T01:42:40.791168+0000","last_active":"2024-04-24T01:45:01.089112+0000","last_peered":"2024-04-24T01:45:01.089112+0000","last_clean":"2024-04-24T01:45:01.089112+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:45:01.089112+0000","last_undegraded":"2024-04-24T01:45:01.089112+0000","last_fullsized":"2024-04-24T01:45:01.089112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.208983+0000","last_change":"2024-04-24T01:46:03.209024+0000","last_active":"2024-04-24T01:46:03.208983+0000","last_peered":"2024-04-24T01:46:03.208983+0000","last_clean":"2024-04-24T01:46:03.208983+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:46:03.208983+0000","last_undegraded":"2024-04-24T01:46:03.208983+0000","last_fullsized":"2024-04-24T01:46:03.208983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.208890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:44.835582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.856137+0000","last_change":"2024-04-24T01:46:05.856196+0000","last_active":"2024-04-24T01:46:05.856137+0000","last_peered":"2024-04-24T01:46:05.856137+0000","last_clean":"2024-04-24T01:46:05.856137+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:46:05.856137+0000","last_undegraded":"2024-04-24T01:46:05.856137+0000","last_fullsized":"2024-04-24T01:46:05.856137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.856052+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:35.561294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.187919+0000","last_change":"2024-04-24T01:46:06.187946+0000","last_active":"2024-04-24T01:46:06.187919+0000","last_peered":"2024-04-24T01:46:06.187919+0000","last_clean":"2024-04-24T01:46:06.187919+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:46:06.187919+0000","last_undegraded":"2024-04-24T01:46:06.187919+0000","last_fullsized":"2024-04-24T01:46:06.187919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.187813+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:35.370509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144674+0000","last_change":"2024-04-24T01:42:42.787100+0000","last_active":"2024-04-24T01:45:50.144674+0000","last_peered":"2024-04-24T01:45:50.144674+0000","last_clean":"2024-04-24T01:45:50.144674+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:45:50.144674+0000","last_undegraded":"2024-04-24T01:45:50.144674+0000","last_fullsized":"2024-04-24T01:45:50.144674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088477+0000","last_change":"2024-04-24T01:42:40.780599+0000","last_active":"2024-04-24T01:44:56.088477+0000","last_peered":"2024-04-24T01:44:56.088477+0000","last_clean":"2024-04-24T01:44:56.088477+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:44:56.088477+0000","last_undegraded":"2024-04-24T01:44:56.088477+0000","last_fullsized":"2024-04-24T01:44:56.088477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.610612+0000","last_change":"2024-04-24T01:46:10.610641+0000","last_active":"2024-04-24T01:46:10.610612+0000","last_peered":"2024-04-24T01:46:10.610612+0000","last_clean":"2024-04-24T01:46:10.610612+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:46:10.610612+0000","last_undegraded":"2024-04-24T01:46:10.610612+0000","last_fullsized":"2024-04-24T01:46:10.610612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.610513+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:05.321177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.823361+0000","last_change":"2024-04-24T01:46:11.823412+0000","last_active":"2024-04-24T01:46:11.823361+0000","last_peered":"2024-04-24T01:46:11.823361+0000","last_clean":"2024-04-24T01:46:11.823361+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:46:11.823361+0000","last_undegraded":"2024-04-24T01:46:11.823361+0000","last_fullsized":"2024-04-24T01:46:11.823361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.823285+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:43.489332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.206754+0000","last_change":"2024-04-24T01:46:03.206777+0000","last_active":"2024-04-24T01:46:03.206754+0000","last_peered":"2024-04-24T01:46:03.206754+0000","last_clean":"2024-04-24T01:46:03.206754+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:46:03.206754+0000","last_undegraded":"2024-04-24T01:46:03.206754+0000","last_fullsized":"2024-04-24T01:46:03.206754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.206669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:46.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088382+0000","last_change":"2024-04-24T01:42:50.799924+0000","last_active":"2024-04-24T01:44:56.088382+0000","last_peered":"2024-04-24T01:44:56.088382+0000","last_clean":"2024-04-24T01:44:56.088382+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:44:56.088382+0000","last_undegraded":"2024-04-24T01:44:56.088382+0000","last_fullsized":"2024-04-24T01:44:56.088382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088345+0000","last_change":"2024-04-24T01:42:42.781439+0000","last_active":"2024-04-24T01:44:56.088345+0000","last_peered":"2024-04-24T01:44:56.088345+0000","last_clean":"2024-04-24T01:44:56.088345+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:44:56.088345+0000","last_undegraded":"2024-04-24T01:44:56.088345+0000","last_fullsized":"2024-04-24T01:44:56.088345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088431+0000","last_change":"2024-04-24T01:42:40.777460+0000","last_active":"2024-04-24T01:44:56.088431+0000","last_peered":"2024-04-24T01:44:56.088431+0000","last_clean":"2024-04-24T01:44:56.088431+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:44:56.088431+0000","last_undegraded":"2024-04-24T01:44:56.088431+0000","last_fullsized":"2024-04-24T01:44:56.088431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083189+0000","last_change":"2024-04-24T01:42:44.775818+0000","last_active":"2024-04-24T01:44:54.083189+0000","last_peered":"2024-04-24T01:44:54.083189+0000","last_clean":"2024-04-24T01:44:54.083189+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:44:54.083189+0000","last_undegraded":"2024-04-24T01:44:54.083189+0000","last_fullsized":"2024-04-24T01:44:54.083189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'46","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.289839+0000","last_change":"2024-04-24T01:46:07.289877+0000","last_active":"2024-04-24T01:46:07.289839+0000","last_peered":"2024-04-24T01:46:07.289839+0000","last_clean":"2024-04-24T01:46:07.289839+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:46:07.289839+0000","last_undegraded":"2024-04-24T01:46:07.289839+0000","last_fullsized":"2024-04-24T01:46:07.289839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.289738+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:04.439196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.283569+0000","last_change":"2024-04-24T01:46:00.283592+0000","last_active":"2024-04-24T01:46:00.283569+0000","last_peered":"2024-04-24T01:46:00.283569+0000","last_clean":"2024-04-24T01:46:00.283569+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:46:00.283569+0000","last_undegraded":"2024-04-24T01:46:00.283569+0000","last_fullsized":"2024-04-24T01:46:00.283569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.283490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:35.270360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088488+0000","last_change":"2024-04-24T01:42:50.797194+0000","last_active":"2024-04-24T01:44:56.088488+0000","last_peered":"2024-04-24T01:44:56.088488+0000","last_clean":"2024-04-24T01:44:56.088488+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:44:56.088488+0000","last_undegraded":"2024-04-24T01:44:56.088488+0000","last_fullsized":"2024-04-24T01:44:56.088488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.282015+0000","last_change":"2024-04-24T01:42:42.790042+0000","last_active":"2024-04-24T01:45:50.282015+0000","last_peered":"2024-04-24T01:45:50.282015+0000","last_clean":"2024-04-24T01:45:50.282015+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:45:50.282015+0000","last_undegraded":"2024-04-24T01:45:50.282015+0000","last_fullsized":"2024-04-24T01:45:50.282015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089105+0000","last_change":"2024-04-24T01:42:40.790278+0000","last_active":"2024-04-24T01:44:56.089105+0000","last_peered":"2024-04-24T01:44:56.089105+0000","last_clean":"2024-04-24T01:44:56.089105+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:44:56.089105+0000","last_undegraded":"2024-04-24T01:44:56.089105+0000","last_fullsized":"2024-04-24T01:44:56.089105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084118+0000","last_change":"2024-04-24T01:42:44.776056+0000","last_active":"2024-04-24T01:44:59.084118+0000","last_peered":"2024-04-24T01:44:59.084118+0000","last_clean":"2024-04-24T01:44:59.084118+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:44:59.084118+0000","last_undegraded":"2024-04-24T01:44:59.084118+0000","last_fullsized":"2024-04-24T01:44:59.084118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'61","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.271123+0000","last_change":"2024-04-24T01:46:05.271175+0000","last_active":"2024-04-24T01:46:05.271123+0000","last_peered":"2024-04-24T01:46:05.271123+0000","last_clean":"2024-04-24T01:46:05.271123+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:46:05.271123+0000","last_undegraded":"2024-04-24T01:46:05.271123+0000","last_fullsized":"2024-04-24T01:46:05.271123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'61","last_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_deep_scrub":"34'61","last_deep_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.271031+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:16.279610+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.199454+0000","last_change":"2024-04-24T01:46:09.199480+0000","last_active":"2024-04-24T01:46:09.199454+0000","last_peered":"2024-04-24T01:46:09.199454+0000","last_clean":"2024-04-24T01:46:09.199454+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:46:09.199454+0000","last_undegraded":"2024-04-24T01:46:09.199454+0000","last_fullsized":"2024-04-24T01:46:09.199454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.199345+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:53.841686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:04.085064+0000","last_change":"2024-04-24T01:42:50.794892+0000","last_active":"2024-04-24T01:45:04.085064+0000","last_peered":"2024-04-24T01:45:04.085064+0000","last_clean":"2024-04-24T01:45:04.085064+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:45:04.085064+0000","last_undegraded":"2024-04-24T01:45:04.085064+0000","last_fullsized":"2024-04-24T01:45:04.085064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089116+0000","last_change":"2024-04-24T01:42:42.778719+0000","last_active":"2024-04-24T01:45:01.089116+0000","last_peered":"2024-04-24T01:45:01.089116+0000","last_clean":"2024-04-24T01:45:01.089116+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:45:01.089116+0000","last_undegraded":"2024-04-24T01:45:01.089116+0000","last_fullsized":"2024-04-24T01:45:01.089116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089004+0000","last_change":"2024-04-24T01:42:40.776747+0000","last_active":"2024-04-24T01:44:56.089004+0000","last_peered":"2024-04-24T01:44:56.089004+0000","last_clean":"2024-04-24T01:44:56.089004+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:44:56.089004+0000","last_undegraded":"2024-04-24T01:44:56.089004+0000","last_fullsized":"2024-04-24T01:44:56.089004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083228+0000","last_change":"2024-04-24T01:42:44.775830+0000","last_active":"2024-04-24T01:44:54.083228+0000","last_peered":"2024-04-24T01:44:54.083228+0000","last_clean":"2024-04-24T01:44:54.083228+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:44:54.083228+0000","last_undegraded":"2024-04-24T01:44:54.083228+0000","last_fullsized":"2024-04-24T01:44:54.083228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'77","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.298350+0000","last_change":"2024-04-24T01:46:15.298393+0000","last_active":"2024-04-24T01:46:15.298350+0000","last_peered":"2024-04-24T01:46:15.298350+0000","last_clean":"2024-04-24T01:46:15.298350+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:46:15.298350+0000","last_undegraded":"2024-04-24T01:46:15.298350+0000","last_fullsized":"2024-04-24T01:46:15.298350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.298262+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:33.449711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084012+0000","last_change":"2024-04-24T01:42:48.794747+0000","last_active":"2024-04-24T01:44:59.084012+0000","last_peered":"2024-04-24T01:44:59.084012+0000","last_clean":"2024-04-24T01:44:59.084012+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:44:59.084012+0000","last_undegraded":"2024-04-24T01:44:59.084012+0000","last_fullsized":"2024-04-24T01:44:59.084012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.446144+0000","last_change":"2024-04-24T01:42:50.802460+0000","last_active":"2024-04-24T01:45:50.446144+0000","last_peered":"2024-04-24T01:45:50.446144+0000","last_clean":"2024-04-24T01:45:50.446144+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:45:50.446144+0000","last_undegraded":"2024-04-24T01:45:50.446144+0000","last_fullsized":"2024-04-24T01:45:50.446144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.322017+0000","last_change":"2024-04-24T01:42:42.783715+0000","last_active":"2024-04-24T01:45:50.322017+0000","last_peered":"2024-04-24T01:45:50.322017+0000","last_clean":"2024-04-24T01:45:50.322017+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:45:50.322017+0000","last_undegraded":"2024-04-24T01:45:50.322017+0000","last_fullsized":"2024-04-24T01:45:50.322017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084100+0000","last_change":"2024-04-24T01:42:40.780994+0000","last_active":"2024-04-24T01:44:59.084100+0000","last_peered":"2024-04-24T01:44:59.084100+0000","last_clean":"2024-04-24T01:44:59.084100+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:44:59.084100+0000","last_undegraded":"2024-04-24T01:44:59.084100+0000","last_fullsized":"2024-04-24T01:44:59.084100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089172+0000","last_change":"2024-04-24T01:42:44.778275+0000","last_active":"2024-04-24T01:45:01.089172+0000","last_peered":"2024-04-24T01:45:01.089172+0000","last_clean":"2024-04-24T01:45:01.089172+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:45:01.089172+0000","last_undegraded":"2024-04-24T01:45:01.089172+0000","last_fullsized":"2024-04-24T01:45:01.089172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.517297+0000","last_change":"2024-04-24T01:46:05.517337+0000","last_active":"2024-04-24T01:46:05.517297+0000","last_peered":"2024-04-24T01:46:05.517297+0000","last_clean":"2024-04-24T01:46:05.517297+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:46:05.517297+0000","last_undegraded":"2024-04-24T01:46:05.517297+0000","last_fullsized":"2024-04-24T01:46:05.517297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.517182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.149356+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090737+0000","last_change":"2024-04-24T01:42:48.790228+0000","last_active":"2024-04-24T01:45:06.090737+0000","last_peered":"2024-04-24T01:45:06.090737+0000","last_clean":"2024-04-24T01:45:06.090737+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:45:06.090737+0000","last_undegraded":"2024-04-24T01:45:06.090737+0000","last_fullsized":"2024-04-24T01:45:06.090737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.402369+0000","last_change":"2024-04-24T01:42:50.799183+0000","last_active":"2024-04-24T01:45:50.402369+0000","last_peered":"2024-04-24T01:45:50.402369+0000","last_clean":"2024-04-24T01:45:50.402369+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:45:50.402369+0000","last_undegraded":"2024-04-24T01:45:50.402369+0000","last_fullsized":"2024-04-24T01:45:50.402369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399700+0000","last_change":"2024-04-24T01:42:42.783267+0000","last_active":"2024-04-24T01:45:50.399700+0000","last_peered":"2024-04-24T01:45:50.399700+0000","last_clean":"2024-04-24T01:45:50.399700+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:45:50.399700+0000","last_undegraded":"2024-04-24T01:45:50.399700+0000","last_fullsized":"2024-04-24T01:45:50.399700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088168+0000","last_change":"2024-04-24T01:42:40.790965+0000","last_active":"2024-04-24T01:44:51.088168+0000","last_peered":"2024-04-24T01:44:51.088168+0000","last_clean":"2024-04-24T01:44:51.088168+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:44:51.088168+0000","last_undegraded":"2024-04-24T01:44:51.088168+0000","last_fullsized":"2024-04-24T01:44:51.088168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.269181+0000","last_change":"2024-04-24T01:46:18.269204+0000","last_active":"2024-04-24T01:46:18.269181+0000","last_peered":"2024-04-24T01:46:18.269181+0000","last_clean":"2024-04-24T01:46:18.269181+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:46:18.269181+0000","last_undegraded":"2024-04-24T01:46:18.269181+0000","last_fullsized":"2024-04-24T01:46:18.269181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.269076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:04.262085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.851173+0000","last_change":"2024-04-24T01:46:13.851216+0000","last_active":"2024-04-24T01:46:13.851173+0000","last_peered":"2024-04-24T01:46:13.851173+0000","last_clean":"2024-04-24T01:46:13.851173+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:46:13.851173+0000","last_undegraded":"2024-04-24T01:46:13.851173+0000","last_fullsized":"2024-04-24T01:46:13.851173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.851090+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:47.344034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.859142+0000","last_change":"2024-04-24T01:46:10.859209+0000","last_active":"2024-04-24T01:46:10.859142+0000","last_peered":"2024-04-24T01:46:10.859142+0000","last_clean":"2024-04-24T01:46:10.859142+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:46:10.859142+0000","last_undegraded":"2024-04-24T01:46:10.859142+0000","last_fullsized":"2024-04-24T01:46:10.859142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.859037+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:04.491211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.404061+0000","last_change":"2024-04-24T01:42:50.793825+0000","last_active":"2024-04-24T01:45:50.404061+0000","last_peered":"2024-04-24T01:45:50.404061+0000","last_clean":"2024-04-24T01:45:50.404061+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:45:50.404061+0000","last_undegraded":"2024-04-24T01:45:50.404061+0000","last_fullsized":"2024-04-24T01:45:50.404061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.281965+0000","last_change":"2024-04-24T01:42:42.790926+0000","last_active":"2024-04-24T01:45:50.281965+0000","last_peered":"2024-04-24T01:45:50.281965+0000","last_clean":"2024-04-24T01:45:50.281965+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:45:50.281965+0000","last_undegraded":"2024-04-24T01:45:50.281965+0000","last_fullsized":"2024-04-24T01:45:50.281965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088100+0000","last_change":"2024-04-24T01:42:40.789191+0000","last_active":"2024-04-24T01:44:51.088100+0000","last_peered":"2024-04-24T01:44:51.088100+0000","last_clean":"2024-04-24T01:44:51.088100+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:44:51.088100+0000","last_undegraded":"2024-04-24T01:44:51.088100+0000","last_fullsized":"2024-04-24T01:44:51.088100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.615925+0000","last_change":"2024-04-24T01:46:14.615987+0000","last_active":"2024-04-24T01:46:14.615925+0000","last_peered":"2024-04-24T01:46:14.615925+0000","last_clean":"2024-04-24T01:46:14.615925+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:46:14.615925+0000","last_undegraded":"2024-04-24T01:46:14.615925+0000","last_fullsized":"2024-04-24T01:46:14.615925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.615812+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:51.435210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.266574+0000","last_change":"2024-04-24T01:46:13.266610+0000","last_active":"2024-04-24T01:46:13.266574+0000","last_peered":"2024-04-24T01:46:13.266574+0000","last_clean":"2024-04-24T01:46:13.266574+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:46:13.266574+0000","last_undegraded":"2024-04-24T01:46:13.266574+0000","last_fullsized":"2024-04-24T01:46:13.266574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.266484+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:40.059339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.594456+0000","last_change":"2024-04-24T01:46:08.594502+0000","last_active":"2024-04-24T01:46:08.594456+0000","last_peered":"2024-04-24T01:46:08.594456+0000","last_clean":"2024-04-24T01:46:08.594456+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:46:08.594456+0000","last_undegraded":"2024-04-24T01:46:08.594456+0000","last_fullsized":"2024-04-24T01:46:08.594456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.594330+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:42.087274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.325729+0000","last_change":"2024-04-24T01:42:50.796703+0000","last_active":"2024-04-24T01:45:50.325729+0000","last_peered":"2024-04-24T01:45:50.325729+0000","last_clean":"2024-04-24T01:45:50.325729+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:45:50.325729+0000","last_undegraded":"2024-04-24T01:45:50.325729+0000","last_fullsized":"2024-04-24T01:45:50.325729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399569+0000","last_change":"2024-04-24T01:42:42.791687+0000","last_active":"2024-04-24T01:45:50.399569+0000","last_peered":"2024-04-24T01:45:50.399569+0000","last_clean":"2024-04-24T01:45:50.399569+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:45:50.399569+0000","last_undegraded":"2024-04-24T01:45:50.399569+0000","last_fullsized":"2024-04-24T01:45:50.399569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088042+0000","last_change":"2024-04-24T01:42:40.787611+0000","last_active":"2024-04-24T01:44:51.088042+0000","last_peered":"2024-04-24T01:44:51.088042+0000","last_clean":"2024-04-24T01:44:51.088042+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:44:51.088042+0000","last_undegraded":"2024-04-24T01:44:51.088042+0000","last_fullsized":"2024-04-24T01:44:51.088042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.286609+0000","last_change":"2024-04-24T01:46:06.286638+0000","last_active":"2024-04-24T01:46:06.286609+0000","last_peered":"2024-04-24T01:46:06.286609+0000","last_clean":"2024-04-24T01:46:06.286609+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:46:06.286609+0000","last_undegraded":"2024-04-24T01:46:06.286609+0000","last_fullsized":"2024-04-24T01:46:06.286609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.286518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:00.727895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.470050+0000","last_change":"2024-04-24T01:46:02.470098+0000","last_active":"2024-04-24T01:46:02.470050+0000","last_peered":"2024-04-24T01:46:02.470050+0000","last_clean":"2024-04-24T01:46:02.470050+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:46:02.470050+0000","last_undegraded":"2024-04-24T01:46:02.470050+0000","last_fullsized":"2024-04-24T01:46:02.470050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.469953+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:28.856113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.853399+0000","last_change":"2024-04-24T01:46:00.853423+0000","last_active":"2024-04-24T01:46:00.853399+0000","last_peered":"2024-04-24T01:46:00.853399+0000","last_clean":"2024-04-24T01:46:00.853399+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:46:00.853399+0000","last_undegraded":"2024-04-24T01:46:00.853399+0000","last_fullsized":"2024-04-24T01:46:00.853399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.853310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:00.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.444511+0000","last_change":"2024-04-24T01:42:50.798885+0000","last_active":"2024-04-24T01:45:50.444511+0000","last_peered":"2024-04-24T01:45:50.444511+0000","last_clean":"2024-04-24T01:45:50.444511+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:45:50.444511+0000","last_undegraded":"2024-04-24T01:45:50.444511+0000","last_fullsized":"2024-04-24T01:45:50.444511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.276916+0000","last_change":"2024-04-24T01:42:42.787563+0000","last_active":"2024-04-24T01:45:50.276916+0000","last_peered":"2024-04-24T01:45:50.276916+0000","last_clean":"2024-04-24T01:45:50.276916+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:45:50.276916+0000","last_undegraded":"2024-04-24T01:45:50.276916+0000","last_fullsized":"2024-04-24T01:45:50.276916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:31.084764+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:44:31.084764+0000","last_peered":"2024-04-24T01:44:31.084764+0000","last_clean":"2024-04-24T01:44:31.084764+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:44:31.084764+0000","last_undegraded":"2024-04-24T01:44:31.084764+0000","last_fullsized":"2024-04-24T01:44:31.084764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:41.086685+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:44:41.086685+0000","last_peered":"2024-04-24T01:44:41.086685+0000","last_clean":"2024-04-24T01:44:41.086685+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:44:41.086685+0000","last_undegraded":"2024-04-24T01:44:41.086685+0000","last_fullsized":"2024-04-24T01:44:41.086685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.087409+0000","last_change":"2024-04-24T01:42:40.787192+0000","last_active":"2024-04-24T01:44:46.087409+0000","last_peered":"2024-04-24T01:44:46.087409+0000","last_clean":"2024-04-24T01:44:46.087409+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:44:46.087409+0000","last_undegraded":"2024-04-24T01:44:46.087409+0000","last_fullsized":"2024-04-24T01:44:46.087409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.646324+0000","last_change":"2024-04-24T01:46:15.646347+0000","last_active":"2024-04-24T01:46:15.646324+0000","last_peered":"2024-04-24T01:46:15.646324+0000","last_clean":"2024-04-24T01:46:15.646324+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:46:15.646324+0000","last_undegraded":"2024-04-24T01:46:15.646324+0000","last_fullsized":"2024-04-24T01:46:15.646324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.646240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:26.583381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'91","reported_seq":179,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:57.013622+0000","last_change":"2024-04-24T01:42:46.785058+0000","last_active":"2024-04-24T01:45:57.013622+0000","last_peered":"2024-04-24T01:45:57.013622+0000","last_clean":"2024-04-24T01:45:57.013622+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:45:57.013622+0000","last_undegraded":"2024-04-24T01:45:57.013622+0000","last_fullsized":"2024-04-24T01:45:57.013622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084174+0000","last_change":"2024-04-24T01:42:48.793592+0000","last_active":"2024-04-24T01:44:59.084174+0000","last_peered":"2024-04-24T01:44:59.084174+0000","last_clean":"2024-04-24T01:44:59.084174+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:44:59.084174+0000","last_undegraded":"2024-04-24T01:44:59.084174+0000","last_fullsized":"2024-04-24T01:44:59.084174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.360318+0000","last_change":"2024-04-24T01:42:50.792016+0000","last_active":"2024-04-24T01:45:50.360318+0000","last_peered":"2024-04-24T01:45:50.360318+0000","last_clean":"2024-04-24T01:45:50.360318+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:45:50.360318+0000","last_undegraded":"2024-04-24T01:45:50.360318+0000","last_fullsized":"2024-04-24T01:45:50.360318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089162+0000","last_change":"2024-04-24T01:42:42.786097+0000","last_active":"2024-04-24T01:44:56.089162+0000","last_peered":"2024-04-24T01:44:56.089162+0000","last_clean":"2024-04-24T01:44:56.089162+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:44:56.089162+0000","last_undegraded":"2024-04-24T01:44:56.089162+0000","last_fullsized":"2024-04-24T01:44:56.089162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:36.085886+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:44:36.085886+0000","last_peered":"2024-04-24T01:44:36.085886+0000","last_clean":"2024-04-24T01:44:36.085886+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:44:36.085886+0000","last_undegraded":"2024-04-24T01:44:36.085886+0000","last_fullsized":"2024-04-24T01:44:36.085886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082515+0000","last_change":"2024-04-24T01:42:40.781303+0000","last_active":"2024-04-24T01:44:49.082515+0000","last_peered":"2024-04-24T01:44:49.082515+0000","last_clean":"2024-04-24T01:44:49.082515+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:44:49.082515+0000","last_undegraded":"2024-04-24T01:44:49.082515+0000","last_fullsized":"2024-04-24T01:44:49.082515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.202261+0000","last_change":"2024-04-24T01:46:02.202303+0000","last_active":"2024-04-24T01:46:02.202261+0000","last_peered":"2024-04-24T01:46:02.202261+0000","last_clean":"2024-04-24T01:46:02.202261+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:46:02.202261+0000","last_undegraded":"2024-04-24T01:46:02.202261+0000","last_fullsized":"2024-04-24T01:46:02.202261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.202137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:08.592288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":528,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.516027+0000","last_change":"2024-04-24T01:46:00.516075+0000","last_active":"2024-04-24T01:46:00.516027+0000","last_peered":"2024-04-24T01:46:00.516027+0000","last_clean":"2024-04-24T01:46:00.516027+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:46:00.516027+0000","last_undegraded":"2024-04-24T01:46:00.516027+0000","last_fullsized":"2024-04-24T01:46:00.516027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.515932+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:28.646371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089048+0000","last_change":"2024-04-24T01:42:48.789708+0000","last_active":"2024-04-24T01:44:56.089048+0000","last_peered":"2024-04-24T01:44:56.089048+0000","last_clean":"2024-04-24T01:44:56.089048+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:44:56.089048+0000","last_undegraded":"2024-04-24T01:44:56.089048+0000","last_fullsized":"2024-04-24T01:44:56.089048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089209+0000","last_change":"2024-04-24T01:42:50.795739+0000","last_active":"2024-04-24T01:45:01.089209+0000","last_peered":"2024-04-24T01:45:01.089209+0000","last_clean":"2024-04-24T01:45:01.089209+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:45:01.089209+0000","last_undegraded":"2024-04-24T01:45:01.089209+0000","last_fullsized":"2024-04-24T01:45:01.089209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083379+0000","last_change":"2024-04-24T01:42:42.783605+0000","last_active":"2024-04-24T01:44:54.083379+0000","last_peered":"2024-04-24T01:44:54.083379+0000","last_clean":"2024-04-24T01:44:54.083379+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:44:54.083379+0000","last_undegraded":"2024-04-24T01:44:54.083379+0000","last_fullsized":"2024-04-24T01:44:54.083379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:36.085349+0000","last_change":"2024-04-24T01:42:32.739720+0000","last_active":"2024-04-24T01:44:36.085349+0000","last_peered":"2024-04-24T01:44:36.085349+0000","last_clean":"2024-04-24T01:44:36.085349+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:44:36.085349+0000","last_undegraded":"2024-04-24T01:44:36.085349+0000","last_fullsized":"2024-04-24T01:44:36.085349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.257895+0000","last_change":"2024-04-24T01:42:40.769426+0000","last_active":"2024-04-24T01:45:50.257895+0000","last_peered":"2024-04-24T01:45:50.257895+0000","last_clean":"2024-04-24T01:45:50.257895+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:45:50.257895+0000","last_undegraded":"2024-04-24T01:45:50.257895+0000","last_fullsized":"2024-04-24T01:45:50.257895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088421+0000","last_change":"2024-04-24T01:42:44.768708+0000","last_active":"2024-04-24T01:44:56.088421+0000","last_peered":"2024-04-24T01:44:56.088421+0000","last_clean":"2024-04-24T01:44:56.088421+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:44:56.088421+0000","last_undegraded":"2024-04-24T01:44:56.088421+0000","last_fullsized":"2024-04-24T01:44:56.088421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.865132+0000","last_change":"2024-04-24T01:46:09.865174+0000","last_active":"2024-04-24T01:46:09.865132+0000","last_peered":"2024-04-24T01:46:09.865132+0000","last_clean":"2024-04-24T01:46:09.865132+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:46:09.865132+0000","last_undegraded":"2024-04-24T01:46:09.865132+0000","last_fullsized":"2024-04-24T01:46:09.865132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.865033+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:26.768496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.219513+0000","last_change":"2024-04-24T01:46:17.219562+0000","last_active":"2024-04-24T01:46:17.219513+0000","last_peered":"2024-04-24T01:46:17.219513+0000","last_clean":"2024-04-24T01:46:17.219513+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:46:17.219513+0000","last_undegraded":"2024-04-24T01:46:17.219513+0000","last_fullsized":"2024-04-24T01:46:17.219513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.219377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:20.724218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090627+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:45:06.090627+0000","last_peered":"2024-04-24T01:45:06.090627+0000","last_clean":"2024-04-24T01:45:06.090627+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:45:06.090627+0000","last_undegraded":"2024-04-24T01:45:06.090627+0000","last_fullsized":"2024-04-24T01:45:06.090627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082590+0000","last_change":"2024-04-24T01:42:42.775667+0000","last_active":"2024-04-24T01:44:49.082590+0000","last_peered":"2024-04-24T01:44:49.082590+0000","last_clean":"2024-04-24T01:44:49.082590+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:44:49.082590+0000","last_undegraded":"2024-04-24T01:44:49.082590+0000","last_fullsized":"2024-04-24T01:44:49.082590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:36.085975+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:44:36.085975+0000","last_peered":"2024-04-24T01:44:36.085975+0000","last_clean":"2024-04-24T01:44:36.085975+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:44:36.085975+0000","last_undegraded":"2024-04-24T01:44:36.085975+0000","last_fullsized":"2024-04-24T01:44:36.085975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.086787+0000","last_change":"2024-04-24T01:42:40.769234+0000","last_active":"2024-04-24T01:44:46.086787+0000","last_peered":"2024-04-24T01:44:46.086787+0000","last_clean":"2024-04-24T01:44:46.086787+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:44:46.086787+0000","last_undegraded":"2024-04-24T01:44:46.086787+0000","last_fullsized":"2024-04-24T01:44:46.086787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.225215+0000","last_change":"2024-04-24T01:46:16.225235+0000","last_active":"2024-04-24T01:46:16.225215+0000","last_peered":"2024-04-24T01:46:16.225215+0000","last_clean":"2024-04-24T01:46:16.225215+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:46:16.225215+0000","last_undegraded":"2024-04-24T01:46:16.225215+0000","last_fullsized":"2024-04-24T01:46:16.225215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.225104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:22.216443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:49.684052+0000","last_change":"2024-04-24T01:42:46.783117+0000","last_active":"2024-04-24T01:45:49.684052+0000","last_peered":"2024-04-24T01:45:49.684052+0000","last_clean":"2024-04-24T01:45:49.684052+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:45:49.684052+0000","last_undegraded":"2024-04-24T01:45:49.684052+0000","last_fullsized":"2024-04-24T01:45:49.684052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089935+0000","last_change":"2024-04-24T01:42:48.789629+0000","last_active":"2024-04-24T01:45:01.089935+0000","last_peered":"2024-04-24T01:45:01.089935+0000","last_clean":"2024-04-24T01:45:01.089935+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:45:01.089935+0000","last_undegraded":"2024-04-24T01:45:01.089935+0000","last_fullsized":"2024-04-24T01:45:01.089935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089149+0000","last_change":"2024-04-24T01:42:50.802434+0000","last_active":"2024-04-24T01:45:01.089149+0000","last_peered":"2024-04-24T01:45:01.089149+0000","last_clean":"2024-04-24T01:45:01.089149+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:45:01.089149+0000","last_undegraded":"2024-04-24T01:45:01.089149+0000","last_fullsized":"2024-04-24T01:45:01.089149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087530+0000","last_change":"2024-04-24T01:42:42.783375+0000","last_active":"2024-04-24T01:44:51.087530+0000","last_peered":"2024-04-24T01:44:51.087530+0000","last_clean":"2024-04-24T01:44:51.087530+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:44:51.087530+0000","last_undegraded":"2024-04-24T01:44:51.087530+0000","last_fullsized":"2024-04-24T01:44:51.087530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.498965+0000","last_change":"2024-04-24T01:42:40.774629+0000","last_active":"2024-04-24T01:44:49.498965+0000","last_peered":"2024-04-24T01:44:49.498965+0000","last_clean":"2024-04-24T01:44:49.498965+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:44:49.498965+0000","last_undegraded":"2024-04-24T01:44:49.498965+0000","last_fullsized":"2024-04-24T01:44:49.498965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:39.081230+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:44:39.081230+0000","last_peered":"2024-04-24T01:44:39.081230+0000","last_clean":"2024-04-24T01:44:39.081230+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:44:39.081230+0000","last_undegraded":"2024-04-24T01:44:39.081230+0000","last_fullsized":"2024-04-24T01:44:39.081230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.866193+0000","last_change":"2024-04-24T01:43:21.814238+0000","last_active":"2024-04-24T01:45:56.866193+0000","last_peered":"2024-04-24T01:45:56.866193+0000","last_clean":"2024-04-24T01:45:56.866193+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:45:56.866193+0000","last_undegraded":"2024-04-24T01:45:56.866193+0000","last_fullsized":"2024-04-24T01:45:56.866193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'89","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.233644+0000","last_change":"2024-04-24T01:46:07.233696+0000","last_active":"2024-04-24T01:46:07.233644+0000","last_peered":"2024-04-24T01:46:07.233644+0000","last_clean":"2024-04-24T01:46:07.233644+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:46:07.233644+0000","last_undegraded":"2024-04-24T01:46:07.233644+0000","last_fullsized":"2024-04-24T01:46:07.233644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'89","last_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_deep_scrub":"34'89","last_deep_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.233553+0000","objects_scrubbed":11,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:09.955408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":99,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.891003+0000","last_change":"2024-04-24T01:46:06.891045+0000","last_active":"2024-04-24T01:46:06.891003+0000","last_peered":"2024-04-24T01:46:06.891003+0000","last_clean":"2024-04-24T01:46:06.891003+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:46:06.891003+0000","last_undegraded":"2024-04-24T01:46:06.891003+0000","last_fullsized":"2024-04-24T01:46:06.891003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.890898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:03.226630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:09.085741+0000","last_change":"2024-04-24T01:42:50.793302+0000","last_active":"2024-04-24T01:45:09.085741+0000","last_peered":"2024-04-24T01:45:09.085741+0000","last_clean":"2024-04-24T01:45:09.085741+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:45:09.085741+0000","last_undegraded":"2024-04-24T01:45:09.085741+0000","last_fullsized":"2024-04-24T01:45:09.085741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.144982+0000","last_change":"2024-04-24T01:42:42.789819+0000","last_active":"2024-04-24T01:45:50.144982+0000","last_peered":"2024-04-24T01:45:50.144982+0000","last_clean":"2024-04-24T01:45:50.144982+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:45:50.144982+0000","last_undegraded":"2024-04-24T01:45:50.144982+0000","last_fullsized":"2024-04-24T01:45:50.144982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082579+0000","last_change":"2024-04-24T01:42:40.778312+0000","last_active":"2024-04-24T01:44:49.082579+0000","last_peered":"2024-04-24T01:44:49.082579+0000","last_clean":"2024-04-24T01:44:49.082579+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:44:49.082579+0000","last_undegraded":"2024-04-24T01:44:49.082579+0000","last_fullsized":"2024-04-24T01:44:49.082579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:41.086736+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:44:41.086736+0000","last_peered":"2024-04-24T01:44:41.086736+0000","last_clean":"2024-04-24T01:44:41.086736+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:44:41.086736+0000","last_undegraded":"2024-04-24T01:44:41.086736+0000","last_fullsized":"2024-04-24T01:44:41.086736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.278301+0000","last_change":"2024-04-24T01:46:12.278325+0000","last_active":"2024-04-24T01:46:12.278301+0000","last_peered":"2024-04-24T01:46:12.278301+0000","last_clean":"2024-04-24T01:46:12.278301+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:46:12.278301+0000","last_undegraded":"2024-04-24T01:46:12.278301+0000","last_fullsized":"2024-04-24T01:46:12.278301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.278217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:12.615210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.482034+0000","last_change":"2024-04-24T01:46:01.482085+0000","last_active":"2024-04-24T01:46:01.482034+0000","last_peered":"2024-04-24T01:46:01.482034+0000","last_clean":"2024-04-24T01:46:01.482034+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:46:01.482034+0000","last_undegraded":"2024-04-24T01:46:01.482034+0000","last_fullsized":"2024-04-24T01:46:01.482034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.481946+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:57.817678+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":359,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:57.029669+0000","last_change":"2024-04-24T01:42:48.794484+0000","last_active":"2024-04-24T01:45:57.029669+0000","last_peered":"2024-04-24T01:45:57.029669+0000","last_clean":"2024-04-24T01:45:57.029669+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:45:57.029669+0000","last_undegraded":"2024-04-24T01:45:57.029669+0000","last_fullsized":"2024-04-24T01:45:57.029669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090729+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:45:06.090729+0000","last_peered":"2024-04-24T01:45:06.090729+0000","last_clean":"2024-04-24T01:45:06.090729+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:45:06.090729+0000","last_undegraded":"2024-04-24T01:45:06.090729+0000","last_fullsized":"2024-04-24T01:45:06.090729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.287046+0000","last_change":"2024-04-24T01:46:14.287073+0000","last_active":"2024-04-24T01:46:14.287046+0000","last_peered":"2024-04-24T01:46:14.287046+0000","last_clean":"2024-04-24T01:46:14.287046+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:46:14.287046+0000","last_undegraded":"2024-04-24T01:46:14.287046+0000","last_fullsized":"2024-04-24T01:46:14.287046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.286944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:31.444362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088265+0000","last_change":"2024-04-24T01:42:40.786621+0000","last_active":"2024-04-24T01:44:51.088265+0000","last_peered":"2024-04-24T01:44:51.088265+0000","last_clean":"2024-04-24T01:44:51.088265+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:44:51.088265+0000","last_undegraded":"2024-04-24T01:44:51.088265+0000","last_fullsized":"2024-04-24T01:44:51.088265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:44.082013+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:44:44.082013+0000","last_peered":"2024-04-24T01:44:44.082013+0000","last_clean":"2024-04-24T01:44:44.082013+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:44:44.082013+0000","last_undegraded":"2024-04-24T01:44:44.082013+0000","last_fullsized":"2024-04-24T01:44:44.082013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.333072+0000","last_change":"2024-04-24T01:46:08.333093+0000","last_active":"2024-04-24T01:46:08.333072+0000","last_peered":"2024-04-24T01:46:08.333072+0000","last_clean":"2024-04-24T01:46:08.333072+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:46:08.333072+0000","last_undegraded":"2024-04-24T01:46:08.333072+0000","last_fullsized":"2024-04-24T01:46:08.333072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.332981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:48.671731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'18","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.283110+0000","last_change":"2024-04-24T01:42:46.782589+0000","last_active":"2024-04-24T01:45:50.283110+0000","last_peered":"2024-04-24T01:45:50.283110+0000","last_clean":"2024-04-24T01:45:50.283110+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:45:50.283110+0000","last_undegraded":"2024-04-24T01:45:50.283110+0000","last_fullsized":"2024-04-24T01:45:50.283110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.218893+0000","last_change":"2024-04-24T01:46:02.218953+0000","last_active":"2024-04-24T01:46:02.218893+0000","last_peered":"2024-04-24T01:46:02.218893+0000","last_clean":"2024-04-24T01:46:02.218893+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:46:02.218893+0000","last_undegraded":"2024-04-24T01:46:02.218893+0000","last_fullsized":"2024-04-24T01:46:02.218893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.218804+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:46.449166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.146164+0000","last_change":"2024-04-24T01:42:50.802205+0000","last_active":"2024-04-24T01:45:50.146164+0000","last_peered":"2024-04-24T01:45:50.146164+0000","last_clean":"2024-04-24T01:45:50.146164+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:45:50.146164+0000","last_undegraded":"2024-04-24T01:45:50.146164+0000","last_fullsized":"2024-04-24T01:45:50.146164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.397943+0000","last_change":"2024-04-24T01:42:42.788944+0000","last_active":"2024-04-24T01:45:50.397943+0000","last_peered":"2024-04-24T01:45:50.397943+0000","last_clean":"2024-04-24T01:45:50.397943+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:45:50.397943+0000","last_undegraded":"2024-04-24T01:45:50.397943+0000","last_fullsized":"2024-04-24T01:45:50.397943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087682+0000","last_change":"2024-04-24T01:42:40.788616+0000","last_active":"2024-04-24T01:44:51.087682+0000","last_peered":"2024-04-24T01:44:51.087682+0000","last_clean":"2024-04-24T01:44:51.087682+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:44:51.087682+0000","last_undegraded":"2024-04-24T01:44:51.087682+0000","last_fullsized":"2024-04-24T01:44:51.087682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:41.086789+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:44:41.086789+0000","last_peered":"2024-04-24T01:44:41.086789+0000","last_clean":"2024-04-24T01:44:41.086789+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:44:41.086789+0000","last_undegraded":"2024-04-24T01:44:41.086789+0000","last_fullsized":"2024-04-24T01:44:41.086789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.339366+0000","last_change":"2024-04-24T01:46:09.339389+0000","last_active":"2024-04-24T01:46:09.339366+0000","last_peered":"2024-04-24T01:46:09.339366+0000","last_clean":"2024-04-24T01:46:09.339366+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:46:09.339366+0000","last_undegraded":"2024-04-24T01:46:09.339366+0000","last_fullsized":"2024-04-24T01:46:09.339366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.339282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:17.983913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'104","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.891457+0000","last_change":"2024-04-24T01:46:07.891513+0000","last_active":"2024-04-24T01:46:07.891457+0000","last_peered":"2024-04-24T01:46:07.891457+0000","last_clean":"2024-04-24T01:46:07.891457+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:46:07.891457+0000","last_undegraded":"2024-04-24T01:46:07.891457+0000","last_fullsized":"2024-04-24T01:46:07.891457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'104","last_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_deep_scrub":"34'104","last_deep_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.891371+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.493980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.166260+0000","last_change":"2024-04-24T01:46:13.166279+0000","last_active":"2024-04-24T01:46:13.166260+0000","last_peered":"2024-04-24T01:46:13.166260+0000","last_clean":"2024-04-24T01:46:13.166260+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:46:13.166260+0000","last_undegraded":"2024-04-24T01:46:13.166260+0000","last_fullsized":"2024-04-24T01:46:13.166260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.166175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:35.987875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.892980+0000","last_change":"2024-04-24T01:46:14.893005+0000","last_active":"2024-04-24T01:46:14.892980+0000","last_peered":"2024-04-24T01:46:14.892980+0000","last_clean":"2024-04-24T01:46:14.892980+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:46:14.892980+0000","last_undegraded":"2024-04-24T01:46:14.892980+0000","last_fullsized":"2024-04-24T01:46:14.892980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.892893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:00.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088453+0000","last_change":"2024-04-24T01:42:50.800231+0000","last_active":"2024-04-24T01:44:56.088453+0000","last_peered":"2024-04-24T01:44:56.088453+0000","last_clean":"2024-04-24T01:44:56.088453+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:44:56.088453+0000","last_undegraded":"2024-04-24T01:44:56.088453+0000","last_fullsized":"2024-04-24T01:44:56.088453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.089886+0000","last_change":"2024-04-24T01:42:42.791072+0000","last_active":"2024-04-24T01:45:06.089886+0000","last_peered":"2024-04-24T01:45:06.089886+0000","last_clean":"2024-04-24T01:45:06.089886+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:45:06.089886+0000","last_undegraded":"2024-04-24T01:45:06.089886+0000","last_fullsized":"2024-04-24T01:45:06.089886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089849+0000","last_change":"2024-04-24T01:42:40.776494+0000","last_active":"2024-04-24T01:45:01.089849+0000","last_peered":"2024-04-24T01:45:01.089849+0000","last_clean":"2024-04-24T01:45:01.089849+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:45:01.089849+0000","last_undegraded":"2024-04-24T01:45:01.089849+0000","last_fullsized":"2024-04-24T01:45:01.089849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.657368+0000","last_change":"2024-04-24T01:46:13.657398+0000","last_active":"2024-04-24T01:46:13.657368+0000","last_peered":"2024-04-24T01:46:13.657368+0000","last_clean":"2024-04-24T01:46:13.657368+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:46:13.657368+0000","last_undegraded":"2024-04-24T01:46:13.657368+0000","last_fullsized":"2024-04-24T01:46:13.657368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.657273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:54.140958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.290072+0000","last_change":"2024-04-24T01:46:11.290116+0000","last_active":"2024-04-24T01:46:11.290072+0000","last_peered":"2024-04-24T01:46:11.290072+0000","last_clean":"2024-04-24T01:46:11.290072+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:46:11.290072+0000","last_undegraded":"2024-04-24T01:46:11.290072+0000","last_fullsized":"2024-04-24T01:46:11.290072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.289983+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:25.084406+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091324+0000","last_change":"2024-04-24T01:42:48.786495+0000","last_active":"2024-04-24T01:45:11.091324+0000","last_peered":"2024-04-24T01:45:11.091324+0000","last_clean":"2024-04-24T01:45:11.091324+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:45:11.091324+0000","last_undegraded":"2024-04-24T01:45:11.091324+0000","last_fullsized":"2024-04-24T01:45:11.091324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083325+0000","last_change":"2024-04-24T01:42:50.802495+0000","last_active":"2024-04-24T01:44:54.083325+0000","last_peered":"2024-04-24T01:44:54.083325+0000","last_clean":"2024-04-24T01:44:54.083325+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:44:54.083325+0000","last_undegraded":"2024-04-24T01:44:54.083325+0000","last_fullsized":"2024-04-24T01:44:54.083325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090014+0000","last_change":"2024-04-24T01:42:42.781334+0000","last_active":"2024-04-24T01:45:06.090014+0000","last_peered":"2024-04-24T01:45:06.090014+0000","last_clean":"2024-04-24T01:45:06.090014+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:45:06.090014+0000","last_undegraded":"2024-04-24T01:45:06.090014+0000","last_fullsized":"2024-04-24T01:45:06.090014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.267209+0000","last_change":"2024-04-24T01:42:40.783014+0000","last_active":"2024-04-24T01:45:50.267209+0000","last_peered":"2024-04-24T01:45:50.267209+0000","last_clean":"2024-04-24T01:45:50.267209+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:45:50.267209+0000","last_undegraded":"2024-04-24T01:45:50.267209+0000","last_fullsized":"2024-04-24T01:45:50.267209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.257405+0000","last_change":"2024-04-24T01:46:04.257440+0000","last_active":"2024-04-24T01:46:04.257405+0000","last_peered":"2024-04-24T01:46:04.257405+0000","last_clean":"2024-04-24T01:46:04.257405+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:46:04.257405+0000","last_undegraded":"2024-04-24T01:46:04.257405+0000","last_fullsized":"2024-04-24T01:46:04.257405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.257282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:20.008478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.173642+0000","last_change":"2024-04-24T01:46:14.173677+0000","last_active":"2024-04-24T01:46:14.173642+0000","last_peered":"2024-04-24T01:46:14.173642+0000","last_clean":"2024-04-24T01:46:14.173642+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:46:14.173642+0000","last_undegraded":"2024-04-24T01:46:14.173642+0000","last_fullsized":"2024-04-24T01:46:14.173642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.173554+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:46.693848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.821154+0000","last_change":"2024-04-24T01:46:01.821203+0000","last_active":"2024-04-24T01:46:01.821154+0000","last_peered":"2024-04-24T01:46:01.821154+0000","last_clean":"2024-04-24T01:46:01.821154+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:46:01.821154+0000","last_undegraded":"2024-04-24T01:46:01.821154+0000","last_fullsized":"2024-04-24T01:46:01.821154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.821055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:04:47.582844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:24.087886+0000","last_change":"2024-04-24T01:42:50.793424+0000","last_active":"2024-04-24T01:45:24.087886+0000","last_peered":"2024-04-24T01:45:24.087886+0000","last_clean":"2024-04-24T01:45:24.087886+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:45:24.087886+0000","last_undegraded":"2024-04-24T01:45:24.087886+0000","last_fullsized":"2024-04-24T01:45:24.087886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351867+0000","last_change":"2024-04-24T01:42:42.790386+0000","last_active":"2024-04-24T01:45:50.351867+0000","last_peered":"2024-04-24T01:45:50.351867+0000","last_clean":"2024-04-24T01:45:50.351867+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:45:50.351867+0000","last_undegraded":"2024-04-24T01:45:50.351867+0000","last_fullsized":"2024-04-24T01:45:50.351867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090008+0000","last_change":"2024-04-24T01:42:40.777727+0000","last_active":"2024-04-24T01:45:06.090008+0000","last_peered":"2024-04-24T01:45:06.090008+0000","last_clean":"2024-04-24T01:45:06.090008+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:45:06.090008+0000","last_undegraded":"2024-04-24T01:45:06.090008+0000","last_fullsized":"2024-04-24T01:45:06.090008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.846071+0000","last_change":"2024-04-24T01:46:15.846094+0000","last_active":"2024-04-24T01:46:15.846071+0000","last_peered":"2024-04-24T01:46:15.846071+0000","last_clean":"2024-04-24T01:46:15.846071+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:46:15.846071+0000","last_undegraded":"2024-04-24T01:46:15.846071+0000","last_fullsized":"2024-04-24T01:46:15.846071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:10.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.247853+0000","last_change":"2024-04-24T01:46:08.247891+0000","last_active":"2024-04-24T01:46:08.247853+0000","last_peered":"2024-04-24T01:46:08.247853+0000","last_clean":"2024-04-24T01:46:08.247853+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:46:08.247853+0000","last_undegraded":"2024-04-24T01:46:08.247853+0000","last_fullsized":"2024-04-24T01:46:08.247853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.247768+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:06:04.087642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.609637+0000","last_change":"2024-04-24T01:46:12.609659+0000","last_active":"2024-04-24T01:46:12.609637+0000","last_peered":"2024-04-24T01:46:12.609637+0000","last_clean":"2024-04-24T01:46:12.609637+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:46:12.609637+0000","last_undegraded":"2024-04-24T01:46:12.609637+0000","last_fullsized":"2024-04-24T01:46:12.609637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.609553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:24:25.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:21.093126+0000","last_change":"2024-04-24T01:42:50.801137+0000","last_active":"2024-04-24T01:45:21.093126+0000","last_peered":"2024-04-24T01:45:21.093126+0000","last_clean":"2024-04-24T01:45:21.093126+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:45:21.093126+0000","last_undegraded":"2024-04-24T01:45:21.093126+0000","last_fullsized":"2024-04-24T01:45:21.093126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090502+0000","last_change":"2024-04-24T01:42:42.786306+0000","last_active":"2024-04-24T01:45:06.090502+0000","last_peered":"2024-04-24T01:45:06.090502+0000","last_clean":"2024-04-24T01:45:06.090502+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:45:06.090502+0000","last_undegraded":"2024-04-24T01:45:06.090502+0000","last_fullsized":"2024-04-24T01:45:06.090502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090199+0000","last_change":"2024-04-24T01:42:40.790215+0000","last_active":"2024-04-24T01:45:06.090199+0000","last_peered":"2024-04-24T01:45:06.090199+0000","last_clean":"2024-04-24T01:45:06.090199+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:45:06.090199+0000","last_undegraded":"2024-04-24T01:45:06.090199+0000","last_fullsized":"2024-04-24T01:45:06.090199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.312282+0000","last_change":"2024-04-24T01:46:10.312308+0000","last_active":"2024-04-24T01:46:10.312282+0000","last_peered":"2024-04-24T01:46:10.312282+0000","last_clean":"2024-04-24T01:46:10.312282+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:46:10.312282+0000","last_undegraded":"2024-04-24T01:46:10.312282+0000","last_fullsized":"2024-04-24T01:46:10.312282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.312190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:07.102122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.806433+0000","last_change":"2024-04-24T01:46:12.806479+0000","last_active":"2024-04-24T01:46:12.806433+0000","last_peered":"2024-04-24T01:46:12.806433+0000","last_clean":"2024-04-24T01:46:12.806433+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:46:12.806433+0000","last_undegraded":"2024-04-24T01:46:12.806433+0000","last_fullsized":"2024-04-24T01:46:12.806433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.806352+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:58.427653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.869091+0000","last_change":"2024-04-24T01:46:03.869117+0000","last_active":"2024-04-24T01:46:03.869091+0000","last_peered":"2024-04-24T01:46:03.869091+0000","last_clean":"2024-04-24T01:46:03.869091+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:46:03.869091+0000","last_undegraded":"2024-04-24T01:46:03.869091+0000","last_fullsized":"2024-04-24T01:46:03.869091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.868982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:27:47.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351558+0000","last_change":"2024-04-24T01:43:21.862671+0000","last_active":"2024-04-24T01:45:50.351558+0000","last_peered":"2024-04-24T01:45:50.351558+0000","last_clean":"2024-04-24T01:45:50.351558+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:45:50.351558+0000","last_undegraded":"2024-04-24T01:45:50.351558+0000","last_fullsized":"2024-04-24T01:45:50.351558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090473+0000","last_change":"2024-04-24T01:42:40.787886+0000","last_active":"2024-04-24T01:45:06.090473+0000","last_peered":"2024-04-24T01:45:06.090473+0000","last_clean":"2024-04-24T01:45:06.090473+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:45:06.090473+0000","last_undegraded":"2024-04-24T01:45:06.090473+0000","last_fullsized":"2024-04-24T01:45:06.090473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:44.082048+0000","last_change":"2024-04-24T01:42:44.773584+0000","last_active":"2024-04-24T01:44:44.082048+0000","last_peered":"2024-04-24T01:44:44.082048+0000","last_clean":"2024-04-24T01:44:44.082048+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:44:44.082048+0000","last_undegraded":"2024-04-24T01:44:44.082048+0000","last_fullsized":"2024-04-24T01:44:44.082048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.198038+0000","last_change":"2024-04-24T01:46:10.198112+0000","last_active":"2024-04-24T01:46:10.198038+0000","last_peered":"2024-04-24T01:46:10.198038+0000","last_clean":"2024-04-24T01:46:10.198038+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:46:10.198038+0000","last_undegraded":"2024-04-24T01:46:10.198038+0000","last_fullsized":"2024-04-24T01:46:10.198038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.197934+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:55.839910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.889685+0000","last_change":"2024-04-24T01:46:04.889720+0000","last_active":"2024-04-24T01:46:04.889685+0000","last_peered":"2024-04-24T01:46:04.889685+0000","last_clean":"2024-04-24T01:46:04.889685+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:46:04.889685+0000","last_undegraded":"2024-04-24T01:46:04.889685+0000","last_fullsized":"2024-04-24T01:46:04.889685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.889593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:29.941134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.274542+0000","last_change":"2024-04-24T01:42:50.794926+0000","last_active":"2024-04-24T01:45:50.274542+0000","last_peered":"2024-04-24T01:45:50.274542+0000","last_clean":"2024-04-24T01:45:50.274542+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:45:50.274542+0000","last_undegraded":"2024-04-24T01:45:50.274542+0000","last_fullsized":"2024-04-24T01:45:50.274542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:44.082039+0000","last_change":"2024-04-24T01:42:42.783533+0000","last_active":"2024-04-24T01:44:44.082039+0000","last_peered":"2024-04-24T01:44:44.082039+0000","last_clean":"2024-04-24T01:44:44.082039+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:44:44.082039+0000","last_undegraded":"2024-04-24T01:44:44.082039+0000","last_fullsized":"2024-04-24T01:44:44.082039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.089951+0000","last_change":"2024-04-24T01:42:40.788925+0000","last_active":"2024-04-24T01:45:06.089951+0000","last_peered":"2024-04-24T01:45:06.089951+0000","last_clean":"2024-04-24T01:45:06.089951+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:45:06.089951+0000","last_undegraded":"2024-04-24T01:45:06.089951+0000","last_fullsized":"2024-04-24T01:45:06.089951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087723+0000","last_change":"2024-04-24T01:42:44.774986+0000","last_active":"2024-04-24T01:44:51.087723+0000","last_peered":"2024-04-24T01:44:51.087723+0000","last_clean":"2024-04-24T01:44:51.087723+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:44:51.087723+0000","last_undegraded":"2024-04-24T01:44:51.087723+0000","last_fullsized":"2024-04-24T01:44:51.087723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.993094+0000","last_change":"2024-04-24T01:42:46.783203+0000","last_active":"2024-04-24T01:45:56.993094+0000","last_peered":"2024-04-24T01:45:56.993094+0000","last_clean":"2024-04-24T01:45:56.993094+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:45:56.993094+0000","last_undegraded":"2024-04-24T01:45:56.993094+0000","last_fullsized":"2024-04-24T01:45:56.993094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:21.092591+0000","last_change":"2024-04-24T01:42:48.791647+0000","last_active":"2024-04-24T01:45:21.092591+0000","last_peered":"2024-04-24T01:45:21.092591+0000","last_clean":"2024-04-24T01:45:21.092591+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:45:21.092591+0000","last_undegraded":"2024-04-24T01:45:21.092591+0000","last_fullsized":"2024-04-24T01:45:21.092591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.349403+0000","last_change":"2024-04-24T01:42:50.797843+0000","last_active":"2024-04-24T01:45:50.349403+0000","last_peered":"2024-04-24T01:45:50.349403+0000","last_clean":"2024-04-24T01:45:50.349403+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:45:50.349403+0000","last_undegraded":"2024-04-24T01:45:50.349403+0000","last_fullsized":"2024-04-24T01:45:50.349403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.092410+0000","last_change":"2024-04-24T01:42:42.786283+0000","last_active":"2024-04-24T01:45:16.092410+0000","last_peered":"2024-04-24T01:45:16.092410+0000","last_clean":"2024-04-24T01:45:16.092410+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:45:16.092410+0000","last_undegraded":"2024-04-24T01:45:16.092410+0000","last_fullsized":"2024-04-24T01:45:16.092410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090904+0000","last_change":"2024-04-24T01:42:40.769690+0000","last_active":"2024-04-24T01:45:11.090904+0000","last_peered":"2024-04-24T01:45:11.090904+0000","last_clean":"2024-04-24T01:45:11.090904+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:45:11.090904+0000","last_undegraded":"2024-04-24T01:45:11.090904+0000","last_fullsized":"2024-04-24T01:45:11.090904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091477+0000","last_change":"2024-04-24T01:42:44.775092+0000","last_active":"2024-04-24T01:45:16.091477+0000","last_peered":"2024-04-24T01:45:16.091477+0000","last_clean":"2024-04-24T01:45:16.091477+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:45:16.091477+0000","last_undegraded":"2024-04-24T01:45:16.091477+0000","last_fullsized":"2024-04-24T01:45:16.091477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.208799+0000","last_change":"2024-04-24T01:46:12.208833+0000","last_active":"2024-04-24T01:46:12.208799+0000","last_peered":"2024-04-24T01:46:12.208799+0000","last_clean":"2024-04-24T01:46:12.208799+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:46:12.208799+0000","last_undegraded":"2024-04-24T01:46:12.208799+0000","last_fullsized":"2024-04-24T01:46:12.208799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.208700+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:29.667207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.222166+0000","last_change":"2024-04-24T01:46:04.222190+0000","last_active":"2024-04-24T01:46:04.222166+0000","last_peered":"2024-04-24T01:46:04.222166+0000","last_clean":"2024-04-24T01:46:04.222166+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:46:04.222166+0000","last_undegraded":"2024-04-24T01:46:04.222166+0000","last_fullsized":"2024-04-24T01:46:04.222166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.222084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:26.106809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091360+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:45:11.091360+0000","last_peered":"2024-04-24T01:45:11.091360+0000","last_clean":"2024-04-24T01:45:11.091360+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:45:11.091360+0000","last_undegraded":"2024-04-24T01:45:11.091360+0000","last_fullsized":"2024-04-24T01:45:11.091360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.324635+0000","last_change":"2024-04-24T01:42:42.776215+0000","last_active":"2024-04-24T01:45:50.324635+0000","last_peered":"2024-04-24T01:45:50.324635+0000","last_clean":"2024-04-24T01:45:50.324635+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:45:50.324635+0000","last_undegraded":"2024-04-24T01:45:50.324635+0000","last_fullsized":"2024-04-24T01:45:50.324635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091410+0000","last_change":"2024-04-24T01:42:40.791055+0000","last_active":"2024-04-24T01:45:11.091410+0000","last_peered":"2024-04-24T01:45:11.091410+0000","last_clean":"2024-04-24T01:45:11.091410+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:45:11.091410+0000","last_undegraded":"2024-04-24T01:45:11.091410+0000","last_fullsized":"2024-04-24T01:45:11.091410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091856+0000","last_change":"2024-04-24T01:42:44.775371+0000","last_active":"2024-04-24T01:45:16.091856+0000","last_peered":"2024-04-24T01:45:16.091856+0000","last_clean":"2024-04-24T01:45:16.091856+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:45:16.091856+0000","last_undegraded":"2024-04-24T01:45:16.091856+0000","last_fullsized":"2024-04-24T01:45:16.091856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.087491+0000","last_change":"2024-04-24T01:42:46.785255+0000","last_active":"2024-04-24T01:44:46.087491+0000","last_peered":"2024-04-24T01:44:46.087491+0000","last_clean":"2024-04-24T01:44:46.087491+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:44:46.087491+0000","last_undegraded":"2024-04-24T01:44:46.087491+0000","last_fullsized":"2024-04-24T01:44:46.087491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.864878+0000","last_change":"2024-04-24T01:46:02.864906+0000","last_active":"2024-04-24T01:46:02.864878+0000","last_peered":"2024-04-24T01:46:02.864878+0000","last_clean":"2024-04-24T01:46:02.864878+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:46:02.864878+0000","last_undegraded":"2024-04-24T01:46:02.864878+0000","last_fullsized":"2024-04-24T01:46:02.864878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.864778+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:58.138209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091284+0000","last_change":"2024-04-24T01:42:50.799047+0000","last_active":"2024-04-24T01:45:11.091284+0000","last_peered":"2024-04-24T01:45:11.091284+0000","last_clean":"2024-04-24T01:45:11.091284+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:45:11.091284+0000","last_undegraded":"2024-04-24T01:45:11.091284+0000","last_fullsized":"2024-04-24T01:45:11.091284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.276921+0000","last_change":"2024-04-24T01:42:42.779703+0000","last_active":"2024-04-24T01:45:50.276921+0000","last_peered":"2024-04-24T01:45:50.276921+0000","last_clean":"2024-04-24T01:45:50.276921+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:45:50.276921+0000","last_undegraded":"2024-04-24T01:45:50.276921+0000","last_fullsized":"2024-04-24T01:45:50.276921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090975+0000","last_change":"2024-04-24T01:42:40.783048+0000","last_active":"2024-04-24T01:45:11.090975+0000","last_peered":"2024-04-24T01:45:11.090975+0000","last_clean":"2024-04-24T01:45:11.090975+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:45:11.090975+0000","last_undegraded":"2024-04-24T01:45:11.090975+0000","last_fullsized":"2024-04-24T01:45:11.090975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.603073+0000","last_change":"2024-04-24T01:46:11.603100+0000","last_active":"2024-04-24T01:46:11.603073+0000","last_peered":"2024-04-24T01:46:11.603073+0000","last_clean":"2024-04-24T01:46:11.603073+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:46:11.603073+0000","last_undegraded":"2024-04-24T01:46:11.603073+0000","last_fullsized":"2024-04-24T01:46:11.603073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.602978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:50.391941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'77","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.529735+0000","last_change":"2024-04-24T01:46:06.529785+0000","last_active":"2024-04-24T01:46:06.529735+0000","last_peered":"2024-04-24T01:46:06.529735+0000","last_clean":"2024-04-24T01:46:06.529735+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:46:06.529735+0000","last_undegraded":"2024-04-24T01:46:06.529735+0000","last_fullsized":"2024-04-24T01:46:06.529735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.529645+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:07.671634+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":85,"num_read_kb":80,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.248633+0000","last_change":"2024-04-24T01:46:01.248655+0000","last_active":"2024-04-24T01:46:01.248633+0000","last_peered":"2024-04-24T01:46:01.248633+0000","last_clean":"2024-04-24T01:46:01.248633+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:46:01.248633+0000","last_undegraded":"2024-04-24T01:46:01.248633+0000","last_fullsized":"2024-04-24T01:46:01.248633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.248553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:14.454609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091921+0000","last_change":"2024-04-24T01:42:50.796877+0000","last_active":"2024-04-24T01:45:16.091921+0000","last_peered":"2024-04-24T01:45:16.091921+0000","last_clean":"2024-04-24T01:45:16.091921+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:45:16.091921+0000","last_undegraded":"2024-04-24T01:45:16.091921+0000","last_fullsized":"2024-04-24T01:45:16.091921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351966+0000","last_change":"2024-04-24T01:42:42.779537+0000","last_active":"2024-04-24T01:45:50.351966+0000","last_peered":"2024-04-24T01:45:50.351966+0000","last_clean":"2024-04-24T01:45:50.351966+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:45:50.351966+0000","last_undegraded":"2024-04-24T01:45:50.351966+0000","last_fullsized":"2024-04-24T01:45:50.351966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.263641+0000","last_change":"2024-04-24T01:42:40.788381+0000","last_active":"2024-04-24T01:45:50.263641+0000","last_peered":"2024-04-24T01:45:50.263641+0000","last_clean":"2024-04-24T01:45:50.263641+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:45:50.263641+0000","last_undegraded":"2024-04-24T01:45:50.263641+0000","last_fullsized":"2024-04-24T01:45:50.263641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091454+0000","last_change":"2024-04-24T01:42:44.775775+0000","last_active":"2024-04-24T01:45:16.091454+0000","last_peered":"2024-04-24T01:45:16.091454+0000","last_clean":"2024-04-24T01:45:16.091454+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:45:16.091454+0000","last_undegraded":"2024-04-24T01:45:16.091454+0000","last_fullsized":"2024-04-24T01:45:16.091454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.187484+0000","last_change":"2024-04-24T01:46:11.187562+0000","last_active":"2024-04-24T01:46:11.187484+0000","last_peered":"2024-04-24T01:46:11.187484+0000","last_clean":"2024-04-24T01:46:11.187484+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:46:11.187484+0000","last_undegraded":"2024-04-24T01:46:11.187484+0000","last_fullsized":"2024-04-24T01:46:11.187484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.187375+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:33:05.075069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.092176+0000","last_change":"2024-04-24T01:42:48.785198+0000","last_active":"2024-04-24T01:45:16.092176+0000","last_peered":"2024-04-24T01:45:16.092176+0000","last_clean":"2024-04-24T01:45:16.092176+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:45:16.092176+0000","last_undegraded":"2024-04-24T01:45:16.092176+0000","last_fullsized":"2024-04-24T01:45:16.092176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.455411+0000","last_change":"2024-04-24T01:42:50.801689+0000","last_active":"2024-04-24T01:45:50.455411+0000","last_peered":"2024-04-24T01:45:50.455411+0000","last_clean":"2024-04-24T01:45:50.455411+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:45:50.455411+0000","last_undegraded":"2024-04-24T01:45:50.455411+0000","last_fullsized":"2024-04-24T01:45:50.455411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:51.096343+0000","last_change":"2024-04-24T01:43:21.864360+0000","last_active":"2024-04-24T01:45:51.096343+0000","last_peered":"2024-04-24T01:45:51.096343+0000","last_clean":"2024-04-24T01:45:51.096343+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:45:51.096343+0000","last_undegraded":"2024-04-24T01:45:51.096343+0000","last_fullsized":"2024-04-24T01:45:51.096343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:44.082025+0000","last_change":"2024-04-24T01:42:40.778077+0000","last_active":"2024-04-24T01:44:44.082025+0000","last_peered":"2024-04-24T01:44:44.082025+0000","last_clean":"2024-04-24T01:44:44.082025+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:44:44.082025+0000","last_undegraded":"2024-04-24T01:44:44.082025+0000","last_fullsized":"2024-04-24T01:44:44.082025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.626204+0000","last_change":"2024-04-24T01:46:09.626256+0000","last_active":"2024-04-24T01:46:09.626204+0000","last_peered":"2024-04-24T01:46:09.626204+0000","last_clean":"2024-04-24T01:46:09.626204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:46:09.626204+0000","last_undegraded":"2024-04-24T01:46:09.626204+0000","last_fullsized":"2024-04-24T01:46:09.626204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.626097+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:56.352550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'35","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.931381+0000","last_change":"2024-04-24T01:42:46.782809+0000","last_active":"2024-04-24T01:45:56.931381+0000","last_peered":"2024-04-24T01:45:56.931381+0000","last_clean":"2024-04-24T01:45:56.931381+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:45:56.931381+0000","last_undegraded":"2024-04-24T01:45:56.931381+0000","last_fullsized":"2024-04-24T01:45:56.931381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:21.093064+0000","last_change":"2024-04-24T01:42:48.793613+0000","last_active":"2024-04-24T01:45:21.093064+0000","last_peered":"2024-04-24T01:45:21.093064+0000","last_clean":"2024-04-24T01:45:21.093064+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:45:21.093064+0000","last_undegraded":"2024-04-24T01:45:21.093064+0000","last_fullsized":"2024-04-24T01:45:21.093064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:47.763665+0000","last_clean_scrub_stamp":"2024-04-24T01:42:47.763665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.092373+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:45:16.092373+0000","last_peered":"2024-04-24T01:45:16.092373+0000","last_clean":"2024-04-24T01:45:16.092373+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:45:16.092373+0000","last_undegraded":"2024-04-24T01:45:16.092373+0000","last_fullsized":"2024-04-24T01:45:16.092373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351889+0000","last_change":"2024-04-24T01:42:42.779597+0000","last_active":"2024-04-24T01:45:50.351889+0000","last_peered":"2024-04-24T01:45:50.351889+0000","last_clean":"2024-04-24T01:45:50.351889+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:45:50.351889+0000","last_undegraded":"2024-04-24T01:45:50.351889+0000","last_fullsized":"2024-04-24T01:45:50.351889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.260690+0000","last_change":"2024-04-24T01:42:40.789710+0000","last_active":"2024-04-24T01:45:50.260690+0000","last_peered":"2024-04-24T01:45:50.260690+0000","last_clean":"2024-04-24T01:45:50.260690+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:45:50.260690+0000","last_undegraded":"2024-04-24T01:45:50.260690+0000","last_fullsized":"2024-04-24T01:45:50.260690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.549193+0000","last_change":"2024-04-24T01:46:07.549244+0000","last_active":"2024-04-24T01:46:07.549193+0000","last_peered":"2024-04-24T01:46:07.549193+0000","last_clean":"2024-04-24T01:46:07.549193+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:46:07.549193+0000","last_undegraded":"2024-04-24T01:46:07.549193+0000","last_fullsized":"2024-04-24T01:46:07.549193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.549082+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:53.170383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.940011+0000","last_change":"2024-04-24T01:42:46.782978+0000","last_active":"2024-04-24T01:45:56.940011+0000","last_peered":"2024-04-24T01:45:56.940011+0000","last_clean":"2024-04-24T01:45:56.940011+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:45:56.940011+0000","last_undegraded":"2024-04-24T01:45:56.940011+0000","last_fullsized":"2024-04-24T01:45:56.940011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:45.761017+0000","last_clean_scrub_stamp":"2024-04-24T01:42:45.761017+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.233029+0000","last_change":"2024-04-24T01:46:05.233070+0000","last_active":"2024-04-24T01:46:05.233029+0000","last_peered":"2024-04-24T01:46:05.233029+0000","last_clean":"2024-04-24T01:46:05.233029+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:46:05.233029+0000","last_undegraded":"2024-04-24T01:46:05.233029+0000","last_fullsized":"2024-04-24T01:46:05.233029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.232926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:34.699770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091436+0000","last_change":"2024-04-24T01:42:50.800862+0000","last_active":"2024-04-24T01:45:11.091436+0000","last_peered":"2024-04-24T01:45:11.091436+0000","last_clean":"2024-04-24T01:45:11.091436+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:45:11.091436+0000","last_undegraded":"2024-04-24T01:45:11.091436+0000","last_fullsized":"2024-04-24T01:45:11.091436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399486+0000","last_change":"2024-04-24T01:42:42.791052+0000","last_active":"2024-04-24T01:45:50.399486+0000","last_peered":"2024-04-24T01:45:50.399486+0000","last_clean":"2024-04-24T01:45:50.399486+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:45:50.399486+0000","last_undegraded":"2024-04-24T01:45:50.399486+0000","last_fullsized":"2024-04-24T01:45:50.399486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.960048+0000","last_change":"2024-04-24T01:42:40.778401+0000","last_active":"2024-04-24T01:45:56.960048+0000","last_peered":"2024-04-24T01:45:56.960048+0000","last_clean":"2024-04-24T01:45:56.960048+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:45:56.960048+0000","last_undegraded":"2024-04-24T01:45:56.960048+0000","last_fullsized":"2024-04-24T01:45:56.960048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321634+0000","last_change":"2024-04-24T01:42:42.779808+0000","last_active":"2024-04-24T01:45:50.321634+0000","last_peered":"2024-04-24T01:45:50.321634+0000","last_clean":"2024-04-24T01:45:50.321634+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:45:50.321634+0000","last_undegraded":"2024-04-24T01:45:50.321634+0000","last_fullsized":"2024-04-24T01:45:50.321634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082506+0000","last_change":"2024-04-24T01:42:40.781020+0000","last_active":"2024-04-24T01:44:49.082506+0000","last_peered":"2024-04-24T01:44:49.082506+0000","last_clean":"2024-04-24T01:44:49.082506+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:44:49.082506+0000","last_undegraded":"2024-04-24T01:44:49.082506+0000","last_fullsized":"2024-04-24T01:44:49.082506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'21","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.397831+0000","last_change":"2024-04-24T01:42:42.782200+0000","last_active":"2024-04-24T01:45:50.397831+0000","last_peered":"2024-04-24T01:45:50.397831+0000","last_clean":"2024-04-24T01:45:50.397831+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:45:50.397831+0000","last_undegraded":"2024-04-24T01:45:50.397831+0000","last_fullsized":"2024-04-24T01:45:50.397831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.027996+0000","last_change":"2024-04-24T01:42:40.785740+0000","last_active":"2024-04-24T01:45:50.027996+0000","last_peered":"2024-04-24T01:45:50.027996+0000","last_clean":"2024-04-24T01:45:50.027996+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:45:50.027996+0000","last_undegraded":"2024-04-24T01:45:50.027996+0000","last_fullsized":"2024-04-24T01:45:50.027996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321594+0000","last_change":"2024-04-24T01:42:42.775754+0000","last_active":"2024-04-24T01:45:50.321594+0000","last_peered":"2024-04-24T01:45:50.321594+0000","last_clean":"2024-04-24T01:45:50.321594+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:45:50.321594+0000","last_undegraded":"2024-04-24T01:45:50.321594+0000","last_fullsized":"2024-04-24T01:45:50.321594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082558+0000","last_change":"2024-04-24T01:42:40.768297+0000","last_active":"2024-04-24T01:44:49.082558+0000","last_peered":"2024-04-24T01:44:49.082558+0000","last_clean":"2024-04-24T01:44:49.082558+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:44:49.082558+0000","last_undegraded":"2024-04-24T01:44:49.082558+0000","last_fullsized":"2024-04-24T01:44:49.082558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082549+0000","last_change":"2024-04-24T01:42:42.790746+0000","last_active":"2024-04-24T01:44:49.082549+0000","last_peered":"2024-04-24T01:44:49.082549+0000","last_clean":"2024-04-24T01:44:49.082549+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:44:49.082549+0000","last_undegraded":"2024-04-24T01:44:49.082549+0000","last_fullsized":"2024-04-24T01:44:49.082549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083303+0000","last_change":"2024-04-24T01:42:40.778267+0000","last_active":"2024-04-24T01:44:54.083303+0000","last_peered":"2024-04-24T01:44:54.083303+0000","last_clean":"2024-04-24T01:44:54.083303+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:44:54.083303+0000","last_undegraded":"2024-04-24T01:44:54.083303+0000","last_fullsized":"2024-04-24T01:44:54.083303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087548+0000","last_change":"2024-04-24T01:42:42.783600+0000","last_active":"2024-04-24T01:44:51.087548+0000","last_peered":"2024-04-24T01:44:51.087548+0000","last_clean":"2024-04-24T01:44:51.087548+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:44:51.087548+0000","last_undegraded":"2024-04-24T01:44:51.087548+0000","last_fullsized":"2024-04-24T01:44:51.087548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087644+0000","last_change":"2024-04-24T01:42:40.792747+0000","last_active":"2024-04-24T01:44:51.087644+0000","last_peered":"2024-04-24T01:44:51.087644+0000","last_clean":"2024-04-24T01:44:51.087644+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:44:51.087644+0000","last_undegraded":"2024-04-24T01:44:51.087644+0000","last_fullsized":"2024-04-24T01:44:51.087644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082527+0000","last_change":"2024-04-24T01:42:42.783541+0000","last_active":"2024-04-24T01:44:49.082527+0000","last_peered":"2024-04-24T01:44:49.082527+0000","last_clean":"2024-04-24T01:44:49.082527+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:44:49.082527+0000","last_undegraded":"2024-04-24T01:44:49.082527+0000","last_fullsized":"2024-04-24T01:44:49.082527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087673+0000","last_change":"2024-04-24T01:42:40.784834+0000","last_active":"2024-04-24T01:44:51.087673+0000","last_peered":"2024-04-24T01:44:51.087673+0000","last_clean":"2024-04-24T01:44:51.087673+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:44:51.087673+0000","last_undegraded":"2024-04-24T01:44:51.087673+0000","last_fullsized":"2024-04-24T01:44:51.087673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087485+0000","last_change":"2024-04-24T01:42:42.784939+0000","last_active":"2024-04-24T01:44:51.087485+0000","last_peered":"2024-04-24T01:44:51.087485+0000","last_clean":"2024-04-24T01:44:51.087485+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:44:51.087485+0000","last_undegraded":"2024-04-24T01:44:51.087485+0000","last_fullsized":"2024-04-24T01:44:51.087485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.005222+0000","last_change":"2024-04-24T01:42:40.774338+0000","last_active":"2024-04-24T01:45:50.005222+0000","last_peered":"2024-04-24T01:45:50.005222+0000","last_clean":"2024-04-24T01:45:50.005222+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:45:50.005222+0000","last_undegraded":"2024-04-24T01:45:50.005222+0000","last_fullsized":"2024-04-24T01:45:50.005222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090235+0000","last_change":"2024-04-24T01:42:42.783518+0000","last_active":"2024-04-24T01:45:06.090235+0000","last_peered":"2024-04-24T01:45:06.090235+0000","last_clean":"2024-04-24T01:45:06.090235+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:45:06.090235+0000","last_undegraded":"2024-04-24T01:45:06.090235+0000","last_fullsized":"2024-04-24T01:45:06.090235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088025+0000","last_change":"2024-04-24T01:42:40.776220+0000","last_active":"2024-04-24T01:44:51.088025+0000","last_peered":"2024-04-24T01:44:51.088025+0000","last_clean":"2024-04-24T01:44:51.088025+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:44:51.088025+0000","last_undegraded":"2024-04-24T01:44:51.088025+0000","last_fullsized":"2024-04-24T01:44:51.088025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090710+0000","last_change":"2024-04-24T01:42:42.780704+0000","last_active":"2024-04-24T01:45:06.090710+0000","last_peered":"2024-04-24T01:45:06.090710+0000","last_clean":"2024-04-24T01:45:06.090710+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:45:06.090710+0000","last_undegraded":"2024-04-24T01:45:06.090710+0000","last_fullsized":"2024-04-24T01:45:06.090710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084049+0000","last_change":"2024-04-24T01:42:40.774379+0000","last_active":"2024-04-24T01:44:59.084049+0000","last_peered":"2024-04-24T01:44:59.084049+0000","last_clean":"2024-04-24T01:44:59.084049+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:44:59.084049+0000","last_undegraded":"2024-04-24T01:44:59.084049+0000","last_fullsized":"2024-04-24T01:44:59.084049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.322022+0000","last_change":"2024-04-24T01:42:42.790910+0000","last_active":"2024-04-24T01:45:50.322022+0000","last_peered":"2024-04-24T01:45:50.322022+0000","last_clean":"2024-04-24T01:45:50.322022+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:45:50.322022+0000","last_undegraded":"2024-04-24T01:45:50.322022+0000","last_fullsized":"2024-04-24T01:45:50.322022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088374+0000","last_change":"2024-04-24T01:42:40.793467+0000","last_active":"2024-04-24T01:44:56.088374+0000","last_peered":"2024-04-24T01:44:56.088374+0000","last_clean":"2024-04-24T01:44:56.088374+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:44:56.088374+0000","last_undegraded":"2024-04-24T01:44:56.088374+0000","last_fullsized":"2024-04-24T01:44:56.088374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089299+0000","last_change":"2024-04-24T01:42:42.781172+0000","last_active":"2024-04-24T01:45:01.089299+0000","last_peered":"2024-04-24T01:45:01.089299+0000","last_clean":"2024-04-24T01:45:01.089299+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:45:01.089299+0000","last_undegraded":"2024-04-24T01:45:01.089299+0000","last_fullsized":"2024-04-24T01:45:01.089299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088414+0000","last_change":"2024-04-24T01:42:40.771155+0000","last_active":"2024-04-24T01:44:56.088414+0000","last_peered":"2024-04-24T01:44:56.088414+0000","last_clean":"2024-04-24T01:44:56.088414+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:44:56.088414+0000","last_undegraded":"2024-04-24T01:44:56.088414+0000","last_fullsized":"2024-04-24T01:44:56.088414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089259+0000","last_change":"2024-04-24T01:42:42.782402+0000","last_active":"2024-04-24T01:45:01.089259+0000","last_peered":"2024-04-24T01:45:01.089259+0000","last_clean":"2024-04-24T01:45:01.089259+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:45:01.089259+0000","last_undegraded":"2024-04-24T01:45:01.089259+0000","last_fullsized":"2024-04-24T01:45:01.089259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089024+0000","last_change":"2024-04-24T01:42:40.785750+0000","last_active":"2024-04-24T01:44:56.089024+0000","last_peered":"2024-04-24T01:44:56.089024+0000","last_clean":"2024-04-24T01:44:56.089024+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:44:56.089024+0000","last_undegraded":"2024-04-24T01:44:56.089024+0000","last_fullsized":"2024-04-24T01:44:56.089024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'11","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.397724+0000","last_change":"2024-04-24T01:42:42.783870+0000","last_active":"2024-04-24T01:45:50.397724+0000","last_peered":"2024-04-24T01:45:50.397724+0000","last_clean":"2024-04-24T01:45:50.397724+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:45:50.397724+0000","last_undegraded":"2024-04-24T01:45:50.397724+0000","last_fullsized":"2024-04-24T01:45:50.397724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.959191+0000","last_change":"2024-04-24T01:42:40.787075+0000","last_active":"2024-04-24T01:45:56.959191+0000","last_peered":"2024-04-24T01:45:56.959191+0000","last_clean":"2024-04-24T01:45:56.959191+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:45:56.959191+0000","last_undegraded":"2024-04-24T01:45:56.959191+0000","last_fullsized":"2024-04-24T01:45:56.959191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089763+0000","last_change":"2024-04-24T01:42:42.783035+0000","last_active":"2024-04-24T01:45:01.089763+0000","last_peered":"2024-04-24T01:45:01.089763+0000","last_clean":"2024-04-24T01:45:01.089763+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:45:01.089763+0000","last_undegraded":"2024-04-24T01:45:01.089763+0000","last_fullsized":"2024-04-24T01:45:01.089763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.959647+0000","last_change":"2024-04-24T01:42:40.780277+0000","last_active":"2024-04-24T01:45:56.959647+0000","last_peered":"2024-04-24T01:45:56.959647+0000","last_clean":"2024-04-24T01:45:56.959647+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:45:56.959647+0000","last_undegraded":"2024-04-24T01:45:56.959647+0000","last_fullsized":"2024-04-24T01:45:56.959647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.398585+0000","last_change":"2024-04-24T01:42:42.785135+0000","last_active":"2024-04-24T01:45:50.398585+0000","last_peered":"2024-04-24T01:45:50.398585+0000","last_clean":"2024-04-24T01:45:50.398585+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:45:50.398585+0000","last_undegraded":"2024-04-24T01:45:50.398585+0000","last_fullsized":"2024-04-24T01:45:50.398585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089944+0000","last_change":"2024-04-24T01:42:40.785768+0000","last_active":"2024-04-24T01:45:01.089944+0000","last_peered":"2024-04-24T01:45:01.089944+0000","last_clean":"2024-04-24T01:45:01.089944+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:45:01.089944+0000","last_undegraded":"2024-04-24T01:45:01.089944+0000","last_fullsized":"2024-04-24T01:45:01.089944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.960993+0000","last_change":"2024-04-24T01:42:40.778631+0000","last_active":"2024-04-24T01:45:56.960993+0000","last_peered":"2024-04-24T01:45:56.960993+0000","last_clean":"2024-04-24T01:45:56.960993+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:45:56.960993+0000","last_undegraded":"2024-04-24T01:45:56.960993+0000","last_fullsized":"2024-04-24T01:45:56.960993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.276553+0000","last_change":"2024-04-24T01:42:42.785218+0000","last_active":"2024-04-24T01:45:50.276553+0000","last_peered":"2024-04-24T01:45:50.276553+0000","last_clean":"2024-04-24T01:45:50.276553+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:45:50.276553+0000","last_undegraded":"2024-04-24T01:45:50.276553+0000","last_fullsized":"2024-04-24T01:45:50.276553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.959903+0000","last_change":"2024-04-24T01:42:40.781285+0000","last_active":"2024-04-24T01:45:56.959903+0000","last_peered":"2024-04-24T01:45:56.959903+0000","last_clean":"2024-04-24T01:45:56.959903+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:45:56.959903+0000","last_undegraded":"2024-04-24T01:45:56.959903+0000","last_fullsized":"2024-04-24T01:45:56.959903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.353570+0000","last_change":"2024-04-24T01:42:42.785126+0000","last_active":"2024-04-24T01:45:50.353570+0000","last_peered":"2024-04-24T01:45:50.353570+0000","last_clean":"2024-04-24T01:45:50.353570+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:45:50.353570+0000","last_undegraded":"2024-04-24T01:45:50.353570+0000","last_fullsized":"2024-04-24T01:45:50.353570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1709,"ondisk_log_size":1709,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640306,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":487424,"data_stored":151081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640307,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":737936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640306,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1036288,"data_stored":739109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":148048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:46:21.818 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.818 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.818 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.818 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.819 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.820 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.821 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.822 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.822 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.822 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.822 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.822 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.822 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.822 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.823 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.824 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.824 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.824 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.824 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.824 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.824 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.824 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.825 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.826 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T01:42:26.693124+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.827 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.828 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.829 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.830 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.831 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.832 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.833 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.834 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.835 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.835 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.835 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.835 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.835 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.835 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.835 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.836 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T01:42:47.763665+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=47, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.837 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-24T01:42:45.761017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=45, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.838 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.839 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.840 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.841 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.842 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.842 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.842 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:21.842 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:46:41.843 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:46:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.950+0000 7f8b9e027640 1 Processor -- start 2024-04-24T01:46:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.950+0000 7f8b9e027640 1 -- start start 2024-04-24T01:46:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.950+0000 7f8b9e027640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8b981287d0 0x7f8b98130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:41.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.950+0000 7f8b9e027640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b98127b00 con 0x7f8b98127ce0 2024-04-24T01:46:41.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.950+0000 7f8b9e027640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8b980708e0 con 0x7f8b981287d0 2024-04-24T01:46:41.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.951+0000 7f8b96ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8b981287d0 0x7f8b98130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:41.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.951+0000 7f8b977fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8b98127ce0 0x7f8b981280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59680/0 (socket says 172.21.15.107:59680) 2024-04-24T01:46:41.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.951+0000 7f8b977fe640 1 -- 172.21.15.107:0/1594556328 learned_addr learned my addr 172.21.15.107:0/1594556328 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:46:41.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.951+0000 7f8b96ffd640 1 -- 172.21.15.107:0/1594556328 >> v1:172.21.15.107:6789/0 conn(0x7f8b98127ce0 legacy=0x7f8b981280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:41.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.951+0000 7f8b96ffd640 1 -- 172.21.15.107:0/1594556328 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b98098800 con 0x7f8b981287d0 2024-04-24T01:46:41.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b96ffd640 1 --2- 172.21.15.107:0/1594556328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b981287d0 0x7f8b98130360 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009750 tx=0x7f8b8c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa27b758a26dd47 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b967fc640 1 -- 172.21.15.107:0/1594556328 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0316d0 con 0x7f8b981287d0 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b967fc640 1 -- 172.21.15.107:0/1594556328 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c037070 con 0x7f8b981287d0 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b967fc640 1 -- 172.21.15.107:0/1594556328 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0319c0 con 0x7f8b981287d0 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b9e027640 1 -- 172.21.15.107:0/1594556328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b981287d0 msgr2=0x7f8b98130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b9e027640 1 --2- 172.21.15.107:0/1594556328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b981287d0 0x7f8b98130360 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009750 tx=0x7f8b8c02b840 comp rx=0 tx=0).stop 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b9e027640 1 -- 172.21.15.107:0/1594556328 shutdown_connections 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b9e027640 1 --2- 172.21.15.107:0/1594556328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b981287d0 0x7f8b98130360 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b9e027640 1 -- 172.21.15.107:0/1594556328 >> 172.21.15.107:0/1594556328 conn(0x7f8b98099680 msgr2=0x7f8b98099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b9e027640 1 -- 172.21.15.107:0/1594556328 shutdown_connections 2024-04-24T01:46:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.952+0000 7f8b9e027640 1 -- 172.21.15.107:0/1594556328 wait complete. 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.953+0000 7f8b9e027640 1 Processor -- start 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.953+0000 7f8b9e027640 1 -- start start 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b9e027640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b98127ce0 0x7f8b98122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b9e027640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9806faa0 con 0x7f8b98127ce0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b977fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b98127ce0 0x7f8b98122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b977fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b98127ce0 0x7f8b98122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46614/0 (socket says 172.21.15.107:46614) 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b977fe640 1 -- 172.21.15.107:0/378217366 learned_addr learned my addr 172.21.15.107:0/378217366 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b977fe640 1 -- 172.21.15.107:0/378217366 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b98130130 con 0x7f8b98127ce0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b977fe640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b98127ce0 0x7f8b98122e40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c380 tx=0x7f8b8800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b7ffff640 1 -- 172.21.15.107:0/378217366 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b88005c10 con 0x7f8b98127ce0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b7ffff640 1 -- 172.21.15.107:0/378217366 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b88005db0 con 0x7f8b98127ce0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b98125a50 con 0x7f8b98127ce0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b7ffff640 1 -- 172.21.15.107:0/378217366 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b88004930 con 0x7f8b98127ce0 2024-04-24T01:46:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.954+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b98123380 con 0x7f8b98127ce0 2024-04-24T01:46:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.955+0000 7f8b7ffff640 1 -- 172.21.15.107:0/378217366 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b8801a020 con 0x7f8b98127ce0 2024-04-24T01:46:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.955+0000 7f8b7ffff640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8b84038060 0x7f8b8403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:46:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.955+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b98062da0 con 0x7f8b98127ce0 2024-04-24T01:46:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.956+0000 7f8b7ffff640 1 -- 172.21.15.107:0/378217366 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8b8804b210 con 0x7f8b98127ce0 2024-04-24T01:46:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.956+0000 7f8b96ffd640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8b84038060 0x7f8b8403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:46:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.956+0000 7f8b96ffd640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8b84038060 0x7f8b8403a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c036000 tx=0x7f8b8c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:46:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:41.960+0000 7f8b7ffff640 1 -- 172.21.15.107:0/378217366 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f8b98127b00 con 0x7f8b98127ce0 2024-04-24T01:46:42.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.133+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b98124920 con 0x7f8b84038060 2024-04-24T01:46:42.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.148+0000 7f8b7ffff640 1 -- 172.21.15.107:0/378217366 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662081 (secure 0 0 0) 0x7f8b98124920 con 0x7f8b84038060 2024-04-24T01:46:42.157 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:46:42.163 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:46:42.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8b84038060 msgr2=0x7f8b8403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:42.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8b84038060 0x7f8b8403a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c036000 tx=0x7f8b8c008030 comp rx=0 tx=0).stop 2024-04-24T01:46:42.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b98127ce0 msgr2=0x7f8b98122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:46:42.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b98127ce0 0x7f8b98122e40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c380 tx=0x7f8b8800c840 comp rx=0 tx=0).stop 2024-04-24T01:46:42.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 shutdown_connections 2024-04-24T01:46:42.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f8b84038060 0x7f8b8403a520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:42.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 --2- 172.21.15.107:0/378217366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b98127ce0 0x7f8b98122e40 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:46:42.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 >> 172.21.15.107:0/378217366 conn(0x7f8b98099680 msgr2=0x7f8b9812b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:46:42.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 shutdown_connections 2024-04-24T01:46:42.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:46:42.153+0000 7f8b9e027640 1 -- 172.21.15.107:0/378217366 wait complete. 2024-04-24T01:46:42.166 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-24T01:46:42.080541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5393,"num_read_kb":4942,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4996,"ondisk_log_size":4996,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160888,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326472,"statfs":{"total":386547056640,"available":386382307328,"internally_reserved":0,"allocated":2973696,"data_stored":1776174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1488,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003665"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.883646+0000","last_change":"2024-04-24T01:46:35.883674+0000","last_active":"2024-04-24T01:46:35.883646+0000","last_peered":"2024-04-24T01:46:35.883646+0000","last_clean":"2024-04-24T01:46:35.883646+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:46:35.883646+0000","last_undegraded":"2024-04-24T01:46:35.883646+0000","last_fullsized":"2024-04-24T01:46:35.883646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.883557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:30.324934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.691836+0000","last_change":"2024-04-24T01:46:22.691864+0000","last_active":"2024-04-24T01:46:22.691836+0000","last_peered":"2024-04-24T01:46:22.691836+0000","last_clean":"2024-04-24T01:46:22.691836+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:46:22.691836+0000","last_undegraded":"2024-04-24T01:46:22.691836+0000","last_fullsized":"2024-04-24T01:46:22.691836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.691735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:31.620109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.959718+0000","last_change":"2024-04-24T01:42:40.769679+0000","last_active":"2024-04-24T01:45:56.959718+0000","last_peered":"2024-04-24T01:45:56.959718+0000","last_clean":"2024-04-24T01:45:56.959718+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:45:56.959718+0000","last_undegraded":"2024-04-24T01:45:56.959718+0000","last_fullsized":"2024-04-24T01:45:56.959718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.050907+0000","last_change":"2024-04-24T01:42:42.780099+0000","last_active":"2024-04-24T01:45:50.050907+0000","last_peered":"2024-04-24T01:45:50.050907+0000","last_clean":"2024-04-24T01:45:50.050907+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:45:50.050907+0000","last_undegraded":"2024-04-24T01:45:50.050907+0000","last_fullsized":"2024-04-24T01:45:50.050907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.087469+0000","last_change":"2024-04-24T01:42:40.787360+0000","last_active":"2024-04-24T01:44:46.087469+0000","last_peered":"2024-04-24T01:44:46.087469+0000","last_clean":"2024-04-24T01:44:46.087469+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:44:46.087469+0000","last_undegraded":"2024-04-24T01:44:46.087469+0000","last_fullsized":"2024-04-24T01:44:46.087469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.321947+0000","last_change":"2024-04-24T01:42:42.777928+0000","last_active":"2024-04-24T01:45:50.321947+0000","last_peered":"2024-04-24T01:45:50.321947+0000","last_clean":"2024-04-24T01:45:50.321947+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:45:50.321947+0000","last_undegraded":"2024-04-24T01:45:50.321947+0000","last_fullsized":"2024-04-24T01:45:50.321947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.658407+0000","last_change":"2024-04-24T01:42:40.777293+0000","last_active":"2024-04-24T01:46:00.658407+0000","last_peered":"2024-04-24T01:46:00.658407+0000","last_clean":"2024-04-24T01:46:00.658407+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:46:00.658407+0000","last_undegraded":"2024-04-24T01:46:00.658407+0000","last_fullsized":"2024-04-24T01:46:00.658407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.454620+0000","last_change":"2024-04-24T01:46:40.454678+0000","last_active":"2024-04-24T01:46:40.454620+0000","last_peered":"2024-04-24T01:46:40.454620+0000","last_clean":"2024-04-24T01:46:40.454620+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:46:40.454620+0000","last_undegraded":"2024-04-24T01:46:40.454620+0000","last_fullsized":"2024-04-24T01:46:40.454620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.454492+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:29.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.254982+0000","last_change":"2024-04-24T01:42:40.787185+0000","last_active":"2024-04-24T01:45:50.254982+0000","last_peered":"2024-04-24T01:45:50.254982+0000","last_clean":"2024-04-24T01:45:50.254982+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:45:50.254982+0000","last_undegraded":"2024-04-24T01:45:50.254982+0000","last_fullsized":"2024-04-24T01:45:50.254982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399460+0000","last_change":"2024-04-24T01:42:42.783384+0000","last_active":"2024-04-24T01:45:50.399460+0000","last_peered":"2024-04-24T01:45:50.399460+0000","last_clean":"2024-04-24T01:45:50.399460+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:45:50.399460+0000","last_undegraded":"2024-04-24T01:45:50.399460+0000","last_fullsized":"2024-04-24T01:45:50.399460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090710+0000","last_change":"2024-04-24T01:42:40.775908+0000","last_active":"2024-04-24T01:45:11.090710+0000","last_peered":"2024-04-24T01:45:11.090710+0000","last_clean":"2024-04-24T01:45:11.090710+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:45:11.090710+0000","last_undegraded":"2024-04-24T01:45:11.090710+0000","last_fullsized":"2024-04-24T01:45:11.090710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:31.093636+0000","last_change":"2024-04-24T01:43:21.820449+0000","last_active":"2024-04-24T01:45:31.093636+0000","last_peered":"2024-04-24T01:45:31.093636+0000","last_clean":"2024-04-24T01:45:31.093636+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:45:31.093636+0000","last_undegraded":"2024-04-24T01:45:31.093636+0000","last_fullsized":"2024-04-24T01:45:31.093636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091348+0000","last_change":"2024-04-24T01:42:40.785983+0000","last_active":"2024-04-24T01:45:11.091348+0000","last_peered":"2024-04-24T01:45:11.091348+0000","last_clean":"2024-04-24T01:45:11.091348+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:45:11.091348+0000","last_undegraded":"2024-04-24T01:45:11.091348+0000","last_fullsized":"2024-04-24T01:45:11.091348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.812374+0000","last_change":"2024-04-24T01:46:30.812398+0000","last_active":"2024-04-24T01:46:30.812374+0000","last_peered":"2024-04-24T01:46:30.812374+0000","last_clean":"2024-04-24T01:46:30.812374+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:46:30.812374+0000","last_undegraded":"2024-04-24T01:46:30.812374+0000","last_fullsized":"2024-04-24T01:46:30.812374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.812254+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.118051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:14.086542+0000","last_change":"2024-04-24T01:42:40.778279+0000","last_active":"2024-04-24T01:45:14.086542+0000","last_peered":"2024-04-24T01:45:14.086542+0000","last_clean":"2024-04-24T01:45:14.086542+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:45:14.086542+0000","last_undegraded":"2024-04-24T01:45:14.086542+0000","last_fullsized":"2024-04-24T01:45:14.086542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.884780+0000","last_change":"2024-04-24T01:46:34.884806+0000","last_active":"2024-04-24T01:46:34.884780+0000","last_peered":"2024-04-24T01:46:34.884780+0000","last_clean":"2024-04-24T01:46:34.884780+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:46:34.884780+0000","last_undegraded":"2024-04-24T01:46:34.884780+0000","last_fullsized":"2024-04-24T01:46:34.884780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.884693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:45.893272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.279425+0000","last_change":"2024-04-24T01:42:42.779841+0000","last_active":"2024-04-24T01:45:50.279425+0000","last_peered":"2024-04-24T01:45:50.279425+0000","last_clean":"2024-04-24T01:45:50.279425+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:45:50.279425+0000","last_undegraded":"2024-04-24T01:45:50.279425+0000","last_fullsized":"2024-04-24T01:45:50.279425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090220+0000","last_change":"2024-04-24T01:42:40.791488+0000","last_active":"2024-04-24T01:45:06.090220+0000","last_peered":"2024-04-24T01:45:06.090220+0000","last_clean":"2024-04-24T01:45:06.090220+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:45:06.090220+0000","last_undegraded":"2024-04-24T01:45:06.090220+0000","last_fullsized":"2024-04-24T01:45:06.090220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.624628+0000","last_change":"2024-04-24T01:46:34.624679+0000","last_active":"2024-04-24T01:46:34.624628+0000","last_peered":"2024-04-24T01:46:34.624628+0000","last_clean":"2024-04-24T01:46:34.624628+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:46:34.624628+0000","last_undegraded":"2024-04-24T01:46:34.624628+0000","last_fullsized":"2024-04-24T01:46:34.624628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.624511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:48.418934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.772525+0000","last_change":"2024-04-24T01:46:29.772551+0000","last_active":"2024-04-24T01:46:29.772525+0000","last_peered":"2024-04-24T01:46:29.772525+0000","last_clean":"2024-04-24T01:46:29.772525+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:46:29.772525+0000","last_undegraded":"2024-04-24T01:46:29.772525+0000","last_fullsized":"2024-04-24T01:46:29.772525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.772438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:56.532007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.399440+0000","last_change":"2024-04-24T01:42:42.783807+0000","last_active":"2024-04-24T01:45:50.399440+0000","last_peered":"2024-04-24T01:45:50.399440+0000","last_clean":"2024-04-24T01:45:50.399440+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:45:50.399440+0000","last_undegraded":"2024-04-24T01:45:50.399440+0000","last_fullsized":"2024-04-24T01:45:50.399440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.573920+0000","last_change":"2024-04-24T01:46:39.573948+0000","last_active":"2024-04-24T01:46:39.573920+0000","last_peered":"2024-04-24T01:46:39.573920+0000","last_clean":"2024-04-24T01:46:39.573920+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:46:39.573920+0000","last_undegraded":"2024-04-24T01:46:39.573920+0000","last_fullsized":"2024-04-24T01:46:39.573920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.573832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:44.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.111312+0000","last_change":"2024-04-24T01:46:28.111336+0000","last_active":"2024-04-24T01:46:28.111312+0000","last_peered":"2024-04-24T01:46:28.111312+0000","last_clean":"2024-04-24T01:46:28.111312+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:46:28.111312+0000","last_undegraded":"2024-04-24T01:46:28.111312+0000","last_fullsized":"2024-04-24T01:46:28.111312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.111230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:02.142302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090116+0000","last_change":"2024-04-24T01:42:40.782750+0000","last_active":"2024-04-24T01:45:06.090116+0000","last_peered":"2024-04-24T01:45:06.090116+0000","last_clean":"2024-04-24T01:45:06.090116+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:45:06.090116+0000","last_undegraded":"2024-04-24T01:45:06.090116+0000","last_fullsized":"2024-04-24T01:45:06.090116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.277100+0000","last_change":"2024-04-24T01:42:42.790992+0000","last_active":"2024-04-24T01:45:50.277100+0000","last_peered":"2024-04-24T01:45:50.277100+0000","last_clean":"2024-04-24T01:45:50.277100+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:45:50.277100+0000","last_undegraded":"2024-04-24T01:45:50.277100+0000","last_fullsized":"2024-04-24T01:45:50.277100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:09.085684+0000","last_change":"2024-04-24T01:42:40.769585+0000","last_active":"2024-04-24T01:45:09.085684+0000","last_peered":"2024-04-24T01:45:09.085684+0000","last_clean":"2024-04-24T01:45:09.085684+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:45:09.085684+0000","last_undegraded":"2024-04-24T01:45:09.085684+0000","last_fullsized":"2024-04-24T01:45:09.085684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.792229+0000","last_change":"2024-04-24T01:46:27.792262+0000","last_active":"2024-04-24T01:46:27.792229+0000","last_peered":"2024-04-24T01:46:27.792229+0000","last_clean":"2024-04-24T01:46:27.792229+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:46:27.792229+0000","last_undegraded":"2024-04-24T01:46:27.792229+0000","last_fullsized":"2024-04-24T01:46:27.792229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.792141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:43.543336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.342835+0000","last_change":"2024-04-24T01:42:40.786476+0000","last_active":"2024-04-24T01:45:50.342835+0000","last_peered":"2024-04-24T01:45:50.342835+0000","last_clean":"2024-04-24T01:45:50.342835+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:45:50.342835+0000","last_undegraded":"2024-04-24T01:45:50.342835+0000","last_fullsized":"2024-04-24T01:45:50.342835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.362100+0000","last_change":"2024-04-24T01:42:50.802941+0000","last_active":"2024-04-24T01:45:50.362100+0000","last_peered":"2024-04-24T01:45:50.362100+0000","last_clean":"2024-04-24T01:45:50.362100+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:45:50.362100+0000","last_undegraded":"2024-04-24T01:45:50.362100+0000","last_fullsized":"2024-04-24T01:45:50.362100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.492346+0000","last_change":"2024-04-24T01:46:33.492406+0000","last_active":"2024-04-24T01:46:33.492346+0000","last_peered":"2024-04-24T01:46:33.492346+0000","last_clean":"2024-04-24T01:46:33.492346+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:46:33.492346+0000","last_undegraded":"2024-04-24T01:46:33.492346+0000","last_fullsized":"2024-04-24T01:46:33.492346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.492233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:04.065546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089818+0000","last_change":"2024-04-24T01:42:40.791802+0000","last_active":"2024-04-24T01:45:01.089818+0000","last_peered":"2024-04-24T01:45:01.089818+0000","last_clean":"2024-04-24T01:45:01.089818+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:45:01.089818+0000","last_undegraded":"2024-04-24T01:45:01.089818+0000","last_fullsized":"2024-04-24T01:45:01.089818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.152740+0000","last_change":"2024-04-24T01:46:01.152762+0000","last_active":"2024-04-24T01:46:01.152740+0000","last_peered":"2024-04-24T01:46:01.152740+0000","last_clean":"2024-04-24T01:46:01.152740+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:46:01.152740+0000","last_undegraded":"2024-04-24T01:46:01.152740+0000","last_fullsized":"2024-04-24T01:46:01.152740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.152654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:54.458451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":117,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.339667+0000","last_change":"2024-04-24T01:46:24.339700+0000","last_active":"2024-04-24T01:46:24.339667+0000","last_peered":"2024-04-24T01:46:24.339667+0000","last_clean":"2024-04-24T01:46:24.339667+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:46:24.339667+0000","last_undegraded":"2024-04-24T01:46:24.339667+0000","last_fullsized":"2024-04-24T01:46:24.339667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.339579+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:22.912549+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.697863+0000","last_change":"2024-04-24T01:46:20.697897+0000","last_active":"2024-04-24T01:46:20.697863+0000","last_peered":"2024-04-24T01:46:20.697863+0000","last_clean":"2024-04-24T01:46:20.697863+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:46:20.697863+0000","last_undegraded":"2024-04-24T01:46:20.697863+0000","last_fullsized":"2024-04-24T01:46:20.697863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.697714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:08.843035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091724+0000","last_change":"2024-04-24T01:42:50.802222+0000","last_active":"2024-04-24T01:45:16.091724+0000","last_peered":"2024-04-24T01:45:16.091724+0000","last_clean":"2024-04-24T01:45:16.091724+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:45:16.091724+0000","last_undegraded":"2024-04-24T01:45:16.091724+0000","last_fullsized":"2024-04-24T01:45:16.091724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.435384+0000","last_change":"2024-04-24T01:46:36.435421+0000","last_active":"2024-04-24T01:46:36.435384+0000","last_peered":"2024-04-24T01:46:36.435384+0000","last_clean":"2024-04-24T01:46:36.435384+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:46:36.435384+0000","last_undegraded":"2024-04-24T01:46:36.435384+0000","last_fullsized":"2024-04-24T01:46:36.435384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.435300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:00.290885+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.838674+0000","last_change":"2024-04-24T01:46:33.838724+0000","last_active":"2024-04-24T01:46:33.838674+0000","last_peered":"2024-04-24T01:46:33.838674+0000","last_clean":"2024-04-24T01:46:33.838674+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:46:33.838674+0000","last_undegraded":"2024-04-24T01:46:33.838674+0000","last_fullsized":"2024-04-24T01:46:33.838674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.838566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:49.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.293308+0000","last_change":"2024-04-24T01:46:19.293332+0000","last_active":"2024-04-24T01:46:19.293308+0000","last_peered":"2024-04-24T01:46:19.293308+0000","last_clean":"2024-04-24T01:46:19.293308+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:46:19.293308+0000","last_undegraded":"2024-04-24T01:46:19.293308+0000","last_fullsized":"2024-04-24T01:46:19.293308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.293213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:34.753066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.489009+0000","last_change":"2024-04-24T01:46:03.489046+0000","last_active":"2024-04-24T01:46:03.489009+0000","last_peered":"2024-04-24T01:46:03.489009+0000","last_clean":"2024-04-24T01:46:03.489009+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:46:03.489009+0000","last_undegraded":"2024-04-24T01:46:03.489009+0000","last_fullsized":"2024-04-24T01:46:03.489009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.488913+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:54.619923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.532812+0000","last_change":"2024-04-24T01:46:04.532851+0000","last_active":"2024-04-24T01:46:04.532812+0000","last_peered":"2024-04-24T01:46:04.532812+0000","last_clean":"2024-04-24T01:46:04.532812+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:46:04.532812+0000","last_undegraded":"2024-04-24T01:46:04.532812+0000","last_fullsized":"2024-04-24T01:46:04.532812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.532716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:21.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.048282+0000","last_change":"2024-04-24T01:42:50.793834+0000","last_active":"2024-04-24T01:45:50.048282+0000","last_peered":"2024-04-24T01:45:50.048282+0000","last_clean":"2024-04-24T01:45:50.048282+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:45:50.048282+0000","last_undegraded":"2024-04-24T01:45:50.048282+0000","last_fullsized":"2024-04-24T01:45:50.048282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'21","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.397912+0000","last_change":"2024-04-24T01:42:42.777752+0000","last_active":"2024-04-24T01:45:50.397912+0000","last_peered":"2024-04-24T01:45:50.397912+0000","last_clean":"2024-04-24T01:45:50.397912+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:45:50.397912+0000","last_undegraded":"2024-04-24T01:45:50.397912+0000","last_fullsized":"2024-04-24T01:45:50.397912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089744+0000","last_change":"2024-04-24T01:42:40.790240+0000","last_active":"2024-04-24T01:45:01.089744+0000","last_peered":"2024-04-24T01:45:01.089744+0000","last_clean":"2024-04-24T01:45:01.089744+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:45:01.089744+0000","last_undegraded":"2024-04-24T01:45:01.089744+0000","last_fullsized":"2024-04-24T01:45:01.089744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.183355+0000","last_change":"2024-04-24T01:46:15.183378+0000","last_active":"2024-04-24T01:46:15.183355+0000","last_peered":"2024-04-24T01:46:15.183355+0000","last_clean":"2024-04-24T01:46:15.183355+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:46:15.183355+0000","last_undegraded":"2024-04-24T01:46:15.183355+0000","last_fullsized":"2024-04-24T01:46:15.183355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.183254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:00.909604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.849954+0000","last_change":"2024-04-24T01:46:08.849993+0000","last_active":"2024-04-24T01:46:08.849954+0000","last_peered":"2024-04-24T01:46:08.849954+0000","last_clean":"2024-04-24T01:46:08.849954+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:46:08.849954+0000","last_undegraded":"2024-04-24T01:46:08.849954+0000","last_fullsized":"2024-04-24T01:46:08.849954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.849869+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:59.980879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":397,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.286885+0000","last_change":"2024-04-24T01:46:23.286945+0000","last_active":"2024-04-24T01:46:23.286885+0000","last_peered":"2024-04-24T01:46:23.286885+0000","last_clean":"2024-04-24T01:46:23.286885+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:46:23.286885+0000","last_undegraded":"2024-04-24T01:46:23.286885+0000","last_fullsized":"2024-04-24T01:46:23.286885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.286754+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:45:55.452597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:21.092323+0000","last_change":"2024-04-24T01:42:50.800444+0000","last_active":"2024-04-24T01:45:21.092323+0000","last_peered":"2024-04-24T01:45:21.092323+0000","last_clean":"2024-04-24T01:45:21.092323+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:45:21.092323+0000","last_undegraded":"2024-04-24T01:45:21.092323+0000","last_fullsized":"2024-04-24T01:45:21.092323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:09.085788+0000","last_change":"2024-04-24T01:42:42.785246+0000","last_active":"2024-04-24T01:45:09.085788+0000","last_peered":"2024-04-24T01:45:09.085788+0000","last_clean":"2024-04-24T01:45:09.085788+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:45:09.085788+0000","last_undegraded":"2024-04-24T01:45:09.085788+0000","last_fullsized":"2024-04-24T01:45:09.085788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089112+0000","last_change":"2024-04-24T01:42:40.791168+0000","last_active":"2024-04-24T01:45:01.089112+0000","last_peered":"2024-04-24T01:45:01.089112+0000","last_clean":"2024-04-24T01:45:01.089112+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:45:01.089112+0000","last_undegraded":"2024-04-24T01:45:01.089112+0000","last_fullsized":"2024-04-24T01:45:01.089112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.208983+0000","last_change":"2024-04-24T01:46:03.209024+0000","last_active":"2024-04-24T01:46:03.208983+0000","last_peered":"2024-04-24T01:46:03.208983+0000","last_clean":"2024-04-24T01:46:03.208983+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:46:03.208983+0000","last_undegraded":"2024-04-24T01:46:03.208983+0000","last_fullsized":"2024-04-24T01:46:03.208983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.208890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:44.835582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.856137+0000","last_change":"2024-04-24T01:46:05.856196+0000","last_active":"2024-04-24T01:46:05.856137+0000","last_peered":"2024-04-24T01:46:05.856137+0000","last_clean":"2024-04-24T01:46:05.856137+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:46:05.856137+0000","last_undegraded":"2024-04-24T01:46:05.856137+0000","last_fullsized":"2024-04-24T01:46:05.856137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.856052+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:35.561294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.187919+0000","last_change":"2024-04-24T01:46:06.187946+0000","last_active":"2024-04-24T01:46:06.187919+0000","last_peered":"2024-04-24T01:46:06.187919+0000","last_clean":"2024-04-24T01:46:06.187919+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:46:06.187919+0000","last_undegraded":"2024-04-24T01:46:06.187919+0000","last_fullsized":"2024-04-24T01:46:06.187919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.187813+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:35.370509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.287548+0000","last_change":"2024-04-24T01:46:17.287580+0000","last_active":"2024-04-24T01:46:17.287548+0000","last_peered":"2024-04-24T01:46:17.287548+0000","last_clean":"2024-04-24T01:46:17.287548+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:46:17.287548+0000","last_undegraded":"2024-04-24T01:46:17.287548+0000","last_fullsized":"2024-04-24T01:46:17.287548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.287452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:10.198303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.871524+0000","last_change":"2024-04-24T01:46:37.871548+0000","last_active":"2024-04-24T01:46:37.871524+0000","last_peered":"2024-04-24T01:46:37.871524+0000","last_clean":"2024-04-24T01:46:37.871524+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:46:37.871524+0000","last_undegraded":"2024-04-24T01:46:37.871524+0000","last_fullsized":"2024-04-24T01:46:37.871524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.871441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:18.210191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.610612+0000","last_change":"2024-04-24T01:46:10.610641+0000","last_active":"2024-04-24T01:46:10.610612+0000","last_peered":"2024-04-24T01:46:10.610612+0000","last_clean":"2024-04-24T01:46:10.610612+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:46:10.610612+0000","last_undegraded":"2024-04-24T01:46:10.610612+0000","last_fullsized":"2024-04-24T01:46:10.610612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.610513+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:05.321177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.823361+0000","last_change":"2024-04-24T01:46:11.823412+0000","last_active":"2024-04-24T01:46:11.823361+0000","last_peered":"2024-04-24T01:46:11.823361+0000","last_clean":"2024-04-24T01:46:11.823361+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:46:11.823361+0000","last_undegraded":"2024-04-24T01:46:11.823361+0000","last_fullsized":"2024-04-24T01:46:11.823361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.823285+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:43.489332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.206754+0000","last_change":"2024-04-24T01:46:03.206777+0000","last_active":"2024-04-24T01:46:03.206754+0000","last_peered":"2024-04-24T01:46:03.206754+0000","last_clean":"2024-04-24T01:46:03.206754+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:46:03.206754+0000","last_undegraded":"2024-04-24T01:46:03.206754+0000","last_fullsized":"2024-04-24T01:46:03.206754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.206669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:46.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088382+0000","last_change":"2024-04-24T01:42:50.799924+0000","last_active":"2024-04-24T01:44:56.088382+0000","last_peered":"2024-04-24T01:44:56.088382+0000","last_clean":"2024-04-24T01:44:56.088382+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:44:56.088382+0000","last_undegraded":"2024-04-24T01:44:56.088382+0000","last_fullsized":"2024-04-24T01:44:56.088382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.762268+0000","last_change":"2024-04-24T01:46:30.762304+0000","last_active":"2024-04-24T01:46:30.762268+0000","last_peered":"2024-04-24T01:46:30.762268+0000","last_clean":"2024-04-24T01:46:30.762268+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:46:30.762268+0000","last_undegraded":"2024-04-24T01:46:30.762268+0000","last_fullsized":"2024-04-24T01:46:30.762268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.762170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:25.539809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088431+0000","last_change":"2024-04-24T01:42:40.777460+0000","last_active":"2024-04-24T01:44:56.088431+0000","last_peered":"2024-04-24T01:44:56.088431+0000","last_clean":"2024-04-24T01:44:56.088431+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:44:56.088431+0000","last_undegraded":"2024-04-24T01:44:56.088431+0000","last_fullsized":"2024-04-24T01:44:56.088431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.170777+0000","last_change":"2024-04-24T01:46:23.170837+0000","last_active":"2024-04-24T01:46:23.170777+0000","last_peered":"2024-04-24T01:46:23.170777+0000","last_clean":"2024-04-24T01:46:23.170777+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:46:23.170777+0000","last_undegraded":"2024-04-24T01:46:23.170777+0000","last_fullsized":"2024-04-24T01:46:23.170777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.170664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:17.051548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'46","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.289839+0000","last_change":"2024-04-24T01:46:07.289877+0000","last_active":"2024-04-24T01:46:07.289839+0000","last_peered":"2024-04-24T01:46:07.289839+0000","last_clean":"2024-04-24T01:46:07.289839+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:46:07.289839+0000","last_undegraded":"2024-04-24T01:46:07.289839+0000","last_fullsized":"2024-04-24T01:46:07.289839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.289738+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:04.439196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.283569+0000","last_change":"2024-04-24T01:46:00.283592+0000","last_active":"2024-04-24T01:46:00.283569+0000","last_peered":"2024-04-24T01:46:00.283569+0000","last_clean":"2024-04-24T01:46:00.283569+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:46:00.283569+0000","last_undegraded":"2024-04-24T01:46:00.283569+0000","last_fullsized":"2024-04-24T01:46:00.283569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.283490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:35.270360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088488+0000","last_change":"2024-04-24T01:42:50.797194+0000","last_active":"2024-04-24T01:44:56.088488+0000","last_peered":"2024-04-24T01:44:56.088488+0000","last_clean":"2024-04-24T01:44:56.088488+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:44:56.088488+0000","last_undegraded":"2024-04-24T01:44:56.088488+0000","last_fullsized":"2024-04-24T01:44:56.088488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.848013+0000","last_change":"2024-04-24T01:46:36.848059+0000","last_active":"2024-04-24T01:46:36.848013+0000","last_peered":"2024-04-24T01:46:36.848013+0000","last_clean":"2024-04-24T01:46:36.848013+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:46:36.848013+0000","last_undegraded":"2024-04-24T01:46:36.848013+0000","last_fullsized":"2024-04-24T01:46:36.848013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.847905+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:33.997362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089105+0000","last_change":"2024-04-24T01:42:40.790278+0000","last_active":"2024-04-24T01:44:56.089105+0000","last_peered":"2024-04-24T01:44:56.089105+0000","last_clean":"2024-04-24T01:44:56.089105+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:44:56.089105+0000","last_undegraded":"2024-04-24T01:44:56.089105+0000","last_fullsized":"2024-04-24T01:44:56.089105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.256531+0000","last_change":"2024-04-24T01:46:20.256556+0000","last_active":"2024-04-24T01:46:20.256531+0000","last_peered":"2024-04-24T01:46:20.256531+0000","last_clean":"2024-04-24T01:46:20.256531+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:46:20.256531+0000","last_undegraded":"2024-04-24T01:46:20.256531+0000","last_fullsized":"2024-04-24T01:46:20.256531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.256445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:51.251216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'61","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.271123+0000","last_change":"2024-04-24T01:46:05.271175+0000","last_active":"2024-04-24T01:46:05.271123+0000","last_peered":"2024-04-24T01:46:05.271123+0000","last_clean":"2024-04-24T01:46:05.271123+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:46:05.271123+0000","last_undegraded":"2024-04-24T01:46:05.271123+0000","last_fullsized":"2024-04-24T01:46:05.271123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'61","last_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_deep_scrub":"34'61","last_deep_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.271031+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:16.279610+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.199454+0000","last_change":"2024-04-24T01:46:09.199480+0000","last_active":"2024-04-24T01:46:09.199454+0000","last_peered":"2024-04-24T01:46:09.199454+0000","last_clean":"2024-04-24T01:46:09.199454+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:46:09.199454+0000","last_undegraded":"2024-04-24T01:46:09.199454+0000","last_fullsized":"2024-04-24T01:46:09.199454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.199345+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:53.841686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:04.085064+0000","last_change":"2024-04-24T01:42:50.794892+0000","last_active":"2024-04-24T01:45:04.085064+0000","last_peered":"2024-04-24T01:45:04.085064+0000","last_clean":"2024-04-24T01:45:04.085064+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:45:04.085064+0000","last_undegraded":"2024-04-24T01:45:04.085064+0000","last_fullsized":"2024-04-24T01:45:04.085064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.692643+0000","last_change":"2024-04-24T01:46:25.692666+0000","last_active":"2024-04-24T01:46:25.692643+0000","last_peered":"2024-04-24T01:46:25.692643+0000","last_clean":"2024-04-24T01:46:25.692643+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:46:25.692643+0000","last_undegraded":"2024-04-24T01:46:25.692643+0000","last_fullsized":"2024-04-24T01:46:25.692643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.692556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:03:26.488607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089004+0000","last_change":"2024-04-24T01:42:40.776747+0000","last_active":"2024-04-24T01:44:56.089004+0000","last_peered":"2024-04-24T01:44:56.089004+0000","last_clean":"2024-04-24T01:44:56.089004+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:44:56.089004+0000","last_undegraded":"2024-04-24T01:44:56.089004+0000","last_fullsized":"2024-04-24T01:44:56.089004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.205515+0000","last_change":"2024-04-24T01:46:22.205537+0000","last_active":"2024-04-24T01:46:22.205515+0000","last_peered":"2024-04-24T01:46:22.205515+0000","last_clean":"2024-04-24T01:46:22.205515+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:46:22.205515+0000","last_undegraded":"2024-04-24T01:46:22.205515+0000","last_fullsized":"2024-04-24T01:46:22.205515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.205433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:02.910528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'77","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.298350+0000","last_change":"2024-04-24T01:46:15.298393+0000","last_active":"2024-04-24T01:46:15.298350+0000","last_peered":"2024-04-24T01:46:15.298350+0000","last_clean":"2024-04-24T01:46:15.298350+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:46:15.298350+0000","last_undegraded":"2024-04-24T01:46:15.298350+0000","last_fullsized":"2024-04-24T01:46:15.298350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.298262+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:33.449711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.165926+0000","last_change":"2024-04-24T01:46:25.165949+0000","last_active":"2024-04-24T01:46:25.165926+0000","last_peered":"2024-04-24T01:46:25.165926+0000","last_clean":"2024-04-24T01:46:25.165926+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:46:25.165926+0000","last_undegraded":"2024-04-24T01:46:25.165926+0000","last_fullsized":"2024-04-24T01:46:25.165926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.165833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:38.566634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.446144+0000","last_change":"2024-04-24T01:42:50.802460+0000","last_active":"2024-04-24T01:45:50.446144+0000","last_peered":"2024-04-24T01:45:50.446144+0000","last_clean":"2024-04-24T01:45:50.446144+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:45:50.446144+0000","last_undegraded":"2024-04-24T01:45:50.446144+0000","last_fullsized":"2024-04-24T01:45:50.446144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.322017+0000","last_change":"2024-04-24T01:42:42.783715+0000","last_active":"2024-04-24T01:45:50.322017+0000","last_peered":"2024-04-24T01:45:50.322017+0000","last_clean":"2024-04-24T01:45:50.322017+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:45:50.322017+0000","last_undegraded":"2024-04-24T01:45:50.322017+0000","last_fullsized":"2024-04-24T01:45:50.322017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.003664+0000","last_change":"2024-04-24T01:46:38.003689+0000","last_active":"2024-04-24T01:46:38.003664+0000","last_peered":"2024-04-24T01:46:38.003664+0000","last_clean":"2024-04-24T01:46:38.003664+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:46:38.003664+0000","last_undegraded":"2024-04-24T01:46:38.003664+0000","last_fullsized":"2024-04-24T01:46:38.003664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.003576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:03.732204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.833874+0000","last_change":"2024-04-24T01:46:16.833895+0000","last_active":"2024-04-24T01:46:16.833874+0000","last_peered":"2024-04-24T01:46:16.833874+0000","last_clean":"2024-04-24T01:46:16.833874+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:46:16.833874+0000","last_undegraded":"2024-04-24T01:46:16.833874+0000","last_fullsized":"2024-04-24T01:46:16.833874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.833759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:04.866593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.517297+0000","last_change":"2024-04-24T01:46:05.517337+0000","last_active":"2024-04-24T01:46:05.517297+0000","last_peered":"2024-04-24T01:46:05.517297+0000","last_clean":"2024-04-24T01:46:05.517297+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:46:05.517297+0000","last_undegraded":"2024-04-24T01:46:05.517297+0000","last_fullsized":"2024-04-24T01:46:05.517297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.517182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.149356+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.480572+0000","last_change":"2024-04-24T01:46:35.480613+0000","last_active":"2024-04-24T01:46:35.480572+0000","last_peered":"2024-04-24T01:46:35.480572+0000","last_clean":"2024-04-24T01:46:35.480572+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:46:35.480572+0000","last_undegraded":"2024-04-24T01:46:35.480572+0000","last_fullsized":"2024-04-24T01:46:35.480572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.480455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:57.552982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.402369+0000","last_change":"2024-04-24T01:42:50.799183+0000","last_active":"2024-04-24T01:45:50.402369+0000","last_peered":"2024-04-24T01:45:50.402369+0000","last_clean":"2024-04-24T01:45:50.402369+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:45:50.402369+0000","last_undegraded":"2024-04-24T01:45:50.402369+0000","last_fullsized":"2024-04-24T01:45:50.402369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.469267+0000","last_change":"2024-04-24T01:46:37.469297+0000","last_active":"2024-04-24T01:46:37.469267+0000","last_peered":"2024-04-24T01:46:37.469267+0000","last_clean":"2024-04-24T01:46:37.469267+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:46:37.469267+0000","last_undegraded":"2024-04-24T01:46:37.469267+0000","last_fullsized":"2024-04-24T01:46:37.469267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.469176+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:59.897731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088168+0000","last_change":"2024-04-24T01:42:40.790965+0000","last_active":"2024-04-24T01:44:51.088168+0000","last_peered":"2024-04-24T01:44:51.088168+0000","last_clean":"2024-04-24T01:44:51.088168+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:44:51.088168+0000","last_undegraded":"2024-04-24T01:44:51.088168+0000","last_fullsized":"2024-04-24T01:44:51.088168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.269181+0000","last_change":"2024-04-24T01:46:18.269204+0000","last_active":"2024-04-24T01:46:18.269181+0000","last_peered":"2024-04-24T01:46:18.269181+0000","last_clean":"2024-04-24T01:46:18.269181+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:46:18.269181+0000","last_undegraded":"2024-04-24T01:46:18.269181+0000","last_fullsized":"2024-04-24T01:46:18.269181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.269076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:04.262085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.851173+0000","last_change":"2024-04-24T01:46:13.851216+0000","last_active":"2024-04-24T01:46:13.851173+0000","last_peered":"2024-04-24T01:46:13.851173+0000","last_clean":"2024-04-24T01:46:13.851173+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:46:13.851173+0000","last_undegraded":"2024-04-24T01:46:13.851173+0000","last_fullsized":"2024-04-24T01:46:13.851173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.851090+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:47.344034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.859142+0000","last_change":"2024-04-24T01:46:10.859209+0000","last_active":"2024-04-24T01:46:10.859142+0000","last_peered":"2024-04-24T01:46:10.859142+0000","last_clean":"2024-04-24T01:46:10.859142+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:46:10.859142+0000","last_undegraded":"2024-04-24T01:46:10.859142+0000","last_fullsized":"2024-04-24T01:46:10.859142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.859037+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:04.491211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.404061+0000","last_change":"2024-04-24T01:42:50.793825+0000","last_active":"2024-04-24T01:45:50.404061+0000","last_peered":"2024-04-24T01:45:50.404061+0000","last_clean":"2024-04-24T01:45:50.404061+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:45:50.404061+0000","last_undegraded":"2024-04-24T01:45:50.404061+0000","last_fullsized":"2024-04-24T01:45:50.404061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.885308+0000","last_change":"2024-04-24T01:46:38.885337+0000","last_active":"2024-04-24T01:46:38.885308+0000","last_peered":"2024-04-24T01:46:38.885308+0000","last_clean":"2024-04-24T01:46:38.885308+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:46:38.885308+0000","last_undegraded":"2024-04-24T01:46:38.885308+0000","last_fullsized":"2024-04-24T01:46:38.885308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.885209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:47.529841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088100+0000","last_change":"2024-04-24T01:42:40.789191+0000","last_active":"2024-04-24T01:44:51.088100+0000","last_peered":"2024-04-24T01:44:51.088100+0000","last_clean":"2024-04-24T01:44:51.088100+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:44:51.088100+0000","last_undegraded":"2024-04-24T01:44:51.088100+0000","last_fullsized":"2024-04-24T01:44:51.088100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.615925+0000","last_change":"2024-04-24T01:46:14.615987+0000","last_active":"2024-04-24T01:46:14.615925+0000","last_peered":"2024-04-24T01:46:14.615925+0000","last_clean":"2024-04-24T01:46:14.615925+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:46:14.615925+0000","last_undegraded":"2024-04-24T01:46:14.615925+0000","last_fullsized":"2024-04-24T01:46:14.615925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.615812+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:51.435210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.266574+0000","last_change":"2024-04-24T01:46:13.266610+0000","last_active":"2024-04-24T01:46:13.266574+0000","last_peered":"2024-04-24T01:46:13.266574+0000","last_clean":"2024-04-24T01:46:13.266574+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:46:13.266574+0000","last_undegraded":"2024-04-24T01:46:13.266574+0000","last_fullsized":"2024-04-24T01:46:13.266574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.266484+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:40.059339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.594456+0000","last_change":"2024-04-24T01:46:08.594502+0000","last_active":"2024-04-24T01:46:08.594456+0000","last_peered":"2024-04-24T01:46:08.594456+0000","last_clean":"2024-04-24T01:46:08.594456+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:46:08.594456+0000","last_undegraded":"2024-04-24T01:46:08.594456+0000","last_fullsized":"2024-04-24T01:46:08.594456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.594330+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:42.087274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.815739+0000","last_change":"2024-04-24T01:46:22.815766+0000","last_active":"2024-04-24T01:46:22.815739+0000","last_peered":"2024-04-24T01:46:22.815739+0000","last_clean":"2024-04-24T01:46:22.815739+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:46:22.815739+0000","last_undegraded":"2024-04-24T01:46:22.815739+0000","last_fullsized":"2024-04-24T01:46:22.815739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.815603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:58.313433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.692939+0000","last_change":"2024-04-24T01:46:18.692968+0000","last_active":"2024-04-24T01:46:18.692939+0000","last_peered":"2024-04-24T01:46:18.692939+0000","last_clean":"2024-04-24T01:46:18.692939+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:46:18.692939+0000","last_undegraded":"2024-04-24T01:46:18.692939+0000","last_fullsized":"2024-04-24T01:46:18.692939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.692855+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:30.275139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088042+0000","last_change":"2024-04-24T01:42:40.787611+0000","last_active":"2024-04-24T01:44:51.088042+0000","last_peered":"2024-04-24T01:44:51.088042+0000","last_clean":"2024-04-24T01:44:51.088042+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:44:51.088042+0000","last_undegraded":"2024-04-24T01:44:51.088042+0000","last_fullsized":"2024-04-24T01:44:51.088042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.286609+0000","last_change":"2024-04-24T01:46:06.286638+0000","last_active":"2024-04-24T01:46:06.286609+0000","last_peered":"2024-04-24T01:46:06.286609+0000","last_clean":"2024-04-24T01:46:06.286609+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:46:06.286609+0000","last_undegraded":"2024-04-24T01:46:06.286609+0000","last_fullsized":"2024-04-24T01:46:06.286609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.286518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:00.727895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.470050+0000","last_change":"2024-04-24T01:46:02.470098+0000","last_active":"2024-04-24T01:46:02.470050+0000","last_peered":"2024-04-24T01:46:02.470050+0000","last_clean":"2024-04-24T01:46:02.470050+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:46:02.470050+0000","last_undegraded":"2024-04-24T01:46:02.470050+0000","last_fullsized":"2024-04-24T01:46:02.470050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.469953+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:28.856113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.853399+0000","last_change":"2024-04-24T01:46:00.853423+0000","last_active":"2024-04-24T01:46:00.853399+0000","last_peered":"2024-04-24T01:46:00.853399+0000","last_clean":"2024-04-24T01:46:00.853399+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:46:00.853399+0000","last_undegraded":"2024-04-24T01:46:00.853399+0000","last_fullsized":"2024-04-24T01:46:00.853399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.853310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:00.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.444511+0000","last_change":"2024-04-24T01:42:50.798885+0000","last_active":"2024-04-24T01:45:50.444511+0000","last_peered":"2024-04-24T01:45:50.444511+0000","last_clean":"2024-04-24T01:45:50.444511+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:45:50.444511+0000","last_undegraded":"2024-04-24T01:45:50.444511+0000","last_fullsized":"2024-04-24T01:45:50.444511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.335856+0000","last_change":"2024-04-24T01:46:16.335882+0000","last_active":"2024-04-24T01:46:16.335856+0000","last_peered":"2024-04-24T01:46:16.335856+0000","last_clean":"2024-04-24T01:46:16.335856+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:46:16.335856+0000","last_undegraded":"2024-04-24T01:46:16.335856+0000","last_fullsized":"2024-04-24T01:46:16.335856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.335729+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:21.641635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.236699+0000","last_change":"2024-04-24T01:42:28.081179+0000","last_active":"2024-04-24T01:46:00.236699+0000","last_peered":"2024-04-24T01:46:00.236699+0000","last_clean":"2024-04-24T01:46:00.236699+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:46:00.236699+0000","last_undegraded":"2024-04-24T01:46:00.236699+0000","last_fullsized":"2024-04-24T01:46:00.236699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:26.693124+0000","last_clean_scrub_stamp":"2024-04-24T01:42:26.693124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:41.086685+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:44:41.086685+0000","last_peered":"2024-04-24T01:44:41.086685+0000","last_clean":"2024-04-24T01:44:41.086685+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:44:41.086685+0000","last_undegraded":"2024-04-24T01:44:41.086685+0000","last_fullsized":"2024-04-24T01:44:41.086685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.087409+0000","last_change":"2024-04-24T01:42:40.787192+0000","last_active":"2024-04-24T01:44:46.087409+0000","last_peered":"2024-04-24T01:44:46.087409+0000","last_clean":"2024-04-24T01:44:46.087409+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:44:46.087409+0000","last_undegraded":"2024-04-24T01:44:46.087409+0000","last_fullsized":"2024-04-24T01:44:46.087409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.646324+0000","last_change":"2024-04-24T01:46:15.646347+0000","last_active":"2024-04-24T01:46:15.646324+0000","last_peered":"2024-04-24T01:46:15.646324+0000","last_clean":"2024-04-24T01:46:15.646324+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:46:15.646324+0000","last_undegraded":"2024-04-24T01:46:15.646324+0000","last_fullsized":"2024-04-24T01:46:15.646324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.646240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:26.583381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.349875+0000","last_change":"2024-04-24T01:46:26.349962+0000","last_active":"2024-04-24T01:46:26.349875+0000","last_peered":"2024-04-24T01:46:26.349875+0000","last_clean":"2024-04-24T01:46:26.349875+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:46:26.349875+0000","last_undegraded":"2024-04-24T01:46:26.349875+0000","last_fullsized":"2024-04-24T01:46:26.349875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.349769+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:50.261205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.235082+0000","last_change":"2024-04-24T01:46:21.235121+0000","last_active":"2024-04-24T01:46:21.235082+0000","last_peered":"2024-04-24T01:46:21.235082+0000","last_clean":"2024-04-24T01:46:21.235082+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:46:21.235082+0000","last_undegraded":"2024-04-24T01:46:21.235082+0000","last_fullsized":"2024-04-24T01:46:21.235082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.234980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:30.075365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.845155+0000","last_change":"2024-04-24T01:46:18.845179+0000","last_active":"2024-04-24T01:46:18.845155+0000","last_peered":"2024-04-24T01:46:18.845155+0000","last_clean":"2024-04-24T01:46:18.845155+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:46:18.845155+0000","last_undegraded":"2024-04-24T01:46:18.845155+0000","last_fullsized":"2024-04-24T01:46:18.845155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.845064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:59.328750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.474887+0000","last_change":"2024-04-24T01:46:34.474912+0000","last_active":"2024-04-24T01:46:34.474887+0000","last_peered":"2024-04-24T01:46:34.474887+0000","last_clean":"2024-04-24T01:46:34.474887+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:46:34.474887+0000","last_undegraded":"2024-04-24T01:46:34.474887+0000","last_fullsized":"2024-04-24T01:46:34.474887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.474793+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:55.055111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084057+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:46:01.084057+0000","last_peered":"2024-04-24T01:46:01.084057+0000","last_clean":"2024-04-24T01:46:01.084057+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:46:01.084057+0000","last_undegraded":"2024-04-24T01:46:01.084057+0000","last_fullsized":"2024-04-24T01:46:01.084057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.039588+0000","last_change":"2024-04-24T01:46:32.039612+0000","last_active":"2024-04-24T01:46:32.039588+0000","last_peered":"2024-04-24T01:46:32.039588+0000","last_clean":"2024-04-24T01:46:32.039588+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:46:32.039588+0000","last_undegraded":"2024-04-24T01:46:32.039588+0000","last_fullsized":"2024-04-24T01:46:32.039588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.039496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:14.657340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.202261+0000","last_change":"2024-04-24T01:46:02.202303+0000","last_active":"2024-04-24T01:46:02.202261+0000","last_peered":"2024-04-24T01:46:02.202261+0000","last_clean":"2024-04-24T01:46:02.202261+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:46:02.202261+0000","last_undegraded":"2024-04-24T01:46:02.202261+0000","last_fullsized":"2024-04-24T01:46:02.202261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.202137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:08.592288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":528,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.516027+0000","last_change":"2024-04-24T01:46:00.516075+0000","last_active":"2024-04-24T01:46:00.516027+0000","last_peered":"2024-04-24T01:46:00.516027+0000","last_clean":"2024-04-24T01:46:00.516027+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:46:00.516027+0000","last_undegraded":"2024-04-24T01:46:00.516027+0000","last_fullsized":"2024-04-24T01:46:00.516027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.515932+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:28.646371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.407172+0000","last_change":"2024-04-24T01:46:31.407195+0000","last_active":"2024-04-24T01:46:31.407172+0000","last_peered":"2024-04-24T01:46:31.407172+0000","last_clean":"2024-04-24T01:46:31.407172+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:46:31.407172+0000","last_undegraded":"2024-04-24T01:46:31.407172+0000","last_fullsized":"2024-04-24T01:46:31.407172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.407050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:50.586031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.812277+0000","last_change":"2024-04-24T01:46:28.812304+0000","last_active":"2024-04-24T01:46:28.812277+0000","last_peered":"2024-04-24T01:46:28.812277+0000","last_clean":"2024-04-24T01:46:28.812277+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:46:28.812277+0000","last_undegraded":"2024-04-24T01:46:28.812277+0000","last_fullsized":"2024-04-24T01:46:28.812277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.812185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:55.500501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083379+0000","last_change":"2024-04-24T01:42:42.783605+0000","last_active":"2024-04-24T01:44:54.083379+0000","last_peered":"2024-04-24T01:44:54.083379+0000","last_clean":"2024-04-24T01:44:54.083379+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:44:54.083379+0000","last_undegraded":"2024-04-24T01:44:54.083379+0000","last_fullsized":"2024-04-24T01:44:54.083379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.865588+0000","last_change":"2024-04-24T01:46:40.865588+0000","last_active":"2024-04-24T01:46:40.865588+0000","last_peered":"2024-04-24T01:46:40.865588+0000","last_clean":"2024-04-24T01:46:40.865588+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:46:40.865588+0000","last_undegraded":"2024-04-24T01:46:40.865588+0000","last_fullsized":"2024-04-24T01:46:40.865588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.865456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:54.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.257895+0000","last_change":"2024-04-24T01:42:40.769426+0000","last_active":"2024-04-24T01:45:50.257895+0000","last_peered":"2024-04-24T01:45:50.257895+0000","last_clean":"2024-04-24T01:45:50.257895+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:45:50.257895+0000","last_undegraded":"2024-04-24T01:45:50.257895+0000","last_fullsized":"2024-04-24T01:45:50.257895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.850355+0000","last_change":"2024-04-24T01:46:21.850406+0000","last_active":"2024-04-24T01:46:21.850355+0000","last_peered":"2024-04-24T01:46:21.850355+0000","last_clean":"2024-04-24T01:46:21.850355+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:46:21.850355+0000","last_undegraded":"2024-04-24T01:46:21.850355+0000","last_fullsized":"2024-04-24T01:46:21.850355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.850235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:05.283033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.865132+0000","last_change":"2024-04-24T01:46:09.865174+0000","last_active":"2024-04-24T01:46:09.865132+0000","last_peered":"2024-04-24T01:46:09.865132+0000","last_clean":"2024-04-24T01:46:09.865132+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:46:09.865132+0000","last_undegraded":"2024-04-24T01:46:09.865132+0000","last_fullsized":"2024-04-24T01:46:09.865132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.865033+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:26.768496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.219513+0000","last_change":"2024-04-24T01:46:17.219562+0000","last_active":"2024-04-24T01:46:17.219513+0000","last_peered":"2024-04-24T01:46:17.219513+0000","last_clean":"2024-04-24T01:46:17.219513+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:46:17.219513+0000","last_undegraded":"2024-04-24T01:46:17.219513+0000","last_fullsized":"2024-04-24T01:46:17.219513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.219377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:20.724218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090627+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:45:06.090627+0000","last_peered":"2024-04-24T01:45:06.090627+0000","last_clean":"2024-04-24T01:45:06.090627+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:45:06.090627+0000","last_undegraded":"2024-04-24T01:45:06.090627+0000","last_fullsized":"2024-04-24T01:45:06.090627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.084517+0000","last_change":"2024-04-24T01:46:31.084556+0000","last_active":"2024-04-24T01:46:31.084517+0000","last_peered":"2024-04-24T01:46:31.084517+0000","last_clean":"2024-04-24T01:46:31.084517+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:46:31.084517+0000","last_undegraded":"2024-04-24T01:46:31.084517+0000","last_fullsized":"2024-04-24T01:46:31.084517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.084413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:24.777154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084055+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:46:01.084055+0000","last_peered":"2024-04-24T01:46:01.084055+0000","last_clean":"2024-04-24T01:46:01.084055+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:46:01.084055+0000","last_undegraded":"2024-04-24T01:46:01.084055+0000","last_fullsized":"2024-04-24T01:46:01.084055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:46.086787+0000","last_change":"2024-04-24T01:42:40.769234+0000","last_active":"2024-04-24T01:44:46.086787+0000","last_peered":"2024-04-24T01:44:46.086787+0000","last_clean":"2024-04-24T01:44:46.086787+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:44:46.086787+0000","last_undegraded":"2024-04-24T01:44:46.086787+0000","last_fullsized":"2024-04-24T01:44:46.086787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.225215+0000","last_change":"2024-04-24T01:46:16.225235+0000","last_active":"2024-04-24T01:46:16.225215+0000","last_peered":"2024-04-24T01:46:16.225215+0000","last_clean":"2024-04-24T01:46:16.225215+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:46:16.225215+0000","last_undegraded":"2024-04-24T01:46:16.225215+0000","last_fullsized":"2024-04-24T01:46:16.225215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.225104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:22.216443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.361510+0000","last_change":"2024-04-24T01:46:29.361545+0000","last_active":"2024-04-24T01:46:29.361510+0000","last_peered":"2024-04-24T01:46:29.361510+0000","last_clean":"2024-04-24T01:46:29.361510+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:46:29.361510+0000","last_undegraded":"2024-04-24T01:46:29.361510+0000","last_fullsized":"2024-04-24T01:46:29.361510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.361431+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:30.282814+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.364954+0000","last_change":"2024-04-24T01:46:27.364979+0000","last_active":"2024-04-24T01:46:27.364954+0000","last_peered":"2024-04-24T01:46:27.364954+0000","last_clean":"2024-04-24T01:46:27.364954+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:46:27.364954+0000","last_undegraded":"2024-04-24T01:46:27.364954+0000","last_fullsized":"2024-04-24T01:46:27.364954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.364865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:11.158866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089149+0000","last_change":"2024-04-24T01:42:50.802434+0000","last_active":"2024-04-24T01:45:01.089149+0000","last_peered":"2024-04-24T01:45:01.089149+0000","last_clean":"2024-04-24T01:45:01.089149+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:45:01.089149+0000","last_undegraded":"2024-04-24T01:45:01.089149+0000","last_fullsized":"2024-04-24T01:45:01.089149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.536365+0000","last_change":"2024-04-24T01:46:36.536415+0000","last_active":"2024-04-24T01:46:36.536365+0000","last_peered":"2024-04-24T01:46:36.536365+0000","last_clean":"2024-04-24T01:46:36.536365+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:46:36.536365+0000","last_undegraded":"2024-04-24T01:46:36.536365+0000","last_fullsized":"2024-04-24T01:46:36.536365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.536262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:42.146239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.498965+0000","last_change":"2024-04-24T01:42:40.774629+0000","last_active":"2024-04-24T01:44:49.498965+0000","last_peered":"2024-04-24T01:44:49.498965+0000","last_clean":"2024-04-24T01:44:49.498965+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:44:49.498965+0000","last_undegraded":"2024-04-24T01:44:49.498965+0000","last_fullsized":"2024-04-24T01:44:49.498965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:39.081230+0000","last_change":"2024-04-24T01:42:32.734070+0000","last_active":"2024-04-24T01:44:39.081230+0000","last_peered":"2024-04-24T01:44:39.081230+0000","last_clean":"2024-04-24T01:44:39.081230+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:44:39.081230+0000","last_undegraded":"2024-04-24T01:44:39.081230+0000","last_fullsized":"2024-04-24T01:44:39.081230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.866193+0000","last_change":"2024-04-24T01:43:21.814238+0000","last_active":"2024-04-24T01:45:56.866193+0000","last_peered":"2024-04-24T01:45:56.866193+0000","last_clean":"2024-04-24T01:45:56.866193+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:45:56.866193+0000","last_undegraded":"2024-04-24T01:45:56.866193+0000","last_fullsized":"2024-04-24T01:45:56.866193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:43.758869+0000","last_clean_scrub_stamp":"2024-04-24T01:42:43.758869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'89","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.233644+0000","last_change":"2024-04-24T01:46:07.233696+0000","last_active":"2024-04-24T01:46:07.233644+0000","last_peered":"2024-04-24T01:46:07.233644+0000","last_clean":"2024-04-24T01:46:07.233644+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:46:07.233644+0000","last_undegraded":"2024-04-24T01:46:07.233644+0000","last_fullsized":"2024-04-24T01:46:07.233644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'89","last_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_deep_scrub":"34'89","last_deep_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.233553+0000","objects_scrubbed":11,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:09.955408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":99,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.891003+0000","last_change":"2024-04-24T01:46:06.891045+0000","last_active":"2024-04-24T01:46:06.891003+0000","last_peered":"2024-04-24T01:46:06.891003+0000","last_clean":"2024-04-24T01:46:06.891003+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:46:06.891003+0000","last_undegraded":"2024-04-24T01:46:06.891003+0000","last_fullsized":"2024-04-24T01:46:06.891003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.890898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:03.226630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.132644+0000","last_change":"2024-04-24T01:46:29.132700+0000","last_active":"2024-04-24T01:46:29.132644+0000","last_peered":"2024-04-24T01:46:29.132644+0000","last_clean":"2024-04-24T01:46:29.132644+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:46:29.132644+0000","last_undegraded":"2024-04-24T01:46:29.132644+0000","last_fullsized":"2024-04-24T01:46:29.132644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.132536+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:12.697153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.728130+0000","last_change":"2024-04-24T01:46:21.728154+0000","last_active":"2024-04-24T01:46:21.728130+0000","last_peered":"2024-04-24T01:46:21.728130+0000","last_clean":"2024-04-24T01:46:21.728130+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:46:21.728130+0000","last_undegraded":"2024-04-24T01:46:21.728130+0000","last_fullsized":"2024-04-24T01:46:21.728130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.728040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:08.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082579+0000","last_change":"2024-04-24T01:42:40.778312+0000","last_active":"2024-04-24T01:44:49.082579+0000","last_peered":"2024-04-24T01:44:49.082579+0000","last_clean":"2024-04-24T01:44:49.082579+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:44:49.082579+0000","last_undegraded":"2024-04-24T01:44:49.082579+0000","last_fullsized":"2024-04-24T01:44:49.082579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:41.086736+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:44:41.086736+0000","last_peered":"2024-04-24T01:44:41.086736+0000","last_clean":"2024-04-24T01:44:41.086736+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:44:41.086736+0000","last_undegraded":"2024-04-24T01:44:41.086736+0000","last_fullsized":"2024-04-24T01:44:41.086736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.278301+0000","last_change":"2024-04-24T01:46:12.278325+0000","last_active":"2024-04-24T01:46:12.278301+0000","last_peered":"2024-04-24T01:46:12.278301+0000","last_clean":"2024-04-24T01:46:12.278301+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:46:12.278301+0000","last_undegraded":"2024-04-24T01:46:12.278301+0000","last_fullsized":"2024-04-24T01:46:12.278301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.278217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:12.615210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.482034+0000","last_change":"2024-04-24T01:46:01.482085+0000","last_active":"2024-04-24T01:46:01.482034+0000","last_peered":"2024-04-24T01:46:01.482034+0000","last_clean":"2024-04-24T01:46:01.482034+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:46:01.482034+0000","last_undegraded":"2024-04-24T01:46:01.482034+0000","last_fullsized":"2024-04-24T01:46:01.482034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.481946+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:57.817678+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.707551+0000","last_change":"2024-04-24T01:46:24.707597+0000","last_active":"2024-04-24T01:46:24.707551+0000","last_peered":"2024-04-24T01:46:24.707551+0000","last_clean":"2024-04-24T01:46:24.707551+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:46:24.707551+0000","last_undegraded":"2024-04-24T01:46:24.707551+0000","last_fullsized":"2024-04-24T01:46:24.707551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.707426+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:18.013223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090729+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:45:06.090729+0000","last_peered":"2024-04-24T01:45:06.090729+0000","last_clean":"2024-04-24T01:45:06.090729+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:45:06.090729+0000","last_undegraded":"2024-04-24T01:45:06.090729+0000","last_fullsized":"2024-04-24T01:45:06.090729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.287046+0000","last_change":"2024-04-24T01:46:14.287073+0000","last_active":"2024-04-24T01:46:14.287046+0000","last_peered":"2024-04-24T01:46:14.287046+0000","last_clean":"2024-04-24T01:46:14.287046+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:46:14.287046+0000","last_undegraded":"2024-04-24T01:46:14.287046+0000","last_fullsized":"2024-04-24T01:46:14.287046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.286944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:31.444362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088265+0000","last_change":"2024-04-24T01:42:40.786621+0000","last_active":"2024-04-24T01:44:51.088265+0000","last_peered":"2024-04-24T01:44:51.088265+0000","last_clean":"2024-04-24T01:44:51.088265+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:44:51.088265+0000","last_undegraded":"2024-04-24T01:44:51.088265+0000","last_fullsized":"2024-04-24T01:44:51.088265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:44.082013+0000","last_change":"2024-04-24T01:42:32.734469+0000","last_active":"2024-04-24T01:44:44.082013+0000","last_peered":"2024-04-24T01:44:44.082013+0000","last_clean":"2024-04-24T01:44:44.082013+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:44:44.082013+0000","last_undegraded":"2024-04-24T01:44:44.082013+0000","last_fullsized":"2024-04-24T01:44:44.082013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.333072+0000","last_change":"2024-04-24T01:46:08.333093+0000","last_active":"2024-04-24T01:46:08.333072+0000","last_peered":"2024-04-24T01:46:08.333072+0000","last_clean":"2024-04-24T01:46:08.333072+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:46:08.333072+0000","last_undegraded":"2024-04-24T01:46:08.333072+0000","last_fullsized":"2024-04-24T01:46:08.333072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.332981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:48.671731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'24","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.321066+0000","last_change":"2024-04-24T01:46:19.321125+0000","last_active":"2024-04-24T01:46:19.321066+0000","last_peered":"2024-04-24T01:46:19.321066+0000","last_clean":"2024-04-24T01:46:19.321066+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:46:19.321066+0000","last_undegraded":"2024-04-24T01:46:19.321066+0000","last_fullsized":"2024-04-24T01:46:19.321066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.320973+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:49.328557+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.218893+0000","last_change":"2024-04-24T01:46:02.218953+0000","last_active":"2024-04-24T01:46:02.218893+0000","last_peered":"2024-04-24T01:46:02.218893+0000","last_clean":"2024-04-24T01:46:02.218893+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:46:02.218893+0000","last_undegraded":"2024-04-24T01:46:02.218893+0000","last_fullsized":"2024-04-24T01:46:02.218893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.218804+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:46.449166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.146164+0000","last_change":"2024-04-24T01:42:50.802205+0000","last_active":"2024-04-24T01:45:50.146164+0000","last_peered":"2024-04-24T01:45:50.146164+0000","last_clean":"2024-04-24T01:45:50.146164+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:45:50.146164+0000","last_undegraded":"2024-04-24T01:45:50.146164+0000","last_fullsized":"2024-04-24T01:45:50.146164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.831100+0000","last_change":"2024-04-24T01:46:32.831123+0000","last_active":"2024-04-24T01:46:32.831100+0000","last_peered":"2024-04-24T01:46:32.831100+0000","last_clean":"2024-04-24T01:46:32.831100+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:46:32.831100+0000","last_undegraded":"2024-04-24T01:46:32.831100+0000","last_fullsized":"2024-04-24T01:46:32.831100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.831018+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:14.457711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.087682+0000","last_change":"2024-04-24T01:42:40.788616+0000","last_active":"2024-04-24T01:44:51.087682+0000","last_peered":"2024-04-24T01:44:51.087682+0000","last_clean":"2024-04-24T01:44:51.087682+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:44:51.087682+0000","last_undegraded":"2024-04-24T01:44:51.087682+0000","last_fullsized":"2024-04-24T01:44:51.087682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:41.086789+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:44:41.086789+0000","last_peered":"2024-04-24T01:44:41.086789+0000","last_clean":"2024-04-24T01:44:41.086789+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:44:41.086789+0000","last_undegraded":"2024-04-24T01:44:41.086789+0000","last_fullsized":"2024-04-24T01:44:41.086789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.339366+0000","last_change":"2024-04-24T01:46:09.339389+0000","last_active":"2024-04-24T01:46:09.339366+0000","last_peered":"2024-04-24T01:46:09.339366+0000","last_clean":"2024-04-24T01:46:09.339366+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:46:09.339366+0000","last_undegraded":"2024-04-24T01:46:09.339366+0000","last_fullsized":"2024-04-24T01:46:09.339366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.339282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:17.983913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'104","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.891457+0000","last_change":"2024-04-24T01:46:07.891513+0000","last_active":"2024-04-24T01:46:07.891457+0000","last_peered":"2024-04-24T01:46:07.891457+0000","last_clean":"2024-04-24T01:46:07.891457+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:46:07.891457+0000","last_undegraded":"2024-04-24T01:46:07.891457+0000","last_fullsized":"2024-04-24T01:46:07.891457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'104","last_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_deep_scrub":"34'104","last_deep_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.891371+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.493980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.166260+0000","last_change":"2024-04-24T01:46:13.166279+0000","last_active":"2024-04-24T01:46:13.166260+0000","last_peered":"2024-04-24T01:46:13.166260+0000","last_clean":"2024-04-24T01:46:13.166260+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:46:13.166260+0000","last_undegraded":"2024-04-24T01:46:13.166260+0000","last_fullsized":"2024-04-24T01:46:13.166260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.166175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:35.987875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.892980+0000","last_change":"2024-04-24T01:46:14.893005+0000","last_active":"2024-04-24T01:46:14.892980+0000","last_peered":"2024-04-24T01:46:14.892980+0000","last_clean":"2024-04-24T01:46:14.892980+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:46:14.892980+0000","last_undegraded":"2024-04-24T01:46:14.892980+0000","last_fullsized":"2024-04-24T01:46:14.892980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.892893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:00.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088453+0000","last_change":"2024-04-24T01:42:50.800231+0000","last_active":"2024-04-24T01:44:56.088453+0000","last_peered":"2024-04-24T01:44:56.088453+0000","last_clean":"2024-04-24T01:44:56.088453+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:44:56.088453+0000","last_undegraded":"2024-04-24T01:44:56.088453+0000","last_fullsized":"2024-04-24T01:44:56.088453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.778215+0000","last_change":"2024-04-24T01:46:23.778252+0000","last_active":"2024-04-24T01:46:23.778215+0000","last_peered":"2024-04-24T01:46:23.778215+0000","last_clean":"2024-04-24T01:46:23.778215+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:46:23.778215+0000","last_undegraded":"2024-04-24T01:46:23.778215+0000","last_fullsized":"2024-04-24T01:46:23.778215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.778097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:35.360382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089849+0000","last_change":"2024-04-24T01:42:40.776494+0000","last_active":"2024-04-24T01:45:01.089849+0000","last_peered":"2024-04-24T01:45:01.089849+0000","last_clean":"2024-04-24T01:45:01.089849+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:45:01.089849+0000","last_undegraded":"2024-04-24T01:45:01.089849+0000","last_fullsized":"2024-04-24T01:45:01.089849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.657368+0000","last_change":"2024-04-24T01:46:13.657398+0000","last_active":"2024-04-24T01:46:13.657368+0000","last_peered":"2024-04-24T01:46:13.657368+0000","last_clean":"2024-04-24T01:46:13.657368+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:46:13.657368+0000","last_undegraded":"2024-04-24T01:46:13.657368+0000","last_fullsized":"2024-04-24T01:46:13.657368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.657273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:54.140958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.290072+0000","last_change":"2024-04-24T01:46:11.290116+0000","last_active":"2024-04-24T01:46:11.290072+0000","last_peered":"2024-04-24T01:46:11.290072+0000","last_clean":"2024-04-24T01:46:11.290072+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:46:11.290072+0000","last_undegraded":"2024-04-24T01:46:11.290072+0000","last_fullsized":"2024-04-24T01:46:11.290072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.289983+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:25.084406+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.324290+0000","last_change":"2024-04-24T01:46:21.324364+0000","last_active":"2024-04-24T01:46:21.324290+0000","last_peered":"2024-04-24T01:46:21.324290+0000","last_clean":"2024-04-24T01:46:21.324290+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:46:21.324290+0000","last_undegraded":"2024-04-24T01:46:21.324290+0000","last_fullsized":"2024-04-24T01:46:21.324290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.324188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:58.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083325+0000","last_change":"2024-04-24T01:42:50.802495+0000","last_active":"2024-04-24T01:44:54.083325+0000","last_peered":"2024-04-24T01:44:54.083325+0000","last_clean":"2024-04-24T01:44:54.083325+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:44:54.083325+0000","last_undegraded":"2024-04-24T01:44:54.083325+0000","last_fullsized":"2024-04-24T01:44:54.083325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.748183+0000","last_change":"2024-04-24T01:46:31.748224+0000","last_active":"2024-04-24T01:46:31.748183+0000","last_peered":"2024-04-24T01:46:31.748183+0000","last_clean":"2024-04-24T01:46:31.748183+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:46:31.748183+0000","last_undegraded":"2024-04-24T01:46:31.748183+0000","last_fullsized":"2024-04-24T01:46:31.748183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.748068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:58.027530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.830371+0000","last_change":"2024-04-24T01:46:31.830423+0000","last_active":"2024-04-24T01:46:31.830371+0000","last_peered":"2024-04-24T01:46:31.830371+0000","last_clean":"2024-04-24T01:46:31.830371+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:46:31.830371+0000","last_undegraded":"2024-04-24T01:46:31.830371+0000","last_fullsized":"2024-04-24T01:46:31.830371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.830255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:38.220407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.257405+0000","last_change":"2024-04-24T01:46:04.257440+0000","last_active":"2024-04-24T01:46:04.257405+0000","last_peered":"2024-04-24T01:46:04.257405+0000","last_clean":"2024-04-24T01:46:04.257405+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:46:04.257405+0000","last_undegraded":"2024-04-24T01:46:04.257405+0000","last_fullsized":"2024-04-24T01:46:04.257405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.257282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:20.008478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.173642+0000","last_change":"2024-04-24T01:46:14.173677+0000","last_active":"2024-04-24T01:46:14.173642+0000","last_peered":"2024-04-24T01:46:14.173642+0000","last_clean":"2024-04-24T01:46:14.173642+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:46:14.173642+0000","last_undegraded":"2024-04-24T01:46:14.173642+0000","last_fullsized":"2024-04-24T01:46:14.173642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.173554+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:46.693848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.821154+0000","last_change":"2024-04-24T01:46:01.821203+0000","last_active":"2024-04-24T01:46:01.821154+0000","last_peered":"2024-04-24T01:46:01.821154+0000","last_clean":"2024-04-24T01:46:01.821154+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:46:01.821154+0000","last_undegraded":"2024-04-24T01:46:01.821154+0000","last_fullsized":"2024-04-24T01:46:01.821154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.821055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:04:47.582844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:24.087886+0000","last_change":"2024-04-24T01:42:50.793424+0000","last_active":"2024-04-24T01:45:24.087886+0000","last_peered":"2024-04-24T01:45:24.087886+0000","last_clean":"2024-04-24T01:45:24.087886+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:45:24.087886+0000","last_undegraded":"2024-04-24T01:45:24.087886+0000","last_fullsized":"2024-04-24T01:45:24.087886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.102487+0000","last_change":"2024-04-24T01:46:30.102527+0000","last_active":"2024-04-24T01:46:30.102487+0000","last_peered":"2024-04-24T01:46:30.102487+0000","last_clean":"2024-04-24T01:46:30.102487+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:46:30.102487+0000","last_undegraded":"2024-04-24T01:46:30.102487+0000","last_fullsized":"2024-04-24T01:46:30.102487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.102347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:37.775249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090008+0000","last_change":"2024-04-24T01:42:40.777727+0000","last_active":"2024-04-24T01:45:06.090008+0000","last_peered":"2024-04-24T01:45:06.090008+0000","last_clean":"2024-04-24T01:45:06.090008+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:45:06.090008+0000","last_undegraded":"2024-04-24T01:45:06.090008+0000","last_fullsized":"2024-04-24T01:45:06.090008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.846071+0000","last_change":"2024-04-24T01:46:15.846094+0000","last_active":"2024-04-24T01:46:15.846071+0000","last_peered":"2024-04-24T01:46:15.846071+0000","last_clean":"2024-04-24T01:46:15.846071+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:46:15.846071+0000","last_undegraded":"2024-04-24T01:46:15.846071+0000","last_fullsized":"2024-04-24T01:46:15.846071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:10.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.247853+0000","last_change":"2024-04-24T01:46:08.247891+0000","last_active":"2024-04-24T01:46:08.247853+0000","last_peered":"2024-04-24T01:46:08.247853+0000","last_clean":"2024-04-24T01:46:08.247853+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:46:08.247853+0000","last_undegraded":"2024-04-24T01:46:08.247853+0000","last_fullsized":"2024-04-24T01:46:08.247853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.247768+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:06:04.087642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.609637+0000","last_change":"2024-04-24T01:46:12.609659+0000","last_active":"2024-04-24T01:46:12.609637+0000","last_peered":"2024-04-24T01:46:12.609637+0000","last_clean":"2024-04-24T01:46:12.609637+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:46:12.609637+0000","last_undegraded":"2024-04-24T01:46:12.609637+0000","last_fullsized":"2024-04-24T01:46:12.609637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.609553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:24:25.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:21.093126+0000","last_change":"2024-04-24T01:42:50.801137+0000","last_active":"2024-04-24T01:45:21.093126+0000","last_peered":"2024-04-24T01:45:21.093126+0000","last_clean":"2024-04-24T01:45:21.093126+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:45:21.093126+0000","last_undegraded":"2024-04-24T01:45:21.093126+0000","last_fullsized":"2024-04-24T01:45:21.093126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.327638+0000","last_change":"2024-04-24T01:46:18.327664+0000","last_active":"2024-04-24T01:46:18.327638+0000","last_peered":"2024-04-24T01:46:18.327638+0000","last_clean":"2024-04-24T01:46:18.327638+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:46:18.327638+0000","last_undegraded":"2024-04-24T01:46:18.327638+0000","last_fullsized":"2024-04-24T01:46:18.327638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.327548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:36.700735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090199+0000","last_change":"2024-04-24T01:42:40.790215+0000","last_active":"2024-04-24T01:45:06.090199+0000","last_peered":"2024-04-24T01:45:06.090199+0000","last_clean":"2024-04-24T01:45:06.090199+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:45:06.090199+0000","last_undegraded":"2024-04-24T01:45:06.090199+0000","last_fullsized":"2024-04-24T01:45:06.090199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.312282+0000","last_change":"2024-04-24T01:46:10.312308+0000","last_active":"2024-04-24T01:46:10.312282+0000","last_peered":"2024-04-24T01:46:10.312282+0000","last_clean":"2024-04-24T01:46:10.312282+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:46:10.312282+0000","last_undegraded":"2024-04-24T01:46:10.312282+0000","last_fullsized":"2024-04-24T01:46:10.312282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.312190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:07.102122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.806433+0000","last_change":"2024-04-24T01:46:12.806479+0000","last_active":"2024-04-24T01:46:12.806433+0000","last_peered":"2024-04-24T01:46:12.806433+0000","last_clean":"2024-04-24T01:46:12.806433+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:46:12.806433+0000","last_undegraded":"2024-04-24T01:46:12.806433+0000","last_fullsized":"2024-04-24T01:46:12.806433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.806352+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:58.427653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.869091+0000","last_change":"2024-04-24T01:46:03.869117+0000","last_active":"2024-04-24T01:46:03.869091+0000","last_peered":"2024-04-24T01:46:03.869091+0000","last_clean":"2024-04-24T01:46:03.869091+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:46:03.869091+0000","last_undegraded":"2024-04-24T01:46:03.869091+0000","last_fullsized":"2024-04-24T01:46:03.869091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.868982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:27:47.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.351558+0000","last_change":"2024-04-24T01:43:21.862671+0000","last_active":"2024-04-24T01:45:50.351558+0000","last_peered":"2024-04-24T01:45:50.351558+0000","last_clean":"2024-04-24T01:45:50.351558+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:45:50.351558+0000","last_undegraded":"2024-04-24T01:45:50.351558+0000","last_fullsized":"2024-04-24T01:45:50.351558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090473+0000","last_change":"2024-04-24T01:42:40.787886+0000","last_active":"2024-04-24T01:45:06.090473+0000","last_peered":"2024-04-24T01:45:06.090473+0000","last_clean":"2024-04-24T01:45:06.090473+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:45:06.090473+0000","last_undegraded":"2024-04-24T01:45:06.090473+0000","last_fullsized":"2024-04-24T01:45:06.090473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.176843+0000","last_change":"2024-04-24T01:46:24.176864+0000","last_active":"2024-04-24T01:46:24.176843+0000","last_peered":"2024-04-24T01:46:24.176843+0000","last_clean":"2024-04-24T01:46:24.176843+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:46:24.176843+0000","last_undegraded":"2024-04-24T01:46:24.176843+0000","last_fullsized":"2024-04-24T01:46:24.176843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.176757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:03.301459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.198038+0000","last_change":"2024-04-24T01:46:10.198112+0000","last_active":"2024-04-24T01:46:10.198038+0000","last_peered":"2024-04-24T01:46:10.198038+0000","last_clean":"2024-04-24T01:46:10.198038+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:46:10.198038+0000","last_undegraded":"2024-04-24T01:46:10.198038+0000","last_fullsized":"2024-04-24T01:46:10.198038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.197934+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:55.839910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.889685+0000","last_change":"2024-04-24T01:46:04.889720+0000","last_active":"2024-04-24T01:46:04.889685+0000","last_peered":"2024-04-24T01:46:04.889685+0000","last_clean":"2024-04-24T01:46:04.889685+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:46:04.889685+0000","last_undegraded":"2024-04-24T01:46:04.889685+0000","last_fullsized":"2024-04-24T01:46:04.889685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.889593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:29.941134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.274542+0000","last_change":"2024-04-24T01:42:50.794926+0000","last_active":"2024-04-24T01:45:50.274542+0000","last_peered":"2024-04-24T01:45:50.274542+0000","last_clean":"2024-04-24T01:45:50.274542+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:45:50.274542+0000","last_undegraded":"2024-04-24T01:45:50.274542+0000","last_fullsized":"2024-04-24T01:45:50.274542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.006908+0000","last_change":"2024-04-24T01:46:39.006935+0000","last_active":"2024-04-24T01:46:39.006908+0000","last_peered":"2024-04-24T01:46:39.006908+0000","last_clean":"2024-04-24T01:46:39.006908+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:46:39.006908+0000","last_undegraded":"2024-04-24T01:46:39.006908+0000","last_fullsized":"2024-04-24T01:46:39.006908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.006790+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:00.354935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.089951+0000","last_change":"2024-04-24T01:42:40.788925+0000","last_active":"2024-04-24T01:45:06.089951+0000","last_peered":"2024-04-24T01:45:06.089951+0000","last_clean":"2024-04-24T01:45:06.089951+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:45:06.089951+0000","last_undegraded":"2024-04-24T01:45:06.089951+0000","last_fullsized":"2024-04-24T01:45:06.089951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.846148+0000","last_change":"2024-04-24T01:46:20.846187+0000","last_active":"2024-04-24T01:46:20.846148+0000","last_peered":"2024-04-24T01:46:20.846148+0000","last_clean":"2024-04-24T01:46:20.846148+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:46:20.846148+0000","last_undegraded":"2024-04-24T01:46:20.846148+0000","last_fullsized":"2024-04-24T01:46:20.846148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.846022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:44.249657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.332061+0000","last_change":"2024-04-24T01:46:28.332109+0000","last_active":"2024-04-24T01:46:28.332061+0000","last_peered":"2024-04-24T01:46:28.332061+0000","last_clean":"2024-04-24T01:46:28.332061+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:46:28.332061+0000","last_undegraded":"2024-04-24T01:46:28.332061+0000","last_fullsized":"2024-04-24T01:46:28.332061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.331976+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:47:29.283395+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.676027+0000","last_change":"2024-04-24T01:46:16.676052+0000","last_active":"2024-04-24T01:46:16.676027+0000","last_peered":"2024-04-24T01:46:16.676027+0000","last_clean":"2024-04-24T01:46:16.676027+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:46:16.676027+0000","last_undegraded":"2024-04-24T01:46:16.676027+0000","last_fullsized":"2024-04-24T01:46:16.676027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.675939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:00.108736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.349403+0000","last_change":"2024-04-24T01:42:50.797843+0000","last_active":"2024-04-24T01:45:50.349403+0000","last_peered":"2024-04-24T01:45:50.349403+0000","last_clean":"2024-04-24T01:45:50.349403+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:45:50.349403+0000","last_undegraded":"2024-04-24T01:45:50.349403+0000","last_fullsized":"2024-04-24T01:45:50.349403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.302166+0000","last_change":"2024-04-24T01:46:20.302191+0000","last_active":"2024-04-24T01:46:20.302166+0000","last_peered":"2024-04-24T01:46:20.302166+0000","last_clean":"2024-04-24T01:46:20.302166+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:46:20.302166+0000","last_undegraded":"2024-04-24T01:46:20.302166+0000","last_fullsized":"2024-04-24T01:46:20.302166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.302076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:18.662863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090904+0000","last_change":"2024-04-24T01:42:40.769690+0000","last_active":"2024-04-24T01:45:11.090904+0000","last_peered":"2024-04-24T01:45:11.090904+0000","last_clean":"2024-04-24T01:45:11.090904+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:45:11.090904+0000","last_undegraded":"2024-04-24T01:45:11.090904+0000","last_fullsized":"2024-04-24T01:45:11.090904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.842016+0000","last_change":"2024-04-24T01:46:19.842038+0000","last_active":"2024-04-24T01:46:19.842016+0000","last_peered":"2024-04-24T01:46:19.842016+0000","last_clean":"2024-04-24T01:46:19.842016+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:46:19.842016+0000","last_undegraded":"2024-04-24T01:46:19.842016+0000","last_fullsized":"2024-04-24T01:46:19.842016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.841928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:50:06.176480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.208799+0000","last_change":"2024-04-24T01:46:12.208833+0000","last_active":"2024-04-24T01:46:12.208799+0000","last_peered":"2024-04-24T01:46:12.208799+0000","last_clean":"2024-04-24T01:46:12.208799+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:46:12.208799+0000","last_undegraded":"2024-04-24T01:46:12.208799+0000","last_fullsized":"2024-04-24T01:46:12.208799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.208700+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:29.667207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.222166+0000","last_change":"2024-04-24T01:46:04.222190+0000","last_active":"2024-04-24T01:46:04.222166+0000","last_peered":"2024-04-24T01:46:04.222166+0000","last_clean":"2024-04-24T01:46:04.222166+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:46:04.222166+0000","last_undegraded":"2024-04-24T01:46:04.222166+0000","last_fullsized":"2024-04-24T01:46:04.222166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.222084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:26.106809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091360+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:45:11.091360+0000","last_peered":"2024-04-24T01:45:11.091360+0000","last_clean":"2024-04-24T01:45:11.091360+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:45:11.091360+0000","last_undegraded":"2024-04-24T01:45:11.091360+0000","last_fullsized":"2024-04-24T01:45:11.091360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.060904+0000","last_change":"2024-04-24T01:46:35.060928+0000","last_active":"2024-04-24T01:46:35.060904+0000","last_peered":"2024-04-24T01:46:35.060904+0000","last_clean":"2024-04-24T01:46:35.060904+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:46:35.060904+0000","last_undegraded":"2024-04-24T01:46:35.060904+0000","last_fullsized":"2024-04-24T01:46:35.060904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.060814+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:10.400767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091410+0000","last_change":"2024-04-24T01:42:40.791055+0000","last_active":"2024-04-24T01:45:11.091410+0000","last_peered":"2024-04-24T01:45:11.091410+0000","last_clean":"2024-04-24T01:45:11.091410+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:45:11.091410+0000","last_undegraded":"2024-04-24T01:45:11.091410+0000","last_fullsized":"2024-04-24T01:45:11.091410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.688836+0000","last_change":"2024-04-24T01:46:17.688868+0000","last_active":"2024-04-24T01:46:17.688836+0000","last_peered":"2024-04-24T01:46:17.688836+0000","last_clean":"2024-04-24T01:46:17.688836+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:46:17.688836+0000","last_undegraded":"2024-04-24T01:46:17.688836+0000","last_fullsized":"2024-04-24T01:46:17.688836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.688748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:53.186579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.316217+0000","last_change":"2024-04-24T01:46:25.316258+0000","last_active":"2024-04-24T01:46:25.316217+0000","last_peered":"2024-04-24T01:46:25.316217+0000","last_clean":"2024-04-24T01:46:25.316217+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:46:25.316217+0000","last_undegraded":"2024-04-24T01:46:25.316217+0000","last_fullsized":"2024-04-24T01:46:25.316217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.316122+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:09.639811+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.864878+0000","last_change":"2024-04-24T01:46:02.864906+0000","last_active":"2024-04-24T01:46:02.864878+0000","last_peered":"2024-04-24T01:46:02.864878+0000","last_clean":"2024-04-24T01:46:02.864878+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:46:02.864878+0000","last_undegraded":"2024-04-24T01:46:02.864878+0000","last_fullsized":"2024-04-24T01:46:02.864878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.864778+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:58.138209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091284+0000","last_change":"2024-04-24T01:42:50.799047+0000","last_active":"2024-04-24T01:45:11.091284+0000","last_peered":"2024-04-24T01:45:11.091284+0000","last_clean":"2024-04-24T01:45:11.091284+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:45:11.091284+0000","last_undegraded":"2024-04-24T01:45:11.091284+0000","last_fullsized":"2024-04-24T01:45:11.091284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.731138+0000","last_change":"2024-04-24T01:46:28.731165+0000","last_active":"2024-04-24T01:46:28.731138+0000","last_peered":"2024-04-24T01:46:28.731138+0000","last_clean":"2024-04-24T01:46:28.731138+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:46:28.731138+0000","last_undegraded":"2024-04-24T01:46:28.731138+0000","last_fullsized":"2024-04-24T01:46:28.731138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.731048+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:37.095746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.090975+0000","last_change":"2024-04-24T01:42:40.783048+0000","last_active":"2024-04-24T01:45:11.090975+0000","last_peered":"2024-04-24T01:45:11.090975+0000","last_clean":"2024-04-24T01:45:11.090975+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:45:11.090975+0000","last_undegraded":"2024-04-24T01:45:11.090975+0000","last_fullsized":"2024-04-24T01:45:11.090975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.603073+0000","last_change":"2024-04-24T01:46:11.603100+0000","last_active":"2024-04-24T01:46:11.603073+0000","last_peered":"2024-04-24T01:46:11.603073+0000","last_clean":"2024-04-24T01:46:11.603073+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:46:11.603073+0000","last_undegraded":"2024-04-24T01:46:11.603073+0000","last_fullsized":"2024-04-24T01:46:11.603073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.602978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:50.391941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'77","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.529735+0000","last_change":"2024-04-24T01:46:06.529785+0000","last_active":"2024-04-24T01:46:06.529735+0000","last_peered":"2024-04-24T01:46:06.529735+0000","last_clean":"2024-04-24T01:46:06.529735+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:46:06.529735+0000","last_undegraded":"2024-04-24T01:46:06.529735+0000","last_fullsized":"2024-04-24T01:46:06.529735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.529645+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:07.671634+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":85,"num_read_kb":80,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.248633+0000","last_change":"2024-04-24T01:46:01.248655+0000","last_active":"2024-04-24T01:46:01.248633+0000","last_peered":"2024-04-24T01:46:01.248633+0000","last_clean":"2024-04-24T01:46:01.248633+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:46:01.248633+0000","last_undegraded":"2024-04-24T01:46:01.248633+0000","last_fullsized":"2024-04-24T01:46:01.248633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.248553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:14.454609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.091921+0000","last_change":"2024-04-24T01:42:50.796877+0000","last_active":"2024-04-24T01:45:16.091921+0000","last_peered":"2024-04-24T01:45:16.091921+0000","last_clean":"2024-04-24T01:45:16.091921+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:45:16.091921+0000","last_undegraded":"2024-04-24T01:45:16.091921+0000","last_fullsized":"2024-04-24T01:45:16.091921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.729913+0000","last_change":"2024-04-24T01:46:24.729938+0000","last_active":"2024-04-24T01:46:24.729913+0000","last_peered":"2024-04-24T01:46:24.729913+0000","last_clean":"2024-04-24T01:46:24.729913+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:46:24.729913+0000","last_undegraded":"2024-04-24T01:46:24.729913+0000","last_fullsized":"2024-04-24T01:46:24.729913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.729803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:38.596795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.263641+0000","last_change":"2024-04-24T01:42:40.788381+0000","last_active":"2024-04-24T01:45:50.263641+0000","last_peered":"2024-04-24T01:45:50.263641+0000","last_clean":"2024-04-24T01:45:50.263641+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:45:50.263641+0000","last_undegraded":"2024-04-24T01:45:50.263641+0000","last_fullsized":"2024-04-24T01:45:50.263641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.809263+0000","last_change":"2024-04-24T01:46:17.809286+0000","last_active":"2024-04-24T01:46:17.809263+0000","last_peered":"2024-04-24T01:46:17.809263+0000","last_clean":"2024-04-24T01:46:17.809263+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:46:17.809263+0000","last_undegraded":"2024-04-24T01:46:17.809263+0000","last_fullsized":"2024-04-24T01:46:17.809263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.809172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:15:28.587615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.187484+0000","last_change":"2024-04-24T01:46:11.187562+0000","last_active":"2024-04-24T01:46:11.187484+0000","last_peered":"2024-04-24T01:46:11.187484+0000","last_clean":"2024-04-24T01:46:11.187484+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:46:11.187484+0000","last_undegraded":"2024-04-24T01:46:11.187484+0000","last_fullsized":"2024-04-24T01:46:11.187484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.187375+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:33:05.075069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.327296+0000","last_change":"2024-04-24T01:46:22.327330+0000","last_active":"2024-04-24T01:46:22.327296+0000","last_peered":"2024-04-24T01:46:22.327296+0000","last_clean":"2024-04-24T01:46:22.327296+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:46:22.327296+0000","last_undegraded":"2024-04-24T01:46:22.327296+0000","last_fullsized":"2024-04-24T01:46:22.327296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.327198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:51:25.780951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.455411+0000","last_change":"2024-04-24T01:42:50.801689+0000","last_active":"2024-04-24T01:45:50.455411+0000","last_peered":"2024-04-24T01:45:50.455411+0000","last_clean":"2024-04-24T01:45:50.455411+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:45:50.455411+0000","last_undegraded":"2024-04-24T01:45:50.455411+0000","last_fullsized":"2024-04-24T01:45:50.455411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:51.096343+0000","last_change":"2024-04-24T01:43:21.864360+0000","last_active":"2024-04-24T01:45:51.096343+0000","last_peered":"2024-04-24T01:45:51.096343+0000","last_clean":"2024-04-24T01:45:51.096343+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:45:51.096343+0000","last_undegraded":"2024-04-24T01:45:51.096343+0000","last_fullsized":"2024-04-24T01:45:51.096343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:44.082025+0000","last_change":"2024-04-24T01:42:40.778077+0000","last_active":"2024-04-24T01:44:44.082025+0000","last_peered":"2024-04-24T01:44:44.082025+0000","last_clean":"2024-04-24T01:44:44.082025+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:44:44.082025+0000","last_undegraded":"2024-04-24T01:44:44.082025+0000","last_fullsized":"2024-04-24T01:44:44.082025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.626204+0000","last_change":"2024-04-24T01:46:09.626256+0000","last_active":"2024-04-24T01:46:09.626204+0000","last_peered":"2024-04-24T01:46:09.626204+0000","last_clean":"2024-04-24T01:46:09.626204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:46:09.626204+0000","last_undegraded":"2024-04-24T01:46:09.626204+0000","last_fullsized":"2024-04-24T01:46:09.626204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.626097+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:56.352550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.447709+0000","last_change":"2024-04-24T01:46:32.447742+0000","last_active":"2024-04-24T01:46:32.447709+0000","last_peered":"2024-04-24T01:46:32.447709+0000","last_clean":"2024-04-24T01:46:32.447709+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:46:32.447709+0000","last_undegraded":"2024-04-24T01:46:32.447709+0000","last_fullsized":"2024-04-24T01:46:32.447709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.447622+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:41:24.256346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.467508+0000","last_change":"2024-04-24T01:46:39.467533+0000","last_active":"2024-04-24T01:46:39.467508+0000","last_peered":"2024-04-24T01:46:39.467508+0000","last_clean":"2024-04-24T01:46:39.467508+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:46:39.467508+0000","last_undegraded":"2024-04-24T01:46:39.467508+0000","last_fullsized":"2024-04-24T01:46:39.467508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.467419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:58.802238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.092373+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:45:16.092373+0000","last_peered":"2024-04-24T01:45:16.092373+0000","last_clean":"2024-04-24T01:45:16.092373+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:45:16.092373+0000","last_undegraded":"2024-04-24T01:45:16.092373+0000","last_fullsized":"2024-04-24T01:45:16.092373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.657151+0000","last_change":"2024-04-24T01:46:26.657191+0000","last_active":"2024-04-24T01:46:26.657151+0000","last_peered":"2024-04-24T01:46:26.657151+0000","last_clean":"2024-04-24T01:46:26.657151+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:46:26.657151+0000","last_undegraded":"2024-04-24T01:46:26.657151+0000","last_fullsized":"2024-04-24T01:46:26.657151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.657061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:13.375971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.260690+0000","last_change":"2024-04-24T01:42:40.789710+0000","last_active":"2024-04-24T01:45:50.260690+0000","last_peered":"2024-04-24T01:45:50.260690+0000","last_clean":"2024-04-24T01:45:50.260690+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:45:50.260690+0000","last_undegraded":"2024-04-24T01:45:50.260690+0000","last_fullsized":"2024-04-24T01:45:50.260690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.549193+0000","last_change":"2024-04-24T01:46:07.549244+0000","last_active":"2024-04-24T01:46:07.549193+0000","last_peered":"2024-04-24T01:46:07.549193+0000","last_clean":"2024-04-24T01:46:07.549193+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:46:07.549193+0000","last_undegraded":"2024-04-24T01:46:07.549193+0000","last_fullsized":"2024-04-24T01:46:07.549193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.549082+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:53.170383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.365622+0000","last_change":"2024-04-24T01:46:30.365660+0000","last_active":"2024-04-24T01:46:30.365622+0000","last_peered":"2024-04-24T01:46:30.365622+0000","last_clean":"2024-04-24T01:46:30.365622+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:46:30.365622+0000","last_undegraded":"2024-04-24T01:46:30.365622+0000","last_fullsized":"2024-04-24T01:46:30.365622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.365531+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:04.108602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.233029+0000","last_change":"2024-04-24T01:46:05.233070+0000","last_active":"2024-04-24T01:46:05.233029+0000","last_peered":"2024-04-24T01:46:05.233029+0000","last_clean":"2024-04-24T01:46:05.233029+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:46:05.233029+0000","last_undegraded":"2024-04-24T01:46:05.233029+0000","last_fullsized":"2024-04-24T01:46:05.233029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.232926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:34.699770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091436+0000","last_change":"2024-04-24T01:42:50.800862+0000","last_active":"2024-04-24T01:45:11.091436+0000","last_peered":"2024-04-24T01:45:11.091436+0000","last_clean":"2024-04-24T01:45:11.091436+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:45:11.091436+0000","last_undegraded":"2024-04-24T01:45:11.091436+0000","last_fullsized":"2024-04-24T01:45:11.091436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.738749+0000","last_change":"2024-04-24T01:46:19.738791+0000","last_active":"2024-04-24T01:46:19.738749+0000","last_peered":"2024-04-24T01:46:19.738749+0000","last_clean":"2024-04-24T01:46:19.738749+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:46:19.738749+0000","last_undegraded":"2024-04-24T01:46:19.738749+0000","last_fullsized":"2024-04-24T01:46:19.738749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.738637+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:33.605630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.960048+0000","last_change":"2024-04-24T01:42:40.778401+0000","last_active":"2024-04-24T01:45:56.960048+0000","last_peered":"2024-04-24T01:45:56.960048+0000","last_clean":"2024-04-24T01:45:56.960048+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:45:56.960048+0000","last_undegraded":"2024-04-24T01:45:56.960048+0000","last_fullsized":"2024-04-24T01:45:56.960048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.009841+0000","last_change":"2024-04-24T01:46:37.009864+0000","last_active":"2024-04-24T01:46:37.009841+0000","last_peered":"2024-04-24T01:46:37.009841+0000","last_clean":"2024-04-24T01:46:37.009841+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:46:37.009841+0000","last_undegraded":"2024-04-24T01:46:37.009841+0000","last_fullsized":"2024-04-24T01:46:37.009841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.009754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.687137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.055567+0000","last_change":"2024-04-24T01:46:36.055589+0000","last_active":"2024-04-24T01:46:36.055567+0000","last_peered":"2024-04-24T01:46:36.055567+0000","last_clean":"2024-04-24T01:46:36.055567+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:46:36.055567+0000","last_undegraded":"2024-04-24T01:46:36.055567+0000","last_fullsized":"2024-04-24T01:46:36.055567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.055479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:08.968901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'21","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.397831+0000","last_change":"2024-04-24T01:42:42.782200+0000","last_active":"2024-04-24T01:45:50.397831+0000","last_peered":"2024-04-24T01:45:50.397831+0000","last_clean":"2024-04-24T01:45:50.397831+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:45:50.397831+0000","last_undegraded":"2024-04-24T01:45:50.397831+0000","last_fullsized":"2024-04-24T01:45:50.397831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.027996+0000","last_change":"2024-04-24T01:42:40.785740+0000","last_active":"2024-04-24T01:45:50.027996+0000","last_peered":"2024-04-24T01:45:50.027996+0000","last_clean":"2024-04-24T01:45:50.027996+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:45:50.027996+0000","last_undegraded":"2024-04-24T01:45:50.027996+0000","last_fullsized":"2024-04-24T01:45:50.027996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.041510+0000","last_change":"2024-04-24T01:46:33.041537+0000","last_active":"2024-04-24T01:46:33.041510+0000","last_peered":"2024-04-24T01:46:33.041510+0000","last_clean":"2024-04-24T01:46:33.041510+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:46:33.041510+0000","last_undegraded":"2024-04-24T01:46:33.041510+0000","last_fullsized":"2024-04-24T01:46:33.041510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.041416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:42.167160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082558+0000","last_change":"2024-04-24T01:42:40.768297+0000","last_active":"2024-04-24T01:44:49.082558+0000","last_peered":"2024-04-24T01:44:49.082558+0000","last_clean":"2024-04-24T01:44:49.082558+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:44:49.082558+0000","last_undegraded":"2024-04-24T01:44:49.082558+0000","last_fullsized":"2024-04-24T01:44:49.082558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.095590+0000","last_change":"2024-04-24T01:46:27.095611+0000","last_active":"2024-04-24T01:46:27.095590+0000","last_peered":"2024-04-24T01:46:27.095590+0000","last_clean":"2024-04-24T01:46:27.095590+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:46:27.095590+0000","last_undegraded":"2024-04-24T01:46:27.095590+0000","last_fullsized":"2024-04-24T01:46:27.095590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.095499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:50.346774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:54.083303+0000","last_change":"2024-04-24T01:42:40.778267+0000","last_active":"2024-04-24T01:44:54.083303+0000","last_peered":"2024-04-24T01:44:54.083303+0000","last_clean":"2024-04-24T01:44:54.083303+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:44:54.083303+0000","last_undegraded":"2024-04-24T01:44:54.083303+0000","last_fullsized":"2024-04-24T01:44:54.083303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.617555+0000","last_change":"2024-04-24T01:46:40.617579+0000","last_active":"2024-04-24T01:46:40.617555+0000","last_peered":"2024-04-24T01:46:40.617555+0000","last_clean":"2024-04-24T01:46:40.617555+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:46:40.617555+0000","last_undegraded":"2024-04-24T01:46:40.617555+0000","last_fullsized":"2024-04-24T01:46:40.617555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.617471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:40.544588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.564270+0000","last_change":"2024-04-24T01:46:37.564301+0000","last_active":"2024-04-24T01:46:37.564270+0000","last_peered":"2024-04-24T01:46:37.564270+0000","last_clean":"2024-04-24T01:46:37.564270+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:46:37.564270+0000","last_undegraded":"2024-04-24T01:46:37.564270+0000","last_fullsized":"2024-04-24T01:46:37.564270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.564177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:54.721595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:49.082527+0000","last_change":"2024-04-24T01:42:42.783541+0000","last_active":"2024-04-24T01:44:49.082527+0000","last_peered":"2024-04-24T01:44:49.082527+0000","last_clean":"2024-04-24T01:44:49.082527+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:44:49.082527+0000","last_undegraded":"2024-04-24T01:44:49.082527+0000","last_fullsized":"2024-04-24T01:44:49.082527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.684355+0000","last_change":"2024-04-24T01:46:27.684403+0000","last_active":"2024-04-24T01:46:27.684355+0000","last_peered":"2024-04-24T01:46:27.684355+0000","last_clean":"2024-04-24T01:46:27.684355+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:46:27.684355+0000","last_undegraded":"2024-04-24T01:46:27.684355+0000","last_fullsized":"2024-04-24T01:46:27.684355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.684268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:36.612643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.763077+0000","last_change":"2024-04-24T01:46:26.763139+0000","last_active":"2024-04-24T01:46:26.763077+0000","last_peered":"2024-04-24T01:46:26.763077+0000","last_clean":"2024-04-24T01:46:26.763077+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:46:26.763077+0000","last_undegraded":"2024-04-24T01:46:26.763077+0000","last_fullsized":"2024-04-24T01:46:26.763077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.762976+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:08.389668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.005222+0000","last_change":"2024-04-24T01:42:40.774338+0000","last_active":"2024-04-24T01:45:50.005222+0000","last_peered":"2024-04-24T01:45:50.005222+0000","last_clean":"2024-04-24T01:45:50.005222+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:45:50.005222+0000","last_undegraded":"2024-04-24T01:45:50.005222+0000","last_fullsized":"2024-04-24T01:45:50.005222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.601049+0000","last_change":"2024-04-24T01:46:38.601104+0000","last_active":"2024-04-24T01:46:38.601049+0000","last_peered":"2024-04-24T01:46:38.601049+0000","last_clean":"2024-04-24T01:46:38.601049+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:46:38.601049+0000","last_undegraded":"2024-04-24T01:46:38.601049+0000","last_fullsized":"2024-04-24T01:46:38.601049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.600952+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:56.752401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:51.088025+0000","last_change":"2024-04-24T01:42:40.776220+0000","last_active":"2024-04-24T01:44:51.088025+0000","last_peered":"2024-04-24T01:44:51.088025+0000","last_clean":"2024-04-24T01:44:51.088025+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:44:51.088025+0000","last_undegraded":"2024-04-24T01:44:51.088025+0000","last_fullsized":"2024-04-24T01:44:51.088025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090710+0000","last_change":"2024-04-24T01:42:42.780704+0000","last_active":"2024-04-24T01:45:06.090710+0000","last_peered":"2024-04-24T01:45:06.090710+0000","last_clean":"2024-04-24T01:45:06.090710+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:45:06.090710+0000","last_undegraded":"2024-04-24T01:45:06.090710+0000","last_fullsized":"2024-04-24T01:45:06.090710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:59.084049+0000","last_change":"2024-04-24T01:42:40.774379+0000","last_active":"2024-04-24T01:44:59.084049+0000","last_peered":"2024-04-24T01:44:59.084049+0000","last_clean":"2024-04-24T01:44:59.084049+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:44:59.084049+0000","last_undegraded":"2024-04-24T01:44:59.084049+0000","last_fullsized":"2024-04-24T01:44:59.084049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.140979+0000","last_change":"2024-04-24T01:46:26.141005+0000","last_active":"2024-04-24T01:46:26.140979+0000","last_peered":"2024-04-24T01:46:26.140979+0000","last_clean":"2024-04-24T01:46:26.140979+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:46:26.140979+0000","last_undegraded":"2024-04-24T01:46:26.140979+0000","last_fullsized":"2024-04-24T01:46:26.140979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.140882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:51.458855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.584641+0000","last_change":"2024-04-24T01:46:35.584676+0000","last_active":"2024-04-24T01:46:35.584641+0000","last_peered":"2024-04-24T01:46:35.584641+0000","last_clean":"2024-04-24T01:46:35.584641+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:46:35.584641+0000","last_undegraded":"2024-04-24T01:46:35.584641+0000","last_fullsized":"2024-04-24T01:46:35.584641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.584557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:35.921550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.671364+0000","last_change":"2024-04-24T01:46:33.671390+0000","last_active":"2024-04-24T01:46:33.671364+0000","last_peered":"2024-04-24T01:46:33.671364+0000","last_clean":"2024-04-24T01:46:33.671364+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:46:33.671364+0000","last_undegraded":"2024-04-24T01:46:33.671364+0000","last_fullsized":"2024-04-24T01:46:33.671364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.671230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:30.461162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.088414+0000","last_change":"2024-04-24T01:42:40.771155+0000","last_active":"2024-04-24T01:44:56.088414+0000","last_peered":"2024-04-24T01:44:56.088414+0000","last_clean":"2024-04-24T01:44:56.088414+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:44:56.088414+0000","last_undegraded":"2024-04-24T01:44:56.088414+0000","last_fullsized":"2024-04-24T01:44:56.088414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.701788+0000","last_change":"2024-04-24T01:46:32.701837+0000","last_active":"2024-04-24T01:46:32.701788+0000","last_peered":"2024-04-24T01:46:32.701788+0000","last_clean":"2024-04-24T01:46:32.701788+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:46:32.701788+0000","last_undegraded":"2024-04-24T01:46:32.701788+0000","last_fullsized":"2024-04-24T01:46:32.701788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.701691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:25.764735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089024+0000","last_change":"2024-04-24T01:42:40.785750+0000","last_active":"2024-04-24T01:44:56.089024+0000","last_peered":"2024-04-24T01:44:56.089024+0000","last_clean":"2024-04-24T01:44:56.089024+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:44:56.089024+0000","last_undegraded":"2024-04-24T01:44:56.089024+0000","last_fullsized":"2024-04-24T01:44:56.089024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.780498+0000","last_change":"2024-04-24T01:46:29.780528+0000","last_active":"2024-04-24T01:46:29.780498+0000","last_peered":"2024-04-24T01:46:29.780498+0000","last_clean":"2024-04-24T01:46:29.780498+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:46:29.780498+0000","last_undegraded":"2024-04-24T01:46:29.780498+0000","last_fullsized":"2024-04-24T01:46:29.780498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.780404+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.221782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.959191+0000","last_change":"2024-04-24T01:42:40.787075+0000","last_active":"2024-04-24T01:45:56.959191+0000","last_peered":"2024-04-24T01:45:56.959191+0000","last_clean":"2024-04-24T01:45:56.959191+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:45:56.959191+0000","last_undegraded":"2024-04-24T01:45:56.959191+0000","last_fullsized":"2024-04-24T01:45:56.959191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.430519+0000","last_change":"2024-04-24T01:46:38.430544+0000","last_active":"2024-04-24T01:46:38.430519+0000","last_peered":"2024-04-24T01:46:38.430519+0000","last_clean":"2024-04-24T01:46:38.430519+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:46:38.430519+0000","last_undegraded":"2024-04-24T01:46:38.430519+0000","last_fullsized":"2024-04-24T01:46:38.430519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.430431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:51.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.843218+0000","last_change":"2024-04-24T01:46:39.843242+0000","last_active":"2024-04-24T01:46:39.843218+0000","last_peered":"2024-04-24T01:46:39.843218+0000","last_clean":"2024-04-24T01:46:39.843218+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:46:39.843218+0000","last_undegraded":"2024-04-24T01:46:39.843218+0000","last_fullsized":"2024-04-24T01:46:39.843218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.843127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:36.633059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.668222+0000","last_change":"2024-04-24T01:46:23.668254+0000","last_active":"2024-04-24T01:46:23.668222+0000","last_peered":"2024-04-24T01:46:23.668222+0000","last_clean":"2024-04-24T01:46:23.668222+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:46:23.668222+0000","last_undegraded":"2024-04-24T01:46:23.668222+0000","last_fullsized":"2024-04-24T01:46:23.668222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.668128+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:28.941092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089944+0000","last_change":"2024-04-24T01:42:40.785768+0000","last_active":"2024-04-24T01:45:01.089944+0000","last_peered":"2024-04-24T01:45:01.089944+0000","last_clean":"2024-04-24T01:45:01.089944+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:45:01.089944+0000","last_undegraded":"2024-04-24T01:45:01.089944+0000","last_fullsized":"2024-04-24T01:45:01.089944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.960993+0000","last_change":"2024-04-24T01:42:40.778631+0000","last_active":"2024-04-24T01:45:56.960993+0000","last_peered":"2024-04-24T01:45:56.960993+0000","last_clean":"2024-04-24T01:45:56.960993+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:45:56.960993+0000","last_undegraded":"2024-04-24T01:45:56.960993+0000","last_fullsized":"2024-04-24T01:45:56.960993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.276553+0000","last_change":"2024-04-24T01:42:42.785218+0000","last_active":"2024-04-24T01:45:50.276553+0000","last_peered":"2024-04-24T01:45:50.276553+0000","last_clean":"2024-04-24T01:45:50.276553+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:45:50.276553+0000","last_undegraded":"2024-04-24T01:45:50.276553+0000","last_fullsized":"2024-04-24T01:45:50.276553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:41.751617+0000","last_clean_scrub_stamp":"2024-04-24T01:42:41.751617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.023253+0000","last_change":"2024-04-24T01:46:34.023306+0000","last_active":"2024-04-24T01:46:34.023253+0000","last_peered":"2024-04-24T01:46:34.023253+0000","last_clean":"2024-04-24T01:46:34.023253+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:46:34.023253+0000","last_undegraded":"2024-04-24T01:46:34.023253+0000","last_fullsized":"2024-04-24T01:46:34.023253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.023152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:00.522740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.717282+0000","last_change":"2024-04-24T01:46:25.717306+0000","last_active":"2024-04-24T01:46:25.717282+0000","last_peered":"2024-04-24T01:46:25.717282+0000","last_clean":"2024-04-24T01:46:25.717282+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:46:25.717282+0000","last_undegraded":"2024-04-24T01:46:25.717282+0000","last_fullsized":"2024-04-24T01:46:25.717282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.717163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:29:26.860189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":478,"ondisk_log_size":478,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640311,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":487424,"data_stored":151081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640312,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":737936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640311,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":739109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":148048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:46:42.177 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.177 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.177 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.177 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.177 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.178 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.179 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.180 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.180 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.180 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.180 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.180 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.180 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.180 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.181 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.181 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.181 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.181 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.181 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.181 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.181 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.182 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.182 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.182 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.182 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.182 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.182 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.182 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T01:42:26.693124+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.183 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.183 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.183 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.183 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.183 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.183 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.183 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T01:42:43.758869+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=43, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.184 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.185 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.185 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.185 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.185 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.185 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.185 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.185 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.186 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.186 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.186 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.186 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.186 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.186 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.186 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.187 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.187 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.187 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.187 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.187 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.187 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.187 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.188 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.189 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.189 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.189 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.189 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.189 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.189 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.189 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.190 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.191 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.191 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T01:42:41.751617+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=41, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:46:42.191 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:47:02.192 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:47:02.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d37ce640 1 Processor -- start 2024-04-24T01:47:02.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d37ce640 1 -- start start 2024-04-24T01:47:02.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d37ce640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb5cc127ce0 0x7fb5cc1280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:02.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d37ce640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5cc127b00 con 0x7fb5cc070100 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d37ce640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb5cc0708e0 con 0x7fb5cc127ce0 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d156a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb5cc127ce0 0x7fb5cc1280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d156a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb5cc127ce0 0x7fb5cc1280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39650/0 (socket says 172.21.15.107:39650) 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d156a640 1 -- 172.21.15.107:0/3365989728 learned_addr learned my addr 172.21.15.107:0/3365989728 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.299+0000 7fb5d0d69640 1 --1- 172.21.15.107:0/3365989728 >> v1:172.21.15.107:6789/0 conn(0x7fb5cc070100 0x7fb5cc12b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:45646/0 (socket says 172.21.15.107:45646) 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.300+0000 7fb5d156a640 1 -- 172.21.15.107:0/3365989728 >> v1:172.21.15.107:6789/0 conn(0x7fb5cc070100 legacy=0x7fb5cc12b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.300+0000 7fb5d156a640 1 -- 172.21.15.107:0/3365989728 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc098800 con 0x7fb5cc127ce0 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.300+0000 7fb5cbfff640 1 -- 172.21.15.107:0/3365989728 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895364562 0 0) 0x7fb5c0001110 con 0x7fb5cc070100 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.300+0000 7fb5d156a640 1 --2- 172.21.15.107:0/3365989728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc127ce0 0x7fb5cc1280c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009e50 tx=0x7fb5c402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f475b0bee39d3fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.300+0000 7fb5cbfff640 1 -- 172.21.15.107:0/3365989728 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c402c8a0 con 0x7fb5cc127ce0 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.300+0000 7fb5cbfff640 1 -- 172.21.15.107:0/3365989728 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c402ca40 con 0x7fb5cc127ce0 2024-04-24T01:47:02.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.300+0000 7fb5cbfff640 1 -- 172.21.15.107:0/3365989728 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c402cd40 con 0x7fb5cc127ce0 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.301+0000 7fb5d37ce640 1 -- 172.21.15.107:0/3365989728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc127ce0 msgr2=0x7fb5cc1280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.301+0000 7fb5d37ce640 1 --2- 172.21.15.107:0/3365989728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc127ce0 0x7fb5cc1280c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009e50 tx=0x7fb5c402bf80 comp rx=0 tx=0).stop 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.301+0000 7fb5d37ce640 1 -- 172.21.15.107:0/3365989728 shutdown_connections 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.301+0000 7fb5d37ce640 1 --2- 172.21.15.107:0/3365989728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc127ce0 0x7fb5cc1280c0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.301+0000 7fb5d37ce640 1 -- 172.21.15.107:0/3365989728 >> 172.21.15.107:0/3365989728 conn(0x7fb5cc099680 msgr2=0x7fb5cc099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.301+0000 7fb5d37ce640 1 -- 172.21.15.107:0/3365989728 shutdown_connections 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.301+0000 7fb5d37ce640 1 -- 172.21.15.107:0/3365989728 wait complete. 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.302+0000 7fb5d37ce640 1 Processor -- start 2024-04-24T01:47:02.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.302+0000 7fb5d37ce640 1 -- start start 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.302+0000 7fb5d37ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc070100 0x7fb5cc12c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.302+0000 7fb5d37ce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc128780 con 0x7fb5cc070100 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.302+0000 7fb5d156a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc070100 0x7fb5cc12c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.302+0000 7fb5d156a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc070100 0x7fb5cc12c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39660/0 (socket says 172.21.15.107:39660) 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.302+0000 7fb5d156a640 1 -- 172.21.15.107:0/2951843054 learned_addr learned my addr 172.21.15.107:0/2951843054 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.303+0000 7fb5d156a640 1 -- 172.21.15.107:0/2951843054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc12d720 con 0x7fb5cc070100 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.303+0000 7fb5d156a640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc070100 0x7fb5cc12c0f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009e50 tx=0x7fb5c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.303+0000 7fb5c9ffb640 1 -- 172.21.15.107:0/2951843054 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c4043020 con 0x7fb5cc070100 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.303+0000 7fb5c9ffb640 1 -- 172.21.15.107:0/2951843054 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c403e660 con 0x7fb5cc070100 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.303+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc125410 con 0x7fb5cc070100 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.303+0000 7fb5c9ffb640 1 -- 172.21.15.107:0/2951843054 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c402c8a0 con 0x7fb5cc070100 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.303+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc12e3b0 con 0x7fb5cc070100 2024-04-24T01:47:02.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.304+0000 7fb5c9ffb640 1 -- 172.21.15.107:0/2951843054 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5c4046020 con 0x7fb5cc070100 2024-04-24T01:47:02.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.304+0000 7fb5c9ffb640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb5b8038060 0x7fb5b803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:02.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.304+0000 7fb5c9ffb640 1 -- 172.21.15.107:0/2951843054 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb5c403a040 con 0x7fb5cc070100 2024-04-24T01:47:02.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.304+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5cc062da0 con 0x7fb5cc070100 2024-04-24T01:47:02.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.304+0000 7fb5d0d69640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb5b8038060 0x7fb5b803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:02.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.305+0000 7fb5d0d69640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb5b8038060 0x7fb5b803a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0000c00 tx=0x7fb5c0001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:02.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.309+0000 7fb5c9ffb640 1 -- 172.21.15.107:0/2951843054 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fb5c404d030 con 0x7fb5cc070100 2024-04-24T01:47:02.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.478+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5cc12d2a0 con 0x7fb5b8038060 2024-04-24T01:47:02.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.493+0000 7fb5c9ffb640 1 -- 172.21.15.107:0/2951843054 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664977 (secure 0 0 0) 0x7fb5cc12d2a0 con 0x7fb5b8038060 2024-04-24T01:47:02.502 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:47:02.508 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:47:02.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb5b8038060 msgr2=0x7fb5b803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:02.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb5b8038060 0x7fb5b803a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0000c00 tx=0x7fb5c0001310 comp rx=0 tx=0).stop 2024-04-24T01:47:02.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc070100 msgr2=0x7fb5cc12c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc070100 0x7fb5cc12c0f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009e50 tx=0x7fb5c4004a40 comp rx=0 tx=0).stop 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 shutdown_connections 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7fb5b8038060 0x7fb5b803a520 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 --2- 172.21.15.107:0/2951843054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc070100 0x7fb5cc12c0f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 >> 172.21.15.107:0/2951843054 conn(0x7fb5cc099680 msgr2=0x7fb5cc126300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 shutdown_connections 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:02.498+0000 7fb5d37ce640 1 -- 172.21.15.107:0/2951843054 wait complete. 2024-04-24T01:47:02.511 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-04-24T01:47:02.086965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5393,"num_read_kb":4942,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5007,"ondisk_log_size":5007,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160888,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326472,"statfs":{"total":386547056640,"available":386382307328,"internally_reserved":0,"allocated":2973696,"data_stored":1776174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003740"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.883674+0000","last_change":"2024-04-24T01:46:35.883674+0000","last_active":"2024-04-24T01:46:35.883674+0000","last_peered":"2024-04-24T01:46:35.883674+0000","last_clean":"2024-04-24T01:46:35.883674+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:46:35.883674+0000","last_undegraded":"2024-04-24T01:46:35.883674+0000","last_fullsized":"2024-04-24T01:46:35.883674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.883557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:30.324934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.691836+0000","last_change":"2024-04-24T01:46:22.691864+0000","last_active":"2024-04-24T01:46:22.691836+0000","last_peered":"2024-04-24T01:46:22.691836+0000","last_clean":"2024-04-24T01:46:22.691836+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:46:22.691836+0000","last_undegraded":"2024-04-24T01:46:22.691836+0000","last_fullsized":"2024-04-24T01:46:22.691836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.691735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:31.620109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.899233+0000","last_change":"2024-04-24T01:46:51.899233+0000","last_active":"2024-04-24T01:46:51.899233+0000","last_peered":"2024-04-24T01:46:51.899233+0000","last_clean":"2024-04-24T01:46:51.899233+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:46:51.899233+0000","last_undegraded":"2024-04-24T01:46:51.899233+0000","last_fullsized":"2024-04-24T01:46:51.899233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:51.899117+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:51.899117+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.899117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:01.559805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.524058+0000","last_change":"2024-04-24T01:46:45.524093+0000","last_active":"2024-04-24T01:46:45.524058+0000","last_peered":"2024-04-24T01:46:45.524058+0000","last_clean":"2024-04-24T01:46:45.524058+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:46:45.524058+0000","last_undegraded":"2024-04-24T01:46:45.524058+0000","last_fullsized":"2024-04-24T01:46:45.524058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:45.523961+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:45.523961+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.523961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:33.787603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.574324+0000","last_change":"2024-04-24T01:46:57.574351+0000","last_active":"2024-04-24T01:46:57.574324+0000","last_peered":"2024-04-24T01:46:57.574324+0000","last_clean":"2024-04-24T01:46:57.574324+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:46:57.574324+0000","last_undegraded":"2024-04-24T01:46:57.574324+0000","last_fullsized":"2024-04-24T01:46:57.574324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:57.574225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:57.574225+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.574225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:53:21.599863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.474764+0000","last_change":"2024-04-24T01:46:42.474835+0000","last_active":"2024-04-24T01:46:42.474764+0000","last_peered":"2024-04-24T01:46:42.474764+0000","last_clean":"2024-04-24T01:46:42.474764+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:46:42.474764+0000","last_undegraded":"2024-04-24T01:46:42.474764+0000","last_fullsized":"2024-04-24T01:46:42.474764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:42.474656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:42.474656+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.474656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:09.390976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.953342+0000","last_change":"2024-04-24T01:46:44.953366+0000","last_active":"2024-04-24T01:46:44.953342+0000","last_peered":"2024-04-24T01:46:44.953342+0000","last_clean":"2024-04-24T01:46:44.953342+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:46:44.953342+0000","last_undegraded":"2024-04-24T01:46:44.953342+0000","last_fullsized":"2024-04-24T01:46:44.953342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:44.953254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:44.953254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.953254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:03.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.454620+0000","last_change":"2024-04-24T01:46:40.454678+0000","last_active":"2024-04-24T01:46:40.454620+0000","last_peered":"2024-04-24T01:46:40.454620+0000","last_clean":"2024-04-24T01:46:40.454620+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:46:40.454620+0000","last_undegraded":"2024-04-24T01:46:40.454620+0000","last_fullsized":"2024-04-24T01:46:40.454620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.454492+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:29.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.531759+0000","last_change":"2024-04-24T01:46:53.531786+0000","last_active":"2024-04-24T01:46:53.531759+0000","last_peered":"2024-04-24T01:46:53.531759+0000","last_clean":"2024-04-24T01:46:53.531759+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:46:53.531759+0000","last_undegraded":"2024-04-24T01:46:53.531759+0000","last_fullsized":"2024-04-24T01:46:53.531759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.531673+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.531673+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.531673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:53:09.240319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.642290+0000","last_change":"2024-04-24T01:46:54.642339+0000","last_active":"2024-04-24T01:46:54.642290+0000","last_peered":"2024-04-24T01:46:54.642290+0000","last_clean":"2024-04-24T01:46:54.642290+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:46:54.642290+0000","last_undegraded":"2024-04-24T01:46:54.642290+0000","last_fullsized":"2024-04-24T01:46:54.642290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.642187+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.642187+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.642187+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:32.194355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.903414+0000","last_change":"2024-04-24T01:46:43.903454+0000","last_active":"2024-04-24T01:46:43.903414+0000","last_peered":"2024-04-24T01:46:43.903414+0000","last_clean":"2024-04-24T01:46:43.903414+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:46:43.903414+0000","last_undegraded":"2024-04-24T01:46:43.903414+0000","last_fullsized":"2024-04-24T01:46:43.903414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:43.903307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:43.903307+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.903307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:56.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.064030+0000","last_change":"2024-04-24T01:46:54.064060+0000","last_active":"2024-04-24T01:46:54.064030+0000","last_peered":"2024-04-24T01:46:54.064030+0000","last_clean":"2024-04-24T01:46:54.064030+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:46:54.064030+0000","last_undegraded":"2024-04-24T01:46:54.064030+0000","last_fullsized":"2024-04-24T01:46:54.064030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.063931+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.063931+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.063931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:17.638374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.623179+0000","last_change":"2024-04-24T01:47:00.623227+0000","last_active":"2024-04-24T01:47:00.623179+0000","last_peered":"2024-04-24T01:47:00.623179+0000","last_clean":"2024-04-24T01:47:00.623179+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:47:00.623179+0000","last_undegraded":"2024-04-24T01:47:00.623179+0000","last_fullsized":"2024-04-24T01:47:00.623179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:00.623079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:00.623079+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.623079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:43:16.932027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.812398+0000","last_change":"2024-04-24T01:46:30.812398+0000","last_active":"2024-04-24T01:46:30.812398+0000","last_peered":"2024-04-24T01:46:30.812398+0000","last_clean":"2024-04-24T01:46:30.812398+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:46:30.812398+0000","last_undegraded":"2024-04-24T01:46:30.812398+0000","last_fullsized":"2024-04-24T01:46:30.812398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.812254+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.118051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.039002+0000","last_change":"2024-04-24T01:46:42.039024+0000","last_active":"2024-04-24T01:46:42.039002+0000","last_peered":"2024-04-24T01:46:42.039002+0000","last_clean":"2024-04-24T01:46:42.039002+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:46:42.039002+0000","last_undegraded":"2024-04-24T01:46:42.039002+0000","last_fullsized":"2024-04-24T01:46:42.039002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:42.038927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:42.038927+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.038927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:42.971477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.884806+0000","last_change":"2024-04-24T01:46:34.884806+0000","last_active":"2024-04-24T01:46:34.884806+0000","last_peered":"2024-04-24T01:46:34.884806+0000","last_clean":"2024-04-24T01:46:34.884806+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:46:34.884806+0000","last_undegraded":"2024-04-24T01:46:34.884806+0000","last_fullsized":"2024-04-24T01:46:34.884806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.884693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:45.893272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.553894+0000","last_change":"2024-04-24T01:46:46.553918+0000","last_active":"2024-04-24T01:46:46.553894+0000","last_peered":"2024-04-24T01:46:46.553894+0000","last_clean":"2024-04-24T01:46:46.553894+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:46:46.553894+0000","last_undegraded":"2024-04-24T01:46:46.553894+0000","last_fullsized":"2024-04-24T01:46:46.553894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:46.553790+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:46.553790+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.553790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:44.288870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.604151+0000","last_change":"2024-04-24T01:46:41.604175+0000","last_active":"2024-04-24T01:46:41.604151+0000","last_peered":"2024-04-24T01:46:41.604151+0000","last_clean":"2024-04-24T01:46:41.604151+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:46:41.604151+0000","last_undegraded":"2024-04-24T01:46:41.604151+0000","last_fullsized":"2024-04-24T01:46:41.604151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:41.604041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:41.604041+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.604041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:59.977227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.624628+0000","last_change":"2024-04-24T01:46:34.624679+0000","last_active":"2024-04-24T01:46:34.624628+0000","last_peered":"2024-04-24T01:46:34.624628+0000","last_clean":"2024-04-24T01:46:34.624628+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:46:34.624628+0000","last_undegraded":"2024-04-24T01:46:34.624628+0000","last_fullsized":"2024-04-24T01:46:34.624628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.624511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:48.418934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.772525+0000","last_change":"2024-04-24T01:46:29.772551+0000","last_active":"2024-04-24T01:46:29.772525+0000","last_peered":"2024-04-24T01:46:29.772525+0000","last_clean":"2024-04-24T01:46:29.772525+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:46:29.772525+0000","last_undegraded":"2024-04-24T01:46:29.772525+0000","last_fullsized":"2024-04-24T01:46:29.772525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.772438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:56.532007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.614118+0000","last_change":"2024-04-24T01:46:44.614151+0000","last_active":"2024-04-24T01:46:44.614118+0000","last_peered":"2024-04-24T01:46:44.614118+0000","last_clean":"2024-04-24T01:46:44.614118+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:46:44.614118+0000","last_undegraded":"2024-04-24T01:46:44.614118+0000","last_fullsized":"2024-04-24T01:46:44.614118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:44.614034+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:44.614034+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.614034+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:23.716834+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.573920+0000","last_change":"2024-04-24T01:46:39.573948+0000","last_active":"2024-04-24T01:46:39.573920+0000","last_peered":"2024-04-24T01:46:39.573920+0000","last_clean":"2024-04-24T01:46:39.573920+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:46:39.573920+0000","last_undegraded":"2024-04-24T01:46:39.573920+0000","last_fullsized":"2024-04-24T01:46:39.573920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.573832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:44.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.111312+0000","last_change":"2024-04-24T01:46:28.111336+0000","last_active":"2024-04-24T01:46:28.111312+0000","last_peered":"2024-04-24T01:46:28.111312+0000","last_clean":"2024-04-24T01:46:28.111312+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:46:28.111312+0000","last_undegraded":"2024-04-24T01:46:28.111312+0000","last_fullsized":"2024-04-24T01:46:28.111312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.111230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:02.142302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.670923+0000","last_change":"2024-04-24T01:46:49.670967+0000","last_active":"2024-04-24T01:46:49.670923+0000","last_peered":"2024-04-24T01:46:49.670923+0000","last_clean":"2024-04-24T01:46:49.670923+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:46:49.670923+0000","last_undegraded":"2024-04-24T01:46:49.670923+0000","last_fullsized":"2024-04-24T01:46:49.670923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:49.670815+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:49.670815+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.670815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:33.464816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.041076+0000","last_change":"2024-04-24T01:46:49.041103+0000","last_active":"2024-04-24T01:46:49.041076+0000","last_peered":"2024-04-24T01:46:49.041076+0000","last_clean":"2024-04-24T01:46:49.041076+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:46:49.041076+0000","last_undegraded":"2024-04-24T01:46:49.041076+0000","last_fullsized":"2024-04-24T01:46:49.041076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:49.040983+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:49.040983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.040983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:52.960393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.936697+0000","last_change":"2024-04-24T01:46:50.936723+0000","last_active":"2024-04-24T01:46:50.936697+0000","last_peered":"2024-04-24T01:46:50.936697+0000","last_clean":"2024-04-24T01:46:50.936697+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:46:50.936697+0000","last_undegraded":"2024-04-24T01:46:50.936697+0000","last_fullsized":"2024-04-24T01:46:50.936697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.936606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.936606+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.936606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:13.077347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.792229+0000","last_change":"2024-04-24T01:46:27.792262+0000","last_active":"2024-04-24T01:46:27.792229+0000","last_peered":"2024-04-24T01:46:27.792229+0000","last_clean":"2024-04-24T01:46:27.792229+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:46:27.792229+0000","last_undegraded":"2024-04-24T01:46:27.792229+0000","last_fullsized":"2024-04-24T01:46:27.792229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.792141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:43.543336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.595593+0000","last_change":"2024-04-24T01:46:58.595622+0000","last_active":"2024-04-24T01:46:58.595593+0000","last_peered":"2024-04-24T01:46:58.595593+0000","last_clean":"2024-04-24T01:46:58.595593+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:46:58.595593+0000","last_undegraded":"2024-04-24T01:46:58.595593+0000","last_fullsized":"2024-04-24T01:46:58.595593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:58.595487+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:58.595487+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.595487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:29.835584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.362100+0000","last_change":"2024-04-24T01:42:50.802941+0000","last_active":"2024-04-24T01:45:50.362100+0000","last_peered":"2024-04-24T01:45:50.362100+0000","last_clean":"2024-04-24T01:45:50.362100+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:45:50.362100+0000","last_undegraded":"2024-04-24T01:45:50.362100+0000","last_fullsized":"2024-04-24T01:45:50.362100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.492346+0000","last_change":"2024-04-24T01:46:33.492406+0000","last_active":"2024-04-24T01:46:33.492346+0000","last_peered":"2024-04-24T01:46:33.492346+0000","last_clean":"2024-04-24T01:46:33.492346+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:46:33.492346+0000","last_undegraded":"2024-04-24T01:46:33.492346+0000","last_fullsized":"2024-04-24T01:46:33.492346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.492233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:04.065546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.547462+0000","last_change":"2024-04-24T01:46:49.547488+0000","last_active":"2024-04-24T01:46:49.547462+0000","last_peered":"2024-04-24T01:46:49.547462+0000","last_clean":"2024-04-24T01:46:49.547462+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:46:49.547462+0000","last_undegraded":"2024-04-24T01:46:49.547462+0000","last_fullsized":"2024-04-24T01:46:49.547462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:49.547352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:49.547352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.547352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:40.238735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.152740+0000","last_change":"2024-04-24T01:46:01.152762+0000","last_active":"2024-04-24T01:46:01.152740+0000","last_peered":"2024-04-24T01:46:01.152740+0000","last_clean":"2024-04-24T01:46:01.152740+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:46:01.152740+0000","last_undegraded":"2024-04-24T01:46:01.152740+0000","last_fullsized":"2024-04-24T01:46:01.152740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.152654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:54.458451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":117,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.339667+0000","last_change":"2024-04-24T01:46:24.339700+0000","last_active":"2024-04-24T01:46:24.339667+0000","last_peered":"2024-04-24T01:46:24.339667+0000","last_clean":"2024-04-24T01:46:24.339667+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:46:24.339667+0000","last_undegraded":"2024-04-24T01:46:24.339667+0000","last_fullsized":"2024-04-24T01:46:24.339667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.339579+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:22.912549+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.697863+0000","last_change":"2024-04-24T01:46:20.697897+0000","last_active":"2024-04-24T01:46:20.697863+0000","last_peered":"2024-04-24T01:46:20.697863+0000","last_clean":"2024-04-24T01:46:20.697863+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:46:20.697863+0000","last_undegraded":"2024-04-24T01:46:20.697863+0000","last_fullsized":"2024-04-24T01:46:20.697863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.697714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:08.843035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.498905+0000","last_change":"2024-04-24T01:46:59.498955+0000","last_active":"2024-04-24T01:46:59.498905+0000","last_peered":"2024-04-24T01:46:59.498905+0000","last_clean":"2024-04-24T01:46:59.498905+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:46:59.498905+0000","last_undegraded":"2024-04-24T01:46:59.498905+0000","last_fullsized":"2024-04-24T01:46:59.498905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:59.498781+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:59.498781+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.498781+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:31.347722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.435384+0000","last_change":"2024-04-24T01:46:36.435421+0000","last_active":"2024-04-24T01:46:36.435384+0000","last_peered":"2024-04-24T01:46:36.435384+0000","last_clean":"2024-04-24T01:46:36.435384+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:46:36.435384+0000","last_undegraded":"2024-04-24T01:46:36.435384+0000","last_fullsized":"2024-04-24T01:46:36.435384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.435300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:00.290885+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.838674+0000","last_change":"2024-04-24T01:46:33.838724+0000","last_active":"2024-04-24T01:46:33.838674+0000","last_peered":"2024-04-24T01:46:33.838674+0000","last_clean":"2024-04-24T01:46:33.838674+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:46:33.838674+0000","last_undegraded":"2024-04-24T01:46:33.838674+0000","last_fullsized":"2024-04-24T01:46:33.838674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.838566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:49.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.293308+0000","last_change":"2024-04-24T01:46:19.293332+0000","last_active":"2024-04-24T01:46:19.293308+0000","last_peered":"2024-04-24T01:46:19.293308+0000","last_clean":"2024-04-24T01:46:19.293308+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:46:19.293308+0000","last_undegraded":"2024-04-24T01:46:19.293308+0000","last_fullsized":"2024-04-24T01:46:19.293308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.293213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:34.753066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.489009+0000","last_change":"2024-04-24T01:46:03.489046+0000","last_active":"2024-04-24T01:46:03.489009+0000","last_peered":"2024-04-24T01:46:03.489009+0000","last_clean":"2024-04-24T01:46:03.489009+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:46:03.489009+0000","last_undegraded":"2024-04-24T01:46:03.489009+0000","last_fullsized":"2024-04-24T01:46:03.489009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.488913+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:54.619923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.532812+0000","last_change":"2024-04-24T01:46:04.532851+0000","last_active":"2024-04-24T01:46:04.532812+0000","last_peered":"2024-04-24T01:46:04.532812+0000","last_clean":"2024-04-24T01:46:04.532812+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:46:04.532812+0000","last_undegraded":"2024-04-24T01:46:04.532812+0000","last_fullsized":"2024-04-24T01:46:04.532812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.532716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:21.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.927860+0000","last_change":"2024-04-24T01:46:57.927893+0000","last_active":"2024-04-24T01:46:57.927860+0000","last_peered":"2024-04-24T01:46:57.927860+0000","last_clean":"2024-04-24T01:46:57.927860+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:46:57.927860+0000","last_undegraded":"2024-04-24T01:46:57.927860+0000","last_fullsized":"2024-04-24T01:46:57.927860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:57.927771+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:57.927771+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.927771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:33:30.002077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.557245+0000","last_change":"2024-04-24T01:46:48.557275+0000","last_active":"2024-04-24T01:46:48.557245+0000","last_peered":"2024-04-24T01:46:48.557245+0000","last_clean":"2024-04-24T01:46:48.557245+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:46:48.557245+0000","last_undegraded":"2024-04-24T01:46:48.557245+0000","last_fullsized":"2024-04-24T01:46:48.557245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:48.557121+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:48.557121+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.557121+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:27.827410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089744+0000","last_change":"2024-04-24T01:42:40.790240+0000","last_active":"2024-04-24T01:45:01.089744+0000","last_peered":"2024-04-24T01:45:01.089744+0000","last_clean":"2024-04-24T01:45:01.089744+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:45:01.089744+0000","last_undegraded":"2024-04-24T01:45:01.089744+0000","last_fullsized":"2024-04-24T01:45:01.089744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.183355+0000","last_change":"2024-04-24T01:46:15.183378+0000","last_active":"2024-04-24T01:46:15.183355+0000","last_peered":"2024-04-24T01:46:15.183355+0000","last_clean":"2024-04-24T01:46:15.183355+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:46:15.183355+0000","last_undegraded":"2024-04-24T01:46:15.183355+0000","last_fullsized":"2024-04-24T01:46:15.183355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.183254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:00.909604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.849954+0000","last_change":"2024-04-24T01:46:08.849993+0000","last_active":"2024-04-24T01:46:08.849954+0000","last_peered":"2024-04-24T01:46:08.849954+0000","last_clean":"2024-04-24T01:46:08.849954+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:46:08.849954+0000","last_undegraded":"2024-04-24T01:46:08.849954+0000","last_fullsized":"2024-04-24T01:46:08.849954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.849869+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:59.980879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":397,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.286885+0000","last_change":"2024-04-24T01:46:23.286945+0000","last_active":"2024-04-24T01:46:23.286885+0000","last_peered":"2024-04-24T01:46:23.286885+0000","last_clean":"2024-04-24T01:46:23.286885+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:46:23.286885+0000","last_undegraded":"2024-04-24T01:46:23.286885+0000","last_fullsized":"2024-04-24T01:46:23.286885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.286754+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:45:55.452597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.048742+0000","last_change":"2024-04-24T01:46:52.048768+0000","last_active":"2024-04-24T01:46:52.048742+0000","last_peered":"2024-04-24T01:46:52.048742+0000","last_clean":"2024-04-24T01:46:52.048742+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:46:52.048742+0000","last_undegraded":"2024-04-24T01:46:52.048742+0000","last_fullsized":"2024-04-24T01:46:52.048742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:52.048656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:52.048656+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.048656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:31.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.867248+0000","last_change":"2024-04-24T01:46:54.867278+0000","last_active":"2024-04-24T01:46:54.867248+0000","last_peered":"2024-04-24T01:46:54.867248+0000","last_clean":"2024-04-24T01:46:54.867248+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:46:54.867248+0000","last_undegraded":"2024-04-24T01:46:54.867248+0000","last_fullsized":"2024-04-24T01:46:54.867248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:54.867147+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:54.867147+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.867147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:52.237810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.590779+0000","last_change":"2024-04-24T01:46:43.590810+0000","last_active":"2024-04-24T01:46:43.590779+0000","last_peered":"2024-04-24T01:46:43.590779+0000","last_clean":"2024-04-24T01:46:43.590779+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:46:43.590779+0000","last_undegraded":"2024-04-24T01:46:43.590779+0000","last_fullsized":"2024-04-24T01:46:43.590779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:43.590695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:43.590695+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.590695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:20.764987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.208983+0000","last_change":"2024-04-24T01:46:03.209024+0000","last_active":"2024-04-24T01:46:03.208983+0000","last_peered":"2024-04-24T01:46:03.208983+0000","last_clean":"2024-04-24T01:46:03.208983+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:46:03.208983+0000","last_undegraded":"2024-04-24T01:46:03.208983+0000","last_fullsized":"2024-04-24T01:46:03.208983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.208890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:44.835582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.856137+0000","last_change":"2024-04-24T01:46:05.856196+0000","last_active":"2024-04-24T01:46:05.856137+0000","last_peered":"2024-04-24T01:46:05.856137+0000","last_clean":"2024-04-24T01:46:05.856137+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:46:05.856137+0000","last_undegraded":"2024-04-24T01:46:05.856137+0000","last_fullsized":"2024-04-24T01:46:05.856137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.856052+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:35.561294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.187919+0000","last_change":"2024-04-24T01:46:06.187946+0000","last_active":"2024-04-24T01:46:06.187919+0000","last_peered":"2024-04-24T01:46:06.187919+0000","last_clean":"2024-04-24T01:46:06.187919+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:46:06.187919+0000","last_undegraded":"2024-04-24T01:46:06.187919+0000","last_fullsized":"2024-04-24T01:46:06.187919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.187813+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:35.370509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.287548+0000","last_change":"2024-04-24T01:46:17.287580+0000","last_active":"2024-04-24T01:46:17.287548+0000","last_peered":"2024-04-24T01:46:17.287548+0000","last_clean":"2024-04-24T01:46:17.287548+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:46:17.287548+0000","last_undegraded":"2024-04-24T01:46:17.287548+0000","last_fullsized":"2024-04-24T01:46:17.287548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.287452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:10.198303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.871524+0000","last_change":"2024-04-24T01:46:37.871548+0000","last_active":"2024-04-24T01:46:37.871524+0000","last_peered":"2024-04-24T01:46:37.871524+0000","last_clean":"2024-04-24T01:46:37.871524+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:46:37.871524+0000","last_undegraded":"2024-04-24T01:46:37.871524+0000","last_fullsized":"2024-04-24T01:46:37.871524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.871441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:18.210191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.610612+0000","last_change":"2024-04-24T01:46:10.610641+0000","last_active":"2024-04-24T01:46:10.610612+0000","last_peered":"2024-04-24T01:46:10.610612+0000","last_clean":"2024-04-24T01:46:10.610612+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:46:10.610612+0000","last_undegraded":"2024-04-24T01:46:10.610612+0000","last_fullsized":"2024-04-24T01:46:10.610612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.610513+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:05.321177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.823361+0000","last_change":"2024-04-24T01:46:11.823412+0000","last_active":"2024-04-24T01:46:11.823361+0000","last_peered":"2024-04-24T01:46:11.823361+0000","last_clean":"2024-04-24T01:46:11.823361+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:46:11.823361+0000","last_undegraded":"2024-04-24T01:46:11.823361+0000","last_fullsized":"2024-04-24T01:46:11.823361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.823285+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:43.489332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.206754+0000","last_change":"2024-04-24T01:46:03.206777+0000","last_active":"2024-04-24T01:46:03.206754+0000","last_peered":"2024-04-24T01:46:03.206754+0000","last_clean":"2024-04-24T01:46:03.206754+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:46:03.206754+0000","last_undegraded":"2024-04-24T01:46:03.206754+0000","last_fullsized":"2024-04-24T01:46:03.206754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.206669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:46.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.998764+0000","last_change":"2024-04-24T01:46:49.998764+0000","last_active":"2024-04-24T01:46:49.998764+0000","last_peered":"2024-04-24T01:46:49.998764+0000","last_clean":"2024-04-24T01:46:49.998764+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:46:49.998764+0000","last_undegraded":"2024-04-24T01:46:49.998764+0000","last_fullsized":"2024-04-24T01:46:49.998764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:49.998606+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:49.998606+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.998606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:48.359394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.762268+0000","last_change":"2024-04-24T01:46:30.762304+0000","last_active":"2024-04-24T01:46:30.762268+0000","last_peered":"2024-04-24T01:46:30.762268+0000","last_clean":"2024-04-24T01:46:30.762268+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:46:30.762268+0000","last_undegraded":"2024-04-24T01:46:30.762268+0000","last_fullsized":"2024-04-24T01:46:30.762268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.762170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:25.539809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.959289+0000","last_change":"2024-04-24T01:46:45.959316+0000","last_active":"2024-04-24T01:46:45.959289+0000","last_peered":"2024-04-24T01:46:45.959289+0000","last_clean":"2024-04-24T01:46:45.959289+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:46:45.959289+0000","last_undegraded":"2024-04-24T01:46:45.959289+0000","last_fullsized":"2024-04-24T01:46:45.959289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:45.959202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:45.959202+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.959202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:51.265107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.170777+0000","last_change":"2024-04-24T01:46:23.170837+0000","last_active":"2024-04-24T01:46:23.170777+0000","last_peered":"2024-04-24T01:46:23.170777+0000","last_clean":"2024-04-24T01:46:23.170777+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:46:23.170777+0000","last_undegraded":"2024-04-24T01:46:23.170777+0000","last_fullsized":"2024-04-24T01:46:23.170777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.170664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:17.051548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'46","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.289839+0000","last_change":"2024-04-24T01:46:07.289877+0000","last_active":"2024-04-24T01:46:07.289839+0000","last_peered":"2024-04-24T01:46:07.289839+0000","last_clean":"2024-04-24T01:46:07.289839+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:46:07.289839+0000","last_undegraded":"2024-04-24T01:46:07.289839+0000","last_fullsized":"2024-04-24T01:46:07.289839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.289738+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:04.439196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.283569+0000","last_change":"2024-04-24T01:46:00.283592+0000","last_active":"2024-04-24T01:46:00.283569+0000","last_peered":"2024-04-24T01:46:00.283569+0000","last_clean":"2024-04-24T01:46:00.283569+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:46:00.283569+0000","last_undegraded":"2024-04-24T01:46:00.283569+0000","last_fullsized":"2024-04-24T01:46:00.283569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.283490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:35.270360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.628016+0000","last_change":"2024-04-24T01:46:56.628016+0000","last_active":"2024-04-24T01:46:56.628016+0000","last_peered":"2024-04-24T01:46:56.628016+0000","last_clean":"2024-04-24T01:46:56.628016+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:46:56.628016+0000","last_undegraded":"2024-04-24T01:46:56.628016+0000","last_fullsized":"2024-04-24T01:46:56.628016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:56.627869+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:56.627869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.627869+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:25.561990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.848013+0000","last_change":"2024-04-24T01:46:36.848059+0000","last_active":"2024-04-24T01:46:36.848013+0000","last_peered":"2024-04-24T01:46:36.848013+0000","last_clean":"2024-04-24T01:46:36.848013+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:46:36.848013+0000","last_undegraded":"2024-04-24T01:46:36.848013+0000","last_fullsized":"2024-04-24T01:46:36.848013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.847905+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:33.997362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089105+0000","last_change":"2024-04-24T01:42:40.790278+0000","last_active":"2024-04-24T01:44:56.089105+0000","last_peered":"2024-04-24T01:44:56.089105+0000","last_clean":"2024-04-24T01:44:56.089105+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:44:56.089105+0000","last_undegraded":"2024-04-24T01:44:56.089105+0000","last_fullsized":"2024-04-24T01:44:56.089105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.256531+0000","last_change":"2024-04-24T01:46:20.256556+0000","last_active":"2024-04-24T01:46:20.256531+0000","last_peered":"2024-04-24T01:46:20.256531+0000","last_clean":"2024-04-24T01:46:20.256531+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:46:20.256531+0000","last_undegraded":"2024-04-24T01:46:20.256531+0000","last_fullsized":"2024-04-24T01:46:20.256531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.256445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:51.251216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'61","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.271123+0000","last_change":"2024-04-24T01:46:05.271175+0000","last_active":"2024-04-24T01:46:05.271123+0000","last_peered":"2024-04-24T01:46:05.271123+0000","last_clean":"2024-04-24T01:46:05.271123+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:46:05.271123+0000","last_undegraded":"2024-04-24T01:46:05.271123+0000","last_fullsized":"2024-04-24T01:46:05.271123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'61","last_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_deep_scrub":"34'61","last_deep_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.271031+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:16.279610+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.199454+0000","last_change":"2024-04-24T01:46:09.199480+0000","last_active":"2024-04-24T01:46:09.199454+0000","last_peered":"2024-04-24T01:46:09.199454+0000","last_clean":"2024-04-24T01:46:09.199454+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:46:09.199454+0000","last_undegraded":"2024-04-24T01:46:09.199454+0000","last_fullsized":"2024-04-24T01:46:09.199454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.199345+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:53.841686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.967860+0000","last_change":"2024-04-24T01:46:58.967887+0000","last_active":"2024-04-24T01:46:58.967860+0000","last_peered":"2024-04-24T01:46:58.967860+0000","last_clean":"2024-04-24T01:46:58.967860+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:46:58.967860+0000","last_undegraded":"2024-04-24T01:46:58.967860+0000","last_fullsized":"2024-04-24T01:46:58.967860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:58.967754+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:58.967754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.967754+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:40.745058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.692643+0000","last_change":"2024-04-24T01:46:25.692666+0000","last_active":"2024-04-24T01:46:25.692643+0000","last_peered":"2024-04-24T01:46:25.692643+0000","last_clean":"2024-04-24T01:46:25.692643+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:46:25.692643+0000","last_undegraded":"2024-04-24T01:46:25.692643+0000","last_fullsized":"2024-04-24T01:46:25.692643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.692556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:03:26.488607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089004+0000","last_change":"2024-04-24T01:42:40.776747+0000","last_active":"2024-04-24T01:44:56.089004+0000","last_peered":"2024-04-24T01:44:56.089004+0000","last_clean":"2024-04-24T01:44:56.089004+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:44:56.089004+0000","last_undegraded":"2024-04-24T01:44:56.089004+0000","last_fullsized":"2024-04-24T01:44:56.089004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.205515+0000","last_change":"2024-04-24T01:46:22.205537+0000","last_active":"2024-04-24T01:46:22.205515+0000","last_peered":"2024-04-24T01:46:22.205515+0000","last_clean":"2024-04-24T01:46:22.205515+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:46:22.205515+0000","last_undegraded":"2024-04-24T01:46:22.205515+0000","last_fullsized":"2024-04-24T01:46:22.205515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.205433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:02.910528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'77","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.298350+0000","last_change":"2024-04-24T01:46:15.298393+0000","last_active":"2024-04-24T01:46:15.298350+0000","last_peered":"2024-04-24T01:46:15.298350+0000","last_clean":"2024-04-24T01:46:15.298350+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:46:15.298350+0000","last_undegraded":"2024-04-24T01:46:15.298350+0000","last_fullsized":"2024-04-24T01:46:15.298350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.298262+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:33.449711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.165926+0000","last_change":"2024-04-24T01:46:25.165949+0000","last_active":"2024-04-24T01:46:25.165926+0000","last_peered":"2024-04-24T01:46:25.165926+0000","last_clean":"2024-04-24T01:46:25.165926+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:46:25.165926+0000","last_undegraded":"2024-04-24T01:46:25.165926+0000","last_fullsized":"2024-04-24T01:46:25.165926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.165833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:38.566634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.446144+0000","last_change":"2024-04-24T01:42:50.802460+0000","last_active":"2024-04-24T01:45:50.446144+0000","last_peered":"2024-04-24T01:45:50.446144+0000","last_clean":"2024-04-24T01:45:50.446144+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:45:50.446144+0000","last_undegraded":"2024-04-24T01:45:50.446144+0000","last_fullsized":"2024-04-24T01:45:50.446144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.606632+0000","last_change":"2024-04-24T01:46:42.606660+0000","last_active":"2024-04-24T01:46:42.606632+0000","last_peered":"2024-04-24T01:46:42.606632+0000","last_clean":"2024-04-24T01:46:42.606632+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:46:42.606632+0000","last_undegraded":"2024-04-24T01:46:42.606632+0000","last_fullsized":"2024-04-24T01:46:42.606632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:42.606517+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:42.606517+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.606517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:22.631331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.003664+0000","last_change":"2024-04-24T01:46:38.003689+0000","last_active":"2024-04-24T01:46:38.003664+0000","last_peered":"2024-04-24T01:46:38.003664+0000","last_clean":"2024-04-24T01:46:38.003664+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:46:38.003664+0000","last_undegraded":"2024-04-24T01:46:38.003664+0000","last_fullsized":"2024-04-24T01:46:38.003664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.003576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:03.732204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.833874+0000","last_change":"2024-04-24T01:46:16.833895+0000","last_active":"2024-04-24T01:46:16.833874+0000","last_peered":"2024-04-24T01:46:16.833874+0000","last_clean":"2024-04-24T01:46:16.833874+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:46:16.833874+0000","last_undegraded":"2024-04-24T01:46:16.833874+0000","last_fullsized":"2024-04-24T01:46:16.833874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.833759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:04.866593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.517297+0000","last_change":"2024-04-24T01:46:05.517337+0000","last_active":"2024-04-24T01:46:05.517297+0000","last_peered":"2024-04-24T01:46:05.517297+0000","last_clean":"2024-04-24T01:46:05.517297+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:46:05.517297+0000","last_undegraded":"2024-04-24T01:46:05.517297+0000","last_fullsized":"2024-04-24T01:46:05.517297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.517182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.149356+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.480572+0000","last_change":"2024-04-24T01:46:35.480613+0000","last_active":"2024-04-24T01:46:35.480572+0000","last_peered":"2024-04-24T01:46:35.480572+0000","last_clean":"2024-04-24T01:46:35.480572+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:46:35.480572+0000","last_undegraded":"2024-04-24T01:46:35.480572+0000","last_fullsized":"2024-04-24T01:46:35.480572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.480455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:57.552982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.503496+0000","last_change":"2024-04-24T01:46:51.503526+0000","last_active":"2024-04-24T01:46:51.503496+0000","last_peered":"2024-04-24T01:46:51.503496+0000","last_clean":"2024-04-24T01:46:51.503496+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:46:51.503496+0000","last_undegraded":"2024-04-24T01:46:51.503496+0000","last_fullsized":"2024-04-24T01:46:51.503496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:51.503412+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:51.503412+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.503412+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:08.069919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.469267+0000","last_change":"2024-04-24T01:46:37.469297+0000","last_active":"2024-04-24T01:46:37.469267+0000","last_peered":"2024-04-24T01:46:37.469267+0000","last_clean":"2024-04-24T01:46:37.469267+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:46:37.469267+0000","last_undegraded":"2024-04-24T01:46:37.469267+0000","last_fullsized":"2024-04-24T01:46:37.469267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.469176+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:59.897731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.497980+0000","last_change":"2024-04-24T01:46:52.497980+0000","last_active":"2024-04-24T01:46:52.497980+0000","last_peered":"2024-04-24T01:46:52.497980+0000","last_clean":"2024-04-24T01:46:52.497980+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:46:52.497980+0000","last_undegraded":"2024-04-24T01:46:52.497980+0000","last_fullsized":"2024-04-24T01:46:52.497980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:52.497803+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:52.497803+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.497803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:57.481894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.269181+0000","last_change":"2024-04-24T01:46:18.269204+0000","last_active":"2024-04-24T01:46:18.269181+0000","last_peered":"2024-04-24T01:46:18.269181+0000","last_clean":"2024-04-24T01:46:18.269181+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:46:18.269181+0000","last_undegraded":"2024-04-24T01:46:18.269181+0000","last_fullsized":"2024-04-24T01:46:18.269181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.269076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:04.262085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.851173+0000","last_change":"2024-04-24T01:46:13.851216+0000","last_active":"2024-04-24T01:46:13.851173+0000","last_peered":"2024-04-24T01:46:13.851173+0000","last_clean":"2024-04-24T01:46:13.851173+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:46:13.851173+0000","last_undegraded":"2024-04-24T01:46:13.851173+0000","last_fullsized":"2024-04-24T01:46:13.851173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.851090+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:47.344034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.859142+0000","last_change":"2024-04-24T01:46:10.859209+0000","last_active":"2024-04-24T01:46:10.859142+0000","last_peered":"2024-04-24T01:46:10.859142+0000","last_clean":"2024-04-24T01:46:10.859142+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:46:10.859142+0000","last_undegraded":"2024-04-24T01:46:10.859142+0000","last_fullsized":"2024-04-24T01:46:10.859142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.859037+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:04.491211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.888378+0000","last_change":"2024-04-24T01:46:56.888439+0000","last_active":"2024-04-24T01:46:56.888378+0000","last_peered":"2024-04-24T01:46:56.888378+0000","last_clean":"2024-04-24T01:46:56.888378+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:46:56.888378+0000","last_undegraded":"2024-04-24T01:46:56.888378+0000","last_fullsized":"2024-04-24T01:46:56.888378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-24T01:46:56.888278+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-24T01:46:56.888278+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.888278+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:11.138110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.885308+0000","last_change":"2024-04-24T01:46:38.885337+0000","last_active":"2024-04-24T01:46:38.885308+0000","last_peered":"2024-04-24T01:46:38.885308+0000","last_clean":"2024-04-24T01:46:38.885308+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:46:38.885308+0000","last_undegraded":"2024-04-24T01:46:38.885308+0000","last_fullsized":"2024-04-24T01:46:38.885308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.885209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:47.529841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084184+0000","last_change":"2024-04-24T01:42:40.789191+0000","last_active":"2024-04-24T01:46:01.084184+0000","last_peered":"2024-04-24T01:46:01.084184+0000","last_clean":"2024-04-24T01:46:01.084184+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:46:01.084184+0000","last_undegraded":"2024-04-24T01:46:01.084184+0000","last_fullsized":"2024-04-24T01:46:01.084184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.615925+0000","last_change":"2024-04-24T01:46:14.615987+0000","last_active":"2024-04-24T01:46:14.615925+0000","last_peered":"2024-04-24T01:46:14.615925+0000","last_clean":"2024-04-24T01:46:14.615925+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:46:14.615925+0000","last_undegraded":"2024-04-24T01:46:14.615925+0000","last_fullsized":"2024-04-24T01:46:14.615925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.615812+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:51.435210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.266574+0000","last_change":"2024-04-24T01:46:13.266610+0000","last_active":"2024-04-24T01:46:13.266574+0000","last_peered":"2024-04-24T01:46:13.266574+0000","last_clean":"2024-04-24T01:46:13.266574+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:46:13.266574+0000","last_undegraded":"2024-04-24T01:46:13.266574+0000","last_fullsized":"2024-04-24T01:46:13.266574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.266484+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:40.059339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.594456+0000","last_change":"2024-04-24T01:46:08.594502+0000","last_active":"2024-04-24T01:46:08.594456+0000","last_peered":"2024-04-24T01:46:08.594456+0000","last_clean":"2024-04-24T01:46:08.594456+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:46:08.594456+0000","last_undegraded":"2024-04-24T01:46:08.594456+0000","last_fullsized":"2024-04-24T01:46:08.594456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.594330+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:42.087274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.815766+0000","last_change":"2024-04-24T01:46:22.815766+0000","last_active":"2024-04-24T01:46:22.815766+0000","last_peered":"2024-04-24T01:46:22.815766+0000","last_clean":"2024-04-24T01:46:22.815766+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:46:22.815766+0000","last_undegraded":"2024-04-24T01:46:22.815766+0000","last_fullsized":"2024-04-24T01:46:22.815766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.815603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:58.313433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.692939+0000","last_change":"2024-04-24T01:46:18.692968+0000","last_active":"2024-04-24T01:46:18.692939+0000","last_peered":"2024-04-24T01:46:18.692939+0000","last_clean":"2024-04-24T01:46:18.692939+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:46:18.692939+0000","last_undegraded":"2024-04-24T01:46:18.692939+0000","last_fullsized":"2024-04-24T01:46:18.692939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.692855+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:30.275139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.580440+0000","last_change":"2024-04-24T01:46:59.580440+0000","last_active":"2024-04-24T01:46:59.580440+0000","last_peered":"2024-04-24T01:46:59.580440+0000","last_clean":"2024-04-24T01:46:59.580440+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:46:59.580440+0000","last_undegraded":"2024-04-24T01:46:59.580440+0000","last_fullsized":"2024-04-24T01:46:59.580440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:59.580314+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:59.580314+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.580314+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:38.621627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.286609+0000","last_change":"2024-04-24T01:46:06.286638+0000","last_active":"2024-04-24T01:46:06.286609+0000","last_peered":"2024-04-24T01:46:06.286609+0000","last_clean":"2024-04-24T01:46:06.286609+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:46:06.286609+0000","last_undegraded":"2024-04-24T01:46:06.286609+0000","last_fullsized":"2024-04-24T01:46:06.286609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.286518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:00.727895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.470050+0000","last_change":"2024-04-24T01:46:02.470098+0000","last_active":"2024-04-24T01:46:02.470050+0000","last_peered":"2024-04-24T01:46:02.470050+0000","last_clean":"2024-04-24T01:46:02.470050+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:46:02.470050+0000","last_undegraded":"2024-04-24T01:46:02.470050+0000","last_fullsized":"2024-04-24T01:46:02.470050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.469953+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:28.856113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.853399+0000","last_change":"2024-04-24T01:46:00.853423+0000","last_active":"2024-04-24T01:46:00.853399+0000","last_peered":"2024-04-24T01:46:00.853399+0000","last_clean":"2024-04-24T01:46:00.853399+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:46:00.853399+0000","last_undegraded":"2024-04-24T01:46:00.853399+0000","last_fullsized":"2024-04-24T01:46:00.853399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.853310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:00.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.587848+0000","last_change":"2024-04-24T01:46:57.587848+0000","last_active":"2024-04-24T01:46:57.587848+0000","last_peered":"2024-04-24T01:46:57.587848+0000","last_clean":"2024-04-24T01:46:57.587848+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:46:57.587848+0000","last_undegraded":"2024-04-24T01:46:57.587848+0000","last_fullsized":"2024-04-24T01:46:57.587848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:46:57.587726+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:46:57.587726+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.587726+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:52.339001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.335882+0000","last_change":"2024-04-24T01:46:16.335882+0000","last_active":"2024-04-24T01:46:16.335882+0000","last_peered":"2024-04-24T01:46:16.335882+0000","last_clean":"2024-04-24T01:46:16.335882+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:46:16.335882+0000","last_undegraded":"2024-04-24T01:46:16.335882+0000","last_fullsized":"2024-04-24T01:46:16.335882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.335729+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:21.641635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.628222+0000","last_change":"2024-04-24T01:46:46.628258+0000","last_active":"2024-04-24T01:46:46.628222+0000","last_peered":"2024-04-24T01:46:46.628222+0000","last_clean":"2024-04-24T01:46:46.628222+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:46:46.628222+0000","last_undegraded":"2024-04-24T01:46:46.628222+0000","last_fullsized":"2024-04-24T01:46:46.628222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-24T01:46:46.628127+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-24T01:46:46.628127+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.628127+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:17.157394+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084094+0000","last_change":"2024-04-24T01:42:32.734681+0000","last_active":"2024-04-24T01:46:01.084094+0000","last_peered":"2024-04-24T01:46:01.084094+0000","last_clean":"2024-04-24T01:46:01.084094+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:46:01.084094+0000","last_undegraded":"2024-04-24T01:46:01.084094+0000","last_fullsized":"2024-04-24T01:46:01.084094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.602456+0000","last_change":"2024-04-24T01:46:55.602479+0000","last_active":"2024-04-24T01:46:55.602456+0000","last_peered":"2024-04-24T01:46:55.602456+0000","last_clean":"2024-04-24T01:46:55.602456+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:46:55.602456+0000","last_undegraded":"2024-04-24T01:46:55.602456+0000","last_fullsized":"2024-04-24T01:46:55.602456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:55.602359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:55.602359+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.602359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:37.653272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.646347+0000","last_change":"2024-04-24T01:46:15.646347+0000","last_active":"2024-04-24T01:46:15.646347+0000","last_peered":"2024-04-24T01:46:15.646347+0000","last_clean":"2024-04-24T01:46:15.646347+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:46:15.646347+0000","last_undegraded":"2024-04-24T01:46:15.646347+0000","last_fullsized":"2024-04-24T01:46:15.646347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.646240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:26.583381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.349875+0000","last_change":"2024-04-24T01:46:26.349962+0000","last_active":"2024-04-24T01:46:26.349875+0000","last_peered":"2024-04-24T01:46:26.349875+0000","last_clean":"2024-04-24T01:46:26.349875+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:46:26.349875+0000","last_undegraded":"2024-04-24T01:46:26.349875+0000","last_fullsized":"2024-04-24T01:46:26.349875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.349769+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:50.261205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.235082+0000","last_change":"2024-04-24T01:46:21.235121+0000","last_active":"2024-04-24T01:46:21.235082+0000","last_peered":"2024-04-24T01:46:21.235082+0000","last_clean":"2024-04-24T01:46:21.235082+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:46:21.235082+0000","last_undegraded":"2024-04-24T01:46:21.235082+0000","last_fullsized":"2024-04-24T01:46:21.235082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.234980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:30.075365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.845155+0000","last_change":"2024-04-24T01:46:18.845179+0000","last_active":"2024-04-24T01:46:18.845155+0000","last_peered":"2024-04-24T01:46:18.845155+0000","last_clean":"2024-04-24T01:46:18.845155+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:46:18.845155+0000","last_undegraded":"2024-04-24T01:46:18.845155+0000","last_fullsized":"2024-04-24T01:46:18.845155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.845064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:59.328750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.474887+0000","last_change":"2024-04-24T01:46:34.474912+0000","last_active":"2024-04-24T01:46:34.474887+0000","last_peered":"2024-04-24T01:46:34.474887+0000","last_clean":"2024-04-24T01:46:34.474887+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:46:34.474887+0000","last_undegraded":"2024-04-24T01:46:34.474887+0000","last_fullsized":"2024-04-24T01:46:34.474887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.474793+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:55.055111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084057+0000","last_change":"2024-04-24T01:42:32.739657+0000","last_active":"2024-04-24T01:46:01.084057+0000","last_peered":"2024-04-24T01:46:01.084057+0000","last_clean":"2024-04-24T01:46:01.084057+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:46:01.084057+0000","last_undegraded":"2024-04-24T01:46:01.084057+0000","last_fullsized":"2024-04-24T01:46:01.084057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.039612+0000","last_change":"2024-04-24T01:46:32.039612+0000","last_active":"2024-04-24T01:46:32.039612+0000","last_peered":"2024-04-24T01:46:32.039612+0000","last_clean":"2024-04-24T01:46:32.039612+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:46:32.039612+0000","last_undegraded":"2024-04-24T01:46:32.039612+0000","last_fullsized":"2024-04-24T01:46:32.039612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.039496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:14.657340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.202261+0000","last_change":"2024-04-24T01:46:02.202303+0000","last_active":"2024-04-24T01:46:02.202261+0000","last_peered":"2024-04-24T01:46:02.202261+0000","last_clean":"2024-04-24T01:46:02.202261+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:46:02.202261+0000","last_undegraded":"2024-04-24T01:46:02.202261+0000","last_fullsized":"2024-04-24T01:46:02.202261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.202137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:08.592288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":529,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.516075+0000","last_change":"2024-04-24T01:46:00.516075+0000","last_active":"2024-04-24T01:46:00.516075+0000","last_peered":"2024-04-24T01:46:00.516075+0000","last_clean":"2024-04-24T01:46:00.516075+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:46:00.516075+0000","last_undegraded":"2024-04-24T01:46:00.516075+0000","last_fullsized":"2024-04-24T01:46:00.516075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.515932+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:28.646371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.407195+0000","last_change":"2024-04-24T01:46:31.407195+0000","last_active":"2024-04-24T01:46:31.407195+0000","last_peered":"2024-04-24T01:46:31.407195+0000","last_clean":"2024-04-24T01:46:31.407195+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:46:31.407195+0000","last_undegraded":"2024-04-24T01:46:31.407195+0000","last_fullsized":"2024-04-24T01:46:31.407195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.407050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:50.586031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.812277+0000","last_change":"2024-04-24T01:46:28.812304+0000","last_active":"2024-04-24T01:46:28.812277+0000","last_peered":"2024-04-24T01:46:28.812277+0000","last_clean":"2024-04-24T01:46:28.812277+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:46:28.812277+0000","last_undegraded":"2024-04-24T01:46:28.812277+0000","last_fullsized":"2024-04-24T01:46:28.812277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.812185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:55.500501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.033078+0000","last_change":"2024-04-24T01:46:43.033100+0000","last_active":"2024-04-24T01:46:43.033078+0000","last_peered":"2024-04-24T01:46:43.033078+0000","last_clean":"2024-04-24T01:46:43.033078+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:46:43.033078+0000","last_undegraded":"2024-04-24T01:46:43.033078+0000","last_fullsized":"2024-04-24T01:46:43.033078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T01:46:43.032993+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T01:46:43.032993+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.032993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:51.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.865588+0000","last_change":"2024-04-24T01:46:40.865588+0000","last_active":"2024-04-24T01:46:40.865588+0000","last_peered":"2024-04-24T01:46:40.865588+0000","last_clean":"2024-04-24T01:46:40.865588+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:46:40.865588+0000","last_undegraded":"2024-04-24T01:46:40.865588+0000","last_fullsized":"2024-04-24T01:46:40.865588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.865456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:54.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.978549+0000","last_change":"2024-04-24T01:46:49.978580+0000","last_active":"2024-04-24T01:46:49.978549+0000","last_peered":"2024-04-24T01:46:49.978549+0000","last_clean":"2024-04-24T01:46:49.978549+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:46:49.978549+0000","last_undegraded":"2024-04-24T01:46:49.978549+0000","last_fullsized":"2024-04-24T01:46:49.978549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:49.978455+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:49.978455+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.978455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:23:23.581015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.850355+0000","last_change":"2024-04-24T01:46:21.850406+0000","last_active":"2024-04-24T01:46:21.850355+0000","last_peered":"2024-04-24T01:46:21.850355+0000","last_clean":"2024-04-24T01:46:21.850355+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:46:21.850355+0000","last_undegraded":"2024-04-24T01:46:21.850355+0000","last_fullsized":"2024-04-24T01:46:21.850355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.850235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:05.283033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.865174+0000","last_change":"2024-04-24T01:46:09.865174+0000","last_active":"2024-04-24T01:46:09.865174+0000","last_peered":"2024-04-24T01:46:09.865174+0000","last_clean":"2024-04-24T01:46:09.865174+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:46:09.865174+0000","last_undegraded":"2024-04-24T01:46:09.865174+0000","last_fullsized":"2024-04-24T01:46:09.865174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.865033+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:26.768496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.219562+0000","last_change":"2024-04-24T01:46:17.219562+0000","last_active":"2024-04-24T01:46:17.219562+0000","last_peered":"2024-04-24T01:46:17.219562+0000","last_clean":"2024-04-24T01:46:17.219562+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:46:17.219562+0000","last_undegraded":"2024-04-24T01:46:17.219562+0000","last_fullsized":"2024-04-24T01:46:17.219562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.219377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:20.724218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090627+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:45:06.090627+0000","last_peered":"2024-04-24T01:45:06.090627+0000","last_clean":"2024-04-24T01:45:06.090627+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:45:06.090627+0000","last_undegraded":"2024-04-24T01:45:06.090627+0000","last_fullsized":"2024-04-24T01:45:06.090627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.084556+0000","last_change":"2024-04-24T01:46:31.084556+0000","last_active":"2024-04-24T01:46:31.084556+0000","last_peered":"2024-04-24T01:46:31.084556+0000","last_clean":"2024-04-24T01:46:31.084556+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:46:31.084556+0000","last_undegraded":"2024-04-24T01:46:31.084556+0000","last_fullsized":"2024-04-24T01:46:31.084556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.084413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:24.777154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084055+0000","last_change":"2024-04-24T01:42:32.740188+0000","last_active":"2024-04-24T01:46:01.084055+0000","last_peered":"2024-04-24T01:46:01.084055+0000","last_clean":"2024-04-24T01:46:01.084055+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:46:01.084055+0000","last_undegraded":"2024-04-24T01:46:01.084055+0000","last_fullsized":"2024-04-24T01:46:01.084055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.912286+0000","last_change":"2024-04-24T01:46:41.912286+0000","last_active":"2024-04-24T01:46:41.912286+0000","last_peered":"2024-04-24T01:46:41.912286+0000","last_clean":"2024-04-24T01:46:41.912286+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:46:41.912286+0000","last_undegraded":"2024-04-24T01:46:41.912286+0000","last_fullsized":"2024-04-24T01:46:41.912286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:41.912117+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:41.912117+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.912117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:42.249111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.225235+0000","last_change":"2024-04-24T01:46:16.225235+0000","last_active":"2024-04-24T01:46:16.225235+0000","last_peered":"2024-04-24T01:46:16.225235+0000","last_clean":"2024-04-24T01:46:16.225235+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:46:16.225235+0000","last_undegraded":"2024-04-24T01:46:16.225235+0000","last_fullsized":"2024-04-24T01:46:16.225235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.225104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:22.216443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.361510+0000","last_change":"2024-04-24T01:46:29.361545+0000","last_active":"2024-04-24T01:46:29.361510+0000","last_peered":"2024-04-24T01:46:29.361510+0000","last_clean":"2024-04-24T01:46:29.361510+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:46:29.361510+0000","last_undegraded":"2024-04-24T01:46:29.361510+0000","last_fullsized":"2024-04-24T01:46:29.361510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.361431+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:30.282814+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.364954+0000","last_change":"2024-04-24T01:46:27.364979+0000","last_active":"2024-04-24T01:46:27.364954+0000","last_peered":"2024-04-24T01:46:27.364954+0000","last_clean":"2024-04-24T01:46:27.364954+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:46:27.364954+0000","last_undegraded":"2024-04-24T01:46:27.364954+0000","last_fullsized":"2024-04-24T01:46:27.364954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.364865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:11.158866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.453282+0000","last_change":"2024-04-24T01:47:00.453310+0000","last_active":"2024-04-24T01:47:00.453282+0000","last_peered":"2024-04-24T01:47:00.453282+0000","last_clean":"2024-04-24T01:47:00.453282+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:47:00.453282+0000","last_undegraded":"2024-04-24T01:47:00.453282+0000","last_fullsized":"2024-04-24T01:47:00.453282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:47:00.453192+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:47:00.453192+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.453192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:22:55.876575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.536415+0000","last_change":"2024-04-24T01:46:36.536415+0000","last_active":"2024-04-24T01:46:36.536415+0000","last_peered":"2024-04-24T01:46:36.536415+0000","last_clean":"2024-04-24T01:46:36.536415+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:46:36.536415+0000","last_undegraded":"2024-04-24T01:46:36.536415+0000","last_fullsized":"2024-04-24T01:46:36.536415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.536262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:42.146239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.865928+0000","last_change":"2024-04-24T01:46:42.865928+0000","last_active":"2024-04-24T01:46:42.865928+0000","last_peered":"2024-04-24T01:46:42.865928+0000","last_clean":"2024-04-24T01:46:42.865928+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:46:42.865928+0000","last_undegraded":"2024-04-24T01:46:42.865928+0000","last_fullsized":"2024-04-24T01:46:42.865928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:42.865739+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:42.865739+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.865739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:09.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.010284+0000","last_change":"2024-04-24T01:46:47.010324+0000","last_active":"2024-04-24T01:46:47.010284+0000","last_peered":"2024-04-24T01:46:47.010284+0000","last_clean":"2024-04-24T01:46:47.010284+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:46:47.010284+0000","last_undegraded":"2024-04-24T01:46:47.010284+0000","last_fullsized":"2024-04-24T01:46:47.010284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.010163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.010163+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.010163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:37:23.212750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.015172+0000","last_change":"2024-04-24T01:46:53.015222+0000","last_active":"2024-04-24T01:46:53.015172+0000","last_peered":"2024-04-24T01:46:53.015172+0000","last_clean":"2024-04-24T01:46:53.015172+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:46:53.015172+0000","last_undegraded":"2024-04-24T01:46:53.015172+0000","last_fullsized":"2024-04-24T01:46:53.015172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.015074+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.015074+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.015074+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:46:25.180917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'89","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.233696+0000","last_change":"2024-04-24T01:46:07.233696+0000","last_active":"2024-04-24T01:46:07.233696+0000","last_peered":"2024-04-24T01:46:07.233696+0000","last_clean":"2024-04-24T01:46:07.233696+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:46:07.233696+0000","last_undegraded":"2024-04-24T01:46:07.233696+0000","last_fullsized":"2024-04-24T01:46:07.233696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'89","last_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_deep_scrub":"34'89","last_deep_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.233553+0000","objects_scrubbed":11,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:09.955408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":99,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.891045+0000","last_change":"2024-04-24T01:46:06.891045+0000","last_active":"2024-04-24T01:46:06.891045+0000","last_peered":"2024-04-24T01:46:06.891045+0000","last_clean":"2024-04-24T01:46:06.891045+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:46:06.891045+0000","last_undegraded":"2024-04-24T01:46:06.891045+0000","last_fullsized":"2024-04-24T01:46:06.891045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.890898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:03.226630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.132644+0000","last_change":"2024-04-24T01:46:29.132700+0000","last_active":"2024-04-24T01:46:29.132644+0000","last_peered":"2024-04-24T01:46:29.132644+0000","last_clean":"2024-04-24T01:46:29.132644+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:46:29.132644+0000","last_undegraded":"2024-04-24T01:46:29.132644+0000","last_fullsized":"2024-04-24T01:46:29.132644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.132536+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:12.697153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.728154+0000","last_change":"2024-04-24T01:46:21.728154+0000","last_active":"2024-04-24T01:46:21.728154+0000","last_peered":"2024-04-24T01:46:21.728154+0000","last_clean":"2024-04-24T01:46:21.728154+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:46:21.728154+0000","last_undegraded":"2024-04-24T01:46:21.728154+0000","last_fullsized":"2024-04-24T01:46:21.728154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.728040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:08.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.014866+0000","last_change":"2024-04-24T01:46:40.014866+0000","last_active":"2024-04-24T01:46:40.014866+0000","last_peered":"2024-04-24T01:46:40.014866+0000","last_clean":"2024-04-24T01:46:40.014866+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:46:40.014866+0000","last_undegraded":"2024-04-24T01:46:40.014866+0000","last_fullsized":"2024-04-24T01:46:40.014866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:40.014720+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:40.014720+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.014720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:59.544406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084029+0000","last_change":"2024-04-24T01:42:32.739652+0000","last_active":"2024-04-24T01:46:01.084029+0000","last_peered":"2024-04-24T01:46:01.084029+0000","last_clean":"2024-04-24T01:46:01.084029+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:46:01.084029+0000","last_undegraded":"2024-04-24T01:46:01.084029+0000","last_fullsized":"2024-04-24T01:46:01.084029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.278325+0000","last_change":"2024-04-24T01:46:12.278325+0000","last_active":"2024-04-24T01:46:12.278325+0000","last_peered":"2024-04-24T01:46:12.278325+0000","last_clean":"2024-04-24T01:46:12.278325+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:46:12.278325+0000","last_undegraded":"2024-04-24T01:46:12.278325+0000","last_fullsized":"2024-04-24T01:46:12.278325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.278217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:12.615210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.482085+0000","last_change":"2024-04-24T01:46:01.482085+0000","last_active":"2024-04-24T01:46:01.482085+0000","last_peered":"2024-04-24T01:46:01.482085+0000","last_clean":"2024-04-24T01:46:01.482085+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:46:01.482085+0000","last_undegraded":"2024-04-24T01:46:01.482085+0000","last_fullsized":"2024-04-24T01:46:01.482085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.481946+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:57.817678+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.707597+0000","last_change":"2024-04-24T01:46:24.707597+0000","last_active":"2024-04-24T01:46:24.707597+0000","last_peered":"2024-04-24T01:46:24.707597+0000","last_clean":"2024-04-24T01:46:24.707597+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:46:24.707597+0000","last_undegraded":"2024-04-24T01:46:24.707597+0000","last_fullsized":"2024-04-24T01:46:24.707597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.707426+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:18.013223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090729+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:45:06.090729+0000","last_peered":"2024-04-24T01:45:06.090729+0000","last_clean":"2024-04-24T01:45:06.090729+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:45:06.090729+0000","last_undegraded":"2024-04-24T01:45:06.090729+0000","last_fullsized":"2024-04-24T01:45:06.090729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.287073+0000","last_change":"2024-04-24T01:46:14.287073+0000","last_active":"2024-04-24T01:46:14.287073+0000","last_peered":"2024-04-24T01:46:14.287073+0000","last_clean":"2024-04-24T01:46:14.287073+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:46:14.287073+0000","last_undegraded":"2024-04-24T01:46:14.287073+0000","last_fullsized":"2024-04-24T01:46:14.287073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.286944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:31.444362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.558770+0000","last_change":"2024-04-24T01:46:56.558770+0000","last_active":"2024-04-24T01:46:56.558770+0000","last_peered":"2024-04-24T01:46:56.558770+0000","last_clean":"2024-04-24T01:46:56.558770+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:46:56.558770+0000","last_undegraded":"2024-04-24T01:46:56.558770+0000","last_fullsized":"2024-04-24T01:46:56.558770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:56.558658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:56.558658+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.558658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:53:32.368481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.982868+0000","last_change":"2024-04-24T01:46:47.982868+0000","last_active":"2024-04-24T01:46:47.982868+0000","last_peered":"2024-04-24T01:46:47.982868+0000","last_clean":"2024-04-24T01:46:47.982868+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:46:47.982868+0000","last_undegraded":"2024-04-24T01:46:47.982868+0000","last_fullsized":"2024-04-24T01:46:47.982868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.982756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.982756+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.982756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:33:59.525276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.333093+0000","last_change":"2024-04-24T01:46:08.333093+0000","last_active":"2024-04-24T01:46:08.333093+0000","last_peered":"2024-04-24T01:46:08.333093+0000","last_clean":"2024-04-24T01:46:08.333093+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:46:08.333093+0000","last_undegraded":"2024-04-24T01:46:08.333093+0000","last_fullsized":"2024-04-24T01:46:08.333093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.332981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:48.671731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'24","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.321125+0000","last_change":"2024-04-24T01:46:19.321125+0000","last_active":"2024-04-24T01:46:19.321125+0000","last_peered":"2024-04-24T01:46:19.321125+0000","last_clean":"2024-04-24T01:46:19.321125+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:46:19.321125+0000","last_undegraded":"2024-04-24T01:46:19.321125+0000","last_fullsized":"2024-04-24T01:46:19.321125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.320973+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:49.328557+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.218953+0000","last_change":"2024-04-24T01:46:02.218953+0000","last_active":"2024-04-24T01:46:02.218953+0000","last_peered":"2024-04-24T01:46:02.218953+0000","last_clean":"2024-04-24T01:46:02.218953+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:46:02.218953+0000","last_undegraded":"2024-04-24T01:46:02.218953+0000","last_fullsized":"2024-04-24T01:46:02.218953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.218804+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:46.449166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.541915+0000","last_change":"2024-04-24T01:46:58.541942+0000","last_active":"2024-04-24T01:46:58.541915+0000","last_peered":"2024-04-24T01:46:58.541915+0000","last_clean":"2024-04-24T01:46:58.541915+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:46:58.541915+0000","last_undegraded":"2024-04-24T01:46:58.541915+0000","last_fullsized":"2024-04-24T01:46:58.541915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:58.541808+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:58.541808+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.541808+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.746837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.831123+0000","last_change":"2024-04-24T01:46:32.831123+0000","last_active":"2024-04-24T01:46:32.831123+0000","last_peered":"2024-04-24T01:46:32.831123+0000","last_clean":"2024-04-24T01:46:32.831123+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:46:32.831123+0000","last_undegraded":"2024-04-24T01:46:32.831123+0000","last_fullsized":"2024-04-24T01:46:32.831123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.831018+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:14.457711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.703562+0000","last_change":"2024-04-24T01:46:51.703562+0000","last_active":"2024-04-24T01:46:51.703562+0000","last_peered":"2024-04-24T01:46:51.703562+0000","last_clean":"2024-04-24T01:46:51.703562+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:46:51.703562+0000","last_undegraded":"2024-04-24T01:46:51.703562+0000","last_fullsized":"2024-04-24T01:46:51.703562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:51.703403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:51.703403+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.703403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:20.140548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084036+0000","last_change":"2024-04-24T01:42:33.179478+0000","last_active":"2024-04-24T01:46:01.084036+0000","last_peered":"2024-04-24T01:46:01.084036+0000","last_clean":"2024-04-24T01:46:01.084036+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:46:01.084036+0000","last_undegraded":"2024-04-24T01:46:01.084036+0000","last_fullsized":"2024-04-24T01:46:01.084036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:31.718947+0000","last_clean_scrub_stamp":"2024-04-24T01:42:31.718947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.339389+0000","last_change":"2024-04-24T01:46:09.339389+0000","last_active":"2024-04-24T01:46:09.339389+0000","last_peered":"2024-04-24T01:46:09.339389+0000","last_clean":"2024-04-24T01:46:09.339389+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:46:09.339389+0000","last_undegraded":"2024-04-24T01:46:09.339389+0000","last_fullsized":"2024-04-24T01:46:09.339389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.339282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:17.983913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'104","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.891513+0000","last_change":"2024-04-24T01:46:07.891513+0000","last_active":"2024-04-24T01:46:07.891513+0000","last_peered":"2024-04-24T01:46:07.891513+0000","last_clean":"2024-04-24T01:46:07.891513+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:46:07.891513+0000","last_undegraded":"2024-04-24T01:46:07.891513+0000","last_fullsized":"2024-04-24T01:46:07.891513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'104","last_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_deep_scrub":"34'104","last_deep_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.891371+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.493980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.166279+0000","last_change":"2024-04-24T01:46:13.166279+0000","last_active":"2024-04-24T01:46:13.166279+0000","last_peered":"2024-04-24T01:46:13.166279+0000","last_clean":"2024-04-24T01:46:13.166279+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:46:13.166279+0000","last_undegraded":"2024-04-24T01:46:13.166279+0000","last_fullsized":"2024-04-24T01:46:13.166279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.166175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:35.987875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.892980+0000","last_change":"2024-04-24T01:46:14.893005+0000","last_active":"2024-04-24T01:46:14.892980+0000","last_peered":"2024-04-24T01:46:14.892980+0000","last_clean":"2024-04-24T01:46:14.892980+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:46:14.892980+0000","last_undegraded":"2024-04-24T01:46:14.892980+0000","last_fullsized":"2024-04-24T01:46:14.892980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.892893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:00.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.000042+0000","last_change":"2024-04-24T01:46:51.000042+0000","last_active":"2024-04-24T01:46:51.000042+0000","last_peered":"2024-04-24T01:46:51.000042+0000","last_clean":"2024-04-24T01:46:51.000042+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:46:51.000042+0000","last_undegraded":"2024-04-24T01:46:51.000042+0000","last_fullsized":"2024-04-24T01:46:51.000042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.999930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.999930+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.999930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:28.174222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.778215+0000","last_change":"2024-04-24T01:46:23.778252+0000","last_active":"2024-04-24T01:46:23.778215+0000","last_peered":"2024-04-24T01:46:23.778215+0000","last_clean":"2024-04-24T01:46:23.778215+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:46:23.778215+0000","last_undegraded":"2024-04-24T01:46:23.778215+0000","last_fullsized":"2024-04-24T01:46:23.778215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.778097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:35.360382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089849+0000","last_change":"2024-04-24T01:42:40.776494+0000","last_active":"2024-04-24T01:45:01.089849+0000","last_peered":"2024-04-24T01:45:01.089849+0000","last_clean":"2024-04-24T01:45:01.089849+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:45:01.089849+0000","last_undegraded":"2024-04-24T01:45:01.089849+0000","last_fullsized":"2024-04-24T01:45:01.089849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.657368+0000","last_change":"2024-04-24T01:46:13.657398+0000","last_active":"2024-04-24T01:46:13.657368+0000","last_peered":"2024-04-24T01:46:13.657368+0000","last_clean":"2024-04-24T01:46:13.657368+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:46:13.657368+0000","last_undegraded":"2024-04-24T01:46:13.657368+0000","last_fullsized":"2024-04-24T01:46:13.657368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.657273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:54.140958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.290072+0000","last_change":"2024-04-24T01:46:11.290116+0000","last_active":"2024-04-24T01:46:11.290072+0000","last_peered":"2024-04-24T01:46:11.290072+0000","last_clean":"2024-04-24T01:46:11.290072+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:46:11.290072+0000","last_undegraded":"2024-04-24T01:46:11.290072+0000","last_fullsized":"2024-04-24T01:46:11.290072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.289983+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:25.084406+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.324290+0000","last_change":"2024-04-24T01:46:21.324364+0000","last_active":"2024-04-24T01:46:21.324290+0000","last_peered":"2024-04-24T01:46:21.324290+0000","last_clean":"2024-04-24T01:46:21.324290+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:46:21.324290+0000","last_undegraded":"2024-04-24T01:46:21.324290+0000","last_fullsized":"2024-04-24T01:46:21.324290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.324188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:58.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:59.817638+0000","last_change":"2024-04-24T01:42:50.802495+0000","last_active":"2024-04-24T01:45:59.817638+0000","last_peered":"2024-04-24T01:45:59.817638+0000","last_clean":"2024-04-24T01:45:59.817638+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:45:59.817638+0000","last_undegraded":"2024-04-24T01:45:59.817638+0000","last_fullsized":"2024-04-24T01:45:59.817638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.748183+0000","last_change":"2024-04-24T01:46:31.748224+0000","last_active":"2024-04-24T01:46:31.748183+0000","last_peered":"2024-04-24T01:46:31.748183+0000","last_clean":"2024-04-24T01:46:31.748183+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:46:31.748183+0000","last_undegraded":"2024-04-24T01:46:31.748183+0000","last_fullsized":"2024-04-24T01:46:31.748183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.748068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:58.027530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.830371+0000","last_change":"2024-04-24T01:46:31.830423+0000","last_active":"2024-04-24T01:46:31.830371+0000","last_peered":"2024-04-24T01:46:31.830371+0000","last_clean":"2024-04-24T01:46:31.830371+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:46:31.830371+0000","last_undegraded":"2024-04-24T01:46:31.830371+0000","last_fullsized":"2024-04-24T01:46:31.830371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.830255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:38.220407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.257405+0000","last_change":"2024-04-24T01:46:04.257440+0000","last_active":"2024-04-24T01:46:04.257405+0000","last_peered":"2024-04-24T01:46:04.257405+0000","last_clean":"2024-04-24T01:46:04.257405+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:46:04.257405+0000","last_undegraded":"2024-04-24T01:46:04.257405+0000","last_fullsized":"2024-04-24T01:46:04.257405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.257282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:20.008478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.173642+0000","last_change":"2024-04-24T01:46:14.173677+0000","last_active":"2024-04-24T01:46:14.173642+0000","last_peered":"2024-04-24T01:46:14.173642+0000","last_clean":"2024-04-24T01:46:14.173642+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:46:14.173642+0000","last_undegraded":"2024-04-24T01:46:14.173642+0000","last_fullsized":"2024-04-24T01:46:14.173642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.173554+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:46.693848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.821154+0000","last_change":"2024-04-24T01:46:01.821203+0000","last_active":"2024-04-24T01:46:01.821154+0000","last_peered":"2024-04-24T01:46:01.821154+0000","last_clean":"2024-04-24T01:46:01.821154+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:46:01.821154+0000","last_undegraded":"2024-04-24T01:46:01.821154+0000","last_fullsized":"2024-04-24T01:46:01.821154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.821055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:04:47.582844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.878399+0000","last_change":"2024-04-24T01:46:55.878435+0000","last_active":"2024-04-24T01:46:55.878399+0000","last_peered":"2024-04-24T01:46:55.878399+0000","last_clean":"2024-04-24T01:46:55.878399+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:46:55.878399+0000","last_undegraded":"2024-04-24T01:46:55.878399+0000","last_fullsized":"2024-04-24T01:46:55.878399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:55.878310+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:55.878310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.878310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:00.355820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.102487+0000","last_change":"2024-04-24T01:46:30.102527+0000","last_active":"2024-04-24T01:46:30.102487+0000","last_peered":"2024-04-24T01:46:30.102487+0000","last_clean":"2024-04-24T01:46:30.102487+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:46:30.102487+0000","last_undegraded":"2024-04-24T01:46:30.102487+0000","last_fullsized":"2024-04-24T01:46:30.102487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.102347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:37.775249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.971444+0000","last_change":"2024-04-24T01:46:46.971498+0000","last_active":"2024-04-24T01:46:46.971444+0000","last_peered":"2024-04-24T01:46:46.971444+0000","last_clean":"2024-04-24T01:46:46.971444+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:46:46.971444+0000","last_undegraded":"2024-04-24T01:46:46.971444+0000","last_fullsized":"2024-04-24T01:46:46.971444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:46.971350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:46.971350+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.971350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:46.898467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.846071+0000","last_change":"2024-04-24T01:46:15.846094+0000","last_active":"2024-04-24T01:46:15.846071+0000","last_peered":"2024-04-24T01:46:15.846071+0000","last_clean":"2024-04-24T01:46:15.846071+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:46:15.846071+0000","last_undegraded":"2024-04-24T01:46:15.846071+0000","last_fullsized":"2024-04-24T01:46:15.846071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:10.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.247853+0000","last_change":"2024-04-24T01:46:08.247891+0000","last_active":"2024-04-24T01:46:08.247853+0000","last_peered":"2024-04-24T01:46:08.247853+0000","last_clean":"2024-04-24T01:46:08.247853+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:46:08.247853+0000","last_undegraded":"2024-04-24T01:46:08.247853+0000","last_fullsized":"2024-04-24T01:46:08.247853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.247768+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:06:04.087642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.609637+0000","last_change":"2024-04-24T01:46:12.609659+0000","last_active":"2024-04-24T01:46:12.609637+0000","last_peered":"2024-04-24T01:46:12.609637+0000","last_clean":"2024-04-24T01:46:12.609637+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:46:12.609637+0000","last_undegraded":"2024-04-24T01:46:12.609637+0000","last_fullsized":"2024-04-24T01:46:12.609637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.609553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:24:25.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:21.093126+0000","last_change":"2024-04-24T01:42:50.801137+0000","last_active":"2024-04-24T01:45:21.093126+0000","last_peered":"2024-04-24T01:45:21.093126+0000","last_clean":"2024-04-24T01:45:21.093126+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:45:21.093126+0000","last_undegraded":"2024-04-24T01:45:21.093126+0000","last_fullsized":"2024-04-24T01:45:21.093126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.327638+0000","last_change":"2024-04-24T01:46:18.327664+0000","last_active":"2024-04-24T01:46:18.327638+0000","last_peered":"2024-04-24T01:46:18.327638+0000","last_clean":"2024-04-24T01:46:18.327638+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:46:18.327638+0000","last_undegraded":"2024-04-24T01:46:18.327638+0000","last_fullsized":"2024-04-24T01:46:18.327638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.327548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:36.700735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.594289+0000","last_change":"2024-04-24T01:46:45.594312+0000","last_active":"2024-04-24T01:46:45.594289+0000","last_peered":"2024-04-24T01:46:45.594289+0000","last_clean":"2024-04-24T01:46:45.594289+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:46:45.594289+0000","last_undegraded":"2024-04-24T01:46:45.594289+0000","last_fullsized":"2024-04-24T01:46:45.594289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:45.594150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:45.594150+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.594150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:47.377188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.312282+0000","last_change":"2024-04-24T01:46:10.312308+0000","last_active":"2024-04-24T01:46:10.312282+0000","last_peered":"2024-04-24T01:46:10.312282+0000","last_clean":"2024-04-24T01:46:10.312282+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:46:10.312282+0000","last_undegraded":"2024-04-24T01:46:10.312282+0000","last_fullsized":"2024-04-24T01:46:10.312282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.312190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:07.102122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.806433+0000","last_change":"2024-04-24T01:46:12.806479+0000","last_active":"2024-04-24T01:46:12.806433+0000","last_peered":"2024-04-24T01:46:12.806433+0000","last_clean":"2024-04-24T01:46:12.806433+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:46:12.806433+0000","last_undegraded":"2024-04-24T01:46:12.806433+0000","last_fullsized":"2024-04-24T01:46:12.806433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.806352+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:58.427653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.869091+0000","last_change":"2024-04-24T01:46:03.869117+0000","last_active":"2024-04-24T01:46:03.869091+0000","last_peered":"2024-04-24T01:46:03.869091+0000","last_clean":"2024-04-24T01:46:03.869091+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:46:03.869091+0000","last_undegraded":"2024-04-24T01:46:03.869091+0000","last_fullsized":"2024-04-24T01:46:03.869091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.868982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:27:47.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.097668+0000","last_change":"2024-04-24T01:46:55.097703+0000","last_active":"2024-04-24T01:46:55.097668+0000","last_peered":"2024-04-24T01:46:55.097668+0000","last_clean":"2024-04-24T01:46:55.097668+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:46:55.097668+0000","last_undegraded":"2024-04-24T01:46:55.097668+0000","last_fullsized":"2024-04-24T01:46:55.097668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:55.097583+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:55.097583+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.097583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:19.009019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:06.090473+0000","last_change":"2024-04-24T01:42:40.787886+0000","last_active":"2024-04-24T01:45:06.090473+0000","last_peered":"2024-04-24T01:45:06.090473+0000","last_clean":"2024-04-24T01:45:06.090473+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:45:06.090473+0000","last_undegraded":"2024-04-24T01:45:06.090473+0000","last_fullsized":"2024-04-24T01:45:06.090473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.176864+0000","last_change":"2024-04-24T01:46:24.176864+0000","last_active":"2024-04-24T01:46:24.176864+0000","last_peered":"2024-04-24T01:46:24.176864+0000","last_clean":"2024-04-24T01:46:24.176864+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:46:24.176864+0000","last_undegraded":"2024-04-24T01:46:24.176864+0000","last_fullsized":"2024-04-24T01:46:24.176864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.176757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:03.301459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.198038+0000","last_change":"2024-04-24T01:46:10.198112+0000","last_active":"2024-04-24T01:46:10.198038+0000","last_peered":"2024-04-24T01:46:10.198038+0000","last_clean":"2024-04-24T01:46:10.198038+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:46:10.198038+0000","last_undegraded":"2024-04-24T01:46:10.198038+0000","last_fullsized":"2024-04-24T01:46:10.198038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.197934+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:55.839910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.889685+0000","last_change":"2024-04-24T01:46:04.889720+0000","last_active":"2024-04-24T01:46:04.889685+0000","last_peered":"2024-04-24T01:46:04.889685+0000","last_clean":"2024-04-24T01:46:04.889685+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:46:04.889685+0000","last_undegraded":"2024-04-24T01:46:04.889685+0000","last_fullsized":"2024-04-24T01:46:04.889685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.889593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:29.941134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.274542+0000","last_change":"2024-04-24T01:42:50.794926+0000","last_active":"2024-04-24T01:45:50.274542+0000","last_peered":"2024-04-24T01:45:50.274542+0000","last_clean":"2024-04-24T01:45:50.274542+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:45:50.274542+0000","last_undegraded":"2024-04-24T01:45:50.274542+0000","last_fullsized":"2024-04-24T01:45:50.274542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.006935+0000","last_change":"2024-04-24T01:46:39.006935+0000","last_active":"2024-04-24T01:46:39.006935+0000","last_peered":"2024-04-24T01:46:39.006935+0000","last_clean":"2024-04-24T01:46:39.006935+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:46:39.006935+0000","last_undegraded":"2024-04-24T01:46:39.006935+0000","last_fullsized":"2024-04-24T01:46:39.006935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.006790+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:00.354935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.670774+0000","last_change":"2024-04-24T01:46:52.670814+0000","last_active":"2024-04-24T01:46:52.670774+0000","last_peered":"2024-04-24T01:46:52.670774+0000","last_clean":"2024-04-24T01:46:52.670774+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:46:52.670774+0000","last_undegraded":"2024-04-24T01:46:52.670774+0000","last_fullsized":"2024-04-24T01:46:52.670774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:52.670660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:52.670660+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.670660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:26.413731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.846187+0000","last_change":"2024-04-24T01:46:20.846187+0000","last_active":"2024-04-24T01:46:20.846187+0000","last_peered":"2024-04-24T01:46:20.846187+0000","last_clean":"2024-04-24T01:46:20.846187+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:46:20.846187+0000","last_undegraded":"2024-04-24T01:46:20.846187+0000","last_fullsized":"2024-04-24T01:46:20.846187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.846022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:44.249657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.332061+0000","last_change":"2024-04-24T01:46:28.332109+0000","last_active":"2024-04-24T01:46:28.332061+0000","last_peered":"2024-04-24T01:46:28.332061+0000","last_clean":"2024-04-24T01:46:28.332061+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:46:28.332061+0000","last_undegraded":"2024-04-24T01:46:28.332061+0000","last_fullsized":"2024-04-24T01:46:28.332061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.331976+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:47:29.283395+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.676027+0000","last_change":"2024-04-24T01:46:16.676052+0000","last_active":"2024-04-24T01:46:16.676027+0000","last_peered":"2024-04-24T01:46:16.676027+0000","last_clean":"2024-04-24T01:46:16.676027+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:46:16.676027+0000","last_undegraded":"2024-04-24T01:46:16.676027+0000","last_fullsized":"2024-04-24T01:46:16.676027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.675939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:00.108736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.459774+0000","last_change":"2024-04-24T01:46:43.459800+0000","last_active":"2024-04-24T01:46:43.459774+0000","last_peered":"2024-04-24T01:46:43.459774+0000","last_clean":"2024-04-24T01:46:43.459774+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:46:43.459774+0000","last_undegraded":"2024-04-24T01:46:43.459774+0000","last_fullsized":"2024-04-24T01:46:43.459774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:43.459683+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:43.459683+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.459683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:38:34.496131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.302166+0000","last_change":"2024-04-24T01:46:20.302191+0000","last_active":"2024-04-24T01:46:20.302166+0000","last_peered":"2024-04-24T01:46:20.302166+0000","last_clean":"2024-04-24T01:46:20.302166+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:46:20.302166+0000","last_undegraded":"2024-04-24T01:46:20.302166+0000","last_fullsized":"2024-04-24T01:46:20.302166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.302076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:18.662863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.608992+0000","last_change":"2024-04-24T01:46:47.609040+0000","last_active":"2024-04-24T01:46:47.608992+0000","last_peered":"2024-04-24T01:46:47.608992+0000","last_clean":"2024-04-24T01:46:47.608992+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:46:47.608992+0000","last_undegraded":"2024-04-24T01:46:47.608992+0000","last_fullsized":"2024-04-24T01:46:47.608992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:47.608894+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:47.608894+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.608894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:11.183336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.842016+0000","last_change":"2024-04-24T01:46:19.842038+0000","last_active":"2024-04-24T01:46:19.842016+0000","last_peered":"2024-04-24T01:46:19.842016+0000","last_clean":"2024-04-24T01:46:19.842016+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:46:19.842016+0000","last_undegraded":"2024-04-24T01:46:19.842016+0000","last_fullsized":"2024-04-24T01:46:19.842016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.841928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:50:06.176480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.208833+0000","last_change":"2024-04-24T01:46:12.208833+0000","last_active":"2024-04-24T01:46:12.208833+0000","last_peered":"2024-04-24T01:46:12.208833+0000","last_clean":"2024-04-24T01:46:12.208833+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:46:12.208833+0000","last_undegraded":"2024-04-24T01:46:12.208833+0000","last_fullsized":"2024-04-24T01:46:12.208833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.208700+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:29.667207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.222190+0000","last_change":"2024-04-24T01:46:04.222190+0000","last_active":"2024-04-24T01:46:04.222190+0000","last_peered":"2024-04-24T01:46:04.222190+0000","last_clean":"2024-04-24T01:46:04.222190+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:46:04.222190+0000","last_undegraded":"2024-04-24T01:46:04.222190+0000","last_fullsized":"2024-04-24T01:46:04.222190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.222084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:26.106809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091360+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:45:11.091360+0000","last_peered":"2024-04-24T01:45:11.091360+0000","last_clean":"2024-04-24T01:45:11.091360+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:45:11.091360+0000","last_undegraded":"2024-04-24T01:45:11.091360+0000","last_fullsized":"2024-04-24T01:45:11.091360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.060904+0000","last_change":"2024-04-24T01:46:35.060928+0000","last_active":"2024-04-24T01:46:35.060904+0000","last_peered":"2024-04-24T01:46:35.060904+0000","last_clean":"2024-04-24T01:46:35.060904+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:46:35.060904+0000","last_undegraded":"2024-04-24T01:46:35.060904+0000","last_fullsized":"2024-04-24T01:46:35.060904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.060814+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:10.400767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.498295+0000","last_change":"2024-04-24T01:46:50.498321+0000","last_active":"2024-04-24T01:46:50.498295+0000","last_peered":"2024-04-24T01:46:50.498295+0000","last_clean":"2024-04-24T01:46:50.498295+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:46:50.498295+0000","last_undegraded":"2024-04-24T01:46:50.498295+0000","last_fullsized":"2024-04-24T01:46:50.498295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.498211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.498211+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.498211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:11.641334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.688836+0000","last_change":"2024-04-24T01:46:17.688868+0000","last_active":"2024-04-24T01:46:17.688836+0000","last_peered":"2024-04-24T01:46:17.688836+0000","last_clean":"2024-04-24T01:46:17.688836+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:46:17.688836+0000","last_undegraded":"2024-04-24T01:46:17.688836+0000","last_fullsized":"2024-04-24T01:46:17.688836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.688748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:53.186579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.316258+0000","last_change":"2024-04-24T01:46:25.316258+0000","last_active":"2024-04-24T01:46:25.316258+0000","last_peered":"2024-04-24T01:46:25.316258+0000","last_clean":"2024-04-24T01:46:25.316258+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:46:25.316258+0000","last_undegraded":"2024-04-24T01:46:25.316258+0000","last_fullsized":"2024-04-24T01:46:25.316258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.316122+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:09.639811+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.864906+0000","last_change":"2024-04-24T01:46:02.864906+0000","last_active":"2024-04-24T01:46:02.864906+0000","last_peered":"2024-04-24T01:46:02.864906+0000","last_clean":"2024-04-24T01:46:02.864906+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:46:02.864906+0000","last_undegraded":"2024-04-24T01:46:02.864906+0000","last_fullsized":"2024-04-24T01:46:02.864906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.864778+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:58.138209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.555523+0000","last_change":"2024-04-24T01:46:47.555558+0000","last_active":"2024-04-24T01:46:47.555523+0000","last_peered":"2024-04-24T01:46:47.555523+0000","last_clean":"2024-04-24T01:46:47.555523+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:46:47.555523+0000","last_undegraded":"2024-04-24T01:46:47.555523+0000","last_fullsized":"2024-04-24T01:46:47.555523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.555434+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.555434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:37.166499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.731138+0000","last_change":"2024-04-24T01:46:28.731165+0000","last_active":"2024-04-24T01:46:28.731138+0000","last_peered":"2024-04-24T01:46:28.731138+0000","last_clean":"2024-04-24T01:46:28.731138+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:46:28.731138+0000","last_undegraded":"2024-04-24T01:46:28.731138+0000","last_fullsized":"2024-04-24T01:46:28.731138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.731048+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:37.095746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.672611+0000","last_change":"2024-04-24T01:46:50.672639+0000","last_active":"2024-04-24T01:46:50.672611+0000","last_peered":"2024-04-24T01:46:50.672611+0000","last_clean":"2024-04-24T01:46:50.672611+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:46:50.672611+0000","last_undegraded":"2024-04-24T01:46:50.672611+0000","last_fullsized":"2024-04-24T01:46:50.672611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:46:50.672502+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:46:50.672502+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.672502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:33.442436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.603073+0000","last_change":"2024-04-24T01:46:11.603100+0000","last_active":"2024-04-24T01:46:11.603073+0000","last_peered":"2024-04-24T01:46:11.603073+0000","last_clean":"2024-04-24T01:46:11.603073+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:46:11.603073+0000","last_undegraded":"2024-04-24T01:46:11.603073+0000","last_fullsized":"2024-04-24T01:46:11.603073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.602978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:50.391941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'77","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.529735+0000","last_change":"2024-04-24T01:46:06.529785+0000","last_active":"2024-04-24T01:46:06.529735+0000","last_peered":"2024-04-24T01:46:06.529735+0000","last_clean":"2024-04-24T01:46:06.529735+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:46:06.529735+0000","last_undegraded":"2024-04-24T01:46:06.529735+0000","last_fullsized":"2024-04-24T01:46:06.529735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.529645+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:07.671634+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":85,"num_read_kb":80,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.248633+0000","last_change":"2024-04-24T01:46:01.248655+0000","last_active":"2024-04-24T01:46:01.248633+0000","last_peered":"2024-04-24T01:46:01.248633+0000","last_clean":"2024-04-24T01:46:01.248633+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:46:01.248633+0000","last_undegraded":"2024-04-24T01:46:01.248633+0000","last_fullsized":"2024-04-24T01:46:01.248633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.248553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:14.454609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.663889+0000","last_change":"2024-04-24T01:46:55.663916+0000","last_active":"2024-04-24T01:46:55.663889+0000","last_peered":"2024-04-24T01:46:55.663889+0000","last_clean":"2024-04-24T01:46:55.663889+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:46:55.663889+0000","last_undegraded":"2024-04-24T01:46:55.663889+0000","last_fullsized":"2024-04-24T01:46:55.663889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:46:55.663784+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:46:55.663784+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.663784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:17.480072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.729913+0000","last_change":"2024-04-24T01:46:24.729938+0000","last_active":"2024-04-24T01:46:24.729913+0000","last_peered":"2024-04-24T01:46:24.729913+0000","last_clean":"2024-04-24T01:46:24.729913+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:46:24.729913+0000","last_undegraded":"2024-04-24T01:46:24.729913+0000","last_fullsized":"2024-04-24T01:46:24.729913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.729803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:38.596795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.263641+0000","last_change":"2024-04-24T01:42:40.788381+0000","last_active":"2024-04-24T01:45:50.263641+0000","last_peered":"2024-04-24T01:45:50.263641+0000","last_clean":"2024-04-24T01:45:50.263641+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:45:50.263641+0000","last_undegraded":"2024-04-24T01:45:50.263641+0000","last_fullsized":"2024-04-24T01:45:50.263641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.809263+0000","last_change":"2024-04-24T01:46:17.809286+0000","last_active":"2024-04-24T01:46:17.809263+0000","last_peered":"2024-04-24T01:46:17.809263+0000","last_clean":"2024-04-24T01:46:17.809263+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:46:17.809263+0000","last_undegraded":"2024-04-24T01:46:17.809263+0000","last_fullsized":"2024-04-24T01:46:17.809263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.809172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:15:28.587615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.187484+0000","last_change":"2024-04-24T01:46:11.187562+0000","last_active":"2024-04-24T01:46:11.187484+0000","last_peered":"2024-04-24T01:46:11.187484+0000","last_clean":"2024-04-24T01:46:11.187484+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:46:11.187484+0000","last_undegraded":"2024-04-24T01:46:11.187484+0000","last_fullsized":"2024-04-24T01:46:11.187484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.187375+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:33:05.075069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.327296+0000","last_change":"2024-04-24T01:46:22.327330+0000","last_active":"2024-04-24T01:46:22.327296+0000","last_peered":"2024-04-24T01:46:22.327296+0000","last_clean":"2024-04-24T01:46:22.327296+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:46:22.327296+0000","last_undegraded":"2024-04-24T01:46:22.327296+0000","last_fullsized":"2024-04-24T01:46:22.327296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.327198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:51:25.780951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:50.455411+0000","last_change":"2024-04-24T01:42:50.801689+0000","last_active":"2024-04-24T01:45:50.455411+0000","last_peered":"2024-04-24T01:45:50.455411+0000","last_clean":"2024-04-24T01:45:50.455411+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:45:50.455411+0000","last_undegraded":"2024-04-24T01:45:50.455411+0000","last_fullsized":"2024-04-24T01:45:50.455411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.083199+0000","last_change":"2024-04-24T01:46:56.083262+0000","last_active":"2024-04-24T01:46:56.083199+0000","last_peered":"2024-04-24T01:46:56.083199+0000","last_clean":"2024-04-24T01:46:56.083199+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:46:56.083199+0000","last_undegraded":"2024-04-24T01:46:56.083199+0000","last_fullsized":"2024-04-24T01:46:56.083199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:56.083100+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:56.083100+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.083100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:39.877101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.039300+0000","last_change":"2024-04-24T01:46:46.039351+0000","last_active":"2024-04-24T01:46:46.039300+0000","last_peered":"2024-04-24T01:46:46.039300+0000","last_clean":"2024-04-24T01:46:46.039300+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:46:46.039300+0000","last_undegraded":"2024-04-24T01:46:46.039300+0000","last_fullsized":"2024-04-24T01:46:46.039300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:46.039190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:46.039190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.039190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:23:57.436296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.626204+0000","last_change":"2024-04-24T01:46:09.626256+0000","last_active":"2024-04-24T01:46:09.626204+0000","last_peered":"2024-04-24T01:46:09.626204+0000","last_clean":"2024-04-24T01:46:09.626204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:46:09.626204+0000","last_undegraded":"2024-04-24T01:46:09.626204+0000","last_fullsized":"2024-04-24T01:46:09.626204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.626097+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:56.352550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.447709+0000","last_change":"2024-04-24T01:46:32.447742+0000","last_active":"2024-04-24T01:46:32.447709+0000","last_peered":"2024-04-24T01:46:32.447709+0000","last_clean":"2024-04-24T01:46:32.447709+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:46:32.447709+0000","last_undegraded":"2024-04-24T01:46:32.447709+0000","last_fullsized":"2024-04-24T01:46:32.447709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.447622+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:41:24.256346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.467508+0000","last_change":"2024-04-24T01:46:39.467533+0000","last_active":"2024-04-24T01:46:39.467508+0000","last_peered":"2024-04-24T01:46:39.467508+0000","last_clean":"2024-04-24T01:46:39.467508+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:46:39.467508+0000","last_undegraded":"2024-04-24T01:46:39.467508+0000","last_fullsized":"2024-04-24T01:46:39.467508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.467419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:58.802238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.092373+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:45:16.092373+0000","last_peered":"2024-04-24T01:45:16.092373+0000","last_clean":"2024-04-24T01:45:16.092373+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:45:16.092373+0000","last_undegraded":"2024-04-24T01:45:16.092373+0000","last_fullsized":"2024-04-24T01:45:16.092373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.657151+0000","last_change":"2024-04-24T01:46:26.657191+0000","last_active":"2024-04-24T01:46:26.657151+0000","last_peered":"2024-04-24T01:46:26.657151+0000","last_clean":"2024-04-24T01:46:26.657151+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:46:26.657151+0000","last_undegraded":"2024-04-24T01:46:26.657151+0000","last_fullsized":"2024-04-24T01:46:26.657151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.657061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:13.375971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.675482+0000","last_change":"2024-04-24T01:46:53.675546+0000","last_active":"2024-04-24T01:46:53.675482+0000","last_peered":"2024-04-24T01:46:53.675482+0000","last_clean":"2024-04-24T01:46:53.675482+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:46:53.675482+0000","last_undegraded":"2024-04-24T01:46:53.675482+0000","last_fullsized":"2024-04-24T01:46:53.675482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.675383+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.675383+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.675383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:20.329284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.549193+0000","last_change":"2024-04-24T01:46:07.549244+0000","last_active":"2024-04-24T01:46:07.549193+0000","last_peered":"2024-04-24T01:46:07.549193+0000","last_clean":"2024-04-24T01:46:07.549193+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:46:07.549193+0000","last_undegraded":"2024-04-24T01:46:07.549193+0000","last_fullsized":"2024-04-24T01:46:07.549193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.549082+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:53.170383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.365622+0000","last_change":"2024-04-24T01:46:30.365660+0000","last_active":"2024-04-24T01:46:30.365622+0000","last_peered":"2024-04-24T01:46:30.365622+0000","last_clean":"2024-04-24T01:46:30.365622+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:46:30.365622+0000","last_undegraded":"2024-04-24T01:46:30.365622+0000","last_fullsized":"2024-04-24T01:46:30.365622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.365531+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:04.108602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.233029+0000","last_change":"2024-04-24T01:46:05.233070+0000","last_active":"2024-04-24T01:46:05.233029+0000","last_peered":"2024-04-24T01:46:05.233029+0000","last_clean":"2024-04-24T01:46:05.233029+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:46:05.233029+0000","last_undegraded":"2024-04-24T01:46:05.233029+0000","last_fullsized":"2024-04-24T01:46:05.233029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.232926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:34.699770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091436+0000","last_change":"2024-04-24T01:42:50.800862+0000","last_active":"2024-04-24T01:45:11.091436+0000","last_peered":"2024-04-24T01:45:11.091436+0000","last_clean":"2024-04-24T01:45:11.091436+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:45:11.091436+0000","last_undegraded":"2024-04-24T01:45:11.091436+0000","last_fullsized":"2024-04-24T01:45:11.091436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.738749+0000","last_change":"2024-04-24T01:46:19.738791+0000","last_active":"2024-04-24T01:46:19.738749+0000","last_peered":"2024-04-24T01:46:19.738749+0000","last_clean":"2024-04-24T01:46:19.738749+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:46:19.738749+0000","last_undegraded":"2024-04-24T01:46:19.738749+0000","last_fullsized":"2024-04-24T01:46:19.738749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.738637+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:33.605630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.003925+0000","last_change":"2024-04-24T01:46:48.003925+0000","last_active":"2024-04-24T01:46:48.003925+0000","last_peered":"2024-04-24T01:46:48.003925+0000","last_clean":"2024-04-24T01:46:48.003925+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:46:48.003925+0000","last_undegraded":"2024-04-24T01:46:48.003925+0000","last_fullsized":"2024-04-24T01:46:48.003925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:48.003792+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:48.003792+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.003792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:58:51.323040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.009841+0000","last_change":"2024-04-24T01:46:37.009864+0000","last_active":"2024-04-24T01:46:37.009841+0000","last_peered":"2024-04-24T01:46:37.009841+0000","last_clean":"2024-04-24T01:46:37.009841+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:46:37.009841+0000","last_undegraded":"2024-04-24T01:46:37.009841+0000","last_fullsized":"2024-04-24T01:46:37.009841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.009754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.687137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.055589+0000","last_change":"2024-04-24T01:46:36.055589+0000","last_active":"2024-04-24T01:46:36.055589+0000","last_peered":"2024-04-24T01:46:36.055589+0000","last_clean":"2024-04-24T01:46:36.055589+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:46:36.055589+0000","last_undegraded":"2024-04-24T01:46:36.055589+0000","last_fullsized":"2024-04-24T01:46:36.055589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.055479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:08.968901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":128,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.483645+0000","last_change":"2024-04-24T01:46:41.483720+0000","last_active":"2024-04-24T01:46:41.483645+0000","last_peered":"2024-04-24T01:46:41.483645+0000","last_clean":"2024-04-24T01:46:41.483645+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:46:41.483645+0000","last_undegraded":"2024-04-24T01:46:41.483645+0000","last_fullsized":"2024-04-24T01:46:41.483645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:41.483543+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:41.483543+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.483543+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:05.658646+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084374+0000","last_change":"2024-04-24T01:42:40.785740+0000","last_active":"2024-04-24T01:46:01.084374+0000","last_peered":"2024-04-24T01:46:01.084374+0000","last_clean":"2024-04-24T01:46:01.084374+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:46:01.084374+0000","last_undegraded":"2024-04-24T01:46:01.084374+0000","last_fullsized":"2024-04-24T01:46:01.084374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.041510+0000","last_change":"2024-04-24T01:46:33.041537+0000","last_active":"2024-04-24T01:46:33.041510+0000","last_peered":"2024-04-24T01:46:33.041510+0000","last_clean":"2024-04-24T01:46:33.041510+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:46:33.041510+0000","last_undegraded":"2024-04-24T01:46:33.041510+0000","last_fullsized":"2024-04-24T01:46:33.041510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.041416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:42.167160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.009961+0000","last_change":"2024-04-24T01:46:49.009961+0000","last_active":"2024-04-24T01:46:49.009961+0000","last_peered":"2024-04-24T01:46:49.009961+0000","last_clean":"2024-04-24T01:46:49.009961+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:46:49.009961+0000","last_undegraded":"2024-04-24T01:46:49.009961+0000","last_fullsized":"2024-04-24T01:46:49.009961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:49.009844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:49.009844+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.009844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:05.993663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.095611+0000","last_change":"2024-04-24T01:46:27.095611+0000","last_active":"2024-04-24T01:46:27.095611+0000","last_peered":"2024-04-24T01:46:27.095611+0000","last_clean":"2024-04-24T01:46:27.095611+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:46:27.095611+0000","last_undegraded":"2024-04-24T01:46:27.095611+0000","last_fullsized":"2024-04-24T01:46:27.095611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.095499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:50.346774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.035886+0000","last_change":"2024-04-24T01:46:44.035932+0000","last_active":"2024-04-24T01:46:44.035886+0000","last_peered":"2024-04-24T01:46:44.035886+0000","last_clean":"2024-04-24T01:46:44.035886+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:46:44.035886+0000","last_undegraded":"2024-04-24T01:46:44.035886+0000","last_fullsized":"2024-04-24T01:46:44.035886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:44.035778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:44.035778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.035778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:58.233960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.617579+0000","last_change":"2024-04-24T01:46:40.617579+0000","last_active":"2024-04-24T01:46:40.617579+0000","last_peered":"2024-04-24T01:46:40.617579+0000","last_clean":"2024-04-24T01:46:40.617579+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:46:40.617579+0000","last_undegraded":"2024-04-24T01:46:40.617579+0000","last_fullsized":"2024-04-24T01:46:40.617579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.617471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:40.544588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.564301+0000","last_change":"2024-04-24T01:46:37.564301+0000","last_active":"2024-04-24T01:46:37.564301+0000","last_peered":"2024-04-24T01:46:37.564301+0000","last_clean":"2024-04-24T01:46:37.564301+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:46:37.564301+0000","last_undegraded":"2024-04-24T01:46:37.564301+0000","last_fullsized":"2024-04-24T01:46:37.564301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.564177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:54.721595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.014543+0000","last_change":"2024-04-24T01:46:41.014543+0000","last_active":"2024-04-24T01:46:41.014543+0000","last_peered":"2024-04-24T01:46:41.014543+0000","last_clean":"2024-04-24T01:46:41.014543+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:46:41.014543+0000","last_undegraded":"2024-04-24T01:46:41.014543+0000","last_fullsized":"2024-04-24T01:46:41.014543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:41.014392+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:41.014392+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.014392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:58.382324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.684403+0000","last_change":"2024-04-24T01:46:27.684403+0000","last_active":"2024-04-24T01:46:27.684403+0000","last_peered":"2024-04-24T01:46:27.684403+0000","last_clean":"2024-04-24T01:46:27.684403+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:46:27.684403+0000","last_undegraded":"2024-04-24T01:46:27.684403+0000","last_fullsized":"2024-04-24T01:46:27.684403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.684268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:36.612643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.763139+0000","last_change":"2024-04-24T01:46:26.763139+0000","last_active":"2024-04-24T01:46:26.763139+0000","last_peered":"2024-04-24T01:46:26.763139+0000","last_clean":"2024-04-24T01:46:26.763139+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:46:26.763139+0000","last_undegraded":"2024-04-24T01:46:26.763139+0000","last_fullsized":"2024-04-24T01:46:26.763139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.762976+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:08.389668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.883980+0000","last_change":"2024-04-24T01:46:52.884016+0000","last_active":"2024-04-24T01:46:52.883980+0000","last_peered":"2024-04-24T01:46:52.883980+0000","last_clean":"2024-04-24T01:46:52.883980+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:46:52.883980+0000","last_undegraded":"2024-04-24T01:46:52.883980+0000","last_fullsized":"2024-04-24T01:46:52.883980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:52.883890+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:52.883890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.883890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:00.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.601049+0000","last_change":"2024-04-24T01:46:38.601104+0000","last_active":"2024-04-24T01:46:38.601049+0000","last_peered":"2024-04-24T01:46:38.601049+0000","last_clean":"2024-04-24T01:46:38.601049+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:46:38.601049+0000","last_undegraded":"2024-04-24T01:46:38.601049+0000","last_fullsized":"2024-04-24T01:46:38.601049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.600952+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:56.752401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.084331+0000","last_change":"2024-04-24T01:42:40.776220+0000","last_active":"2024-04-24T01:46:01.084331+0000","last_peered":"2024-04-24T01:46:01.084331+0000","last_clean":"2024-04-24T01:46:01.084331+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:46:01.084331+0000","last_undegraded":"2024-04-24T01:46:01.084331+0000","last_fullsized":"2024-04-24T01:46:01.084331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.487163+0000","last_change":"2024-04-24T01:46:44.487204+0000","last_active":"2024-04-24T01:46:44.487163+0000","last_peered":"2024-04-24T01:46:44.487163+0000","last_clean":"2024-04-24T01:46:44.487163+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:46:44.487163+0000","last_undegraded":"2024-04-24T01:46:44.487163+0000","last_fullsized":"2024-04-24T01:46:44.487163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:44.487074+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:44.487074+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.487074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:02.177404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.886518+0000","last_change":"2024-04-24T01:46:53.886566+0000","last_active":"2024-04-24T01:46:53.886518+0000","last_peered":"2024-04-24T01:46:53.886518+0000","last_clean":"2024-04-24T01:46:53.886518+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:46:53.886518+0000","last_undegraded":"2024-04-24T01:46:53.886518+0000","last_fullsized":"2024-04-24T01:46:53.886518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.886386+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.886386+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.886386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:57:58.598237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.140979+0000","last_change":"2024-04-24T01:46:26.141005+0000","last_active":"2024-04-24T01:46:26.140979+0000","last_peered":"2024-04-24T01:46:26.140979+0000","last_clean":"2024-04-24T01:46:26.140979+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:46:26.140979+0000","last_undegraded":"2024-04-24T01:46:26.140979+0000","last_fullsized":"2024-04-24T01:46:26.140979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.140882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:51.458855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.584641+0000","last_change":"2024-04-24T01:46:35.584676+0000","last_active":"2024-04-24T01:46:35.584641+0000","last_peered":"2024-04-24T01:46:35.584641+0000","last_clean":"2024-04-24T01:46:35.584641+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:46:35.584641+0000","last_undegraded":"2024-04-24T01:46:35.584641+0000","last_fullsized":"2024-04-24T01:46:35.584641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.584557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:35.921550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.671364+0000","last_change":"2024-04-24T01:46:33.671390+0000","last_active":"2024-04-24T01:46:33.671364+0000","last_peered":"2024-04-24T01:46:33.671364+0000","last_clean":"2024-04-24T01:46:33.671364+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:46:33.671364+0000","last_undegraded":"2024-04-24T01:46:33.671364+0000","last_fullsized":"2024-04-24T01:46:33.671364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.671230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:30.461162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.634562+0000","last_change":"2024-04-24T01:46:48.634590+0000","last_active":"2024-04-24T01:46:48.634562+0000","last_peered":"2024-04-24T01:46:48.634562+0000","last_clean":"2024-04-24T01:46:48.634562+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:46:48.634562+0000","last_undegraded":"2024-04-24T01:46:48.634562+0000","last_fullsized":"2024-04-24T01:46:48.634562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:48.634448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:48.634448+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.634448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:05.635594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.701788+0000","last_change":"2024-04-24T01:46:32.701837+0000","last_active":"2024-04-24T01:46:32.701788+0000","last_peered":"2024-04-24T01:46:32.701788+0000","last_clean":"2024-04-24T01:46:32.701788+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:46:32.701788+0000","last_undegraded":"2024-04-24T01:46:32.701788+0000","last_fullsized":"2024-04-24T01:46:32.701788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.701691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:25.764735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:44:56.089024+0000","last_change":"2024-04-24T01:42:40.785750+0000","last_active":"2024-04-24T01:44:56.089024+0000","last_peered":"2024-04-24T01:44:56.089024+0000","last_clean":"2024-04-24T01:44:56.089024+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:44:56.089024+0000","last_undegraded":"2024-04-24T01:44:56.089024+0000","last_fullsized":"2024-04-24T01:44:56.089024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.780498+0000","last_change":"2024-04-24T01:46:29.780528+0000","last_active":"2024-04-24T01:46:29.780498+0000","last_peered":"2024-04-24T01:46:29.780498+0000","last_clean":"2024-04-24T01:46:29.780498+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:46:29.780498+0000","last_undegraded":"2024-04-24T01:46:29.780498+0000","last_fullsized":"2024-04-24T01:46:29.780498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.780404+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.221782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.564284+0000","last_change":"2024-04-24T01:46:54.564325+0000","last_active":"2024-04-24T01:46:54.564284+0000","last_peered":"2024-04-24T01:46:54.564284+0000","last_clean":"2024-04-24T01:46:54.564284+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:46:54.564284+0000","last_undegraded":"2024-04-24T01:46:54.564284+0000","last_fullsized":"2024-04-24T01:46:54.564284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.564193+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.564193+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.564193+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:36.267776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.430519+0000","last_change":"2024-04-24T01:46:38.430544+0000","last_active":"2024-04-24T01:46:38.430519+0000","last_peered":"2024-04-24T01:46:38.430519+0000","last_clean":"2024-04-24T01:46:38.430519+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:46:38.430519+0000","last_undegraded":"2024-04-24T01:46:38.430519+0000","last_fullsized":"2024-04-24T01:46:38.430519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.430431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:51.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.843218+0000","last_change":"2024-04-24T01:46:39.843242+0000","last_active":"2024-04-24T01:46:39.843218+0000","last_peered":"2024-04-24T01:46:39.843218+0000","last_clean":"2024-04-24T01:46:39.843218+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:46:39.843218+0000","last_undegraded":"2024-04-24T01:46:39.843218+0000","last_fullsized":"2024-04-24T01:46:39.843218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.843127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:36.633059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.668222+0000","last_change":"2024-04-24T01:46:23.668254+0000","last_active":"2024-04-24T01:46:23.668222+0000","last_peered":"2024-04-24T01:46:23.668222+0000","last_clean":"2024-04-24T01:46:23.668222+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:46:23.668222+0000","last_undegraded":"2024-04-24T01:46:23.668222+0000","last_fullsized":"2024-04-24T01:46:23.668222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.668128+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:28.941092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:01.089944+0000","last_change":"2024-04-24T01:42:40.785768+0000","last_active":"2024-04-24T01:45:01.089944+0000","last_peered":"2024-04-24T01:45:01.089944+0000","last_clean":"2024-04-24T01:45:01.089944+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:45:01.089944+0000","last_undegraded":"2024-04-24T01:45:01.089944+0000","last_fullsized":"2024-04-24T01:45:01.089944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:56.960993+0000","last_change":"2024-04-24T01:42:40.778631+0000","last_active":"2024-04-24T01:45:56.960993+0000","last_peered":"2024-04-24T01:45:56.960993+0000","last_clean":"2024-04-24T01:45:56.960993+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:45:56.960993+0000","last_undegraded":"2024-04-24T01:45:56.960993+0000","last_fullsized":"2024-04-24T01:45:56.960993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:39.744260+0000","last_clean_scrub_stamp":"2024-04-24T01:42:39.744260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.069651+0000","last_change":"2024-04-24T01:46:45.069683+0000","last_active":"2024-04-24T01:46:45.069651+0000","last_peered":"2024-04-24T01:46:45.069651+0000","last_clean":"2024-04-24T01:46:45.069651+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:46:45.069651+0000","last_undegraded":"2024-04-24T01:46:45.069651+0000","last_fullsized":"2024-04-24T01:46:45.069651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:45.069538+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:45.069538+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.069538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:50:50.879461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.023253+0000","last_change":"2024-04-24T01:46:34.023306+0000","last_active":"2024-04-24T01:46:34.023253+0000","last_peered":"2024-04-24T01:46:34.023253+0000","last_clean":"2024-04-24T01:46:34.023253+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:46:34.023253+0000","last_undegraded":"2024-04-24T01:46:34.023253+0000","last_fullsized":"2024-04-24T01:46:34.023253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.023152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:00.522740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.717282+0000","last_change":"2024-04-24T01:46:25.717306+0000","last_active":"2024-04-24T01:46:25.717282+0000","last_peered":"2024-04-24T01:46:25.717282+0000","last_clean":"2024-04-24T01:46:25.717282+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:46:25.717282+0000","last_undegraded":"2024-04-24T01:46:25.717282+0000","last_fullsized":"2024-04-24T01:46:25.717282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.717163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:29:26.860189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640315,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":487424,"data_stored":151081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640316,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":737936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640315,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":739109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":148048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:47:02.522 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.522 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.523 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.523 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.523 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.523 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.524 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.524 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.524 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.524 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.525 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.525 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.525 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:42:31.718947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=31, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.525 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.525 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.525 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.526 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.526 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.526 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.526 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.527 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.527 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.527 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.527 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.527 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.528 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.528 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.528 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:42:39.744260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=39, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:02.528 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:47:22.530 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff70cb3d640 1 Processor -- start 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff70cb3d640 1 -- start start 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff70cb3d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff708071090 0x7ff708131430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff70cb3d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff708098800 con 0x7ff708096430 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff70cb3d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff708071930 con 0x7ff708071090 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff6fffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff708071090 0x7ff708131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff70659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff708096430 0x7ff708096810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:56156/0 (socket says 172.21.15.107:56156) 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.638+0000 7ff70659c640 1 -- 172.21.15.107:0/467302545 learned_addr learned my addr 172.21.15.107:0/467302545 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.639+0000 7ff6fffff640 1 -- 172.21.15.107:0/467302545 >> v1:172.21.15.107:6789/0 conn(0x7ff708096430 legacy=0x7ff708096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:22.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.639+0000 7ff6fffff640 1 -- 172.21.15.107:0/467302545 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff708071f50 con 0x7ff708071090 2024-04-24T01:47:22.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.639+0000 7ff705d9b640 1 -- 172.21.15.107:0/467302545 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642318402 0 0) 0x7ff708098800 con 0x7ff708096430 2024-04-24T01:47:22.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.639+0000 7ff6fffff640 1 --2- 172.21.15.107:0/467302545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff708131430 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009720 tx=0x7ff6f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e960a443ea17d55 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:22.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff705d9b640 1 -- 172.21.15.107:0/467302545 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f00316d0 con 0x7ff708071090 2024-04-24T01:47:22.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff705d9b640 1 -- 172.21.15.107:0/467302545 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0037070 con 0x7ff708071090 2024-04-24T01:47:22.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff705d9b640 1 -- 172.21.15.107:0/467302545 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f00319c0 con 0x7ff708071090 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff70cb3d640 1 -- 172.21.15.107:0/467302545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 msgr2=0x7ff708131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff70cb3d640 1 --2- 172.21.15.107:0/467302545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff708131430 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009720 tx=0x7ff6f002b840 comp rx=0 tx=0).stop 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff70cb3d640 1 -- 172.21.15.107:0/467302545 shutdown_connections 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff70cb3d640 1 --2- 172.21.15.107:0/467302545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff708131430 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff70cb3d640 1 -- 172.21.15.107:0/467302545 >> 172.21.15.107:0/467302545 conn(0x7ff708099680 msgr2=0x7ff708099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff70cb3d640 1 -- 172.21.15.107:0/467302545 shutdown_connections 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.640+0000 7ff70cb3d640 1 -- 172.21.15.107:0/467302545 wait complete. 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.641+0000 7ff70cb3d640 1 Processor -- start 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.641+0000 7ff70cb3d640 1 -- start start 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70cb3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff7081c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:22.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70cb3d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff708131af0 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff7081c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff7081c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54968/0 (socket says 172.21.15.107:54968) 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70659c640 1 -- 172.21.15.107:0/2741984689 learned_addr learned my addr 172.21.15.107:0/2741984689 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70659c640 1 -- 172.21.15.107:0/2741984689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70806fbf0 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70659c640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff7081c2dc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800c420 tx=0x7ff6f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff6feffd640 1 -- 172.21.15.107:0/2741984689 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f8018070 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff6feffd640 1 -- 172.21.15.107:0/2741984689 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f80074d0 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff708125ea0 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff6feffd640 1 -- 172.21.15.107:0/2741984689 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f8004950 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.642+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff708126380 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.643+0000 7ff6feffd640 1 -- 172.21.15.107:0/2741984689 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff6f801b070 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.644+0000 7ff6feffd640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e8038060 0x7ff6e803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.643+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff708062da0 con 0x7ff708071090 2024-04-24T01:47:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.644+0000 7ff6feffd640 1 -- 172.21.15.107:0/2741984689 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff6f804ad90 con 0x7ff708071090 2024-04-24T01:47:22.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.644+0000 7ff6fffff640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e8038060 0x7ff6e803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:22.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.644+0000 7ff6fffff640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e8038060 0x7ff6e803a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0036000 tx=0x7ff6f0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:22.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.649+0000 7ff6feffd640 1 -- 172.21.15.107:0/2741984689 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7ff6f8011960 con 0x7ff708071090 2024-04-24T01:47:22.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.822+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff70808a4e0 con 0x7ff6e8038060 2024-04-24T01:47:22.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.838+0000 7ff6feffd640 1 -- 172.21.15.107:0/2741984689 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665893 (secure 0 0 0) 0x7ff70808a4e0 con 0x7ff6e8038060 2024-04-24T01:47:22.845 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:47:22.851 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:47:22.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e8038060 msgr2=0x7ff6e803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:22.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e8038060 0x7ff6e803a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0036000 tx=0x7ff6f0008030 comp rx=0 tx=0).stop 2024-04-24T01:47:22.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 msgr2=0x7ff7081c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:22.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff7081c2dc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800c420 tx=0x7ff6f800c8e0 comp rx=0 tx=0).stop 2024-04-24T01:47:22.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 shutdown_connections 2024-04-24T01:47:22.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7ff6e8038060 0x7ff6e803a520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:22.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 --2- 172.21.15.107:0/2741984689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff708071090 0x7ff7081c2dc0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:22.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 >> 172.21.15.107:0/2741984689 conn(0x7ff708099680 msgr2=0x7ff708129ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:22.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 shutdown_connections 2024-04-24T01:47:22.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:22.842+0000 7ff70cb3d640 1 -- 172.21.15.107:0/2741984689 wait complete. 2024-04-24T01:47:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-04-24T01:47:22.093634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5393,"num_read_kb":4942,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5012,"ondisk_log_size":5012,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160888,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326472,"statfs":{"total":386547056640,"available":386382307328,"internally_reserved":0,"allocated":2973696,"data_stored":1776174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003931"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.883674+0000","last_change":"2024-04-24T01:46:35.883674+0000","last_active":"2024-04-24T01:46:35.883674+0000","last_peered":"2024-04-24T01:46:35.883674+0000","last_clean":"2024-04-24T01:46:35.883674+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:46:35.883674+0000","last_undegraded":"2024-04-24T01:46:35.883674+0000","last_fullsized":"2024-04-24T01:46:35.883674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.883557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:30.324934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.691836+0000","last_change":"2024-04-24T01:46:22.691864+0000","last_active":"2024-04-24T01:46:22.691836+0000","last_peered":"2024-04-24T01:46:22.691836+0000","last_clean":"2024-04-24T01:46:22.691836+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:46:22.691836+0000","last_undegraded":"2024-04-24T01:46:22.691836+0000","last_fullsized":"2024-04-24T01:46:22.691836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.691735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:31.620109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.899233+0000","last_change":"2024-04-24T01:46:51.899233+0000","last_active":"2024-04-24T01:46:51.899233+0000","last_peered":"2024-04-24T01:46:51.899233+0000","last_clean":"2024-04-24T01:46:51.899233+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:46:51.899233+0000","last_undegraded":"2024-04-24T01:46:51.899233+0000","last_fullsized":"2024-04-24T01:46:51.899233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:51.899117+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:51.899117+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.899117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:01.559805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.524058+0000","last_change":"2024-04-24T01:46:45.524093+0000","last_active":"2024-04-24T01:46:45.524058+0000","last_peered":"2024-04-24T01:46:45.524058+0000","last_clean":"2024-04-24T01:46:45.524058+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:46:45.524058+0000","last_undegraded":"2024-04-24T01:46:45.524058+0000","last_fullsized":"2024-04-24T01:46:45.524058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:45.523961+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:45.523961+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.523961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:33.787603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.574324+0000","last_change":"2024-04-24T01:46:57.574351+0000","last_active":"2024-04-24T01:46:57.574324+0000","last_peered":"2024-04-24T01:46:57.574324+0000","last_clean":"2024-04-24T01:46:57.574324+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:46:57.574324+0000","last_undegraded":"2024-04-24T01:46:57.574324+0000","last_fullsized":"2024-04-24T01:46:57.574324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:57.574225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:57.574225+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.574225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:53:21.599863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.474764+0000","last_change":"2024-04-24T01:46:42.474835+0000","last_active":"2024-04-24T01:46:42.474764+0000","last_peered":"2024-04-24T01:46:42.474764+0000","last_clean":"2024-04-24T01:46:42.474764+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:46:42.474764+0000","last_undegraded":"2024-04-24T01:46:42.474764+0000","last_fullsized":"2024-04-24T01:46:42.474764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:42.474656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:42.474656+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.474656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:09.390976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.953342+0000","last_change":"2024-04-24T01:46:44.953366+0000","last_active":"2024-04-24T01:46:44.953342+0000","last_peered":"2024-04-24T01:46:44.953342+0000","last_clean":"2024-04-24T01:46:44.953342+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:46:44.953342+0000","last_undegraded":"2024-04-24T01:46:44.953342+0000","last_fullsized":"2024-04-24T01:46:44.953342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:44.953254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:44.953254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.953254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:03.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.454620+0000","last_change":"2024-04-24T01:46:40.454678+0000","last_active":"2024-04-24T01:46:40.454620+0000","last_peered":"2024-04-24T01:46:40.454620+0000","last_clean":"2024-04-24T01:46:40.454620+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:46:40.454620+0000","last_undegraded":"2024-04-24T01:46:40.454620+0000","last_fullsized":"2024-04-24T01:46:40.454620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.454492+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:29.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.531759+0000","last_change":"2024-04-24T01:46:53.531786+0000","last_active":"2024-04-24T01:46:53.531759+0000","last_peered":"2024-04-24T01:46:53.531759+0000","last_clean":"2024-04-24T01:46:53.531759+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:46:53.531759+0000","last_undegraded":"2024-04-24T01:46:53.531759+0000","last_fullsized":"2024-04-24T01:46:53.531759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.531673+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.531673+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.531673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:53:09.240319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.642290+0000","last_change":"2024-04-24T01:46:54.642339+0000","last_active":"2024-04-24T01:46:54.642290+0000","last_peered":"2024-04-24T01:46:54.642290+0000","last_clean":"2024-04-24T01:46:54.642290+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:46:54.642290+0000","last_undegraded":"2024-04-24T01:46:54.642290+0000","last_fullsized":"2024-04-24T01:46:54.642290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.642187+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.642187+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.642187+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:32.194355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.903414+0000","last_change":"2024-04-24T01:46:43.903454+0000","last_active":"2024-04-24T01:46:43.903414+0000","last_peered":"2024-04-24T01:46:43.903414+0000","last_clean":"2024-04-24T01:46:43.903414+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:46:43.903414+0000","last_undegraded":"2024-04-24T01:46:43.903414+0000","last_fullsized":"2024-04-24T01:46:43.903414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:43.903307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:43.903307+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.903307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:56.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.064030+0000","last_change":"2024-04-24T01:46:54.064060+0000","last_active":"2024-04-24T01:46:54.064030+0000","last_peered":"2024-04-24T01:46:54.064030+0000","last_clean":"2024-04-24T01:46:54.064030+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:46:54.064030+0000","last_undegraded":"2024-04-24T01:46:54.064030+0000","last_fullsized":"2024-04-24T01:46:54.064030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.063931+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.063931+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.063931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:17.638374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.623179+0000","last_change":"2024-04-24T01:47:00.623227+0000","last_active":"2024-04-24T01:47:00.623179+0000","last_peered":"2024-04-24T01:47:00.623179+0000","last_clean":"2024-04-24T01:47:00.623179+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:47:00.623179+0000","last_undegraded":"2024-04-24T01:47:00.623179+0000","last_fullsized":"2024-04-24T01:47:00.623179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:00.623079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:00.623079+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.623079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:43:16.932027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.812398+0000","last_change":"2024-04-24T01:46:30.812398+0000","last_active":"2024-04-24T01:46:30.812398+0000","last_peered":"2024-04-24T01:46:30.812398+0000","last_clean":"2024-04-24T01:46:30.812398+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:46:30.812398+0000","last_undegraded":"2024-04-24T01:46:30.812398+0000","last_fullsized":"2024-04-24T01:46:30.812398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.812254+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.118051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.039002+0000","last_change":"2024-04-24T01:46:42.039024+0000","last_active":"2024-04-24T01:46:42.039002+0000","last_peered":"2024-04-24T01:46:42.039002+0000","last_clean":"2024-04-24T01:46:42.039002+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:46:42.039002+0000","last_undegraded":"2024-04-24T01:46:42.039002+0000","last_fullsized":"2024-04-24T01:46:42.039002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:42.038927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:42.038927+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.038927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:42.971477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.884806+0000","last_change":"2024-04-24T01:46:34.884806+0000","last_active":"2024-04-24T01:46:34.884806+0000","last_peered":"2024-04-24T01:46:34.884806+0000","last_clean":"2024-04-24T01:46:34.884806+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:46:34.884806+0000","last_undegraded":"2024-04-24T01:46:34.884806+0000","last_fullsized":"2024-04-24T01:46:34.884806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.884693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:45.893272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.553894+0000","last_change":"2024-04-24T01:46:46.553918+0000","last_active":"2024-04-24T01:46:46.553894+0000","last_peered":"2024-04-24T01:46:46.553894+0000","last_clean":"2024-04-24T01:46:46.553894+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:46:46.553894+0000","last_undegraded":"2024-04-24T01:46:46.553894+0000","last_fullsized":"2024-04-24T01:46:46.553894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:46.553790+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:46.553790+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.553790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:44.288870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.604151+0000","last_change":"2024-04-24T01:46:41.604175+0000","last_active":"2024-04-24T01:46:41.604151+0000","last_peered":"2024-04-24T01:46:41.604151+0000","last_clean":"2024-04-24T01:46:41.604151+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:46:41.604151+0000","last_undegraded":"2024-04-24T01:46:41.604151+0000","last_fullsized":"2024-04-24T01:46:41.604151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:41.604041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:41.604041+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.604041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:59.977227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.624628+0000","last_change":"2024-04-24T01:46:34.624679+0000","last_active":"2024-04-24T01:46:34.624628+0000","last_peered":"2024-04-24T01:46:34.624628+0000","last_clean":"2024-04-24T01:46:34.624628+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:46:34.624628+0000","last_undegraded":"2024-04-24T01:46:34.624628+0000","last_fullsized":"2024-04-24T01:46:34.624628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.624511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:48.418934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.772525+0000","last_change":"2024-04-24T01:46:29.772551+0000","last_active":"2024-04-24T01:46:29.772525+0000","last_peered":"2024-04-24T01:46:29.772525+0000","last_clean":"2024-04-24T01:46:29.772525+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:46:29.772525+0000","last_undegraded":"2024-04-24T01:46:29.772525+0000","last_fullsized":"2024-04-24T01:46:29.772525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.772438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:56.532007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.614118+0000","last_change":"2024-04-24T01:46:44.614151+0000","last_active":"2024-04-24T01:46:44.614118+0000","last_peered":"2024-04-24T01:46:44.614118+0000","last_clean":"2024-04-24T01:46:44.614118+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:46:44.614118+0000","last_undegraded":"2024-04-24T01:46:44.614118+0000","last_fullsized":"2024-04-24T01:46:44.614118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:44.614034+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:44.614034+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.614034+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:23.716834+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.573920+0000","last_change":"2024-04-24T01:46:39.573948+0000","last_active":"2024-04-24T01:46:39.573920+0000","last_peered":"2024-04-24T01:46:39.573920+0000","last_clean":"2024-04-24T01:46:39.573920+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:46:39.573920+0000","last_undegraded":"2024-04-24T01:46:39.573920+0000","last_fullsized":"2024-04-24T01:46:39.573920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.573832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:44.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.111312+0000","last_change":"2024-04-24T01:46:28.111336+0000","last_active":"2024-04-24T01:46:28.111312+0000","last_peered":"2024-04-24T01:46:28.111312+0000","last_clean":"2024-04-24T01:46:28.111312+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:46:28.111312+0000","last_undegraded":"2024-04-24T01:46:28.111312+0000","last_fullsized":"2024-04-24T01:46:28.111312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.111230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:02.142302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.670923+0000","last_change":"2024-04-24T01:46:49.670967+0000","last_active":"2024-04-24T01:46:49.670923+0000","last_peered":"2024-04-24T01:46:49.670923+0000","last_clean":"2024-04-24T01:46:49.670923+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:46:49.670923+0000","last_undegraded":"2024-04-24T01:46:49.670923+0000","last_fullsized":"2024-04-24T01:46:49.670923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:49.670815+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:49.670815+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.670815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:33.464816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.041076+0000","last_change":"2024-04-24T01:46:49.041103+0000","last_active":"2024-04-24T01:46:49.041076+0000","last_peered":"2024-04-24T01:46:49.041076+0000","last_clean":"2024-04-24T01:46:49.041076+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:46:49.041076+0000","last_undegraded":"2024-04-24T01:46:49.041076+0000","last_fullsized":"2024-04-24T01:46:49.041076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:49.040983+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:49.040983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.040983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:52.960393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.936697+0000","last_change":"2024-04-24T01:46:50.936723+0000","last_active":"2024-04-24T01:46:50.936697+0000","last_peered":"2024-04-24T01:46:50.936697+0000","last_clean":"2024-04-24T01:46:50.936697+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:46:50.936697+0000","last_undegraded":"2024-04-24T01:46:50.936697+0000","last_fullsized":"2024-04-24T01:46:50.936697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.936606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.936606+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.936606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:13.077347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.792229+0000","last_change":"2024-04-24T01:46:27.792262+0000","last_active":"2024-04-24T01:46:27.792229+0000","last_peered":"2024-04-24T01:46:27.792229+0000","last_clean":"2024-04-24T01:46:27.792229+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:46:27.792229+0000","last_undegraded":"2024-04-24T01:46:27.792229+0000","last_fullsized":"2024-04-24T01:46:27.792229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.792141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:43.543336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.595622+0000","last_change":"2024-04-24T01:46:58.595622+0000","last_active":"2024-04-24T01:46:58.595622+0000","last_peered":"2024-04-24T01:46:58.595622+0000","last_clean":"2024-04-24T01:46:58.595622+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:46:58.595622+0000","last_undegraded":"2024-04-24T01:46:58.595622+0000","last_fullsized":"2024-04-24T01:46:58.595622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:58.595487+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:58.595487+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.595487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:29.835584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:01.427367+0000","last_change":"2024-04-24T01:47:01.427416+0000","last_active":"2024-04-24T01:47:01.427367+0000","last_peered":"2024-04-24T01:47:01.427367+0000","last_clean":"2024-04-24T01:47:01.427367+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:47:01.427367+0000","last_undegraded":"2024-04-24T01:47:01.427367+0000","last_fullsized":"2024-04-24T01:47:01.427367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:47:01.427258+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:47:01.427258+0000","last_clean_scrub_stamp":"2024-04-24T01:47:01.427258+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:40.856960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.492346+0000","last_change":"2024-04-24T01:46:33.492406+0000","last_active":"2024-04-24T01:46:33.492346+0000","last_peered":"2024-04-24T01:46:33.492346+0000","last_clean":"2024-04-24T01:46:33.492346+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:46:33.492346+0000","last_undegraded":"2024-04-24T01:46:33.492346+0000","last_fullsized":"2024-04-24T01:46:33.492346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.492233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:04.065546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.547488+0000","last_change":"2024-04-24T01:46:49.547488+0000","last_active":"2024-04-24T01:46:49.547488+0000","last_peered":"2024-04-24T01:46:49.547488+0000","last_clean":"2024-04-24T01:46:49.547488+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:46:49.547488+0000","last_undegraded":"2024-04-24T01:46:49.547488+0000","last_fullsized":"2024-04-24T01:46:49.547488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:49.547352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:49.547352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.547352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:40.238735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.152740+0000","last_change":"2024-04-24T01:46:01.152762+0000","last_active":"2024-04-24T01:46:01.152740+0000","last_peered":"2024-04-24T01:46:01.152740+0000","last_clean":"2024-04-24T01:46:01.152740+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:46:01.152740+0000","last_undegraded":"2024-04-24T01:46:01.152740+0000","last_fullsized":"2024-04-24T01:46:01.152740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.152654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:54.458451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":117,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.339667+0000","last_change":"2024-04-24T01:46:24.339700+0000","last_active":"2024-04-24T01:46:24.339667+0000","last_peered":"2024-04-24T01:46:24.339667+0000","last_clean":"2024-04-24T01:46:24.339667+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:46:24.339667+0000","last_undegraded":"2024-04-24T01:46:24.339667+0000","last_fullsized":"2024-04-24T01:46:24.339667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.339579+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:22.912549+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.697863+0000","last_change":"2024-04-24T01:46:20.697897+0000","last_active":"2024-04-24T01:46:20.697863+0000","last_peered":"2024-04-24T01:46:20.697863+0000","last_clean":"2024-04-24T01:46:20.697863+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:46:20.697863+0000","last_undegraded":"2024-04-24T01:46:20.697863+0000","last_fullsized":"2024-04-24T01:46:20.697863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.697714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:08.843035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.498905+0000","last_change":"2024-04-24T01:46:59.498955+0000","last_active":"2024-04-24T01:46:59.498905+0000","last_peered":"2024-04-24T01:46:59.498905+0000","last_clean":"2024-04-24T01:46:59.498905+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:46:59.498905+0000","last_undegraded":"2024-04-24T01:46:59.498905+0000","last_fullsized":"2024-04-24T01:46:59.498905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:59.498781+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:59.498781+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.498781+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:31.347722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.435384+0000","last_change":"2024-04-24T01:46:36.435421+0000","last_active":"2024-04-24T01:46:36.435384+0000","last_peered":"2024-04-24T01:46:36.435384+0000","last_clean":"2024-04-24T01:46:36.435384+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:46:36.435384+0000","last_undegraded":"2024-04-24T01:46:36.435384+0000","last_fullsized":"2024-04-24T01:46:36.435384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.435300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:00.290885+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.838724+0000","last_change":"2024-04-24T01:46:33.838724+0000","last_active":"2024-04-24T01:46:33.838724+0000","last_peered":"2024-04-24T01:46:33.838724+0000","last_clean":"2024-04-24T01:46:33.838724+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:46:33.838724+0000","last_undegraded":"2024-04-24T01:46:33.838724+0000","last_fullsized":"2024-04-24T01:46:33.838724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.838566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:49.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.293308+0000","last_change":"2024-04-24T01:46:19.293332+0000","last_active":"2024-04-24T01:46:19.293308+0000","last_peered":"2024-04-24T01:46:19.293308+0000","last_clean":"2024-04-24T01:46:19.293308+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:46:19.293308+0000","last_undegraded":"2024-04-24T01:46:19.293308+0000","last_fullsized":"2024-04-24T01:46:19.293308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.293213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:34.753066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.489009+0000","last_change":"2024-04-24T01:46:03.489046+0000","last_active":"2024-04-24T01:46:03.489009+0000","last_peered":"2024-04-24T01:46:03.489009+0000","last_clean":"2024-04-24T01:46:03.489009+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:46:03.489009+0000","last_undegraded":"2024-04-24T01:46:03.489009+0000","last_fullsized":"2024-04-24T01:46:03.489009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.488913+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:54.619923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.532812+0000","last_change":"2024-04-24T01:46:04.532851+0000","last_active":"2024-04-24T01:46:04.532812+0000","last_peered":"2024-04-24T01:46:04.532812+0000","last_clean":"2024-04-24T01:46:04.532812+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:46:04.532812+0000","last_undegraded":"2024-04-24T01:46:04.532812+0000","last_fullsized":"2024-04-24T01:46:04.532812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.532716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:21.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.927860+0000","last_change":"2024-04-24T01:46:57.927893+0000","last_active":"2024-04-24T01:46:57.927860+0000","last_peered":"2024-04-24T01:46:57.927860+0000","last_clean":"2024-04-24T01:46:57.927860+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:46:57.927860+0000","last_undegraded":"2024-04-24T01:46:57.927860+0000","last_fullsized":"2024-04-24T01:46:57.927860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:57.927771+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:57.927771+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.927771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:33:30.002077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.557245+0000","last_change":"2024-04-24T01:46:48.557275+0000","last_active":"2024-04-24T01:46:48.557245+0000","last_peered":"2024-04-24T01:46:48.557245+0000","last_clean":"2024-04-24T01:46:48.557245+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:46:48.557245+0000","last_undegraded":"2024-04-24T01:46:48.557245+0000","last_fullsized":"2024-04-24T01:46:48.557245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:48.557121+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:48.557121+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.557121+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:27.827410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:07.644219+0000","last_change":"2024-04-24T01:47:07.644219+0000","last_active":"2024-04-24T01:47:07.644219+0000","last_peered":"2024-04-24T01:47:07.644219+0000","last_clean":"2024-04-24T01:47:07.644219+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:47:07.644219+0000","last_undegraded":"2024-04-24T01:47:07.644219+0000","last_fullsized":"2024-04-24T01:47:07.644219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:07.644089+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:07.644089+0000","last_clean_scrub_stamp":"2024-04-24T01:47:07.644089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:25.188634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.183355+0000","last_change":"2024-04-24T01:46:15.183378+0000","last_active":"2024-04-24T01:46:15.183355+0000","last_peered":"2024-04-24T01:46:15.183355+0000","last_clean":"2024-04-24T01:46:15.183355+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:46:15.183355+0000","last_undegraded":"2024-04-24T01:46:15.183355+0000","last_fullsized":"2024-04-24T01:46:15.183355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.183254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:00.909604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.849954+0000","last_change":"2024-04-24T01:46:08.849993+0000","last_active":"2024-04-24T01:46:08.849954+0000","last_peered":"2024-04-24T01:46:08.849954+0000","last_clean":"2024-04-24T01:46:08.849954+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:46:08.849954+0000","last_undegraded":"2024-04-24T01:46:08.849954+0000","last_fullsized":"2024-04-24T01:46:08.849954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.849869+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:59.980879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":397,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.286885+0000","last_change":"2024-04-24T01:46:23.286945+0000","last_active":"2024-04-24T01:46:23.286885+0000","last_peered":"2024-04-24T01:46:23.286885+0000","last_clean":"2024-04-24T01:46:23.286885+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:46:23.286885+0000","last_undegraded":"2024-04-24T01:46:23.286885+0000","last_fullsized":"2024-04-24T01:46:23.286885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.286754+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:45:55.452597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.048742+0000","last_change":"2024-04-24T01:46:52.048768+0000","last_active":"2024-04-24T01:46:52.048742+0000","last_peered":"2024-04-24T01:46:52.048742+0000","last_clean":"2024-04-24T01:46:52.048742+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:46:52.048742+0000","last_undegraded":"2024-04-24T01:46:52.048742+0000","last_fullsized":"2024-04-24T01:46:52.048742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:52.048656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:52.048656+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.048656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:31.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.867248+0000","last_change":"2024-04-24T01:46:54.867278+0000","last_active":"2024-04-24T01:46:54.867248+0000","last_peered":"2024-04-24T01:46:54.867248+0000","last_clean":"2024-04-24T01:46:54.867248+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:46:54.867248+0000","last_undegraded":"2024-04-24T01:46:54.867248+0000","last_fullsized":"2024-04-24T01:46:54.867248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:54.867147+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:54.867147+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.867147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:52.237810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.590810+0000","last_change":"2024-04-24T01:46:43.590810+0000","last_active":"2024-04-24T01:46:43.590810+0000","last_peered":"2024-04-24T01:46:43.590810+0000","last_clean":"2024-04-24T01:46:43.590810+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:46:43.590810+0000","last_undegraded":"2024-04-24T01:46:43.590810+0000","last_fullsized":"2024-04-24T01:46:43.590810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:43.590695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:43.590695+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.590695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:20.764987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.208983+0000","last_change":"2024-04-24T01:46:03.209024+0000","last_active":"2024-04-24T01:46:03.208983+0000","last_peered":"2024-04-24T01:46:03.208983+0000","last_clean":"2024-04-24T01:46:03.208983+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:46:03.208983+0000","last_undegraded":"2024-04-24T01:46:03.208983+0000","last_fullsized":"2024-04-24T01:46:03.208983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.208890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:44.835582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.856137+0000","last_change":"2024-04-24T01:46:05.856196+0000","last_active":"2024-04-24T01:46:05.856137+0000","last_peered":"2024-04-24T01:46:05.856137+0000","last_clean":"2024-04-24T01:46:05.856137+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:46:05.856137+0000","last_undegraded":"2024-04-24T01:46:05.856137+0000","last_fullsized":"2024-04-24T01:46:05.856137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.856052+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:35.561294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.187919+0000","last_change":"2024-04-24T01:46:06.187946+0000","last_active":"2024-04-24T01:46:06.187919+0000","last_peered":"2024-04-24T01:46:06.187919+0000","last_clean":"2024-04-24T01:46:06.187919+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:46:06.187919+0000","last_undegraded":"2024-04-24T01:46:06.187919+0000","last_fullsized":"2024-04-24T01:46:06.187919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.187813+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:35.370509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.287580+0000","last_change":"2024-04-24T01:46:17.287580+0000","last_active":"2024-04-24T01:46:17.287580+0000","last_peered":"2024-04-24T01:46:17.287580+0000","last_clean":"2024-04-24T01:46:17.287580+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:46:17.287580+0000","last_undegraded":"2024-04-24T01:46:17.287580+0000","last_fullsized":"2024-04-24T01:46:17.287580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.287452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:10.198303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.871548+0000","last_change":"2024-04-24T01:46:37.871548+0000","last_active":"2024-04-24T01:46:37.871548+0000","last_peered":"2024-04-24T01:46:37.871548+0000","last_clean":"2024-04-24T01:46:37.871548+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:46:37.871548+0000","last_undegraded":"2024-04-24T01:46:37.871548+0000","last_fullsized":"2024-04-24T01:46:37.871548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.871441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:18.210191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.610641+0000","last_change":"2024-04-24T01:46:10.610641+0000","last_active":"2024-04-24T01:46:10.610641+0000","last_peered":"2024-04-24T01:46:10.610641+0000","last_clean":"2024-04-24T01:46:10.610641+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:46:10.610641+0000","last_undegraded":"2024-04-24T01:46:10.610641+0000","last_fullsized":"2024-04-24T01:46:10.610641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.610513+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:05.321177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.823412+0000","last_change":"2024-04-24T01:46:11.823412+0000","last_active":"2024-04-24T01:46:11.823412+0000","last_peered":"2024-04-24T01:46:11.823412+0000","last_clean":"2024-04-24T01:46:11.823412+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:46:11.823412+0000","last_undegraded":"2024-04-24T01:46:11.823412+0000","last_fullsized":"2024-04-24T01:46:11.823412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.823285+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:43.489332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.206777+0000","last_change":"2024-04-24T01:46:03.206777+0000","last_active":"2024-04-24T01:46:03.206777+0000","last_peered":"2024-04-24T01:46:03.206777+0000","last_clean":"2024-04-24T01:46:03.206777+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:46:03.206777+0000","last_undegraded":"2024-04-24T01:46:03.206777+0000","last_fullsized":"2024-04-24T01:46:03.206777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.206669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:46.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.998764+0000","last_change":"2024-04-24T01:46:49.998764+0000","last_active":"2024-04-24T01:46:49.998764+0000","last_peered":"2024-04-24T01:46:49.998764+0000","last_clean":"2024-04-24T01:46:49.998764+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:46:49.998764+0000","last_undegraded":"2024-04-24T01:46:49.998764+0000","last_fullsized":"2024-04-24T01:46:49.998764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:49.998606+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:49.998606+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.998606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:48.359394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.762304+0000","last_change":"2024-04-24T01:46:30.762304+0000","last_active":"2024-04-24T01:46:30.762304+0000","last_peered":"2024-04-24T01:46:30.762304+0000","last_clean":"2024-04-24T01:46:30.762304+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:46:30.762304+0000","last_undegraded":"2024-04-24T01:46:30.762304+0000","last_fullsized":"2024-04-24T01:46:30.762304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.762170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:25.539809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.959316+0000","last_change":"2024-04-24T01:46:45.959316+0000","last_active":"2024-04-24T01:46:45.959316+0000","last_peered":"2024-04-24T01:46:45.959316+0000","last_clean":"2024-04-24T01:46:45.959316+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:46:45.959316+0000","last_undegraded":"2024-04-24T01:46:45.959316+0000","last_fullsized":"2024-04-24T01:46:45.959316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:45.959202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:45.959202+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.959202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:51.265107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.170837+0000","last_change":"2024-04-24T01:46:23.170837+0000","last_active":"2024-04-24T01:46:23.170837+0000","last_peered":"2024-04-24T01:46:23.170837+0000","last_clean":"2024-04-24T01:46:23.170837+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:46:23.170837+0000","last_undegraded":"2024-04-24T01:46:23.170837+0000","last_fullsized":"2024-04-24T01:46:23.170837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.170664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:17.051548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.289877+0000","last_change":"2024-04-24T01:46:07.289877+0000","last_active":"2024-04-24T01:46:07.289877+0000","last_peered":"2024-04-24T01:46:07.289877+0000","last_clean":"2024-04-24T01:46:07.289877+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:46:07.289877+0000","last_undegraded":"2024-04-24T01:46:07.289877+0000","last_fullsized":"2024-04-24T01:46:07.289877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.289738+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:04.439196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.283592+0000","last_change":"2024-04-24T01:46:00.283592+0000","last_active":"2024-04-24T01:46:00.283592+0000","last_peered":"2024-04-24T01:46:00.283592+0000","last_clean":"2024-04-24T01:46:00.283592+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:46:00.283592+0000","last_undegraded":"2024-04-24T01:46:00.283592+0000","last_fullsized":"2024-04-24T01:46:00.283592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.283490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:35.270360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.628016+0000","last_change":"2024-04-24T01:46:56.628016+0000","last_active":"2024-04-24T01:46:56.628016+0000","last_peered":"2024-04-24T01:46:56.628016+0000","last_clean":"2024-04-24T01:46:56.628016+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:46:56.628016+0000","last_undegraded":"2024-04-24T01:46:56.628016+0000","last_fullsized":"2024-04-24T01:46:56.628016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:56.627869+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:56.627869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.627869+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:25.561990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.848059+0000","last_change":"2024-04-24T01:46:36.848059+0000","last_active":"2024-04-24T01:46:36.848059+0000","last_peered":"2024-04-24T01:46:36.848059+0000","last_clean":"2024-04-24T01:46:36.848059+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:46:36.848059+0000","last_undegraded":"2024-04-24T01:46:36.848059+0000","last_fullsized":"2024-04-24T01:46:36.848059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.847905+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:33.997362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:17.602729+0000","last_change":"2024-04-24T01:47:17.602751+0000","last_active":"2024-04-24T01:47:17.602729+0000","last_peered":"2024-04-24T01:47:17.602729+0000","last_clean":"2024-04-24T01:47:17.602729+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:47:17.602729+0000","last_undegraded":"2024-04-24T01:47:17.602729+0000","last_fullsized":"2024-04-24T01:47:17.602729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:17.602630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:17.602630+0000","last_clean_scrub_stamp":"2024-04-24T01:47:17.602630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:03.669680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.256556+0000","last_change":"2024-04-24T01:46:20.256556+0000","last_active":"2024-04-24T01:46:20.256556+0000","last_peered":"2024-04-24T01:46:20.256556+0000","last_clean":"2024-04-24T01:46:20.256556+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:46:20.256556+0000","last_undegraded":"2024-04-24T01:46:20.256556+0000","last_fullsized":"2024-04-24T01:46:20.256556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.256445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:51.251216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'61","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.271175+0000","last_change":"2024-04-24T01:46:05.271175+0000","last_active":"2024-04-24T01:46:05.271175+0000","last_peered":"2024-04-24T01:46:05.271175+0000","last_clean":"2024-04-24T01:46:05.271175+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:46:05.271175+0000","last_undegraded":"2024-04-24T01:46:05.271175+0000","last_fullsized":"2024-04-24T01:46:05.271175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'61","last_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_deep_scrub":"34'61","last_deep_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.271031+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:16.279610+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.199480+0000","last_change":"2024-04-24T01:46:09.199480+0000","last_active":"2024-04-24T01:46:09.199480+0000","last_peered":"2024-04-24T01:46:09.199480+0000","last_clean":"2024-04-24T01:46:09.199480+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:46:09.199480+0000","last_undegraded":"2024-04-24T01:46:09.199480+0000","last_fullsized":"2024-04-24T01:46:09.199480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.199345+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:53.841686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.967887+0000","last_change":"2024-04-24T01:46:58.967887+0000","last_active":"2024-04-24T01:46:58.967887+0000","last_peered":"2024-04-24T01:46:58.967887+0000","last_clean":"2024-04-24T01:46:58.967887+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:46:58.967887+0000","last_undegraded":"2024-04-24T01:46:58.967887+0000","last_fullsized":"2024-04-24T01:46:58.967887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:58.967754+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:58.967754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.967754+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:40.745058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.692666+0000","last_change":"2024-04-24T01:46:25.692666+0000","last_active":"2024-04-24T01:46:25.692666+0000","last_peered":"2024-04-24T01:46:25.692666+0000","last_clean":"2024-04-24T01:46:25.692666+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:46:25.692666+0000","last_undegraded":"2024-04-24T01:46:25.692666+0000","last_fullsized":"2024-04-24T01:46:25.692666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.692556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:03:26.488607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:16.651129+0000","last_change":"2024-04-24T01:47:16.651152+0000","last_active":"2024-04-24T01:47:16.651129+0000","last_peered":"2024-04-24T01:47:16.651129+0000","last_clean":"2024-04-24T01:47:16.651129+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:47:16.651129+0000","last_undegraded":"2024-04-24T01:47:16.651129+0000","last_fullsized":"2024-04-24T01:47:16.651129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:16.651037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:16.651037+0000","last_clean_scrub_stamp":"2024-04-24T01:47:16.651037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:30:29.536498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.205537+0000","last_change":"2024-04-24T01:46:22.205537+0000","last_active":"2024-04-24T01:46:22.205537+0000","last_peered":"2024-04-24T01:46:22.205537+0000","last_clean":"2024-04-24T01:46:22.205537+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:46:22.205537+0000","last_undegraded":"2024-04-24T01:46:22.205537+0000","last_fullsized":"2024-04-24T01:46:22.205537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.205433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:02.910528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'77","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.298393+0000","last_change":"2024-04-24T01:46:15.298393+0000","last_active":"2024-04-24T01:46:15.298393+0000","last_peered":"2024-04-24T01:46:15.298393+0000","last_clean":"2024-04-24T01:46:15.298393+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:46:15.298393+0000","last_undegraded":"2024-04-24T01:46:15.298393+0000","last_fullsized":"2024-04-24T01:46:15.298393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.298262+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:33.449711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.165949+0000","last_change":"2024-04-24T01:46:25.165949+0000","last_active":"2024-04-24T01:46:25.165949+0000","last_peered":"2024-04-24T01:46:25.165949+0000","last_clean":"2024-04-24T01:46:25.165949+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:46:25.165949+0000","last_undegraded":"2024-04-24T01:46:25.165949+0000","last_fullsized":"2024-04-24T01:46:25.165949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.165833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:38.566634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.960071+0000","last_change":"2024-04-24T01:47:00.960071+0000","last_active":"2024-04-24T01:47:00.960071+0000","last_peered":"2024-04-24T01:47:00.960071+0000","last_clean":"2024-04-24T01:47:00.960071+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:47:00.960071+0000","last_undegraded":"2024-04-24T01:47:00.960071+0000","last_fullsized":"2024-04-24T01:47:00.960071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-24T01:47:00.959959+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-24T01:47:00.959959+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.959959+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:10.371922+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.606660+0000","last_change":"2024-04-24T01:46:42.606660+0000","last_active":"2024-04-24T01:46:42.606660+0000","last_peered":"2024-04-24T01:46:42.606660+0000","last_clean":"2024-04-24T01:46:42.606660+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:46:42.606660+0000","last_undegraded":"2024-04-24T01:46:42.606660+0000","last_fullsized":"2024-04-24T01:46:42.606660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:42.606517+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:42.606517+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.606517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:22.631331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.003689+0000","last_change":"2024-04-24T01:46:38.003689+0000","last_active":"2024-04-24T01:46:38.003689+0000","last_peered":"2024-04-24T01:46:38.003689+0000","last_clean":"2024-04-24T01:46:38.003689+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:46:38.003689+0000","last_undegraded":"2024-04-24T01:46:38.003689+0000","last_fullsized":"2024-04-24T01:46:38.003689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.003576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:03.732204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.833895+0000","last_change":"2024-04-24T01:46:16.833895+0000","last_active":"2024-04-24T01:46:16.833895+0000","last_peered":"2024-04-24T01:46:16.833895+0000","last_clean":"2024-04-24T01:46:16.833895+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:46:16.833895+0000","last_undegraded":"2024-04-24T01:46:16.833895+0000","last_fullsized":"2024-04-24T01:46:16.833895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.833759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:04.866593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.517337+0000","last_change":"2024-04-24T01:46:05.517337+0000","last_active":"2024-04-24T01:46:05.517337+0000","last_peered":"2024-04-24T01:46:05.517337+0000","last_clean":"2024-04-24T01:46:05.517337+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:46:05.517337+0000","last_undegraded":"2024-04-24T01:46:05.517337+0000","last_fullsized":"2024-04-24T01:46:05.517337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.517182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.149356+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.480613+0000","last_change":"2024-04-24T01:46:35.480613+0000","last_active":"2024-04-24T01:46:35.480613+0000","last_peered":"2024-04-24T01:46:35.480613+0000","last_clean":"2024-04-24T01:46:35.480613+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:46:35.480613+0000","last_undegraded":"2024-04-24T01:46:35.480613+0000","last_fullsized":"2024-04-24T01:46:35.480613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.480455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:57.552982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.503496+0000","last_change":"2024-04-24T01:46:51.503526+0000","last_active":"2024-04-24T01:46:51.503496+0000","last_peered":"2024-04-24T01:46:51.503496+0000","last_clean":"2024-04-24T01:46:51.503496+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:46:51.503496+0000","last_undegraded":"2024-04-24T01:46:51.503496+0000","last_fullsized":"2024-04-24T01:46:51.503496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:51.503412+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:51.503412+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.503412+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:08.069919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.469297+0000","last_change":"2024-04-24T01:46:37.469297+0000","last_active":"2024-04-24T01:46:37.469297+0000","last_peered":"2024-04-24T01:46:37.469297+0000","last_clean":"2024-04-24T01:46:37.469297+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:46:37.469297+0000","last_undegraded":"2024-04-24T01:46:37.469297+0000","last_fullsized":"2024-04-24T01:46:37.469297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.469176+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:59.897731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.497980+0000","last_change":"2024-04-24T01:46:52.497980+0000","last_active":"2024-04-24T01:46:52.497980+0000","last_peered":"2024-04-24T01:46:52.497980+0000","last_clean":"2024-04-24T01:46:52.497980+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:46:52.497980+0000","last_undegraded":"2024-04-24T01:46:52.497980+0000","last_fullsized":"2024-04-24T01:46:52.497980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:52.497803+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:52.497803+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.497803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:57.481894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.269204+0000","last_change":"2024-04-24T01:46:18.269204+0000","last_active":"2024-04-24T01:46:18.269204+0000","last_peered":"2024-04-24T01:46:18.269204+0000","last_clean":"2024-04-24T01:46:18.269204+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:46:18.269204+0000","last_undegraded":"2024-04-24T01:46:18.269204+0000","last_fullsized":"2024-04-24T01:46:18.269204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.269076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:04.262085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.851216+0000","last_change":"2024-04-24T01:46:13.851216+0000","last_active":"2024-04-24T01:46:13.851216+0000","last_peered":"2024-04-24T01:46:13.851216+0000","last_clean":"2024-04-24T01:46:13.851216+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:46:13.851216+0000","last_undegraded":"2024-04-24T01:46:13.851216+0000","last_fullsized":"2024-04-24T01:46:13.851216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.851090+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:47.344034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.859209+0000","last_change":"2024-04-24T01:46:10.859209+0000","last_active":"2024-04-24T01:46:10.859209+0000","last_peered":"2024-04-24T01:46:10.859209+0000","last_clean":"2024-04-24T01:46:10.859209+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:46:10.859209+0000","last_undegraded":"2024-04-24T01:46:10.859209+0000","last_fullsized":"2024-04-24T01:46:10.859209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.859037+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:04.491211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.888439+0000","last_change":"2024-04-24T01:46:56.888439+0000","last_active":"2024-04-24T01:46:56.888439+0000","last_peered":"2024-04-24T01:46:56.888439+0000","last_clean":"2024-04-24T01:46:56.888439+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:46:56.888439+0000","last_undegraded":"2024-04-24T01:46:56.888439+0000","last_fullsized":"2024-04-24T01:46:56.888439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-24T01:46:56.888278+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-24T01:46:56.888278+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.888278+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:11.138110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.885337+0000","last_change":"2024-04-24T01:46:38.885337+0000","last_active":"2024-04-24T01:46:38.885337+0000","last_peered":"2024-04-24T01:46:38.885337+0000","last_clean":"2024-04-24T01:46:38.885337+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:46:38.885337+0000","last_undegraded":"2024-04-24T01:46:38.885337+0000","last_fullsized":"2024-04-24T01:46:38.885337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.885209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:47.529841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:05.619197+0000","last_change":"2024-04-24T01:47:05.619226+0000","last_active":"2024-04-24T01:47:05.619197+0000","last_peered":"2024-04-24T01:47:05.619197+0000","last_clean":"2024-04-24T01:47:05.619197+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:47:05.619197+0000","last_undegraded":"2024-04-24T01:47:05.619197+0000","last_fullsized":"2024-04-24T01:47:05.619197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:05.619096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:05.619096+0000","last_clean_scrub_stamp":"2024-04-24T01:47:05.619096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:24:14.792833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.615987+0000","last_change":"2024-04-24T01:46:14.615987+0000","last_active":"2024-04-24T01:46:14.615987+0000","last_peered":"2024-04-24T01:46:14.615987+0000","last_clean":"2024-04-24T01:46:14.615987+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:46:14.615987+0000","last_undegraded":"2024-04-24T01:46:14.615987+0000","last_fullsized":"2024-04-24T01:46:14.615987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.615812+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:51.435210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.266610+0000","last_change":"2024-04-24T01:46:13.266610+0000","last_active":"2024-04-24T01:46:13.266610+0000","last_peered":"2024-04-24T01:46:13.266610+0000","last_clean":"2024-04-24T01:46:13.266610+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:46:13.266610+0000","last_undegraded":"2024-04-24T01:46:13.266610+0000","last_fullsized":"2024-04-24T01:46:13.266610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.266484+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:40.059339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.594502+0000","last_change":"2024-04-24T01:46:08.594502+0000","last_active":"2024-04-24T01:46:08.594502+0000","last_peered":"2024-04-24T01:46:08.594502+0000","last_clean":"2024-04-24T01:46:08.594502+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:46:08.594502+0000","last_undegraded":"2024-04-24T01:46:08.594502+0000","last_fullsized":"2024-04-24T01:46:08.594502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.594330+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:42.087274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.815766+0000","last_change":"2024-04-24T01:46:22.815766+0000","last_active":"2024-04-24T01:46:22.815766+0000","last_peered":"2024-04-24T01:46:22.815766+0000","last_clean":"2024-04-24T01:46:22.815766+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:46:22.815766+0000","last_undegraded":"2024-04-24T01:46:22.815766+0000","last_fullsized":"2024-04-24T01:46:22.815766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.815603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:58.313433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.692968+0000","last_change":"2024-04-24T01:46:18.692968+0000","last_active":"2024-04-24T01:46:18.692968+0000","last_peered":"2024-04-24T01:46:18.692968+0000","last_clean":"2024-04-24T01:46:18.692968+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:46:18.692968+0000","last_undegraded":"2024-04-24T01:46:18.692968+0000","last_fullsized":"2024-04-24T01:46:18.692968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.692855+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:30.275139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.580440+0000","last_change":"2024-04-24T01:46:59.580440+0000","last_active":"2024-04-24T01:46:59.580440+0000","last_peered":"2024-04-24T01:46:59.580440+0000","last_clean":"2024-04-24T01:46:59.580440+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:46:59.580440+0000","last_undegraded":"2024-04-24T01:46:59.580440+0000","last_fullsized":"2024-04-24T01:46:59.580440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:59.580314+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:59.580314+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.580314+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:38.621627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.286638+0000","last_change":"2024-04-24T01:46:06.286638+0000","last_active":"2024-04-24T01:46:06.286638+0000","last_peered":"2024-04-24T01:46:06.286638+0000","last_clean":"2024-04-24T01:46:06.286638+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:46:06.286638+0000","last_undegraded":"2024-04-24T01:46:06.286638+0000","last_fullsized":"2024-04-24T01:46:06.286638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.286518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:00.727895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.470098+0000","last_change":"2024-04-24T01:46:02.470098+0000","last_active":"2024-04-24T01:46:02.470098+0000","last_peered":"2024-04-24T01:46:02.470098+0000","last_clean":"2024-04-24T01:46:02.470098+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:46:02.470098+0000","last_undegraded":"2024-04-24T01:46:02.470098+0000","last_fullsized":"2024-04-24T01:46:02.470098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.469953+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:28.856113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.853423+0000","last_change":"2024-04-24T01:46:00.853423+0000","last_active":"2024-04-24T01:46:00.853423+0000","last_peered":"2024-04-24T01:46:00.853423+0000","last_clean":"2024-04-24T01:46:00.853423+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:46:00.853423+0000","last_undegraded":"2024-04-24T01:46:00.853423+0000","last_fullsized":"2024-04-24T01:46:00.853423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.853310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:00.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.587848+0000","last_change":"2024-04-24T01:46:57.587848+0000","last_active":"2024-04-24T01:46:57.587848+0000","last_peered":"2024-04-24T01:46:57.587848+0000","last_clean":"2024-04-24T01:46:57.587848+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:46:57.587848+0000","last_undegraded":"2024-04-24T01:46:57.587848+0000","last_fullsized":"2024-04-24T01:46:57.587848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:46:57.587726+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:46:57.587726+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.587726+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:52.339001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.335882+0000","last_change":"2024-04-24T01:46:16.335882+0000","last_active":"2024-04-24T01:46:16.335882+0000","last_peered":"2024-04-24T01:46:16.335882+0000","last_clean":"2024-04-24T01:46:16.335882+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:46:16.335882+0000","last_undegraded":"2024-04-24T01:46:16.335882+0000","last_fullsized":"2024-04-24T01:46:16.335882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.335729+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:21.641635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.628222+0000","last_change":"2024-04-24T01:46:46.628258+0000","last_active":"2024-04-24T01:46:46.628222+0000","last_peered":"2024-04-24T01:46:46.628222+0000","last_clean":"2024-04-24T01:46:46.628222+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:46:46.628222+0000","last_undegraded":"2024-04-24T01:46:46.628222+0000","last_fullsized":"2024-04-24T01:46:46.628222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-24T01:46:46.628127+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-24T01:46:46.628127+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.628127+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:17.157394+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:09.610871+0000","last_change":"2024-04-24T01:47:09.610895+0000","last_active":"2024-04-24T01:47:09.610871+0000","last_peered":"2024-04-24T01:47:09.610871+0000","last_clean":"2024-04-24T01:47:09.610871+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:47:09.610871+0000","last_undegraded":"2024-04-24T01:47:09.610871+0000","last_fullsized":"2024-04-24T01:47:09.610871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:09.610769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:09.610769+0000","last_clean_scrub_stamp":"2024-04-24T01:47:09.610769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:07.038848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.602456+0000","last_change":"2024-04-24T01:46:55.602479+0000","last_active":"2024-04-24T01:46:55.602456+0000","last_peered":"2024-04-24T01:46:55.602456+0000","last_clean":"2024-04-24T01:46:55.602456+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:46:55.602456+0000","last_undegraded":"2024-04-24T01:46:55.602456+0000","last_fullsized":"2024-04-24T01:46:55.602456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:55.602359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:55.602359+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.602359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:37.653272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.646347+0000","last_change":"2024-04-24T01:46:15.646347+0000","last_active":"2024-04-24T01:46:15.646347+0000","last_peered":"2024-04-24T01:46:15.646347+0000","last_clean":"2024-04-24T01:46:15.646347+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:46:15.646347+0000","last_undegraded":"2024-04-24T01:46:15.646347+0000","last_fullsized":"2024-04-24T01:46:15.646347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.646240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:26.583381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.349962+0000","last_change":"2024-04-24T01:46:26.349962+0000","last_active":"2024-04-24T01:46:26.349962+0000","last_peered":"2024-04-24T01:46:26.349962+0000","last_clean":"2024-04-24T01:46:26.349962+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:46:26.349962+0000","last_undegraded":"2024-04-24T01:46:26.349962+0000","last_fullsized":"2024-04-24T01:46:26.349962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.349769+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:50.261205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.235121+0000","last_change":"2024-04-24T01:46:21.235121+0000","last_active":"2024-04-24T01:46:21.235121+0000","last_peered":"2024-04-24T01:46:21.235121+0000","last_clean":"2024-04-24T01:46:21.235121+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:46:21.235121+0000","last_undegraded":"2024-04-24T01:46:21.235121+0000","last_fullsized":"2024-04-24T01:46:21.235121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.234980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:30.075365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.845179+0000","last_change":"2024-04-24T01:46:18.845179+0000","last_active":"2024-04-24T01:46:18.845179+0000","last_peered":"2024-04-24T01:46:18.845179+0000","last_clean":"2024-04-24T01:46:18.845179+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:46:18.845179+0000","last_undegraded":"2024-04-24T01:46:18.845179+0000","last_fullsized":"2024-04-24T01:46:18.845179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.845064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:59.328750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.474912+0000","last_change":"2024-04-24T01:46:34.474912+0000","last_active":"2024-04-24T01:46:34.474912+0000","last_peered":"2024-04-24T01:46:34.474912+0000","last_clean":"2024-04-24T01:46:34.474912+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:46:34.474912+0000","last_undegraded":"2024-04-24T01:46:34.474912+0000","last_fullsized":"2024-04-24T01:46:34.474912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.474793+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:55.055111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:11.678130+0000","last_change":"2024-04-24T01:47:11.678153+0000","last_active":"2024-04-24T01:47:11.678130+0000","last_peered":"2024-04-24T01:47:11.678130+0000","last_clean":"2024-04-24T01:47:11.678130+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:47:11.678130+0000","last_undegraded":"2024-04-24T01:47:11.678130+0000","last_fullsized":"2024-04-24T01:47:11.678130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:11.678020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:11.678020+0000","last_clean_scrub_stamp":"2024-04-24T01:47:11.678020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:35.138491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.039612+0000","last_change":"2024-04-24T01:46:32.039612+0000","last_active":"2024-04-24T01:46:32.039612+0000","last_peered":"2024-04-24T01:46:32.039612+0000","last_clean":"2024-04-24T01:46:32.039612+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:46:32.039612+0000","last_undegraded":"2024-04-24T01:46:32.039612+0000","last_fullsized":"2024-04-24T01:46:32.039612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.039496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:14.657340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.202303+0000","last_change":"2024-04-24T01:46:02.202303+0000","last_active":"2024-04-24T01:46:02.202303+0000","last_peered":"2024-04-24T01:46:02.202303+0000","last_clean":"2024-04-24T01:46:02.202303+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:46:02.202303+0000","last_undegraded":"2024-04-24T01:46:02.202303+0000","last_fullsized":"2024-04-24T01:46:02.202303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.202137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:08.592288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":529,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.516075+0000","last_change":"2024-04-24T01:46:00.516075+0000","last_active":"2024-04-24T01:46:00.516075+0000","last_peered":"2024-04-24T01:46:00.516075+0000","last_clean":"2024-04-24T01:46:00.516075+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:46:00.516075+0000","last_undegraded":"2024-04-24T01:46:00.516075+0000","last_fullsized":"2024-04-24T01:46:00.516075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.515932+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:28.646371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.407195+0000","last_change":"2024-04-24T01:46:31.407195+0000","last_active":"2024-04-24T01:46:31.407195+0000","last_peered":"2024-04-24T01:46:31.407195+0000","last_clean":"2024-04-24T01:46:31.407195+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:46:31.407195+0000","last_undegraded":"2024-04-24T01:46:31.407195+0000","last_fullsized":"2024-04-24T01:46:31.407195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.407050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:50.586031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.812304+0000","last_change":"2024-04-24T01:46:28.812304+0000","last_active":"2024-04-24T01:46:28.812304+0000","last_peered":"2024-04-24T01:46:28.812304+0000","last_clean":"2024-04-24T01:46:28.812304+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:46:28.812304+0000","last_undegraded":"2024-04-24T01:46:28.812304+0000","last_fullsized":"2024-04-24T01:46:28.812304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.812185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:55.500501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.033100+0000","last_change":"2024-04-24T01:46:43.033100+0000","last_active":"2024-04-24T01:46:43.033100+0000","last_peered":"2024-04-24T01:46:43.033100+0000","last_clean":"2024-04-24T01:46:43.033100+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:46:43.033100+0000","last_undegraded":"2024-04-24T01:46:43.033100+0000","last_fullsized":"2024-04-24T01:46:43.033100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T01:46:43.032993+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T01:46:43.032993+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.032993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:51.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.865588+0000","last_change":"2024-04-24T01:46:40.865588+0000","last_active":"2024-04-24T01:46:40.865588+0000","last_peered":"2024-04-24T01:46:40.865588+0000","last_clean":"2024-04-24T01:46:40.865588+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:46:40.865588+0000","last_undegraded":"2024-04-24T01:46:40.865588+0000","last_fullsized":"2024-04-24T01:46:40.865588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.865456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:54.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.978549+0000","last_change":"2024-04-24T01:46:49.978580+0000","last_active":"2024-04-24T01:46:49.978549+0000","last_peered":"2024-04-24T01:46:49.978549+0000","last_clean":"2024-04-24T01:46:49.978549+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:46:49.978549+0000","last_undegraded":"2024-04-24T01:46:49.978549+0000","last_fullsized":"2024-04-24T01:46:49.978549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:49.978455+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:49.978455+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.978455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:23:23.581015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.850406+0000","last_change":"2024-04-24T01:46:21.850406+0000","last_active":"2024-04-24T01:46:21.850406+0000","last_peered":"2024-04-24T01:46:21.850406+0000","last_clean":"2024-04-24T01:46:21.850406+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:46:21.850406+0000","last_undegraded":"2024-04-24T01:46:21.850406+0000","last_fullsized":"2024-04-24T01:46:21.850406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.850235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:05.283033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.865174+0000","last_change":"2024-04-24T01:46:09.865174+0000","last_active":"2024-04-24T01:46:09.865174+0000","last_peered":"2024-04-24T01:46:09.865174+0000","last_clean":"2024-04-24T01:46:09.865174+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:46:09.865174+0000","last_undegraded":"2024-04-24T01:46:09.865174+0000","last_fullsized":"2024-04-24T01:46:09.865174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.865033+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:26.768496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.219562+0000","last_change":"2024-04-24T01:46:17.219562+0000","last_active":"2024-04-24T01:46:17.219562+0000","last_peered":"2024-04-24T01:46:17.219562+0000","last_clean":"2024-04-24T01:46:17.219562+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:46:17.219562+0000","last_undegraded":"2024-04-24T01:46:17.219562+0000","last_fullsized":"2024-04-24T01:46:17.219562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.219377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:20.724218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.085378+0000","last_change":"2024-04-24T01:42:50.802667+0000","last_active":"2024-04-24T01:46:01.085378+0000","last_peered":"2024-04-24T01:46:01.085378+0000","last_clean":"2024-04-24T01:46:01.085378+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:46:01.085378+0000","last_undegraded":"2024-04-24T01:46:01.085378+0000","last_fullsized":"2024-04-24T01:46:01.085378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.084556+0000","last_change":"2024-04-24T01:46:31.084556+0000","last_active":"2024-04-24T01:46:31.084556+0000","last_peered":"2024-04-24T01:46:31.084556+0000","last_clean":"2024-04-24T01:46:31.084556+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:46:31.084556+0000","last_undegraded":"2024-04-24T01:46:31.084556+0000","last_fullsized":"2024-04-24T01:46:31.084556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.084413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:24.777154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:12.653703+0000","last_change":"2024-04-24T01:47:12.653726+0000","last_active":"2024-04-24T01:47:12.653703+0000","last_peered":"2024-04-24T01:47:12.653703+0000","last_clean":"2024-04-24T01:47:12.653703+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:47:12.653703+0000","last_undegraded":"2024-04-24T01:47:12.653703+0000","last_fullsized":"2024-04-24T01:47:12.653703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:12.653598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:12.653598+0000","last_clean_scrub_stamp":"2024-04-24T01:47:12.653598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:22:15.155401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.912286+0000","last_change":"2024-04-24T01:46:41.912286+0000","last_active":"2024-04-24T01:46:41.912286+0000","last_peered":"2024-04-24T01:46:41.912286+0000","last_clean":"2024-04-24T01:46:41.912286+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:46:41.912286+0000","last_undegraded":"2024-04-24T01:46:41.912286+0000","last_fullsized":"2024-04-24T01:46:41.912286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:41.912117+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:41.912117+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.912117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:42.249111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.225235+0000","last_change":"2024-04-24T01:46:16.225235+0000","last_active":"2024-04-24T01:46:16.225235+0000","last_peered":"2024-04-24T01:46:16.225235+0000","last_clean":"2024-04-24T01:46:16.225235+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:46:16.225235+0000","last_undegraded":"2024-04-24T01:46:16.225235+0000","last_fullsized":"2024-04-24T01:46:16.225235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.225104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:22.216443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.361545+0000","last_change":"2024-04-24T01:46:29.361545+0000","last_active":"2024-04-24T01:46:29.361545+0000","last_peered":"2024-04-24T01:46:29.361545+0000","last_clean":"2024-04-24T01:46:29.361545+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:46:29.361545+0000","last_undegraded":"2024-04-24T01:46:29.361545+0000","last_fullsized":"2024-04-24T01:46:29.361545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.361431+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:30.282814+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.364979+0000","last_change":"2024-04-24T01:46:27.364979+0000","last_active":"2024-04-24T01:46:27.364979+0000","last_peered":"2024-04-24T01:46:27.364979+0000","last_clean":"2024-04-24T01:46:27.364979+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:46:27.364979+0000","last_undegraded":"2024-04-24T01:46:27.364979+0000","last_fullsized":"2024-04-24T01:46:27.364979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.364865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:11.158866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.453310+0000","last_change":"2024-04-24T01:47:00.453310+0000","last_active":"2024-04-24T01:47:00.453310+0000","last_peered":"2024-04-24T01:47:00.453310+0000","last_clean":"2024-04-24T01:47:00.453310+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:47:00.453310+0000","last_undegraded":"2024-04-24T01:47:00.453310+0000","last_fullsized":"2024-04-24T01:47:00.453310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:47:00.453192+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:47:00.453192+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.453192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:22:55.876575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.536415+0000","last_change":"2024-04-24T01:46:36.536415+0000","last_active":"2024-04-24T01:46:36.536415+0000","last_peered":"2024-04-24T01:46:36.536415+0000","last_clean":"2024-04-24T01:46:36.536415+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:46:36.536415+0000","last_undegraded":"2024-04-24T01:46:36.536415+0000","last_fullsized":"2024-04-24T01:46:36.536415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.536262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:42.146239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.865928+0000","last_change":"2024-04-24T01:46:42.865928+0000","last_active":"2024-04-24T01:46:42.865928+0000","last_peered":"2024-04-24T01:46:42.865928+0000","last_clean":"2024-04-24T01:46:42.865928+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:46:42.865928+0000","last_undegraded":"2024-04-24T01:46:42.865928+0000","last_fullsized":"2024-04-24T01:46:42.865928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:42.865739+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:42.865739+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.865739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:09.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.010284+0000","last_change":"2024-04-24T01:46:47.010324+0000","last_active":"2024-04-24T01:46:47.010284+0000","last_peered":"2024-04-24T01:46:47.010284+0000","last_clean":"2024-04-24T01:46:47.010284+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:46:47.010284+0000","last_undegraded":"2024-04-24T01:46:47.010284+0000","last_fullsized":"2024-04-24T01:46:47.010284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.010163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.010163+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.010163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:37:23.212750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.015172+0000","last_change":"2024-04-24T01:46:53.015222+0000","last_active":"2024-04-24T01:46:53.015172+0000","last_peered":"2024-04-24T01:46:53.015172+0000","last_clean":"2024-04-24T01:46:53.015172+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:46:53.015172+0000","last_undegraded":"2024-04-24T01:46:53.015172+0000","last_fullsized":"2024-04-24T01:46:53.015172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.015074+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.015074+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.015074+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:46:25.180917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'89","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.233696+0000","last_change":"2024-04-24T01:46:07.233696+0000","last_active":"2024-04-24T01:46:07.233696+0000","last_peered":"2024-04-24T01:46:07.233696+0000","last_clean":"2024-04-24T01:46:07.233696+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:46:07.233696+0000","last_undegraded":"2024-04-24T01:46:07.233696+0000","last_fullsized":"2024-04-24T01:46:07.233696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'89","last_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_deep_scrub":"34'89","last_deep_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.233553+0000","objects_scrubbed":11,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:09.955408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":99,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.891045+0000","last_change":"2024-04-24T01:46:06.891045+0000","last_active":"2024-04-24T01:46:06.891045+0000","last_peered":"2024-04-24T01:46:06.891045+0000","last_clean":"2024-04-24T01:46:06.891045+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:46:06.891045+0000","last_undegraded":"2024-04-24T01:46:06.891045+0000","last_fullsized":"2024-04-24T01:46:06.891045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.890898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:03.226630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.132644+0000","last_change":"2024-04-24T01:46:29.132700+0000","last_active":"2024-04-24T01:46:29.132644+0000","last_peered":"2024-04-24T01:46:29.132644+0000","last_clean":"2024-04-24T01:46:29.132644+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:46:29.132644+0000","last_undegraded":"2024-04-24T01:46:29.132644+0000","last_fullsized":"2024-04-24T01:46:29.132644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.132536+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:12.697153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.728154+0000","last_change":"2024-04-24T01:46:21.728154+0000","last_active":"2024-04-24T01:46:21.728154+0000","last_peered":"2024-04-24T01:46:21.728154+0000","last_clean":"2024-04-24T01:46:21.728154+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:46:21.728154+0000","last_undegraded":"2024-04-24T01:46:21.728154+0000","last_fullsized":"2024-04-24T01:46:21.728154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.728040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:08.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.014866+0000","last_change":"2024-04-24T01:46:40.014866+0000","last_active":"2024-04-24T01:46:40.014866+0000","last_peered":"2024-04-24T01:46:40.014866+0000","last_clean":"2024-04-24T01:46:40.014866+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:46:40.014866+0000","last_undegraded":"2024-04-24T01:46:40.014866+0000","last_fullsized":"2024-04-24T01:46:40.014866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:40.014720+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:40.014720+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.014720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:59.544406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:10.652385+0000","last_change":"2024-04-24T01:47:10.652407+0000","last_active":"2024-04-24T01:47:10.652385+0000","last_peered":"2024-04-24T01:47:10.652385+0000","last_clean":"2024-04-24T01:47:10.652385+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:47:10.652385+0000","last_undegraded":"2024-04-24T01:47:10.652385+0000","last_fullsized":"2024-04-24T01:47:10.652385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:10.652290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:10.652290+0000","last_clean_scrub_stamp":"2024-04-24T01:47:10.652290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:53:43.335089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.278325+0000","last_change":"2024-04-24T01:46:12.278325+0000","last_active":"2024-04-24T01:46:12.278325+0000","last_peered":"2024-04-24T01:46:12.278325+0000","last_clean":"2024-04-24T01:46:12.278325+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:46:12.278325+0000","last_undegraded":"2024-04-24T01:46:12.278325+0000","last_fullsized":"2024-04-24T01:46:12.278325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.278217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:12.615210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.482085+0000","last_change":"2024-04-24T01:46:01.482085+0000","last_active":"2024-04-24T01:46:01.482085+0000","last_peered":"2024-04-24T01:46:01.482085+0000","last_clean":"2024-04-24T01:46:01.482085+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:46:01.482085+0000","last_undegraded":"2024-04-24T01:46:01.482085+0000","last_fullsized":"2024-04-24T01:46:01.482085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.481946+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:57.817678+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.707597+0000","last_change":"2024-04-24T01:46:24.707597+0000","last_active":"2024-04-24T01:46:24.707597+0000","last_peered":"2024-04-24T01:46:24.707597+0000","last_clean":"2024-04-24T01:46:24.707597+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:46:24.707597+0000","last_undegraded":"2024-04-24T01:46:24.707597+0000","last_fullsized":"2024-04-24T01:46:24.707597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.707426+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:18.013223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.085383+0000","last_change":"2024-04-24T01:42:50.802397+0000","last_active":"2024-04-24T01:46:01.085383+0000","last_peered":"2024-04-24T01:46:01.085383+0000","last_clean":"2024-04-24T01:46:01.085383+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:46:01.085383+0000","last_undegraded":"2024-04-24T01:46:01.085383+0000","last_fullsized":"2024-04-24T01:46:01.085383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.287073+0000","last_change":"2024-04-24T01:46:14.287073+0000","last_active":"2024-04-24T01:46:14.287073+0000","last_peered":"2024-04-24T01:46:14.287073+0000","last_clean":"2024-04-24T01:46:14.287073+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:46:14.287073+0000","last_undegraded":"2024-04-24T01:46:14.287073+0000","last_fullsized":"2024-04-24T01:46:14.287073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.286944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:31.444362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.558770+0000","last_change":"2024-04-24T01:46:56.558770+0000","last_active":"2024-04-24T01:46:56.558770+0000","last_peered":"2024-04-24T01:46:56.558770+0000","last_clean":"2024-04-24T01:46:56.558770+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:46:56.558770+0000","last_undegraded":"2024-04-24T01:46:56.558770+0000","last_fullsized":"2024-04-24T01:46:56.558770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:56.558658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:56.558658+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.558658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:53:32.368481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.982868+0000","last_change":"2024-04-24T01:46:47.982868+0000","last_active":"2024-04-24T01:46:47.982868+0000","last_peered":"2024-04-24T01:46:47.982868+0000","last_clean":"2024-04-24T01:46:47.982868+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:46:47.982868+0000","last_undegraded":"2024-04-24T01:46:47.982868+0000","last_fullsized":"2024-04-24T01:46:47.982868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.982756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.982756+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.982756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:33:59.525276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.333093+0000","last_change":"2024-04-24T01:46:08.333093+0000","last_active":"2024-04-24T01:46:08.333093+0000","last_peered":"2024-04-24T01:46:08.333093+0000","last_clean":"2024-04-24T01:46:08.333093+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:46:08.333093+0000","last_undegraded":"2024-04-24T01:46:08.333093+0000","last_fullsized":"2024-04-24T01:46:08.333093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.332981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:48.671731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'24","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.321125+0000","last_change":"2024-04-24T01:46:19.321125+0000","last_active":"2024-04-24T01:46:19.321125+0000","last_peered":"2024-04-24T01:46:19.321125+0000","last_clean":"2024-04-24T01:46:19.321125+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:46:19.321125+0000","last_undegraded":"2024-04-24T01:46:19.321125+0000","last_fullsized":"2024-04-24T01:46:19.321125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.320973+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:49.328557+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.218953+0000","last_change":"2024-04-24T01:46:02.218953+0000","last_active":"2024-04-24T01:46:02.218953+0000","last_peered":"2024-04-24T01:46:02.218953+0000","last_clean":"2024-04-24T01:46:02.218953+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:46:02.218953+0000","last_undegraded":"2024-04-24T01:46:02.218953+0000","last_fullsized":"2024-04-24T01:46:02.218953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.218804+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:46.449166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.541942+0000","last_change":"2024-04-24T01:46:58.541942+0000","last_active":"2024-04-24T01:46:58.541942+0000","last_peered":"2024-04-24T01:46:58.541942+0000","last_clean":"2024-04-24T01:46:58.541942+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:46:58.541942+0000","last_undegraded":"2024-04-24T01:46:58.541942+0000","last_fullsized":"2024-04-24T01:46:58.541942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:58.541808+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:58.541808+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.541808+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.746837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.831123+0000","last_change":"2024-04-24T01:46:32.831123+0000","last_active":"2024-04-24T01:46:32.831123+0000","last_peered":"2024-04-24T01:46:32.831123+0000","last_clean":"2024-04-24T01:46:32.831123+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:46:32.831123+0000","last_undegraded":"2024-04-24T01:46:32.831123+0000","last_fullsized":"2024-04-24T01:46:32.831123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.831018+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:14.457711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.703562+0000","last_change":"2024-04-24T01:46:51.703562+0000","last_active":"2024-04-24T01:46:51.703562+0000","last_peered":"2024-04-24T01:46:51.703562+0000","last_clean":"2024-04-24T01:46:51.703562+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:46:51.703562+0000","last_undegraded":"2024-04-24T01:46:51.703562+0000","last_fullsized":"2024-04-24T01:46:51.703562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:51.703403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:51.703403+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.703403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:20.140548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:13.687114+0000","last_change":"2024-04-24T01:47:13.687138+0000","last_active":"2024-04-24T01:47:13.687114+0000","last_peered":"2024-04-24T01:47:13.687114+0000","last_clean":"2024-04-24T01:47:13.687114+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:47:13.687114+0000","last_undegraded":"2024-04-24T01:47:13.687114+0000","last_fullsized":"2024-04-24T01:47:13.687114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:13.687007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:13.687007+0000","last_clean_scrub_stamp":"2024-04-24T01:47:13.687007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:32.559784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.339389+0000","last_change":"2024-04-24T01:46:09.339389+0000","last_active":"2024-04-24T01:46:09.339389+0000","last_peered":"2024-04-24T01:46:09.339389+0000","last_clean":"2024-04-24T01:46:09.339389+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:46:09.339389+0000","last_undegraded":"2024-04-24T01:46:09.339389+0000","last_fullsized":"2024-04-24T01:46:09.339389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.339282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:17.983913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'104","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.891513+0000","last_change":"2024-04-24T01:46:07.891513+0000","last_active":"2024-04-24T01:46:07.891513+0000","last_peered":"2024-04-24T01:46:07.891513+0000","last_clean":"2024-04-24T01:46:07.891513+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:46:07.891513+0000","last_undegraded":"2024-04-24T01:46:07.891513+0000","last_fullsized":"2024-04-24T01:46:07.891513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'104","last_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_deep_scrub":"34'104","last_deep_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.891371+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.493980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.166279+0000","last_change":"2024-04-24T01:46:13.166279+0000","last_active":"2024-04-24T01:46:13.166279+0000","last_peered":"2024-04-24T01:46:13.166279+0000","last_clean":"2024-04-24T01:46:13.166279+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:46:13.166279+0000","last_undegraded":"2024-04-24T01:46:13.166279+0000","last_fullsized":"2024-04-24T01:46:13.166279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.166175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:35.987875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.893005+0000","last_change":"2024-04-24T01:46:14.893005+0000","last_active":"2024-04-24T01:46:14.893005+0000","last_peered":"2024-04-24T01:46:14.893005+0000","last_clean":"2024-04-24T01:46:14.893005+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:46:14.893005+0000","last_undegraded":"2024-04-24T01:46:14.893005+0000","last_fullsized":"2024-04-24T01:46:14.893005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.892893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:00.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.000042+0000","last_change":"2024-04-24T01:46:51.000042+0000","last_active":"2024-04-24T01:46:51.000042+0000","last_peered":"2024-04-24T01:46:51.000042+0000","last_clean":"2024-04-24T01:46:51.000042+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:46:51.000042+0000","last_undegraded":"2024-04-24T01:46:51.000042+0000","last_fullsized":"2024-04-24T01:46:51.000042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.999930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.999930+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.999930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:28.174222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.778215+0000","last_change":"2024-04-24T01:46:23.778252+0000","last_active":"2024-04-24T01:46:23.778215+0000","last_peered":"2024-04-24T01:46:23.778215+0000","last_clean":"2024-04-24T01:46:23.778215+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:46:23.778215+0000","last_undegraded":"2024-04-24T01:46:23.778215+0000","last_fullsized":"2024-04-24T01:46:23.778215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.778097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:35.360382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:15.686301+0000","last_change":"2024-04-24T01:47:15.686301+0000","last_active":"2024-04-24T01:47:15.686301+0000","last_peered":"2024-04-24T01:47:15.686301+0000","last_clean":"2024-04-24T01:47:15.686301+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:47:15.686301+0000","last_undegraded":"2024-04-24T01:47:15.686301+0000","last_fullsized":"2024-04-24T01:47:15.686301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:15.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:15.686173+0000","last_clean_scrub_stamp":"2024-04-24T01:47:15.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:06:49.936416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.657368+0000","last_change":"2024-04-24T01:46:13.657398+0000","last_active":"2024-04-24T01:46:13.657368+0000","last_peered":"2024-04-24T01:46:13.657368+0000","last_clean":"2024-04-24T01:46:13.657368+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:46:13.657368+0000","last_undegraded":"2024-04-24T01:46:13.657368+0000","last_fullsized":"2024-04-24T01:46:13.657368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.657273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:54.140958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.290072+0000","last_change":"2024-04-24T01:46:11.290116+0000","last_active":"2024-04-24T01:46:11.290072+0000","last_peered":"2024-04-24T01:46:11.290072+0000","last_clean":"2024-04-24T01:46:11.290072+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:46:11.290072+0000","last_undegraded":"2024-04-24T01:46:11.290072+0000","last_fullsized":"2024-04-24T01:46:11.290072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.289983+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:25.084406+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.324290+0000","last_change":"2024-04-24T01:46:21.324364+0000","last_active":"2024-04-24T01:46:21.324290+0000","last_peered":"2024-04-24T01:46:21.324290+0000","last_clean":"2024-04-24T01:46:21.324290+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:46:21.324290+0000","last_undegraded":"2024-04-24T01:46:21.324290+0000","last_fullsized":"2024-04-24T01:46:21.324290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.324188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:58.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:01.965715+0000","last_change":"2024-04-24T01:47:01.965742+0000","last_active":"2024-04-24T01:47:01.965715+0000","last_peered":"2024-04-24T01:47:01.965715+0000","last_clean":"2024-04-24T01:47:01.965715+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:47:01.965715+0000","last_undegraded":"2024-04-24T01:47:01.965715+0000","last_fullsized":"2024-04-24T01:47:01.965715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:47:01.965621+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:47:01.965621+0000","last_clean_scrub_stamp":"2024-04-24T01:47:01.965621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:53.556941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.748183+0000","last_change":"2024-04-24T01:46:31.748224+0000","last_active":"2024-04-24T01:46:31.748183+0000","last_peered":"2024-04-24T01:46:31.748183+0000","last_clean":"2024-04-24T01:46:31.748183+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:46:31.748183+0000","last_undegraded":"2024-04-24T01:46:31.748183+0000","last_fullsized":"2024-04-24T01:46:31.748183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.748068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:58.027530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.830371+0000","last_change":"2024-04-24T01:46:31.830423+0000","last_active":"2024-04-24T01:46:31.830371+0000","last_peered":"2024-04-24T01:46:31.830371+0000","last_clean":"2024-04-24T01:46:31.830371+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:46:31.830371+0000","last_undegraded":"2024-04-24T01:46:31.830371+0000","last_fullsized":"2024-04-24T01:46:31.830371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.830255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:38.220407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.257405+0000","last_change":"2024-04-24T01:46:04.257440+0000","last_active":"2024-04-24T01:46:04.257405+0000","last_peered":"2024-04-24T01:46:04.257405+0000","last_clean":"2024-04-24T01:46:04.257405+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:46:04.257405+0000","last_undegraded":"2024-04-24T01:46:04.257405+0000","last_fullsized":"2024-04-24T01:46:04.257405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.257282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:20.008478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.173642+0000","last_change":"2024-04-24T01:46:14.173677+0000","last_active":"2024-04-24T01:46:14.173642+0000","last_peered":"2024-04-24T01:46:14.173642+0000","last_clean":"2024-04-24T01:46:14.173642+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:46:14.173642+0000","last_undegraded":"2024-04-24T01:46:14.173642+0000","last_fullsized":"2024-04-24T01:46:14.173642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.173554+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:46.693848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.821154+0000","last_change":"2024-04-24T01:46:01.821203+0000","last_active":"2024-04-24T01:46:01.821154+0000","last_peered":"2024-04-24T01:46:01.821154+0000","last_clean":"2024-04-24T01:46:01.821154+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:46:01.821154+0000","last_undegraded":"2024-04-24T01:46:01.821154+0000","last_fullsized":"2024-04-24T01:46:01.821154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.821055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:04:47.582844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.878399+0000","last_change":"2024-04-24T01:46:55.878435+0000","last_active":"2024-04-24T01:46:55.878399+0000","last_peered":"2024-04-24T01:46:55.878399+0000","last_clean":"2024-04-24T01:46:55.878399+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:46:55.878399+0000","last_undegraded":"2024-04-24T01:46:55.878399+0000","last_fullsized":"2024-04-24T01:46:55.878399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:55.878310+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:55.878310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.878310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:00.355820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.102487+0000","last_change":"2024-04-24T01:46:30.102527+0000","last_active":"2024-04-24T01:46:30.102487+0000","last_peered":"2024-04-24T01:46:30.102487+0000","last_clean":"2024-04-24T01:46:30.102487+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:46:30.102487+0000","last_undegraded":"2024-04-24T01:46:30.102487+0000","last_fullsized":"2024-04-24T01:46:30.102487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.102347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:37.775249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.971444+0000","last_change":"2024-04-24T01:46:46.971498+0000","last_active":"2024-04-24T01:46:46.971444+0000","last_peered":"2024-04-24T01:46:46.971444+0000","last_clean":"2024-04-24T01:46:46.971444+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:46:46.971444+0000","last_undegraded":"2024-04-24T01:46:46.971444+0000","last_fullsized":"2024-04-24T01:46:46.971444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:46.971350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:46.971350+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.971350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:46.898467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.846071+0000","last_change":"2024-04-24T01:46:15.846094+0000","last_active":"2024-04-24T01:46:15.846071+0000","last_peered":"2024-04-24T01:46:15.846071+0000","last_clean":"2024-04-24T01:46:15.846071+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:46:15.846071+0000","last_undegraded":"2024-04-24T01:46:15.846071+0000","last_fullsized":"2024-04-24T01:46:15.846071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:10.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.247853+0000","last_change":"2024-04-24T01:46:08.247891+0000","last_active":"2024-04-24T01:46:08.247853+0000","last_peered":"2024-04-24T01:46:08.247853+0000","last_clean":"2024-04-24T01:46:08.247853+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:46:08.247853+0000","last_undegraded":"2024-04-24T01:46:08.247853+0000","last_fullsized":"2024-04-24T01:46:08.247853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.247768+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:06:04.087642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.609637+0000","last_change":"2024-04-24T01:46:12.609659+0000","last_active":"2024-04-24T01:46:12.609637+0000","last_peered":"2024-04-24T01:46:12.609637+0000","last_clean":"2024-04-24T01:46:12.609637+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:46:12.609637+0000","last_undegraded":"2024-04-24T01:46:12.609637+0000","last_fullsized":"2024-04-24T01:46:12.609637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.609553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:24:25.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:19.667564+0000","last_change":"2024-04-24T01:47:19.667595+0000","last_active":"2024-04-24T01:47:19.667564+0000","last_peered":"2024-04-24T01:47:19.667564+0000","last_clean":"2024-04-24T01:47:19.667564+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:47:19.667564+0000","last_undegraded":"2024-04-24T01:47:19.667564+0000","last_fullsized":"2024-04-24T01:47:19.667564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:19.667472+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:19.667472+0000","last_clean_scrub_stamp":"2024-04-24T01:47:19.667472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:08:45.916278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.327638+0000","last_change":"2024-04-24T01:46:18.327664+0000","last_active":"2024-04-24T01:46:18.327638+0000","last_peered":"2024-04-24T01:46:18.327638+0000","last_clean":"2024-04-24T01:46:18.327638+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:46:18.327638+0000","last_undegraded":"2024-04-24T01:46:18.327638+0000","last_fullsized":"2024-04-24T01:46:18.327638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.327548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:36.700735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.594289+0000","last_change":"2024-04-24T01:46:45.594312+0000","last_active":"2024-04-24T01:46:45.594289+0000","last_peered":"2024-04-24T01:46:45.594289+0000","last_clean":"2024-04-24T01:46:45.594289+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:46:45.594289+0000","last_undegraded":"2024-04-24T01:46:45.594289+0000","last_fullsized":"2024-04-24T01:46:45.594289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:45.594150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:45.594150+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.594150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:47.377188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.312282+0000","last_change":"2024-04-24T01:46:10.312308+0000","last_active":"2024-04-24T01:46:10.312282+0000","last_peered":"2024-04-24T01:46:10.312282+0000","last_clean":"2024-04-24T01:46:10.312282+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:46:10.312282+0000","last_undegraded":"2024-04-24T01:46:10.312282+0000","last_fullsized":"2024-04-24T01:46:10.312282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.312190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:07.102122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.806433+0000","last_change":"2024-04-24T01:46:12.806479+0000","last_active":"2024-04-24T01:46:12.806433+0000","last_peered":"2024-04-24T01:46:12.806433+0000","last_clean":"2024-04-24T01:46:12.806433+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:46:12.806433+0000","last_undegraded":"2024-04-24T01:46:12.806433+0000","last_fullsized":"2024-04-24T01:46:12.806433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.806352+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:58.427653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.869091+0000","last_change":"2024-04-24T01:46:03.869117+0000","last_active":"2024-04-24T01:46:03.869091+0000","last_peered":"2024-04-24T01:46:03.869091+0000","last_clean":"2024-04-24T01:46:03.869091+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:46:03.869091+0000","last_undegraded":"2024-04-24T01:46:03.869091+0000","last_fullsized":"2024-04-24T01:46:03.869091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.868982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:27:47.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.097668+0000","last_change":"2024-04-24T01:46:55.097703+0000","last_active":"2024-04-24T01:46:55.097668+0000","last_peered":"2024-04-24T01:46:55.097668+0000","last_clean":"2024-04-24T01:46:55.097668+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:46:55.097668+0000","last_undegraded":"2024-04-24T01:46:55.097668+0000","last_fullsized":"2024-04-24T01:46:55.097668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:55.097583+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:55.097583+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.097583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:19.009019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:01.610412+0000","last_change":"2024-04-24T01:47:01.610445+0000","last_active":"2024-04-24T01:47:01.610412+0000","last_peered":"2024-04-24T01:47:01.610412+0000","last_clean":"2024-04-24T01:47:01.610412+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:47:01.610412+0000","last_undegraded":"2024-04-24T01:47:01.610412+0000","last_fullsized":"2024-04-24T01:47:01.610412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:01.610315+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:01.610315+0000","last_clean_scrub_stamp":"2024-04-24T01:47:01.610315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:10.405618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.176864+0000","last_change":"2024-04-24T01:46:24.176864+0000","last_active":"2024-04-24T01:46:24.176864+0000","last_peered":"2024-04-24T01:46:24.176864+0000","last_clean":"2024-04-24T01:46:24.176864+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:46:24.176864+0000","last_undegraded":"2024-04-24T01:46:24.176864+0000","last_fullsized":"2024-04-24T01:46:24.176864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.176757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:03.301459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.198038+0000","last_change":"2024-04-24T01:46:10.198112+0000","last_active":"2024-04-24T01:46:10.198038+0000","last_peered":"2024-04-24T01:46:10.198038+0000","last_clean":"2024-04-24T01:46:10.198038+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:46:10.198038+0000","last_undegraded":"2024-04-24T01:46:10.198038+0000","last_fullsized":"2024-04-24T01:46:10.198038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.197934+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:55.839910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.889685+0000","last_change":"2024-04-24T01:46:04.889720+0000","last_active":"2024-04-24T01:46:04.889685+0000","last_peered":"2024-04-24T01:46:04.889685+0000","last_clean":"2024-04-24T01:46:04.889685+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:46:04.889685+0000","last_undegraded":"2024-04-24T01:46:04.889685+0000","last_fullsized":"2024-04-24T01:46:04.889685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.889593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:29.941134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.981996+0000","last_change":"2024-04-24T01:46:59.982020+0000","last_active":"2024-04-24T01:46:59.981996+0000","last_peered":"2024-04-24T01:46:59.981996+0000","last_clean":"2024-04-24T01:46:59.981996+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:46:59.981996+0000","last_undegraded":"2024-04-24T01:46:59.981996+0000","last_fullsized":"2024-04-24T01:46:59.981996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:46:59.981903+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:46:59.981903+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.981903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:17.961774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.006935+0000","last_change":"2024-04-24T01:46:39.006935+0000","last_active":"2024-04-24T01:46:39.006935+0000","last_peered":"2024-04-24T01:46:39.006935+0000","last_clean":"2024-04-24T01:46:39.006935+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:46:39.006935+0000","last_undegraded":"2024-04-24T01:46:39.006935+0000","last_fullsized":"2024-04-24T01:46:39.006935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.006790+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:00.354935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.670774+0000","last_change":"2024-04-24T01:46:52.670814+0000","last_active":"2024-04-24T01:46:52.670774+0000","last_peered":"2024-04-24T01:46:52.670774+0000","last_clean":"2024-04-24T01:46:52.670774+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:46:52.670774+0000","last_undegraded":"2024-04-24T01:46:52.670774+0000","last_fullsized":"2024-04-24T01:46:52.670774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:52.670660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:52.670660+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.670660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:26.413731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.846187+0000","last_change":"2024-04-24T01:46:20.846187+0000","last_active":"2024-04-24T01:46:20.846187+0000","last_peered":"2024-04-24T01:46:20.846187+0000","last_clean":"2024-04-24T01:46:20.846187+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:46:20.846187+0000","last_undegraded":"2024-04-24T01:46:20.846187+0000","last_fullsized":"2024-04-24T01:46:20.846187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.846022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:44.249657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.332061+0000","last_change":"2024-04-24T01:46:28.332109+0000","last_active":"2024-04-24T01:46:28.332061+0000","last_peered":"2024-04-24T01:46:28.332061+0000","last_clean":"2024-04-24T01:46:28.332061+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:46:28.332061+0000","last_undegraded":"2024-04-24T01:46:28.332061+0000","last_fullsized":"2024-04-24T01:46:28.332061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.331976+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:47:29.283395+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.676027+0000","last_change":"2024-04-24T01:46:16.676052+0000","last_active":"2024-04-24T01:46:16.676027+0000","last_peered":"2024-04-24T01:46:16.676027+0000","last_clean":"2024-04-24T01:46:16.676027+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:46:16.676027+0000","last_undegraded":"2024-04-24T01:46:16.676027+0000","last_fullsized":"2024-04-24T01:46:16.676027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.675939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:00.108736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.459774+0000","last_change":"2024-04-24T01:46:43.459800+0000","last_active":"2024-04-24T01:46:43.459774+0000","last_peered":"2024-04-24T01:46:43.459774+0000","last_clean":"2024-04-24T01:46:43.459774+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:46:43.459774+0000","last_undegraded":"2024-04-24T01:46:43.459774+0000","last_fullsized":"2024-04-24T01:46:43.459774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:43.459683+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:43.459683+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.459683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:38:34.496131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.302166+0000","last_change":"2024-04-24T01:46:20.302191+0000","last_active":"2024-04-24T01:46:20.302166+0000","last_peered":"2024-04-24T01:46:20.302166+0000","last_clean":"2024-04-24T01:46:20.302166+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:46:20.302166+0000","last_undegraded":"2024-04-24T01:46:20.302166+0000","last_fullsized":"2024-04-24T01:46:20.302166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.302076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:18.662863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.608992+0000","last_change":"2024-04-24T01:46:47.609040+0000","last_active":"2024-04-24T01:46:47.608992+0000","last_peered":"2024-04-24T01:46:47.608992+0000","last_clean":"2024-04-24T01:46:47.608992+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:46:47.608992+0000","last_undegraded":"2024-04-24T01:46:47.608992+0000","last_fullsized":"2024-04-24T01:46:47.608992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:47.608894+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:47.608894+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.608894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:11.183336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.842016+0000","last_change":"2024-04-24T01:46:19.842038+0000","last_active":"2024-04-24T01:46:19.842016+0000","last_peered":"2024-04-24T01:46:19.842016+0000","last_clean":"2024-04-24T01:46:19.842016+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:46:19.842016+0000","last_undegraded":"2024-04-24T01:46:19.842016+0000","last_fullsized":"2024-04-24T01:46:19.842016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.841928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:50:06.176480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.208833+0000","last_change":"2024-04-24T01:46:12.208833+0000","last_active":"2024-04-24T01:46:12.208833+0000","last_peered":"2024-04-24T01:46:12.208833+0000","last_clean":"2024-04-24T01:46:12.208833+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:46:12.208833+0000","last_undegraded":"2024-04-24T01:46:12.208833+0000","last_fullsized":"2024-04-24T01:46:12.208833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.208700+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:29.667207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.222190+0000","last_change":"2024-04-24T01:46:04.222190+0000","last_active":"2024-04-24T01:46:04.222190+0000","last_peered":"2024-04-24T01:46:04.222190+0000","last_clean":"2024-04-24T01:46:04.222190+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:46:04.222190+0000","last_undegraded":"2024-04-24T01:46:04.222190+0000","last_fullsized":"2024-04-24T01:46:04.222190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.222084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:26.106809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:11.091360+0000","last_change":"2024-04-24T01:42:50.804015+0000","last_active":"2024-04-24T01:45:11.091360+0000","last_peered":"2024-04-24T01:45:11.091360+0000","last_clean":"2024-04-24T01:45:11.091360+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:45:11.091360+0000","last_undegraded":"2024-04-24T01:45:11.091360+0000","last_fullsized":"2024-04-24T01:45:11.091360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.060904+0000","last_change":"2024-04-24T01:46:35.060928+0000","last_active":"2024-04-24T01:46:35.060904+0000","last_peered":"2024-04-24T01:46:35.060904+0000","last_clean":"2024-04-24T01:46:35.060904+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:46:35.060904+0000","last_undegraded":"2024-04-24T01:46:35.060904+0000","last_fullsized":"2024-04-24T01:46:35.060904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.060814+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:10.400767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.498295+0000","last_change":"2024-04-24T01:46:50.498321+0000","last_active":"2024-04-24T01:46:50.498295+0000","last_peered":"2024-04-24T01:46:50.498295+0000","last_clean":"2024-04-24T01:46:50.498295+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:46:50.498295+0000","last_undegraded":"2024-04-24T01:46:50.498295+0000","last_fullsized":"2024-04-24T01:46:50.498295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.498211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.498211+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.498211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:11.641334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.688836+0000","last_change":"2024-04-24T01:46:17.688868+0000","last_active":"2024-04-24T01:46:17.688836+0000","last_peered":"2024-04-24T01:46:17.688836+0000","last_clean":"2024-04-24T01:46:17.688836+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:46:17.688836+0000","last_undegraded":"2024-04-24T01:46:17.688836+0000","last_fullsized":"2024-04-24T01:46:17.688836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.688748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:53.186579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.316258+0000","last_change":"2024-04-24T01:46:25.316258+0000","last_active":"2024-04-24T01:46:25.316258+0000","last_peered":"2024-04-24T01:46:25.316258+0000","last_clean":"2024-04-24T01:46:25.316258+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:46:25.316258+0000","last_undegraded":"2024-04-24T01:46:25.316258+0000","last_fullsized":"2024-04-24T01:46:25.316258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.316122+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:09.639811+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.864906+0000","last_change":"2024-04-24T01:46:02.864906+0000","last_active":"2024-04-24T01:46:02.864906+0000","last_peered":"2024-04-24T01:46:02.864906+0000","last_clean":"2024-04-24T01:46:02.864906+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:46:02.864906+0000","last_undegraded":"2024-04-24T01:46:02.864906+0000","last_fullsized":"2024-04-24T01:46:02.864906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.864778+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:58.138209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.555523+0000","last_change":"2024-04-24T01:46:47.555558+0000","last_active":"2024-04-24T01:46:47.555523+0000","last_peered":"2024-04-24T01:46:47.555523+0000","last_clean":"2024-04-24T01:46:47.555523+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:46:47.555523+0000","last_undegraded":"2024-04-24T01:46:47.555523+0000","last_fullsized":"2024-04-24T01:46:47.555523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.555434+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.555434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:37.166499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.731138+0000","last_change":"2024-04-24T01:46:28.731165+0000","last_active":"2024-04-24T01:46:28.731138+0000","last_peered":"2024-04-24T01:46:28.731138+0000","last_clean":"2024-04-24T01:46:28.731138+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:46:28.731138+0000","last_undegraded":"2024-04-24T01:46:28.731138+0000","last_fullsized":"2024-04-24T01:46:28.731138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.731048+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:37.095746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.672611+0000","last_change":"2024-04-24T01:46:50.672639+0000","last_active":"2024-04-24T01:46:50.672611+0000","last_peered":"2024-04-24T01:46:50.672611+0000","last_clean":"2024-04-24T01:46:50.672611+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:46:50.672611+0000","last_undegraded":"2024-04-24T01:46:50.672611+0000","last_fullsized":"2024-04-24T01:46:50.672611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:46:50.672502+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:46:50.672502+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.672502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:33.442436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.603073+0000","last_change":"2024-04-24T01:46:11.603100+0000","last_active":"2024-04-24T01:46:11.603073+0000","last_peered":"2024-04-24T01:46:11.603073+0000","last_clean":"2024-04-24T01:46:11.603073+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:46:11.603073+0000","last_undegraded":"2024-04-24T01:46:11.603073+0000","last_fullsized":"2024-04-24T01:46:11.603073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.602978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:50.391941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'77","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.529735+0000","last_change":"2024-04-24T01:46:06.529785+0000","last_active":"2024-04-24T01:46:06.529735+0000","last_peered":"2024-04-24T01:46:06.529735+0000","last_clean":"2024-04-24T01:46:06.529735+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:46:06.529735+0000","last_undegraded":"2024-04-24T01:46:06.529735+0000","last_fullsized":"2024-04-24T01:46:06.529735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.529645+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:07.671634+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":85,"num_read_kb":80,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.248633+0000","last_change":"2024-04-24T01:46:01.248655+0000","last_active":"2024-04-24T01:46:01.248633+0000","last_peered":"2024-04-24T01:46:01.248633+0000","last_clean":"2024-04-24T01:46:01.248633+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:46:01.248633+0000","last_undegraded":"2024-04-24T01:46:01.248633+0000","last_fullsized":"2024-04-24T01:46:01.248633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.248553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:14.454609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.663889+0000","last_change":"2024-04-24T01:46:55.663916+0000","last_active":"2024-04-24T01:46:55.663889+0000","last_peered":"2024-04-24T01:46:55.663889+0000","last_clean":"2024-04-24T01:46:55.663889+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:46:55.663889+0000","last_undegraded":"2024-04-24T01:46:55.663889+0000","last_fullsized":"2024-04-24T01:46:55.663889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:46:55.663784+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:46:55.663784+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.663784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:17.480072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.729913+0000","last_change":"2024-04-24T01:46:24.729938+0000","last_active":"2024-04-24T01:46:24.729913+0000","last_peered":"2024-04-24T01:46:24.729913+0000","last_clean":"2024-04-24T01:46:24.729913+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:46:24.729913+0000","last_undegraded":"2024-04-24T01:46:24.729913+0000","last_fullsized":"2024-04-24T01:46:24.729913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.729803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:38.596795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:03.605532+0000","last_change":"2024-04-24T01:47:03.605559+0000","last_active":"2024-04-24T01:47:03.605532+0000","last_peered":"2024-04-24T01:47:03.605532+0000","last_clean":"2024-04-24T01:47:03.605532+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:47:03.605532+0000","last_undegraded":"2024-04-24T01:47:03.605532+0000","last_fullsized":"2024-04-24T01:47:03.605532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:03.605435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:03.605435+0000","last_clean_scrub_stamp":"2024-04-24T01:47:03.605435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:42.240673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.809263+0000","last_change":"2024-04-24T01:46:17.809286+0000","last_active":"2024-04-24T01:46:17.809263+0000","last_peered":"2024-04-24T01:46:17.809263+0000","last_clean":"2024-04-24T01:46:17.809263+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:46:17.809263+0000","last_undegraded":"2024-04-24T01:46:17.809263+0000","last_fullsized":"2024-04-24T01:46:17.809263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.809172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:15:28.587615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.187484+0000","last_change":"2024-04-24T01:46:11.187562+0000","last_active":"2024-04-24T01:46:11.187484+0000","last_peered":"2024-04-24T01:46:11.187484+0000","last_clean":"2024-04-24T01:46:11.187484+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:46:11.187484+0000","last_undegraded":"2024-04-24T01:46:11.187484+0000","last_fullsized":"2024-04-24T01:46:11.187484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.187375+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:33:05.075069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.327296+0000","last_change":"2024-04-24T01:46:22.327330+0000","last_active":"2024-04-24T01:46:22.327296+0000","last_peered":"2024-04-24T01:46:22.327296+0000","last_clean":"2024-04-24T01:46:22.327296+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:46:22.327296+0000","last_undegraded":"2024-04-24T01:46:22.327296+0000","last_fullsized":"2024-04-24T01:46:22.327296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.327198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:51:25.780951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:20.717503+0000","last_change":"2024-04-24T01:47:20.717571+0000","last_active":"2024-04-24T01:47:20.717503+0000","last_peered":"2024-04-24T01:47:20.717503+0000","last_clean":"2024-04-24T01:47:20.717503+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:47:20.717503+0000","last_undegraded":"2024-04-24T01:47:20.717503+0000","last_fullsized":"2024-04-24T01:47:20.717503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:47:20.717402+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:47:20.717402+0000","last_clean_scrub_stamp":"2024-04-24T01:47:20.717402+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:05.285052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.083199+0000","last_change":"2024-04-24T01:46:56.083262+0000","last_active":"2024-04-24T01:46:56.083199+0000","last_peered":"2024-04-24T01:46:56.083199+0000","last_clean":"2024-04-24T01:46:56.083199+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:46:56.083199+0000","last_undegraded":"2024-04-24T01:46:56.083199+0000","last_fullsized":"2024-04-24T01:46:56.083199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:56.083100+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:56.083100+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.083100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:39.877101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.039300+0000","last_change":"2024-04-24T01:46:46.039351+0000","last_active":"2024-04-24T01:46:46.039300+0000","last_peered":"2024-04-24T01:46:46.039300+0000","last_clean":"2024-04-24T01:46:46.039300+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:46:46.039300+0000","last_undegraded":"2024-04-24T01:46:46.039300+0000","last_fullsized":"2024-04-24T01:46:46.039300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:46.039190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:46.039190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.039190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:23:57.436296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.626204+0000","last_change":"2024-04-24T01:46:09.626256+0000","last_active":"2024-04-24T01:46:09.626204+0000","last_peered":"2024-04-24T01:46:09.626204+0000","last_clean":"2024-04-24T01:46:09.626204+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:46:09.626204+0000","last_undegraded":"2024-04-24T01:46:09.626204+0000","last_fullsized":"2024-04-24T01:46:09.626204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.626097+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:56.352550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.447709+0000","last_change":"2024-04-24T01:46:32.447742+0000","last_active":"2024-04-24T01:46:32.447709+0000","last_peered":"2024-04-24T01:46:32.447709+0000","last_clean":"2024-04-24T01:46:32.447709+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:46:32.447709+0000","last_undegraded":"2024-04-24T01:46:32.447709+0000","last_fullsized":"2024-04-24T01:46:32.447709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.447622+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:41:24.256346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.467508+0000","last_change":"2024-04-24T01:46:39.467533+0000","last_active":"2024-04-24T01:46:39.467508+0000","last_peered":"2024-04-24T01:46:39.467508+0000","last_clean":"2024-04-24T01:46:39.467508+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:46:39.467508+0000","last_undegraded":"2024-04-24T01:46:39.467508+0000","last_fullsized":"2024-04-24T01:46:39.467508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.467419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:58.802238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:45:16.092373+0000","last_change":"2024-04-24T01:42:50.802039+0000","last_active":"2024-04-24T01:45:16.092373+0000","last_peered":"2024-04-24T01:45:16.092373+0000","last_clean":"2024-04-24T01:45:16.092373+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:45:16.092373+0000","last_undegraded":"2024-04-24T01:45:16.092373+0000","last_fullsized":"2024-04-24T01:45:16.092373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:42:49.770640+0000","last_clean_scrub_stamp":"2024-04-24T01:42:49.770640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.657151+0000","last_change":"2024-04-24T01:46:26.657191+0000","last_active":"2024-04-24T01:46:26.657151+0000","last_peered":"2024-04-24T01:46:26.657151+0000","last_clean":"2024-04-24T01:46:26.657151+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:46:26.657151+0000","last_undegraded":"2024-04-24T01:46:26.657151+0000","last_fullsized":"2024-04-24T01:46:26.657151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.657061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:13.375971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.675482+0000","last_change":"2024-04-24T01:46:53.675546+0000","last_active":"2024-04-24T01:46:53.675482+0000","last_peered":"2024-04-24T01:46:53.675482+0000","last_clean":"2024-04-24T01:46:53.675482+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:46:53.675482+0000","last_undegraded":"2024-04-24T01:46:53.675482+0000","last_fullsized":"2024-04-24T01:46:53.675482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.675383+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.675383+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.675383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:20.329284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.549193+0000","last_change":"2024-04-24T01:46:07.549244+0000","last_active":"2024-04-24T01:46:07.549193+0000","last_peered":"2024-04-24T01:46:07.549193+0000","last_clean":"2024-04-24T01:46:07.549193+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:46:07.549193+0000","last_undegraded":"2024-04-24T01:46:07.549193+0000","last_fullsized":"2024-04-24T01:46:07.549193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.549082+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:53.170383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.365622+0000","last_change":"2024-04-24T01:46:30.365660+0000","last_active":"2024-04-24T01:46:30.365622+0000","last_peered":"2024-04-24T01:46:30.365622+0000","last_clean":"2024-04-24T01:46:30.365622+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:46:30.365622+0000","last_undegraded":"2024-04-24T01:46:30.365622+0000","last_fullsized":"2024-04-24T01:46:30.365622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.365531+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:04.108602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.233029+0000","last_change":"2024-04-24T01:46:05.233070+0000","last_active":"2024-04-24T01:46:05.233029+0000","last_peered":"2024-04-24T01:46:05.233029+0000","last_clean":"2024-04-24T01:46:05.233029+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:46:05.233029+0000","last_undegraded":"2024-04-24T01:46:05.233029+0000","last_fullsized":"2024-04-24T01:46:05.233029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.232926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:34.699770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:18.647025+0000","last_change":"2024-04-24T01:47:18.647049+0000","last_active":"2024-04-24T01:47:18.647025+0000","last_peered":"2024-04-24T01:47:18.647025+0000","last_clean":"2024-04-24T01:47:18.647025+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:47:18.647025+0000","last_undegraded":"2024-04-24T01:47:18.647025+0000","last_fullsized":"2024-04-24T01:47:18.647025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:47:18.646940+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:47:18.646940+0000","last_clean_scrub_stamp":"2024-04-24T01:47:18.646940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:57.874461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.738791+0000","last_change":"2024-04-24T01:46:19.738791+0000","last_active":"2024-04-24T01:46:19.738791+0000","last_peered":"2024-04-24T01:46:19.738791+0000","last_clean":"2024-04-24T01:46:19.738791+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:46:19.738791+0000","last_undegraded":"2024-04-24T01:46:19.738791+0000","last_fullsized":"2024-04-24T01:46:19.738791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.738637+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:33.605630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.003925+0000","last_change":"2024-04-24T01:46:48.003925+0000","last_active":"2024-04-24T01:46:48.003925+0000","last_peered":"2024-04-24T01:46:48.003925+0000","last_clean":"2024-04-24T01:46:48.003925+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:46:48.003925+0000","last_undegraded":"2024-04-24T01:46:48.003925+0000","last_fullsized":"2024-04-24T01:46:48.003925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:48.003792+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:48.003792+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.003792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:58:51.323040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.009864+0000","last_change":"2024-04-24T01:46:37.009864+0000","last_active":"2024-04-24T01:46:37.009864+0000","last_peered":"2024-04-24T01:46:37.009864+0000","last_clean":"2024-04-24T01:46:37.009864+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:46:37.009864+0000","last_undegraded":"2024-04-24T01:46:37.009864+0000","last_fullsized":"2024-04-24T01:46:37.009864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.009754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.687137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.055589+0000","last_change":"2024-04-24T01:46:36.055589+0000","last_active":"2024-04-24T01:46:36.055589+0000","last_peered":"2024-04-24T01:46:36.055589+0000","last_clean":"2024-04-24T01:46:36.055589+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:46:36.055589+0000","last_undegraded":"2024-04-24T01:46:36.055589+0000","last_fullsized":"2024-04-24T01:46:36.055589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.055479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:08.968901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":129,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.483720+0000","last_change":"2024-04-24T01:46:41.483720+0000","last_active":"2024-04-24T01:46:41.483720+0000","last_peered":"2024-04-24T01:46:41.483720+0000","last_clean":"2024-04-24T01:46:41.483720+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:46:41.483720+0000","last_undegraded":"2024-04-24T01:46:41.483720+0000","last_fullsized":"2024-04-24T01:46:41.483720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:41.483543+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:41.483543+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.483543+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:05.658646+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:06.621271+0000","last_change":"2024-04-24T01:47:06.621294+0000","last_active":"2024-04-24T01:47:06.621271+0000","last_peered":"2024-04-24T01:47:06.621271+0000","last_clean":"2024-04-24T01:47:06.621271+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:47:06.621271+0000","last_undegraded":"2024-04-24T01:47:06.621271+0000","last_fullsized":"2024-04-24T01:47:06.621271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:06.621161+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:06.621161+0000","last_clean_scrub_stamp":"2024-04-24T01:47:06.621161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:13.725774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.041537+0000","last_change":"2024-04-24T01:46:33.041537+0000","last_active":"2024-04-24T01:46:33.041537+0000","last_peered":"2024-04-24T01:46:33.041537+0000","last_clean":"2024-04-24T01:46:33.041537+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:46:33.041537+0000","last_undegraded":"2024-04-24T01:46:33.041537+0000","last_fullsized":"2024-04-24T01:46:33.041537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.041416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:42.167160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.009961+0000","last_change":"2024-04-24T01:46:49.009961+0000","last_active":"2024-04-24T01:46:49.009961+0000","last_peered":"2024-04-24T01:46:49.009961+0000","last_clean":"2024-04-24T01:46:49.009961+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:46:49.009961+0000","last_undegraded":"2024-04-24T01:46:49.009961+0000","last_fullsized":"2024-04-24T01:46:49.009961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:49.009844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:49.009844+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.009844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:05.993663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.095611+0000","last_change":"2024-04-24T01:46:27.095611+0000","last_active":"2024-04-24T01:46:27.095611+0000","last_peered":"2024-04-24T01:46:27.095611+0000","last_clean":"2024-04-24T01:46:27.095611+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:46:27.095611+0000","last_undegraded":"2024-04-24T01:46:27.095611+0000","last_fullsized":"2024-04-24T01:46:27.095611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.095499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:50.346774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.035932+0000","last_change":"2024-04-24T01:46:44.035932+0000","last_active":"2024-04-24T01:46:44.035932+0000","last_peered":"2024-04-24T01:46:44.035932+0000","last_clean":"2024-04-24T01:46:44.035932+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:46:44.035932+0000","last_undegraded":"2024-04-24T01:46:44.035932+0000","last_fullsized":"2024-04-24T01:46:44.035932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:44.035778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:44.035778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.035778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:58.233960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.617579+0000","last_change":"2024-04-24T01:46:40.617579+0000","last_active":"2024-04-24T01:46:40.617579+0000","last_peered":"2024-04-24T01:46:40.617579+0000","last_clean":"2024-04-24T01:46:40.617579+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:46:40.617579+0000","last_undegraded":"2024-04-24T01:46:40.617579+0000","last_fullsized":"2024-04-24T01:46:40.617579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.617471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:40.544588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.564301+0000","last_change":"2024-04-24T01:46:37.564301+0000","last_active":"2024-04-24T01:46:37.564301+0000","last_peered":"2024-04-24T01:46:37.564301+0000","last_clean":"2024-04-24T01:46:37.564301+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:46:37.564301+0000","last_undegraded":"2024-04-24T01:46:37.564301+0000","last_fullsized":"2024-04-24T01:46:37.564301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.564177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:54.721595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.014543+0000","last_change":"2024-04-24T01:46:41.014543+0000","last_active":"2024-04-24T01:46:41.014543+0000","last_peered":"2024-04-24T01:46:41.014543+0000","last_clean":"2024-04-24T01:46:41.014543+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:46:41.014543+0000","last_undegraded":"2024-04-24T01:46:41.014543+0000","last_fullsized":"2024-04-24T01:46:41.014543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:41.014392+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:41.014392+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.014392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:58.382324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.684403+0000","last_change":"2024-04-24T01:46:27.684403+0000","last_active":"2024-04-24T01:46:27.684403+0000","last_peered":"2024-04-24T01:46:27.684403+0000","last_clean":"2024-04-24T01:46:27.684403+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:46:27.684403+0000","last_undegraded":"2024-04-24T01:46:27.684403+0000","last_fullsized":"2024-04-24T01:46:27.684403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.684268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:36.612643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.763139+0000","last_change":"2024-04-24T01:46:26.763139+0000","last_active":"2024-04-24T01:46:26.763139+0000","last_peered":"2024-04-24T01:46:26.763139+0000","last_clean":"2024-04-24T01:46:26.763139+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:46:26.763139+0000","last_undegraded":"2024-04-24T01:46:26.763139+0000","last_fullsized":"2024-04-24T01:46:26.763139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.762976+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:08.389668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.884016+0000","last_change":"2024-04-24T01:46:52.884016+0000","last_active":"2024-04-24T01:46:52.884016+0000","last_peered":"2024-04-24T01:46:52.884016+0000","last_clean":"2024-04-24T01:46:52.884016+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:46:52.884016+0000","last_undegraded":"2024-04-24T01:46:52.884016+0000","last_fullsized":"2024-04-24T01:46:52.884016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:52.883890+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:52.883890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.883890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:00.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.601049+0000","last_change":"2024-04-24T01:46:38.601104+0000","last_active":"2024-04-24T01:46:38.601049+0000","last_peered":"2024-04-24T01:46:38.601049+0000","last_clean":"2024-04-24T01:46:38.601049+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:46:38.601049+0000","last_undegraded":"2024-04-24T01:46:38.601049+0000","last_fullsized":"2024-04-24T01:46:38.601049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.600952+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:56.752401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:14.704478+0000","last_change":"2024-04-24T01:47:14.704524+0000","last_active":"2024-04-24T01:47:14.704478+0000","last_peered":"2024-04-24T01:47:14.704478+0000","last_clean":"2024-04-24T01:47:14.704478+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:47:14.704478+0000","last_undegraded":"2024-04-24T01:47:14.704478+0000","last_fullsized":"2024-04-24T01:47:14.704478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:14.704361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:14.704361+0000","last_clean_scrub_stamp":"2024-04-24T01:47:14.704361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:57.550931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.487163+0000","last_change":"2024-04-24T01:46:44.487204+0000","last_active":"2024-04-24T01:46:44.487163+0000","last_peered":"2024-04-24T01:46:44.487163+0000","last_clean":"2024-04-24T01:46:44.487163+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:46:44.487163+0000","last_undegraded":"2024-04-24T01:46:44.487163+0000","last_fullsized":"2024-04-24T01:46:44.487163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:44.487074+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:44.487074+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.487074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:02.177404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.886566+0000","last_change":"2024-04-24T01:46:53.886566+0000","last_active":"2024-04-24T01:46:53.886566+0000","last_peered":"2024-04-24T01:46:53.886566+0000","last_clean":"2024-04-24T01:46:53.886566+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:46:53.886566+0000","last_undegraded":"2024-04-24T01:46:53.886566+0000","last_fullsized":"2024-04-24T01:46:53.886566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.886386+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.886386+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.886386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:57:58.598237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.141005+0000","last_change":"2024-04-24T01:46:26.141005+0000","last_active":"2024-04-24T01:46:26.141005+0000","last_peered":"2024-04-24T01:46:26.141005+0000","last_clean":"2024-04-24T01:46:26.141005+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:46:26.141005+0000","last_undegraded":"2024-04-24T01:46:26.141005+0000","last_fullsized":"2024-04-24T01:46:26.141005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.140882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:51.458855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.584676+0000","last_change":"2024-04-24T01:46:35.584676+0000","last_active":"2024-04-24T01:46:35.584676+0000","last_peered":"2024-04-24T01:46:35.584676+0000","last_clean":"2024-04-24T01:46:35.584676+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:46:35.584676+0000","last_undegraded":"2024-04-24T01:46:35.584676+0000","last_fullsized":"2024-04-24T01:46:35.584676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.584557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:35.921550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.671390+0000","last_change":"2024-04-24T01:46:33.671390+0000","last_active":"2024-04-24T01:46:33.671390+0000","last_peered":"2024-04-24T01:46:33.671390+0000","last_clean":"2024-04-24T01:46:33.671390+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:46:33.671390+0000","last_undegraded":"2024-04-24T01:46:33.671390+0000","last_fullsized":"2024-04-24T01:46:33.671390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.671230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:30.461162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.634590+0000","last_change":"2024-04-24T01:46:48.634590+0000","last_active":"2024-04-24T01:46:48.634590+0000","last_peered":"2024-04-24T01:46:48.634590+0000","last_clean":"2024-04-24T01:46:48.634590+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:46:48.634590+0000","last_undegraded":"2024-04-24T01:46:48.634590+0000","last_fullsized":"2024-04-24T01:46:48.634590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:48.634448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:48.634448+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.634448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:05.635594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.701837+0000","last_change":"2024-04-24T01:46:32.701837+0000","last_active":"2024-04-24T01:46:32.701837+0000","last_peered":"2024-04-24T01:46:32.701837+0000","last_clean":"2024-04-24T01:46:32.701837+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:46:32.701837+0000","last_undegraded":"2024-04-24T01:46:32.701837+0000","last_fullsized":"2024-04-24T01:46:32.701837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.701691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:25.764735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:04.578785+0000","last_change":"2024-04-24T01:47:04.578785+0000","last_active":"2024-04-24T01:47:04.578785+0000","last_peered":"2024-04-24T01:47:04.578785+0000","last_clean":"2024-04-24T01:47:04.578785+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:47:04.578785+0000","last_undegraded":"2024-04-24T01:47:04.578785+0000","last_fullsized":"2024-04-24T01:47:04.578785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:04.578633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:04.578633+0000","last_clean_scrub_stamp":"2024-04-24T01:47:04.578633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:08.768260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.780528+0000","last_change":"2024-04-24T01:46:29.780528+0000","last_active":"2024-04-24T01:46:29.780528+0000","last_peered":"2024-04-24T01:46:29.780528+0000","last_clean":"2024-04-24T01:46:29.780528+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:46:29.780528+0000","last_undegraded":"2024-04-24T01:46:29.780528+0000","last_fullsized":"2024-04-24T01:46:29.780528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.780404+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.221782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.564325+0000","last_change":"2024-04-24T01:46:54.564325+0000","last_active":"2024-04-24T01:46:54.564325+0000","last_peered":"2024-04-24T01:46:54.564325+0000","last_clean":"2024-04-24T01:46:54.564325+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:46:54.564325+0000","last_undegraded":"2024-04-24T01:46:54.564325+0000","last_fullsized":"2024-04-24T01:46:54.564325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.564193+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.564193+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.564193+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:36.267776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.430544+0000","last_change":"2024-04-24T01:46:38.430544+0000","last_active":"2024-04-24T01:46:38.430544+0000","last_peered":"2024-04-24T01:46:38.430544+0000","last_clean":"2024-04-24T01:46:38.430544+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:46:38.430544+0000","last_undegraded":"2024-04-24T01:46:38.430544+0000","last_fullsized":"2024-04-24T01:46:38.430544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.430431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:51.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.843242+0000","last_change":"2024-04-24T01:46:39.843242+0000","last_active":"2024-04-24T01:46:39.843242+0000","last_peered":"2024-04-24T01:46:39.843242+0000","last_clean":"2024-04-24T01:46:39.843242+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:46:39.843242+0000","last_undegraded":"2024-04-24T01:46:39.843242+0000","last_fullsized":"2024-04-24T01:46:39.843242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.843127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:36.633059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.668254+0000","last_change":"2024-04-24T01:46:23.668254+0000","last_active":"2024-04-24T01:46:23.668254+0000","last_peered":"2024-04-24T01:46:23.668254+0000","last_clean":"2024-04-24T01:46:23.668254+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:46:23.668254+0000","last_undegraded":"2024-04-24T01:46:23.668254+0000","last_fullsized":"2024-04-24T01:46:23.668254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.668128+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:28.941092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:02.650397+0000","last_change":"2024-04-24T01:47:02.650397+0000","last_active":"2024-04-24T01:47:02.650397+0000","last_peered":"2024-04-24T01:47:02.650397+0000","last_clean":"2024-04-24T01:47:02.650397+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:47:02.650397+0000","last_undegraded":"2024-04-24T01:47:02.650397+0000","last_fullsized":"2024-04-24T01:47:02.650397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:02.650297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:02.650297+0000","last_clean_scrub_stamp":"2024-04-24T01:47:02.650297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:41.826370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:08.658030+0000","last_change":"2024-04-24T01:47:08.658030+0000","last_active":"2024-04-24T01:47:08.658030+0000","last_peered":"2024-04-24T01:47:08.658030+0000","last_clean":"2024-04-24T01:47:08.658030+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:47:08.658030+0000","last_undegraded":"2024-04-24T01:47:08.658030+0000","last_fullsized":"2024-04-24T01:47:08.658030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:08.657913+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:08.657913+0000","last_clean_scrub_stamp":"2024-04-24T01:47:08.657913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:38.422300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.069651+0000","last_change":"2024-04-24T01:46:45.069683+0000","last_active":"2024-04-24T01:46:45.069651+0000","last_peered":"2024-04-24T01:46:45.069651+0000","last_clean":"2024-04-24T01:46:45.069651+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:46:45.069651+0000","last_undegraded":"2024-04-24T01:46:45.069651+0000","last_fullsized":"2024-04-24T01:46:45.069651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:45.069538+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:45.069538+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.069538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:50:50.879461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.023253+0000","last_change":"2024-04-24T01:46:34.023306+0000","last_active":"2024-04-24T01:46:34.023253+0000","last_peered":"2024-04-24T01:46:34.023253+0000","last_clean":"2024-04-24T01:46:34.023253+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:46:34.023253+0000","last_undegraded":"2024-04-24T01:46:34.023253+0000","last_fullsized":"2024-04-24T01:46:34.023253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.023152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:00.522740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.717282+0000","last_change":"2024-04-24T01:46:25.717306+0000","last_active":"2024-04-24T01:46:25.717282+0000","last_peered":"2024-04-24T01:46:25.717282+0000","last_clean":"2024-04-24T01:46:25.717282+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:46:25.717282+0000","last_undegraded":"2024-04-24T01:46:25.717282+0000","last_fullsized":"2024-04-24T01:46:25.717282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.717163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:29:26.860189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640319,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":487424,"data_stored":151081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640320,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":737936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640319,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":739109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":148048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:47:22.868 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:22.868 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:22.869 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:22.869 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:42:49.770640+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=42, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=45, tm_sec=58, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:47:22.870 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:47:42.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:47:42.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.977+0000 7f3c58ca4640 1 Processor -- start 2024-04-24T01:47:42.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.977+0000 7f3c58ca4640 1 -- start start 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c58ca4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3c5406d7d0 0x7f3c5406dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c58ca4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c540a08a0 con 0x7f3c5406e0f0 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c58ca4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5406e560 con 0x7f3c5406d7d0 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c5259c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3c5406d7d0 0x7f3c5406dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c51d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3c5406e0f0 0x7f3c5412e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55848/0 (socket says 172.21.15.107:55848) 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c51d9b640 1 -- 172.21.15.107:0/2021555433 learned_addr learned my addr 172.21.15.107:0/2021555433 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c5259c640 1 -- 172.21.15.107:0/2021555433 >> v1:172.21.15.107:6789/0 conn(0x7f3c5406e0f0 legacy=0x7f3c5412e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c5259c640 1 -- 172.21.15.107:0/2021555433 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5406f6d0 con 0x7f3c5406d7d0 2024-04-24T01:47:42.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.978+0000 7f3c5159a640 1 -- 172.21.15.107:0/2021555433 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829993086 0 0) 0x7f3c540a08a0 con 0x7f3c5406e0f0 2024-04-24T01:47:42.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.979+0000 7f3c5259c640 1 --2- 172.21.15.107:0/2021555433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c5406dbb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009dc0 tx=0x7f3c4402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a55c813e2306b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:42.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.979+0000 7f3c5159a640 1 -- 172.21.15.107:0/2021555433 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44039070 con 0x7f3c5406d7d0 2024-04-24T01:47:42.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.979+0000 7f3c5159a640 1 -- 172.21.15.107:0/2021555433 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4402cb80 con 0x7f3c5406d7d0 2024-04-24T01:47:42.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.979+0000 7f3c5159a640 1 -- 172.21.15.107:0/2021555433 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44034440 con 0x7f3c5406d7d0 2024-04-24T01:47:42.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.980+0000 7f3c58ca4640 1 -- 172.21.15.107:0/2021555433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 msgr2=0x7f3c5406dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:42.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.980+0000 7f3c58ca4640 1 --2- 172.21.15.107:0/2021555433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c5406dbb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009dc0 tx=0x7f3c4402bf20 comp rx=0 tx=0).stop 2024-04-24T01:47:42.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.980+0000 7f3c58ca4640 1 -- 172.21.15.107:0/2021555433 shutdown_connections 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.980+0000 7f3c58ca4640 1 --2- 172.21.15.107:0/2021555433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c5406dbb0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.980+0000 7f3c58ca4640 1 -- 172.21.15.107:0/2021555433 >> 172.21.15.107:0/2021555433 conn(0x7f3c5409ea70 msgr2=0x7f3c5409ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.980+0000 7f3c58ca4640 1 -- 172.21.15.107:0/2021555433 shutdown_connections 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.980+0000 7f3c58ca4640 1 -- 172.21.15.107:0/2021555433 wait complete. 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.981+0000 7f3c58ca4640 1 Processor -- start 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.981+0000 7f3c58ca4640 1 -- start start 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.981+0000 7f3c58ca4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c54129370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.981+0000 7f3c58ca4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5412ebb0 con 0x7f3c5406d7d0 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.981+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c54129370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.981+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c54129370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57958/0 (socket says 172.21.15.107:57958) 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.981+0000 7f3c5259c640 1 -- 172.21.15.107:0/43527229 learned_addr learned my addr 172.21.15.107:0/43527229 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.982+0000 7f3c5259c640 1 -- 172.21.15.107:0/43527229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5412e4f0 con 0x7f3c5406d7d0 2024-04-24T01:47:42.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.982+0000 7f3c5259c640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c54129370 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000f80 tx=0x7f3c44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:42.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.982+0000 7f3c42ffd640 1 -- 172.21.15.107:0/43527229 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44044020 con 0x7f3c5406d7d0 2024-04-24T01:47:42.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.982+0000 7f3c42ffd640 1 -- 172.21.15.107:0/43527229 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4403f5a0 con 0x7f3c5406d7d0 2024-04-24T01:47:42.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.982+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5412b7e0 con 0x7f3c5406d7d0 2024-04-24T01:47:42.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.982+0000 7f3c42ffd640 1 -- 172.21.15.107:0/43527229 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44039040 con 0x7f3c5406d7d0 2024-04-24T01:47:42.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.982+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c54129a90 con 0x7f3c5406d7d0 2024-04-24T01:47:42.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.983+0000 7f3c42ffd640 1 -- 172.21.15.107:0/43527229 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3c44047020 con 0x7f3c5406d7d0 2024-04-24T01:47:42.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.983+0000 7f3c42ffd640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3c34038060 0x7f3c3403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:42.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.983+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c54062da0 con 0x7f3c5406d7d0 2024-04-24T01:47:42.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.983+0000 7f3c42ffd640 1 -- 172.21.15.107:0/43527229 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3c4406e840 con 0x7f3c5406d7d0 2024-04-24T01:47:42.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.983+0000 7f3c51d9b640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3c34038060 0x7f3c3403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:42.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.984+0000 7f3c51d9b640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3c34038060 0x7f3c3403a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3c48005880 tx=0x7f3c48007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:42.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:42.988+0000 7f3c42ffd640 1 -- 172.21.15.107:0/43527229 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f3c4404e030 con 0x7f3c5406d7d0 2024-04-24T01:47:43.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.156+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 --> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c5408ed00 con 0x7f3c34038060 2024-04-24T01:47:43.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.171+0000 7f3c42ffd640 1 -- 172.21.15.107:0/43527229 <== mgr.4102 v2:172.21.15.131:6824/3835564877 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666045 (secure 0 0 0) 0x7f3c5408ed00 con 0x7f3c34038060 2024-04-24T01:47:43.180 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-24T01:47:43.186 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-04-24T01:47:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3c34038060 msgr2=0x7f3c3403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3c34038060 0x7f3c3403a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3c48005880 tx=0x7f3c48007970 comp rx=0 tx=0).stop 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 msgr2=0x7f3c54129370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c54129370 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000f80 tx=0x7f3c44004a40 comp rx=0 tx=0).stop 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 shutdown_connections 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f3c34038060 0x7f3c3403a520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 --2- 172.21.15.107:0/43527229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c5406d7d0 0x7f3c54129370 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 >> 172.21.15.107:0/43527229 conn(0x7f3c5409ea70 msgr2=0x7f3c5409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 shutdown_connections 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.176+0000 7f3c58ca4640 1 -- 172.21.15.107:0/43527229 wait complete. 2024-04-24T01:47:43.189 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-04-24T01:47:42.099845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5393,"num_read_kb":4942,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5012,"ondisk_log_size":5012,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160888,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326472,"statfs":{"total":386547056640,"available":386382307328,"internally_reserved":0,"allocated":2973696,"data_stored":1776174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003540"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.883674+0000","last_change":"2024-04-24T01:46:35.883674+0000","last_active":"2024-04-24T01:46:35.883674+0000","last_peered":"2024-04-24T01:46:35.883674+0000","last_clean":"2024-04-24T01:46:35.883674+0000","last_became_active":"2024-04-24T01:42:40.781127+0000","last_became_peered":"2024-04-24T01:42:40.781127+0000","last_unstale":"2024-04-24T01:46:35.883674+0000","last_undegraded":"2024-04-24T01:46:35.883674+0000","last_fullsized":"2024-04-24T01:46:35.883674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.883557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.883557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:30.324934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.691836+0000","last_change":"2024-04-24T01:46:22.691864+0000","last_active":"2024-04-24T01:46:22.691836+0000","last_peered":"2024-04-24T01:46:22.691836+0000","last_clean":"2024-04-24T01:46:22.691836+0000","last_became_active":"2024-04-24T01:42:42.782855+0000","last_became_peered":"2024-04-24T01:42:42.782855+0000","last_unstale":"2024-04-24T01:46:22.691836+0000","last_undegraded":"2024-04-24T01:46:22.691836+0000","last_fullsized":"2024-04-24T01:46:22.691836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.691735+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.691735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:31.620109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.899233+0000","last_change":"2024-04-24T01:46:51.899233+0000","last_active":"2024-04-24T01:46:51.899233+0000","last_peered":"2024-04-24T01:46:51.899233+0000","last_clean":"2024-04-24T01:46:51.899233+0000","last_became_active":"2024-04-24T01:42:40.769293+0000","last_became_peered":"2024-04-24T01:42:40.769293+0000","last_unstale":"2024-04-24T01:46:51.899233+0000","last_undegraded":"2024-04-24T01:46:51.899233+0000","last_fullsized":"2024-04-24T01:46:51.899233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:51.899117+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:51.899117+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.899117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:01.559805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.524058+0000","last_change":"2024-04-24T01:46:45.524093+0000","last_active":"2024-04-24T01:46:45.524058+0000","last_peered":"2024-04-24T01:46:45.524058+0000","last_clean":"2024-04-24T01:46:45.524058+0000","last_became_active":"2024-04-24T01:42:42.778067+0000","last_became_peered":"2024-04-24T01:42:42.778067+0000","last_unstale":"2024-04-24T01:46:45.524058+0000","last_undegraded":"2024-04-24T01:46:45.524058+0000","last_fullsized":"2024-04-24T01:46:45.524058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:45.523961+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:45.523961+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.523961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:33.787603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.574324+0000","last_change":"2024-04-24T01:46:57.574351+0000","last_active":"2024-04-24T01:46:57.574324+0000","last_peered":"2024-04-24T01:46:57.574324+0000","last_clean":"2024-04-24T01:46:57.574324+0000","last_became_active":"2024-04-24T01:42:40.786447+0000","last_became_peered":"2024-04-24T01:42:40.786447+0000","last_unstale":"2024-04-24T01:46:57.574324+0000","last_undegraded":"2024-04-24T01:46:57.574324+0000","last_fullsized":"2024-04-24T01:46:57.574324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:57.574225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:57.574225+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.574225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:53:21.599863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.474764+0000","last_change":"2024-04-24T01:46:42.474835+0000","last_active":"2024-04-24T01:46:42.474764+0000","last_peered":"2024-04-24T01:46:42.474764+0000","last_clean":"2024-04-24T01:46:42.474764+0000","last_became_active":"2024-04-24T01:42:42.777636+0000","last_became_peered":"2024-04-24T01:42:42.777636+0000","last_unstale":"2024-04-24T01:46:42.474764+0000","last_undegraded":"2024-04-24T01:46:42.474764+0000","last_fullsized":"2024-04-24T01:46:42.474764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:42.474656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:42.474656+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.474656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:09.390976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.953342+0000","last_change":"2024-04-24T01:46:44.953366+0000","last_active":"2024-04-24T01:46:44.953342+0000","last_peered":"2024-04-24T01:46:44.953342+0000","last_clean":"2024-04-24T01:46:44.953342+0000","last_became_active":"2024-04-24T01:42:40.776753+0000","last_became_peered":"2024-04-24T01:42:40.776753+0000","last_unstale":"2024-04-24T01:46:44.953342+0000","last_undegraded":"2024-04-24T01:46:44.953342+0000","last_fullsized":"2024-04-24T01:46:44.953342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:44.953254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:44.953254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.953254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:03.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.454620+0000","last_change":"2024-04-24T01:46:40.454678+0000","last_active":"2024-04-24T01:46:40.454620+0000","last_peered":"2024-04-24T01:46:40.454620+0000","last_clean":"2024-04-24T01:46:40.454620+0000","last_became_active":"2024-04-24T01:42:42.781632+0000","last_became_peered":"2024-04-24T01:42:42.781632+0000","last_unstale":"2024-04-24T01:46:40.454620+0000","last_undegraded":"2024-04-24T01:46:40.454620+0000","last_fullsized":"2024-04-24T01:46:40.454620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.454492+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.454492+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:29.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.531786+0000","last_change":"2024-04-24T01:46:53.531786+0000","last_active":"2024-04-24T01:46:53.531786+0000","last_peered":"2024-04-24T01:46:53.531786+0000","last_clean":"2024-04-24T01:46:53.531786+0000","last_became_active":"2024-04-24T01:42:40.786438+0000","last_became_peered":"2024-04-24T01:42:40.786438+0000","last_unstale":"2024-04-24T01:46:53.531786+0000","last_undegraded":"2024-04-24T01:46:53.531786+0000","last_fullsized":"2024-04-24T01:46:53.531786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.531673+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.531673+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.531673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:53:09.240319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.642290+0000","last_change":"2024-04-24T01:46:54.642339+0000","last_active":"2024-04-24T01:46:54.642290+0000","last_peered":"2024-04-24T01:46:54.642290+0000","last_clean":"2024-04-24T01:46:54.642290+0000","last_became_active":"2024-04-24T01:42:42.783115+0000","last_became_peered":"2024-04-24T01:42:42.783115+0000","last_unstale":"2024-04-24T01:46:54.642290+0000","last_undegraded":"2024-04-24T01:46:54.642290+0000","last_fullsized":"2024-04-24T01:46:54.642290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.642187+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.642187+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.642187+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:04:32.194355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.903454+0000","last_change":"2024-04-24T01:46:43.903454+0000","last_active":"2024-04-24T01:46:43.903454+0000","last_peered":"2024-04-24T01:46:43.903454+0000","last_clean":"2024-04-24T01:46:43.903454+0000","last_became_active":"2024-04-24T01:42:40.775577+0000","last_became_peered":"2024-04-24T01:42:40.775577+0000","last_unstale":"2024-04-24T01:46:43.903454+0000","last_undegraded":"2024-04-24T01:46:43.903454+0000","last_fullsized":"2024-04-24T01:46:43.903454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:43.903307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:43.903307+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.903307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:56.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.064060+0000","last_change":"2024-04-24T01:46:54.064060+0000","last_active":"2024-04-24T01:46:54.064060+0000","last_peered":"2024-04-24T01:46:54.064060+0000","last_clean":"2024-04-24T01:46:54.064060+0000","last_became_active":"2024-04-24T01:43:21.817705+0000","last_became_peered":"2024-04-24T01:43:21.817705+0000","last_unstale":"2024-04-24T01:46:54.064060+0000","last_undegraded":"2024-04-24T01:46:54.064060+0000","last_fullsized":"2024-04-24T01:46:54.064060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.063931+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.063931+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.063931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:17.638374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.623227+0000","last_change":"2024-04-24T01:47:00.623227+0000","last_active":"2024-04-24T01:47:00.623227+0000","last_peered":"2024-04-24T01:47:00.623227+0000","last_clean":"2024-04-24T01:47:00.623227+0000","last_became_active":"2024-04-24T01:42:40.785664+0000","last_became_peered":"2024-04-24T01:42:40.785664+0000","last_unstale":"2024-04-24T01:47:00.623227+0000","last_undegraded":"2024-04-24T01:47:00.623227+0000","last_fullsized":"2024-04-24T01:47:00.623227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:00.623079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:00.623079+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.623079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:43:16.932027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.812398+0000","last_change":"2024-04-24T01:46:30.812398+0000","last_active":"2024-04-24T01:46:30.812398+0000","last_peered":"2024-04-24T01:46:30.812398+0000","last_clean":"2024-04-24T01:46:30.812398+0000","last_became_active":"2024-04-24T01:42:42.787748+0000","last_became_peered":"2024-04-24T01:42:42.787748+0000","last_unstale":"2024-04-24T01:46:30.812398+0000","last_undegraded":"2024-04-24T01:46:30.812398+0000","last_fullsized":"2024-04-24T01:46:30.812398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:30.812254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.812254+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.118051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.039002+0000","last_change":"2024-04-24T01:46:42.039024+0000","last_active":"2024-04-24T01:46:42.039002+0000","last_peered":"2024-04-24T01:46:42.039002+0000","last_clean":"2024-04-24T01:46:42.039002+0000","last_became_active":"2024-04-24T01:42:40.777747+0000","last_became_peered":"2024-04-24T01:42:40.777747+0000","last_unstale":"2024-04-24T01:46:42.039002+0000","last_undegraded":"2024-04-24T01:46:42.039002+0000","last_fullsized":"2024-04-24T01:46:42.039002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:42.038927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:42.038927+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.038927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:42.971477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.884806+0000","last_change":"2024-04-24T01:46:34.884806+0000","last_active":"2024-04-24T01:46:34.884806+0000","last_peered":"2024-04-24T01:46:34.884806+0000","last_clean":"2024-04-24T01:46:34.884806+0000","last_became_active":"2024-04-24T01:42:42.789055+0000","last_became_peered":"2024-04-24T01:42:42.789055+0000","last_unstale":"2024-04-24T01:46:34.884806+0000","last_undegraded":"2024-04-24T01:46:34.884806+0000","last_fullsized":"2024-04-24T01:46:34.884806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.884693+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.884693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:45.893272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.553918+0000","last_change":"2024-04-24T01:46:46.553918+0000","last_active":"2024-04-24T01:46:46.553918+0000","last_peered":"2024-04-24T01:46:46.553918+0000","last_clean":"2024-04-24T01:46:46.553918+0000","last_became_active":"2024-04-24T01:42:42.777449+0000","last_became_peered":"2024-04-24T01:42:42.777449+0000","last_unstale":"2024-04-24T01:46:46.553918+0000","last_undegraded":"2024-04-24T01:46:46.553918+0000","last_fullsized":"2024-04-24T01:46:46.553918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:46.553790+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:46.553790+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.553790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:44.288870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.604175+0000","last_change":"2024-04-24T01:46:41.604175+0000","last_active":"2024-04-24T01:46:41.604175+0000","last_peered":"2024-04-24T01:46:41.604175+0000","last_clean":"2024-04-24T01:46:41.604175+0000","last_became_active":"2024-04-24T01:42:40.791124+0000","last_became_peered":"2024-04-24T01:42:40.791124+0000","last_unstale":"2024-04-24T01:46:41.604175+0000","last_undegraded":"2024-04-24T01:46:41.604175+0000","last_fullsized":"2024-04-24T01:46:41.604175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:41.604041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:41.604041+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.604041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:59.977227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.624679+0000","last_change":"2024-04-24T01:46:34.624679+0000","last_active":"2024-04-24T01:46:34.624679+0000","last_peered":"2024-04-24T01:46:34.624679+0000","last_clean":"2024-04-24T01:46:34.624679+0000","last_became_active":"2024-04-24T01:42:42.782188+0000","last_became_peered":"2024-04-24T01:42:42.782188+0000","last_unstale":"2024-04-24T01:46:34.624679+0000","last_undegraded":"2024-04-24T01:46:34.624679+0000","last_fullsized":"2024-04-24T01:46:34.624679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:34.624511+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.624511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:48.418934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.772551+0000","last_change":"2024-04-24T01:46:29.772551+0000","last_active":"2024-04-24T01:46:29.772551+0000","last_peered":"2024-04-24T01:46:29.772551+0000","last_clean":"2024-04-24T01:46:29.772551+0000","last_became_active":"2024-04-24T01:42:40.783446+0000","last_became_peered":"2024-04-24T01:42:40.783446+0000","last_unstale":"2024-04-24T01:46:29.772551+0000","last_undegraded":"2024-04-24T01:46:29.772551+0000","last_fullsized":"2024-04-24T01:46:29.772551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:29.772438+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.772438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:56.532007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.614151+0000","last_change":"2024-04-24T01:46:44.614151+0000","last_active":"2024-04-24T01:46:44.614151+0000","last_peered":"2024-04-24T01:46:44.614151+0000","last_clean":"2024-04-24T01:46:44.614151+0000","last_became_active":"2024-04-24T01:42:42.783095+0000","last_became_peered":"2024-04-24T01:42:42.783095+0000","last_unstale":"2024-04-24T01:46:44.614151+0000","last_undegraded":"2024-04-24T01:46:44.614151+0000","last_fullsized":"2024-04-24T01:46:44.614151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:44.614034+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:44.614034+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.614034+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:23.716834+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.573948+0000","last_change":"2024-04-24T01:46:39.573948+0000","last_active":"2024-04-24T01:46:39.573948+0000","last_peered":"2024-04-24T01:46:39.573948+0000","last_clean":"2024-04-24T01:46:39.573948+0000","last_became_active":"2024-04-24T01:42:40.792033+0000","last_became_peered":"2024-04-24T01:42:40.792033+0000","last_unstale":"2024-04-24T01:46:39.573948+0000","last_undegraded":"2024-04-24T01:46:39.573948+0000","last_fullsized":"2024-04-24T01:46:39.573948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.573832+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.573832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:44.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.111336+0000","last_change":"2024-04-24T01:46:28.111336+0000","last_active":"2024-04-24T01:46:28.111336+0000","last_peered":"2024-04-24T01:46:28.111336+0000","last_clean":"2024-04-24T01:46:28.111336+0000","last_became_active":"2024-04-24T01:42:42.790447+0000","last_became_peered":"2024-04-24T01:42:42.790447+0000","last_unstale":"2024-04-24T01:46:28.111336+0000","last_undegraded":"2024-04-24T01:46:28.111336+0000","last_fullsized":"2024-04-24T01:46:28.111336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:28.111230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.111230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:02.142302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.670967+0000","last_change":"2024-04-24T01:46:49.670967+0000","last_active":"2024-04-24T01:46:49.670967+0000","last_peered":"2024-04-24T01:46:49.670967+0000","last_clean":"2024-04-24T01:46:49.670967+0000","last_became_active":"2024-04-24T01:42:40.781692+0000","last_became_peered":"2024-04-24T01:42:40.781692+0000","last_unstale":"2024-04-24T01:46:49.670967+0000","last_undegraded":"2024-04-24T01:46:49.670967+0000","last_fullsized":"2024-04-24T01:46:49.670967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:49.670815+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:49.670815+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.670815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:33.464816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.041103+0000","last_change":"2024-04-24T01:46:49.041103+0000","last_active":"2024-04-24T01:46:49.041103+0000","last_peered":"2024-04-24T01:46:49.041103+0000","last_clean":"2024-04-24T01:46:49.041103+0000","last_became_active":"2024-04-24T01:42:42.790619+0000","last_became_peered":"2024-04-24T01:42:42.790619+0000","last_unstale":"2024-04-24T01:46:49.041103+0000","last_undegraded":"2024-04-24T01:46:49.041103+0000","last_fullsized":"2024-04-24T01:46:49.041103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:49.040983+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:49.040983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.040983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:52.960393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.936723+0000","last_change":"2024-04-24T01:46:50.936723+0000","last_active":"2024-04-24T01:46:50.936723+0000","last_peered":"2024-04-24T01:46:50.936723+0000","last_clean":"2024-04-24T01:46:50.936723+0000","last_became_active":"2024-04-24T01:42:40.769205+0000","last_became_peered":"2024-04-24T01:42:40.769205+0000","last_unstale":"2024-04-24T01:46:50.936723+0000","last_undegraded":"2024-04-24T01:46:50.936723+0000","last_fullsized":"2024-04-24T01:46:50.936723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.936606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.936606+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.936606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:13.077347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'12","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.792262+0000","last_change":"2024-04-24T01:46:27.792262+0000","last_active":"2024-04-24T01:46:27.792262+0000","last_peered":"2024-04-24T01:46:27.792262+0000","last_clean":"2024-04-24T01:46:27.792262+0000","last_became_active":"2024-04-24T01:42:42.782049+0000","last_became_peered":"2024-04-24T01:42:42.782049+0000","last_unstale":"2024-04-24T01:46:27.792262+0000","last_undegraded":"2024-04-24T01:46:27.792262+0000","last_fullsized":"2024-04-24T01:46:27.792262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:27.792141+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.792141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:43.543336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.595622+0000","last_change":"2024-04-24T01:46:58.595622+0000","last_active":"2024-04-24T01:46:58.595622+0000","last_peered":"2024-04-24T01:46:58.595622+0000","last_clean":"2024-04-24T01:46:58.595622+0000","last_became_active":"2024-04-24T01:42:40.786104+0000","last_became_peered":"2024-04-24T01:42:40.786104+0000","last_unstale":"2024-04-24T01:46:58.595622+0000","last_undegraded":"2024-04-24T01:46:58.595622+0000","last_fullsized":"2024-04-24T01:46:58.595622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:58.595487+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:58.595487+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.595487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:29.835584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:01.427416+0000","last_change":"2024-04-24T01:47:01.427416+0000","last_active":"2024-04-24T01:47:01.427416+0000","last_peered":"2024-04-24T01:47:01.427416+0000","last_clean":"2024-04-24T01:47:01.427416+0000","last_became_active":"2024-04-24T01:42:50.802660+0000","last_became_peered":"2024-04-24T01:42:50.802660+0000","last_unstale":"2024-04-24T01:47:01.427416+0000","last_undegraded":"2024-04-24T01:47:01.427416+0000","last_fullsized":"2024-04-24T01:47:01.427416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:47:01.427258+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:47:01.427258+0000","last_clean_scrub_stamp":"2024-04-24T01:47:01.427258+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:40.856960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.492406+0000","last_change":"2024-04-24T01:46:33.492406+0000","last_active":"2024-04-24T01:46:33.492406+0000","last_peered":"2024-04-24T01:46:33.492406+0000","last_clean":"2024-04-24T01:46:33.492406+0000","last_became_active":"2024-04-24T01:42:42.785857+0000","last_became_peered":"2024-04-24T01:42:42.785857+0000","last_unstale":"2024-04-24T01:46:33.492406+0000","last_undegraded":"2024-04-24T01:46:33.492406+0000","last_fullsized":"2024-04-24T01:46:33.492406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:33.492233+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.492233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:04.065546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.547488+0000","last_change":"2024-04-24T01:46:49.547488+0000","last_active":"2024-04-24T01:46:49.547488+0000","last_peered":"2024-04-24T01:46:49.547488+0000","last_clean":"2024-04-24T01:46:49.547488+0000","last_became_active":"2024-04-24T01:42:40.791451+0000","last_became_peered":"2024-04-24T01:42:40.791451+0000","last_unstale":"2024-04-24T01:46:49.547488+0000","last_undegraded":"2024-04-24T01:46:49.547488+0000","last_fullsized":"2024-04-24T01:46:49.547488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:49.547352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:49.547352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.547352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:40.238735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.152762+0000","last_change":"2024-04-24T01:46:01.152762+0000","last_active":"2024-04-24T01:46:01.152762+0000","last_peered":"2024-04-24T01:46:01.152762+0000","last_clean":"2024-04-24T01:46:01.152762+0000","last_became_active":"2024-04-24T01:43:21.816862+0000","last_became_peered":"2024-04-24T01:43:21.816862+0000","last_unstale":"2024-04-24T01:46:01.152762+0000","last_undegraded":"2024-04-24T01:46:01.152762+0000","last_fullsized":"2024-04-24T01:46:01.152762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.152654+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.152654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:54.458451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.339700+0000","last_change":"2024-04-24T01:46:24.339700+0000","last_active":"2024-04-24T01:46:24.339700+0000","last_peered":"2024-04-24T01:46:24.339700+0000","last_clean":"2024-04-24T01:46:24.339700+0000","last_became_active":"2024-04-24T01:42:46.785091+0000","last_became_peered":"2024-04-24T01:42:46.785091+0000","last_unstale":"2024-04-24T01:46:24.339700+0000","last_undegraded":"2024-04-24T01:46:24.339700+0000","last_fullsized":"2024-04-24T01:46:24.339700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:46:24.339579+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.339579+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:22.912549+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.697897+0000","last_change":"2024-04-24T01:46:20.697897+0000","last_active":"2024-04-24T01:46:20.697897+0000","last_peered":"2024-04-24T01:46:20.697897+0000","last_clean":"2024-04-24T01:46:20.697897+0000","last_became_active":"2024-04-24T01:42:48.793538+0000","last_became_peered":"2024-04-24T01:42:48.793538+0000","last_unstale":"2024-04-24T01:46:20.697897+0000","last_undegraded":"2024-04-24T01:46:20.697897+0000","last_fullsized":"2024-04-24T01:46:20.697897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.697714+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.697714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:08.843035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.498955+0000","last_change":"2024-04-24T01:46:59.498955+0000","last_active":"2024-04-24T01:46:59.498955+0000","last_peered":"2024-04-24T01:46:59.498955+0000","last_clean":"2024-04-24T01:46:59.498955+0000","last_became_active":"2024-04-24T01:42:50.801891+0000","last_became_peered":"2024-04-24T01:42:50.801891+0000","last_unstale":"2024-04-24T01:46:59.498955+0000","last_undegraded":"2024-04-24T01:46:59.498955+0000","last_fullsized":"2024-04-24T01:46:59.498955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:59.498781+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:59.498781+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.498781+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:31.347722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.435421+0000","last_change":"2024-04-24T01:46:36.435421+0000","last_active":"2024-04-24T01:46:36.435421+0000","last_peered":"2024-04-24T01:46:36.435421+0000","last_clean":"2024-04-24T01:46:36.435421+0000","last_became_active":"2024-04-24T01:42:42.783021+0000","last_became_peered":"2024-04-24T01:42:42.783021+0000","last_unstale":"2024-04-24T01:46:36.435421+0000","last_undegraded":"2024-04-24T01:46:36.435421+0000","last_fullsized":"2024-04-24T01:46:36.435421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:36.435300+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.435300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:00.290885+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.838724+0000","last_change":"2024-04-24T01:46:33.838724+0000","last_active":"2024-04-24T01:46:33.838724+0000","last_peered":"2024-04-24T01:46:33.838724+0000","last_clean":"2024-04-24T01:46:33.838724+0000","last_became_active":"2024-04-24T01:42:40.781757+0000","last_became_peered":"2024-04-24T01:42:40.781757+0000","last_unstale":"2024-04-24T01:46:33.838724+0000","last_undegraded":"2024-04-24T01:46:33.838724+0000","last_fullsized":"2024-04-24T01:46:33.838724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.838566+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.838566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:49.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.293332+0000","last_change":"2024-04-24T01:46:19.293332+0000","last_active":"2024-04-24T01:46:19.293332+0000","last_peered":"2024-04-24T01:46:19.293332+0000","last_clean":"2024-04-24T01:46:19.293332+0000","last_became_active":"2024-04-24T01:42:44.775592+0000","last_became_peered":"2024-04-24T01:42:44.775592+0000","last_unstale":"2024-04-24T01:46:19.293332+0000","last_undegraded":"2024-04-24T01:46:19.293332+0000","last_fullsized":"2024-04-24T01:46:19.293332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.293213+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.293213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:34.753066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.489046+0000","last_change":"2024-04-24T01:46:03.489046+0000","last_active":"2024-04-24T01:46:03.489046+0000","last_peered":"2024-04-24T01:46:03.489046+0000","last_clean":"2024-04-24T01:46:03.489046+0000","last_became_active":"2024-04-24T01:42:46.778125+0000","last_became_peered":"2024-04-24T01:42:46.778125+0000","last_unstale":"2024-04-24T01:46:03.489046+0000","last_undegraded":"2024-04-24T01:46:03.489046+0000","last_fullsized":"2024-04-24T01:46:03.489046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:46:03.488913+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.488913+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:54.619923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.532851+0000","last_change":"2024-04-24T01:46:04.532851+0000","last_active":"2024-04-24T01:46:04.532851+0000","last_peered":"2024-04-24T01:46:04.532851+0000","last_clean":"2024-04-24T01:46:04.532851+0000","last_became_active":"2024-04-24T01:42:48.790181+0000","last_became_peered":"2024-04-24T01:42:48.790181+0000","last_unstale":"2024-04-24T01:46:04.532851+0000","last_undegraded":"2024-04-24T01:46:04.532851+0000","last_fullsized":"2024-04-24T01:46:04.532851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.532716+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.532716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:21.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.927860+0000","last_change":"2024-04-24T01:46:57.927893+0000","last_active":"2024-04-24T01:46:57.927860+0000","last_peered":"2024-04-24T01:46:57.927860+0000","last_clean":"2024-04-24T01:46:57.927860+0000","last_became_active":"2024-04-24T01:42:50.793580+0000","last_became_peered":"2024-04-24T01:42:50.793580+0000","last_unstale":"2024-04-24T01:46:57.927860+0000","last_undegraded":"2024-04-24T01:46:57.927860+0000","last_fullsized":"2024-04-24T01:46:57.927860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:57.927771+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:57.927771+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.927771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:33:30.002077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.557275+0000","last_change":"2024-04-24T01:46:48.557275+0000","last_active":"2024-04-24T01:46:48.557275+0000","last_peered":"2024-04-24T01:46:48.557275+0000","last_clean":"2024-04-24T01:46:48.557275+0000","last_became_active":"2024-04-24T01:42:42.776443+0000","last_became_peered":"2024-04-24T01:42:42.776443+0000","last_unstale":"2024-04-24T01:46:48.557275+0000","last_undegraded":"2024-04-24T01:46:48.557275+0000","last_fullsized":"2024-04-24T01:46:48.557275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:48.557121+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:48.557121+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.557121+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:27.827410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:07.644219+0000","last_change":"2024-04-24T01:47:07.644219+0000","last_active":"2024-04-24T01:47:07.644219+0000","last_peered":"2024-04-24T01:47:07.644219+0000","last_clean":"2024-04-24T01:47:07.644219+0000","last_became_active":"2024-04-24T01:42:40.789912+0000","last_became_peered":"2024-04-24T01:42:40.789912+0000","last_unstale":"2024-04-24T01:47:07.644219+0000","last_undegraded":"2024-04-24T01:47:07.644219+0000","last_fullsized":"2024-04-24T01:47:07.644219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:07.644089+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:07.644089+0000","last_clean_scrub_stamp":"2024-04-24T01:47:07.644089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:25.188634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.183378+0000","last_change":"2024-04-24T01:46:15.183378+0000","last_active":"2024-04-24T01:46:15.183378+0000","last_peered":"2024-04-24T01:46:15.183378+0000","last_clean":"2024-04-24T01:46:15.183378+0000","last_became_active":"2024-04-24T01:42:44.780251+0000","last_became_peered":"2024-04-24T01:42:44.780251+0000","last_unstale":"2024-04-24T01:46:15.183378+0000","last_undegraded":"2024-04-24T01:46:15.183378+0000","last_fullsized":"2024-04-24T01:46:15.183378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.183254+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.183254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:00.909604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.849993+0000","last_change":"2024-04-24T01:46:08.849993+0000","last_active":"2024-04-24T01:46:08.849993+0000","last_peered":"2024-04-24T01:46:08.849993+0000","last_clean":"2024-04-24T01:46:08.849993+0000","last_became_active":"2024-04-24T01:42:46.780363+0000","last_became_peered":"2024-04-24T01:42:46.780363+0000","last_unstale":"2024-04-24T01:46:08.849993+0000","last_undegraded":"2024-04-24T01:46:08.849993+0000","last_fullsized":"2024-04-24T01:46:08.849993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-04-24T01:46:08.849869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.849869+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:45:59.980879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":398,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.286945+0000","last_change":"2024-04-24T01:46:23.286945+0000","last_active":"2024-04-24T01:46:23.286945+0000","last_peered":"2024-04-24T01:46:23.286945+0000","last_clean":"2024-04-24T01:46:23.286945+0000","last_became_active":"2024-04-24T01:42:48.788902+0000","last_became_peered":"2024-04-24T01:42:48.788902+0000","last_unstale":"2024-04-24T01:46:23.286945+0000","last_undegraded":"2024-04-24T01:46:23.286945+0000","last_fullsized":"2024-04-24T01:46:23.286945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:23.286754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.286754+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:45:55.452597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.048742+0000","last_change":"2024-04-24T01:46:52.048768+0000","last_active":"2024-04-24T01:46:52.048742+0000","last_peered":"2024-04-24T01:46:52.048742+0000","last_clean":"2024-04-24T01:46:52.048742+0000","last_became_active":"2024-04-24T01:42:50.800162+0000","last_became_peered":"2024-04-24T01:42:50.800162+0000","last_unstale":"2024-04-24T01:46:52.048742+0000","last_undegraded":"2024-04-24T01:46:52.048742+0000","last_fullsized":"2024-04-24T01:46:52.048742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:52.048656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:52.048656+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.048656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:31.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.867278+0000","last_change":"2024-04-24T01:46:54.867278+0000","last_active":"2024-04-24T01:46:54.867278+0000","last_peered":"2024-04-24T01:46:54.867278+0000","last_clean":"2024-04-24T01:46:54.867278+0000","last_became_active":"2024-04-24T01:42:42.784962+0000","last_became_peered":"2024-04-24T01:42:42.784962+0000","last_unstale":"2024-04-24T01:46:54.867278+0000","last_undegraded":"2024-04-24T01:46:54.867278+0000","last_fullsized":"2024-04-24T01:46:54.867278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:54.867147+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:54.867147+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.867147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:52.237810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.590810+0000","last_change":"2024-04-24T01:46:43.590810+0000","last_active":"2024-04-24T01:46:43.590810+0000","last_peered":"2024-04-24T01:46:43.590810+0000","last_clean":"2024-04-24T01:46:43.590810+0000","last_became_active":"2024-04-24T01:42:40.790464+0000","last_became_peered":"2024-04-24T01:42:40.790464+0000","last_unstale":"2024-04-24T01:46:43.590810+0000","last_undegraded":"2024-04-24T01:46:43.590810+0000","last_fullsized":"2024-04-24T01:46:43.590810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:43.590695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:43.590695+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.590695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:20.764987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.209024+0000","last_change":"2024-04-24T01:46:03.209024+0000","last_active":"2024-04-24T01:46:03.209024+0000","last_peered":"2024-04-24T01:46:03.209024+0000","last_clean":"2024-04-24T01:46:03.209024+0000","last_became_active":"2024-04-24T01:43:21.817786+0000","last_became_peered":"2024-04-24T01:43:21.817786+0000","last_unstale":"2024-04-24T01:46:03.209024+0000","last_undegraded":"2024-04-24T01:46:03.209024+0000","last_fullsized":"2024-04-24T01:46:03.209024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.208890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.208890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:44.835582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.856196+0000","last_change":"2024-04-24T01:46:05.856196+0000","last_active":"2024-04-24T01:46:05.856196+0000","last_peered":"2024-04-24T01:46:05.856196+0000","last_clean":"2024-04-24T01:46:05.856196+0000","last_became_active":"2024-04-24T01:42:46.783721+0000","last_became_peered":"2024-04-24T01:42:46.783721+0000","last_unstale":"2024-04-24T01:46:05.856196+0000","last_undegraded":"2024-04-24T01:46:05.856196+0000","last_fullsized":"2024-04-24T01:46:05.856196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:46:05.856052+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.856052+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:35.561294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.187946+0000","last_change":"2024-04-24T01:46:06.187946+0000","last_active":"2024-04-24T01:46:06.187946+0000","last_peered":"2024-04-24T01:46:06.187946+0000","last_clean":"2024-04-24T01:46:06.187946+0000","last_became_active":"2024-04-24T01:42:48.783426+0000","last_became_peered":"2024-04-24T01:42:48.783426+0000","last_unstale":"2024-04-24T01:46:06.187946+0000","last_undegraded":"2024-04-24T01:46:06.187946+0000","last_fullsized":"2024-04-24T01:46:06.187946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:06.187813+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.187813+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:35.370509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.287580+0000","last_change":"2024-04-24T01:46:17.287580+0000","last_active":"2024-04-24T01:46:17.287580+0000","last_peered":"2024-04-24T01:46:17.287580+0000","last_clean":"2024-04-24T01:46:17.287580+0000","last_became_active":"2024-04-24T01:42:42.786858+0000","last_became_peered":"2024-04-24T01:42:42.786858+0000","last_unstale":"2024-04-24T01:46:17.287580+0000","last_undegraded":"2024-04-24T01:46:17.287580+0000","last_fullsized":"2024-04-24T01:46:17.287580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:17.287452+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.287452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:10.198303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.871548+0000","last_change":"2024-04-24T01:46:37.871548+0000","last_active":"2024-04-24T01:46:37.871548+0000","last_peered":"2024-04-24T01:46:37.871548+0000","last_clean":"2024-04-24T01:46:37.871548+0000","last_became_active":"2024-04-24T01:42:40.780306+0000","last_became_peered":"2024-04-24T01:42:40.780306+0000","last_unstale":"2024-04-24T01:46:37.871548+0000","last_undegraded":"2024-04-24T01:46:37.871548+0000","last_fullsized":"2024-04-24T01:46:37.871548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.871441+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.871441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:18.210191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.610641+0000","last_change":"2024-04-24T01:46:10.610641+0000","last_active":"2024-04-24T01:46:10.610641+0000","last_peered":"2024-04-24T01:46:10.610641+0000","last_clean":"2024-04-24T01:46:10.610641+0000","last_became_active":"2024-04-24T01:42:44.777833+0000","last_became_peered":"2024-04-24T01:42:44.777833+0000","last_unstale":"2024-04-24T01:46:10.610641+0000","last_undegraded":"2024-04-24T01:46:10.610641+0000","last_fullsized":"2024-04-24T01:46:10.610641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:10.610513+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.610513+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:05.321177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.823412+0000","last_change":"2024-04-24T01:46:11.823412+0000","last_active":"2024-04-24T01:46:11.823412+0000","last_peered":"2024-04-24T01:46:11.823412+0000","last_clean":"2024-04-24T01:46:11.823412+0000","last_became_active":"2024-04-24T01:42:46.779186+0000","last_became_peered":"2024-04-24T01:42:46.779186+0000","last_unstale":"2024-04-24T01:46:11.823412+0000","last_undegraded":"2024-04-24T01:46:11.823412+0000","last_fullsized":"2024-04-24T01:46:11.823412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:46:11.823285+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.823285+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:46:43.489332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.206777+0000","last_change":"2024-04-24T01:46:03.206777+0000","last_active":"2024-04-24T01:46:03.206777+0000","last_peered":"2024-04-24T01:46:03.206777+0000","last_clean":"2024-04-24T01:46:03.206777+0000","last_became_active":"2024-04-24T01:42:48.783574+0000","last_became_peered":"2024-04-24T01:42:48.783574+0000","last_unstale":"2024-04-24T01:46:03.206777+0000","last_undegraded":"2024-04-24T01:46:03.206777+0000","last_fullsized":"2024-04-24T01:46:03.206777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.206669+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.206669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:46.699862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.998764+0000","last_change":"2024-04-24T01:46:49.998764+0000","last_active":"2024-04-24T01:46:49.998764+0000","last_peered":"2024-04-24T01:46:49.998764+0000","last_clean":"2024-04-24T01:46:49.998764+0000","last_became_active":"2024-04-24T01:42:50.799532+0000","last_became_peered":"2024-04-24T01:42:50.799532+0000","last_unstale":"2024-04-24T01:46:49.998764+0000","last_undegraded":"2024-04-24T01:46:49.998764+0000","last_fullsized":"2024-04-24T01:46:49.998764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:49.998606+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:49.998606+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.998606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:48.359394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.762304+0000","last_change":"2024-04-24T01:46:30.762304+0000","last_active":"2024-04-24T01:46:30.762304+0000","last_peered":"2024-04-24T01:46:30.762304+0000","last_clean":"2024-04-24T01:46:30.762304+0000","last_became_active":"2024-04-24T01:42:42.781165+0000","last_became_peered":"2024-04-24T01:42:42.781165+0000","last_unstale":"2024-04-24T01:46:30.762304+0000","last_undegraded":"2024-04-24T01:46:30.762304+0000","last_fullsized":"2024-04-24T01:46:30.762304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:30.762170+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.762170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:25.539809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.959316+0000","last_change":"2024-04-24T01:46:45.959316+0000","last_active":"2024-04-24T01:46:45.959316+0000","last_peered":"2024-04-24T01:46:45.959316+0000","last_clean":"2024-04-24T01:46:45.959316+0000","last_became_active":"2024-04-24T01:42:40.776389+0000","last_became_peered":"2024-04-24T01:42:40.776389+0000","last_unstale":"2024-04-24T01:46:45.959316+0000","last_undegraded":"2024-04-24T01:46:45.959316+0000","last_fullsized":"2024-04-24T01:46:45.959316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:45.959202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:45.959202+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.959202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:51.265107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.170837+0000","last_change":"2024-04-24T01:46:23.170837+0000","last_active":"2024-04-24T01:46:23.170837+0000","last_peered":"2024-04-24T01:46:23.170837+0000","last_clean":"2024-04-24T01:46:23.170837+0000","last_became_active":"2024-04-24T01:42:44.775480+0000","last_became_peered":"2024-04-24T01:42:44.775480+0000","last_unstale":"2024-04-24T01:46:23.170837+0000","last_undegraded":"2024-04-24T01:46:23.170837+0000","last_fullsized":"2024-04-24T01:46:23.170837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.170664+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.170664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:17.051548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.289877+0000","last_change":"2024-04-24T01:46:07.289877+0000","last_active":"2024-04-24T01:46:07.289877+0000","last_peered":"2024-04-24T01:46:07.289877+0000","last_clean":"2024-04-24T01:46:07.289877+0000","last_became_active":"2024-04-24T01:42:46.779582+0000","last_became_peered":"2024-04-24T01:42:46.779582+0000","last_unstale":"2024-04-24T01:46:07.289877+0000","last_undegraded":"2024-04-24T01:46:07.289877+0000","last_fullsized":"2024-04-24T01:46:07.289877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:07.289738+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.289738+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:04.439196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.283592+0000","last_change":"2024-04-24T01:46:00.283592+0000","last_active":"2024-04-24T01:46:00.283592+0000","last_peered":"2024-04-24T01:46:00.283592+0000","last_clean":"2024-04-24T01:46:00.283592+0000","last_became_active":"2024-04-24T01:42:48.788503+0000","last_became_peered":"2024-04-24T01:42:48.788503+0000","last_unstale":"2024-04-24T01:46:00.283592+0000","last_undegraded":"2024-04-24T01:46:00.283592+0000","last_fullsized":"2024-04-24T01:46:00.283592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.283490+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.283490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:35.270360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.628016+0000","last_change":"2024-04-24T01:46:56.628016+0000","last_active":"2024-04-24T01:46:56.628016+0000","last_peered":"2024-04-24T01:46:56.628016+0000","last_clean":"2024-04-24T01:46:56.628016+0000","last_became_active":"2024-04-24T01:42:50.796905+0000","last_became_peered":"2024-04-24T01:42:50.796905+0000","last_unstale":"2024-04-24T01:46:56.628016+0000","last_undegraded":"2024-04-24T01:46:56.628016+0000","last_fullsized":"2024-04-24T01:46:56.628016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:56.627869+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:56.627869+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.627869+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:25.561990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'36","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.848059+0000","last_change":"2024-04-24T01:46:36.848059+0000","last_active":"2024-04-24T01:46:36.848059+0000","last_peered":"2024-04-24T01:46:36.848059+0000","last_clean":"2024-04-24T01:46:36.848059+0000","last_became_active":"2024-04-24T01:42:42.789762+0000","last_became_peered":"2024-04-24T01:42:42.789762+0000","last_unstale":"2024-04-24T01:46:36.848059+0000","last_undegraded":"2024-04-24T01:46:36.848059+0000","last_fullsized":"2024-04-24T01:46:36.848059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:36.847905+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.847905+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:33.997362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":91,"num_write":48,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:17.602729+0000","last_change":"2024-04-24T01:47:17.602751+0000","last_active":"2024-04-24T01:47:17.602729+0000","last_peered":"2024-04-24T01:47:17.602729+0000","last_clean":"2024-04-24T01:47:17.602729+0000","last_became_active":"2024-04-24T01:42:40.789955+0000","last_became_peered":"2024-04-24T01:42:40.789955+0000","last_unstale":"2024-04-24T01:47:17.602729+0000","last_undegraded":"2024-04-24T01:47:17.602729+0000","last_fullsized":"2024-04-24T01:47:17.602729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:17.602630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:17.602630+0000","last_clean_scrub_stamp":"2024-04-24T01:47:17.602630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:03.669680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.256556+0000","last_change":"2024-04-24T01:46:20.256556+0000","last_active":"2024-04-24T01:46:20.256556+0000","last_peered":"2024-04-24T01:46:20.256556+0000","last_clean":"2024-04-24T01:46:20.256556+0000","last_became_active":"2024-04-24T01:42:44.775716+0000","last_became_peered":"2024-04-24T01:42:44.775716+0000","last_unstale":"2024-04-24T01:46:20.256556+0000","last_undegraded":"2024-04-24T01:46:20.256556+0000","last_fullsized":"2024-04-24T01:46:20.256556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.256445+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.256445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:51.251216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'61","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.271175+0000","last_change":"2024-04-24T01:46:05.271175+0000","last_active":"2024-04-24T01:46:05.271175+0000","last_peered":"2024-04-24T01:46:05.271175+0000","last_clean":"2024-04-24T01:46:05.271175+0000","last_became_active":"2024-04-24T01:42:46.778232+0000","last_became_peered":"2024-04-24T01:42:46.778232+0000","last_unstale":"2024-04-24T01:46:05.271175+0000","last_undegraded":"2024-04-24T01:46:05.271175+0000","last_fullsized":"2024-04-24T01:46:05.271175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'61","last_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_deep_scrub":"34'61","last_deep_scrub_stamp":"2024-04-24T01:46:05.271031+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.271031+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:58:16.279610+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.199480+0000","last_change":"2024-04-24T01:46:09.199480+0000","last_active":"2024-04-24T01:46:09.199480+0000","last_peered":"2024-04-24T01:46:09.199480+0000","last_clean":"2024-04-24T01:46:09.199480+0000","last_became_active":"2024-04-24T01:42:48.788682+0000","last_became_peered":"2024-04-24T01:42:48.788682+0000","last_unstale":"2024-04-24T01:46:09.199480+0000","last_undegraded":"2024-04-24T01:46:09.199480+0000","last_fullsized":"2024-04-24T01:46:09.199480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:09.199345+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.199345+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:53.841686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.967887+0000","last_change":"2024-04-24T01:46:58.967887+0000","last_active":"2024-04-24T01:46:58.967887+0000","last_peered":"2024-04-24T01:46:58.967887+0000","last_clean":"2024-04-24T01:46:58.967887+0000","last_became_active":"2024-04-24T01:42:50.794477+0000","last_became_peered":"2024-04-24T01:42:50.794477+0000","last_unstale":"2024-04-24T01:46:58.967887+0000","last_undegraded":"2024-04-24T01:46:58.967887+0000","last_fullsized":"2024-04-24T01:46:58.967887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:58.967754+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:58.967754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.967754+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:40.745058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.692666+0000","last_change":"2024-04-24T01:46:25.692666+0000","last_active":"2024-04-24T01:46:25.692666+0000","last_peered":"2024-04-24T01:46:25.692666+0000","last_clean":"2024-04-24T01:46:25.692666+0000","last_became_active":"2024-04-24T01:42:42.778414+0000","last_became_peered":"2024-04-24T01:42:42.778414+0000","last_unstale":"2024-04-24T01:46:25.692666+0000","last_undegraded":"2024-04-24T01:46:25.692666+0000","last_fullsized":"2024-04-24T01:46:25.692666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:25.692556+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.692556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:03:26.488607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:16.651129+0000","last_change":"2024-04-24T01:47:16.651152+0000","last_active":"2024-04-24T01:47:16.651129+0000","last_peered":"2024-04-24T01:47:16.651129+0000","last_clean":"2024-04-24T01:47:16.651129+0000","last_became_active":"2024-04-24T01:42:40.776132+0000","last_became_peered":"2024-04-24T01:42:40.776132+0000","last_unstale":"2024-04-24T01:47:16.651129+0000","last_undegraded":"2024-04-24T01:47:16.651129+0000","last_fullsized":"2024-04-24T01:47:16.651129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:16.651037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:16.651037+0000","last_clean_scrub_stamp":"2024-04-24T01:47:16.651037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:30:29.536498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.205537+0000","last_change":"2024-04-24T01:46:22.205537+0000","last_active":"2024-04-24T01:46:22.205537+0000","last_peered":"2024-04-24T01:46:22.205537+0000","last_clean":"2024-04-24T01:46:22.205537+0000","last_became_active":"2024-04-24T01:42:44.775496+0000","last_became_peered":"2024-04-24T01:42:44.775496+0000","last_unstale":"2024-04-24T01:46:22.205537+0000","last_undegraded":"2024-04-24T01:46:22.205537+0000","last_fullsized":"2024-04-24T01:46:22.205537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.205433+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.205433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:02.910528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'77","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.298393+0000","last_change":"2024-04-24T01:46:15.298393+0000","last_active":"2024-04-24T01:46:15.298393+0000","last_peered":"2024-04-24T01:46:15.298393+0000","last_clean":"2024-04-24T01:46:15.298393+0000","last_became_active":"2024-04-24T01:42:46.781943+0000","last_became_peered":"2024-04-24T01:42:46.781943+0000","last_unstale":"2024-04-24T01:46:15.298393+0000","last_undegraded":"2024-04-24T01:46:15.298393+0000","last_fullsized":"2024-04-24T01:46:15.298393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:15.298262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.298262+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:33.449711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.165949+0000","last_change":"2024-04-24T01:46:25.165949+0000","last_active":"2024-04-24T01:46:25.165949+0000","last_peered":"2024-04-24T01:46:25.165949+0000","last_clean":"2024-04-24T01:46:25.165949+0000","last_became_active":"2024-04-24T01:42:48.794515+0000","last_became_peered":"2024-04-24T01:42:48.794515+0000","last_unstale":"2024-04-24T01:46:25.165949+0000","last_undegraded":"2024-04-24T01:46:25.165949+0000","last_fullsized":"2024-04-24T01:46:25.165949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:25.165833+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.165833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:38.566634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.960071+0000","last_change":"2024-04-24T01:47:00.960071+0000","last_active":"2024-04-24T01:47:00.960071+0000","last_peered":"2024-04-24T01:47:00.960071+0000","last_clean":"2024-04-24T01:47:00.960071+0000","last_became_active":"2024-04-24T01:42:50.802139+0000","last_became_peered":"2024-04-24T01:42:50.802139+0000","last_unstale":"2024-04-24T01:47:00.960071+0000","last_undegraded":"2024-04-24T01:47:00.960071+0000","last_fullsized":"2024-04-24T01:47:00.960071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-24T01:47:00.959959+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-24T01:47:00.959959+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.959959+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:10.371922+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.606660+0000","last_change":"2024-04-24T01:46:42.606660+0000","last_active":"2024-04-24T01:46:42.606660+0000","last_peered":"2024-04-24T01:46:42.606660+0000","last_clean":"2024-04-24T01:46:42.606660+0000","last_became_active":"2024-04-24T01:42:42.783449+0000","last_became_peered":"2024-04-24T01:42:42.783449+0000","last_unstale":"2024-04-24T01:46:42.606660+0000","last_undegraded":"2024-04-24T01:46:42.606660+0000","last_fullsized":"2024-04-24T01:46:42.606660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:42.606517+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:42.606517+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.606517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:22.631331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.003689+0000","last_change":"2024-04-24T01:46:38.003689+0000","last_active":"2024-04-24T01:46:38.003689+0000","last_peered":"2024-04-24T01:46:38.003689+0000","last_clean":"2024-04-24T01:46:38.003689+0000","last_became_active":"2024-04-24T01:42:40.780617+0000","last_became_peered":"2024-04-24T01:42:40.780617+0000","last_unstale":"2024-04-24T01:46:38.003689+0000","last_undegraded":"2024-04-24T01:46:38.003689+0000","last_fullsized":"2024-04-24T01:46:38.003689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.003576+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.003576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:03.732204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.833895+0000","last_change":"2024-04-24T01:46:16.833895+0000","last_active":"2024-04-24T01:46:16.833895+0000","last_peered":"2024-04-24T01:46:16.833895+0000","last_clean":"2024-04-24T01:46:16.833895+0000","last_became_active":"2024-04-24T01:42:44.777955+0000","last_became_peered":"2024-04-24T01:42:44.777955+0000","last_unstale":"2024-04-24T01:46:16.833895+0000","last_undegraded":"2024-04-24T01:46:16.833895+0000","last_fullsized":"2024-04-24T01:46:16.833895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.833759+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.833759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:04.866593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.517337+0000","last_change":"2024-04-24T01:46:05.517337+0000","last_active":"2024-04-24T01:46:05.517337+0000","last_peered":"2024-04-24T01:46:05.517337+0000","last_clean":"2024-04-24T01:46:05.517337+0000","last_became_active":"2024-04-24T01:42:46.778191+0000","last_became_peered":"2024-04-24T01:42:46.778191+0000","last_unstale":"2024-04-24T01:46:05.517337+0000","last_undegraded":"2024-04-24T01:46:05.517337+0000","last_fullsized":"2024-04-24T01:46:05.517337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:46:05.517182+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.517182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.149356+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.480613+0000","last_change":"2024-04-24T01:46:35.480613+0000","last_active":"2024-04-24T01:46:35.480613+0000","last_peered":"2024-04-24T01:46:35.480613+0000","last_clean":"2024-04-24T01:46:35.480613+0000","last_became_active":"2024-04-24T01:42:48.789956+0000","last_became_peered":"2024-04-24T01:42:48.789956+0000","last_unstale":"2024-04-24T01:46:35.480613+0000","last_undegraded":"2024-04-24T01:46:35.480613+0000","last_fullsized":"2024-04-24T01:46:35.480613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.480455+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.480455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:57.552982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.503496+0000","last_change":"2024-04-24T01:46:51.503526+0000","last_active":"2024-04-24T01:46:51.503496+0000","last_peered":"2024-04-24T01:46:51.503496+0000","last_clean":"2024-04-24T01:46:51.503496+0000","last_became_active":"2024-04-24T01:42:50.798904+0000","last_became_peered":"2024-04-24T01:42:50.798904+0000","last_unstale":"2024-04-24T01:46:51.503496+0000","last_undegraded":"2024-04-24T01:46:51.503496+0000","last_fullsized":"2024-04-24T01:46:51.503496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:51.503412+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:51.503412+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.503412+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:08.069919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.469297+0000","last_change":"2024-04-24T01:46:37.469297+0000","last_active":"2024-04-24T01:46:37.469297+0000","last_peered":"2024-04-24T01:46:37.469297+0000","last_clean":"2024-04-24T01:46:37.469297+0000","last_became_active":"2024-04-24T01:42:42.782703+0000","last_became_peered":"2024-04-24T01:42:42.782703+0000","last_unstale":"2024-04-24T01:46:37.469297+0000","last_undegraded":"2024-04-24T01:46:37.469297+0000","last_fullsized":"2024-04-24T01:46:37.469297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:37.469176+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.469176+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:59.897731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.497980+0000","last_change":"2024-04-24T01:46:52.497980+0000","last_active":"2024-04-24T01:46:52.497980+0000","last_peered":"2024-04-24T01:46:52.497980+0000","last_clean":"2024-04-24T01:46:52.497980+0000","last_became_active":"2024-04-24T01:42:40.790642+0000","last_became_peered":"2024-04-24T01:42:40.790642+0000","last_unstale":"2024-04-24T01:46:52.497980+0000","last_undegraded":"2024-04-24T01:46:52.497980+0000","last_fullsized":"2024-04-24T01:46:52.497980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:52.497803+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:52.497803+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.497803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:57.481894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.269204+0000","last_change":"2024-04-24T01:46:18.269204+0000","last_active":"2024-04-24T01:46:18.269204+0000","last_peered":"2024-04-24T01:46:18.269204+0000","last_clean":"2024-04-24T01:46:18.269204+0000","last_became_active":"2024-04-24T01:42:44.775840+0000","last_became_peered":"2024-04-24T01:42:44.775840+0000","last_unstale":"2024-04-24T01:46:18.269204+0000","last_undegraded":"2024-04-24T01:46:18.269204+0000","last_fullsized":"2024-04-24T01:46:18.269204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:18.269076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.269076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:04.262085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.851216+0000","last_change":"2024-04-24T01:46:13.851216+0000","last_active":"2024-04-24T01:46:13.851216+0000","last_peered":"2024-04-24T01:46:13.851216+0000","last_clean":"2024-04-24T01:46:13.851216+0000","last_became_active":"2024-04-24T01:42:46.769780+0000","last_became_peered":"2024-04-24T01:42:46.769780+0000","last_unstale":"2024-04-24T01:46:13.851216+0000","last_undegraded":"2024-04-24T01:46:13.851216+0000","last_fullsized":"2024-04-24T01:46:13.851216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:46:13.851090+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.851090+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:47.344034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.859209+0000","last_change":"2024-04-24T01:46:10.859209+0000","last_active":"2024-04-24T01:46:10.859209+0000","last_peered":"2024-04-24T01:46:10.859209+0000","last_clean":"2024-04-24T01:46:10.859209+0000","last_became_active":"2024-04-24T01:42:48.794461+0000","last_became_peered":"2024-04-24T01:42:48.794461+0000","last_unstale":"2024-04-24T01:46:10.859209+0000","last_undegraded":"2024-04-24T01:46:10.859209+0000","last_fullsized":"2024-04-24T01:46:10.859209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:10.859037+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.859037+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:04.491211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.888439+0000","last_change":"2024-04-24T01:46:56.888439+0000","last_active":"2024-04-24T01:46:56.888439+0000","last_peered":"2024-04-24T01:46:56.888439+0000","last_clean":"2024-04-24T01:46:56.888439+0000","last_became_active":"2024-04-24T01:42:50.793371+0000","last_became_peered":"2024-04-24T01:42:50.793371+0000","last_unstale":"2024-04-24T01:46:56.888439+0000","last_undegraded":"2024-04-24T01:46:56.888439+0000","last_fullsized":"2024-04-24T01:46:56.888439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-24T01:46:56.888278+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-24T01:46:56.888278+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.888278+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:11.138110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.885337+0000","last_change":"2024-04-24T01:46:38.885337+0000","last_active":"2024-04-24T01:46:38.885337+0000","last_peered":"2024-04-24T01:46:38.885337+0000","last_clean":"2024-04-24T01:46:38.885337+0000","last_became_active":"2024-04-24T01:42:42.790625+0000","last_became_peered":"2024-04-24T01:42:42.790625+0000","last_unstale":"2024-04-24T01:46:38.885337+0000","last_undegraded":"2024-04-24T01:46:38.885337+0000","last_fullsized":"2024-04-24T01:46:38.885337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:38.885209+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.885209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:47.529841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:05.619197+0000","last_change":"2024-04-24T01:47:05.619226+0000","last_active":"2024-04-24T01:47:05.619197+0000","last_peered":"2024-04-24T01:47:05.619197+0000","last_clean":"2024-04-24T01:47:05.619197+0000","last_became_active":"2024-04-24T01:42:40.788798+0000","last_became_peered":"2024-04-24T01:42:40.788798+0000","last_unstale":"2024-04-24T01:47:05.619197+0000","last_undegraded":"2024-04-24T01:47:05.619197+0000","last_fullsized":"2024-04-24T01:47:05.619197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:05.619096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:05.619096+0000","last_clean_scrub_stamp":"2024-04-24T01:47:05.619096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:24:14.792833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.615987+0000","last_change":"2024-04-24T01:46:14.615987+0000","last_active":"2024-04-24T01:46:14.615987+0000","last_peered":"2024-04-24T01:46:14.615987+0000","last_clean":"2024-04-24T01:46:14.615987+0000","last_became_active":"2024-04-24T01:42:44.775843+0000","last_became_peered":"2024-04-24T01:42:44.775843+0000","last_unstale":"2024-04-24T01:46:14.615987+0000","last_undegraded":"2024-04-24T01:46:14.615987+0000","last_fullsized":"2024-04-24T01:46:14.615987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:14.615812+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.615812+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:51.435210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.266610+0000","last_change":"2024-04-24T01:46:13.266610+0000","last_active":"2024-04-24T01:46:13.266610+0000","last_peered":"2024-04-24T01:46:13.266610+0000","last_clean":"2024-04-24T01:46:13.266610+0000","last_became_active":"2024-04-24T01:42:46.781872+0000","last_became_peered":"2024-04-24T01:42:46.781872+0000","last_unstale":"2024-04-24T01:46:13.266610+0000","last_undegraded":"2024-04-24T01:46:13.266610+0000","last_fullsized":"2024-04-24T01:46:13.266610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:46:13.266484+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.266484+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:40.059339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.594502+0000","last_change":"2024-04-24T01:46:08.594502+0000","last_active":"2024-04-24T01:46:08.594502+0000","last_peered":"2024-04-24T01:46:08.594502+0000","last_clean":"2024-04-24T01:46:08.594502+0000","last_became_active":"2024-04-24T01:42:48.790298+0000","last_became_peered":"2024-04-24T01:42:48.790298+0000","last_unstale":"2024-04-24T01:46:08.594502+0000","last_undegraded":"2024-04-24T01:46:08.594502+0000","last_fullsized":"2024-04-24T01:46:08.594502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:08.594330+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.594330+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:42.087274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.815766+0000","last_change":"2024-04-24T01:46:22.815766+0000","last_active":"2024-04-24T01:46:22.815766+0000","last_peered":"2024-04-24T01:46:22.815766+0000","last_clean":"2024-04-24T01:46:22.815766+0000","last_became_active":"2024-04-24T01:42:50.796433+0000","last_became_peered":"2024-04-24T01:42:50.796433+0000","last_unstale":"2024-04-24T01:46:22.815766+0000","last_undegraded":"2024-04-24T01:46:22.815766+0000","last_fullsized":"2024-04-24T01:46:22.815766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:22.815603+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.815603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:58.313433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.692968+0000","last_change":"2024-04-24T01:46:18.692968+0000","last_active":"2024-04-24T01:46:18.692968+0000","last_peered":"2024-04-24T01:46:18.692968+0000","last_clean":"2024-04-24T01:46:18.692968+0000","last_became_active":"2024-04-24T01:42:42.790670+0000","last_became_peered":"2024-04-24T01:42:42.790670+0000","last_unstale":"2024-04-24T01:46:18.692968+0000","last_undegraded":"2024-04-24T01:46:18.692968+0000","last_fullsized":"2024-04-24T01:46:18.692968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:18.692855+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.692855+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:30.275139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.580440+0000","last_change":"2024-04-24T01:46:59.580440+0000","last_active":"2024-04-24T01:46:59.580440+0000","last_peered":"2024-04-24T01:46:59.580440+0000","last_clean":"2024-04-24T01:46:59.580440+0000","last_became_active":"2024-04-24T01:42:40.787136+0000","last_became_peered":"2024-04-24T01:42:40.787136+0000","last_unstale":"2024-04-24T01:46:59.580440+0000","last_undegraded":"2024-04-24T01:46:59.580440+0000","last_fullsized":"2024-04-24T01:46:59.580440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:59.580314+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:59.580314+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.580314+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:38.621627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.286638+0000","last_change":"2024-04-24T01:46:06.286638+0000","last_active":"2024-04-24T01:46:06.286638+0000","last_peered":"2024-04-24T01:46:06.286638+0000","last_clean":"2024-04-24T01:46:06.286638+0000","last_became_active":"2024-04-24T01:42:44.776917+0000","last_became_peered":"2024-04-24T01:42:44.776917+0000","last_unstale":"2024-04-24T01:46:06.286638+0000","last_undegraded":"2024-04-24T01:46:06.286638+0000","last_fullsized":"2024-04-24T01:46:06.286638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.286518+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.286518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:00.727895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.470098+0000","last_change":"2024-04-24T01:46:02.470098+0000","last_active":"2024-04-24T01:46:02.470098+0000","last_peered":"2024-04-24T01:46:02.470098+0000","last_clean":"2024-04-24T01:46:02.470098+0000","last_became_active":"2024-04-24T01:42:46.778949+0000","last_became_peered":"2024-04-24T01:42:46.778949+0000","last_unstale":"2024-04-24T01:46:02.470098+0000","last_undegraded":"2024-04-24T01:46:02.470098+0000","last_fullsized":"2024-04-24T01:46:02.470098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:02.469953+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.469953+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:28.856113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.853423+0000","last_change":"2024-04-24T01:46:00.853423+0000","last_active":"2024-04-24T01:46:00.853423+0000","last_peered":"2024-04-24T01:46:00.853423+0000","last_clean":"2024-04-24T01:46:00.853423+0000","last_became_active":"2024-04-24T01:42:48.790011+0000","last_became_peered":"2024-04-24T01:42:48.790011+0000","last_unstale":"2024-04-24T01:46:00.853423+0000","last_undegraded":"2024-04-24T01:46:00.853423+0000","last_fullsized":"2024-04-24T01:46:00.853423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:00.853310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.853310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:00.260486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:57.587848+0000","last_change":"2024-04-24T01:46:57.587848+0000","last_active":"2024-04-24T01:46:57.587848+0000","last_peered":"2024-04-24T01:46:57.587848+0000","last_clean":"2024-04-24T01:46:57.587848+0000","last_became_active":"2024-04-24T01:42:50.798626+0000","last_became_peered":"2024-04-24T01:42:50.798626+0000","last_unstale":"2024-04-24T01:46:57.587848+0000","last_undegraded":"2024-04-24T01:46:57.587848+0000","last_fullsized":"2024-04-24T01:46:57.587848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:46:57.587726+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:46:57.587726+0000","last_clean_scrub_stamp":"2024-04-24T01:46:57.587726+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:52.339001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.335882+0000","last_change":"2024-04-24T01:46:16.335882+0000","last_active":"2024-04-24T01:46:16.335882+0000","last_peered":"2024-04-24T01:46:16.335882+0000","last_clean":"2024-04-24T01:46:16.335882+0000","last_became_active":"2024-04-24T01:42:42.787021+0000","last_became_peered":"2024-04-24T01:42:42.787021+0000","last_unstale":"2024-04-24T01:46:16.335882+0000","last_undegraded":"2024-04-24T01:46:16.335882+0000","last_fullsized":"2024-04-24T01:46:16.335882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:46:16.335729+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.335729+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:21.641635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.628222+0000","last_change":"2024-04-24T01:46:46.628258+0000","last_active":"2024-04-24T01:46:46.628222+0000","last_peered":"2024-04-24T01:46:46.628222+0000","last_clean":"2024-04-24T01:46:46.628222+0000","last_became_active":"2024-04-24T01:42:28.080112+0000","last_became_peered":"2024-04-24T01:42:28.080112+0000","last_unstale":"2024-04-24T01:46:46.628222+0000","last_undegraded":"2024-04-24T01:46:46.628222+0000","last_fullsized":"2024-04-24T01:46:46.628222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-24T01:46:46.628127+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-24T01:46:46.628127+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.628127+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:17.157394+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:09.610871+0000","last_change":"2024-04-24T01:47:09.610895+0000","last_active":"2024-04-24T01:47:09.610871+0000","last_peered":"2024-04-24T01:47:09.610871+0000","last_clean":"2024-04-24T01:47:09.610871+0000","last_became_active":"2024-04-24T01:42:32.734352+0000","last_became_peered":"2024-04-24T01:42:32.734352+0000","last_unstale":"2024-04-24T01:47:09.610871+0000","last_undegraded":"2024-04-24T01:47:09.610871+0000","last_fullsized":"2024-04-24T01:47:09.610871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:09.610769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:09.610769+0000","last_clean_scrub_stamp":"2024-04-24T01:47:09.610769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:07.038848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.602456+0000","last_change":"2024-04-24T01:46:55.602479+0000","last_active":"2024-04-24T01:46:55.602456+0000","last_peered":"2024-04-24T01:46:55.602456+0000","last_clean":"2024-04-24T01:46:55.602456+0000","last_became_active":"2024-04-24T01:42:40.786881+0000","last_became_peered":"2024-04-24T01:42:40.786881+0000","last_unstale":"2024-04-24T01:46:55.602456+0000","last_undegraded":"2024-04-24T01:46:55.602456+0000","last_fullsized":"2024-04-24T01:46:55.602456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:55.602359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:55.602359+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.602359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:37.653272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.646347+0000","last_change":"2024-04-24T01:46:15.646347+0000","last_active":"2024-04-24T01:46:15.646347+0000","last_peered":"2024-04-24T01:46:15.646347+0000","last_clean":"2024-04-24T01:46:15.646347+0000","last_became_active":"2024-04-24T01:42:44.775648+0000","last_became_peered":"2024-04-24T01:42:44.775648+0000","last_unstale":"2024-04-24T01:46:15.646347+0000","last_undegraded":"2024-04-24T01:46:15.646347+0000","last_fullsized":"2024-04-24T01:46:15.646347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.646240+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.646240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:26.583381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.349962+0000","last_change":"2024-04-24T01:46:26.349962+0000","last_active":"2024-04-24T01:46:26.349962+0000","last_peered":"2024-04-24T01:46:26.349962+0000","last_clean":"2024-04-24T01:46:26.349962+0000","last_became_active":"2024-04-24T01:42:46.784687+0000","last_became_peered":"2024-04-24T01:42:46.784687+0000","last_unstale":"2024-04-24T01:46:26.349962+0000","last_undegraded":"2024-04-24T01:46:26.349962+0000","last_fullsized":"2024-04-24T01:46:26.349962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:46:26.349769+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.349769+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:50.261205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.235121+0000","last_change":"2024-04-24T01:46:21.235121+0000","last_active":"2024-04-24T01:46:21.235121+0000","last_peered":"2024-04-24T01:46:21.235121+0000","last_clean":"2024-04-24T01:46:21.235121+0000","last_became_active":"2024-04-24T01:42:48.793239+0000","last_became_peered":"2024-04-24T01:42:48.793239+0000","last_unstale":"2024-04-24T01:46:21.235121+0000","last_undegraded":"2024-04-24T01:46:21.235121+0000","last_fullsized":"2024-04-24T01:46:21.235121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.234980+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.234980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:30.075365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.845179+0000","last_change":"2024-04-24T01:46:18.845179+0000","last_active":"2024-04-24T01:46:18.845179+0000","last_peered":"2024-04-24T01:46:18.845179+0000","last_clean":"2024-04-24T01:46:18.845179+0000","last_became_active":"2024-04-24T01:42:50.791725+0000","last_became_peered":"2024-04-24T01:42:50.791725+0000","last_unstale":"2024-04-24T01:46:18.845179+0000","last_undegraded":"2024-04-24T01:46:18.845179+0000","last_fullsized":"2024-04-24T01:46:18.845179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-04-24T01:46:18.845064+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.845064+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:59.328750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.474912+0000","last_change":"2024-04-24T01:46:34.474912+0000","last_active":"2024-04-24T01:46:34.474912+0000","last_peered":"2024-04-24T01:46:34.474912+0000","last_clean":"2024-04-24T01:46:34.474912+0000","last_became_active":"2024-04-24T01:42:42.785817+0000","last_became_peered":"2024-04-24T01:42:42.785817+0000","last_unstale":"2024-04-24T01:46:34.474912+0000","last_undegraded":"2024-04-24T01:46:34.474912+0000","last_fullsized":"2024-04-24T01:46:34.474912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:34.474793+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.474793+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:55.055111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:11.678130+0000","last_change":"2024-04-24T01:47:11.678153+0000","last_active":"2024-04-24T01:47:11.678130+0000","last_peered":"2024-04-24T01:47:11.678130+0000","last_clean":"2024-04-24T01:47:11.678130+0000","last_became_active":"2024-04-24T01:42:32.739385+0000","last_became_peered":"2024-04-24T01:42:32.739385+0000","last_unstale":"2024-04-24T01:47:11.678130+0000","last_undegraded":"2024-04-24T01:47:11.678130+0000","last_fullsized":"2024-04-24T01:47:11.678130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:11.678020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:11.678020+0000","last_clean_scrub_stamp":"2024-04-24T01:47:11.678020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:35.138491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.039612+0000","last_change":"2024-04-24T01:46:32.039612+0000","last_active":"2024-04-24T01:46:32.039612+0000","last_peered":"2024-04-24T01:46:32.039612+0000","last_clean":"2024-04-24T01:46:32.039612+0000","last_became_active":"2024-04-24T01:42:40.780635+0000","last_became_peered":"2024-04-24T01:42:40.780635+0000","last_unstale":"2024-04-24T01:46:32.039612+0000","last_undegraded":"2024-04-24T01:46:32.039612+0000","last_fullsized":"2024-04-24T01:46:32.039612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.039496+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.039496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:14.657340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.202303+0000","last_change":"2024-04-24T01:46:02.202303+0000","last_active":"2024-04-24T01:46:02.202303+0000","last_peered":"2024-04-24T01:46:02.202303+0000","last_clean":"2024-04-24T01:46:02.202303+0000","last_became_active":"2024-04-24T01:42:44.777120+0000","last_became_peered":"2024-04-24T01:42:44.777120+0000","last_unstale":"2024-04-24T01:46:02.202303+0000","last_undegraded":"2024-04-24T01:46:02.202303+0000","last_fullsized":"2024-04-24T01:46:02.202303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:02.202137+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.202137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:08.592288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":529,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:00.516075+0000","last_change":"2024-04-24T01:46:00.516075+0000","last_active":"2024-04-24T01:46:00.516075+0000","last_peered":"2024-04-24T01:46:00.516075+0000","last_clean":"2024-04-24T01:46:00.516075+0000","last_became_active":"2024-04-24T01:42:46.782531+0000","last_became_peered":"2024-04-24T01:42:46.782531+0000","last_unstale":"2024-04-24T01:46:00.516075+0000","last_undegraded":"2024-04-24T01:46:00.516075+0000","last_fullsized":"2024-04-24T01:46:00.516075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:46:00.515932+0000","last_clean_scrub_stamp":"2024-04-24T01:46:00.515932+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:28.646371+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.407195+0000","last_change":"2024-04-24T01:46:31.407195+0000","last_active":"2024-04-24T01:46:31.407195+0000","last_peered":"2024-04-24T01:46:31.407195+0000","last_clean":"2024-04-24T01:46:31.407195+0000","last_became_active":"2024-04-24T01:42:48.788869+0000","last_became_peered":"2024-04-24T01:42:48.788869+0000","last_unstale":"2024-04-24T01:46:31.407195+0000","last_undegraded":"2024-04-24T01:46:31.407195+0000","last_fullsized":"2024-04-24T01:46:31.407195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.407050+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.407050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:50.586031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.812304+0000","last_change":"2024-04-24T01:46:28.812304+0000","last_active":"2024-04-24T01:46:28.812304+0000","last_peered":"2024-04-24T01:46:28.812304+0000","last_clean":"2024-04-24T01:46:28.812304+0000","last_became_active":"2024-04-24T01:42:50.795472+0000","last_became_peered":"2024-04-24T01:42:50.795472+0000","last_unstale":"2024-04-24T01:46:28.812304+0000","last_undegraded":"2024-04-24T01:46:28.812304+0000","last_fullsized":"2024-04-24T01:46:28.812304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:28.812185+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.812185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:55.500501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.033100+0000","last_change":"2024-04-24T01:46:43.033100+0000","last_active":"2024-04-24T01:46:43.033100+0000","last_peered":"2024-04-24T01:46:43.033100+0000","last_clean":"2024-04-24T01:46:43.033100+0000","last_became_active":"2024-04-24T01:42:42.783291+0000","last_became_peered":"2024-04-24T01:42:42.783291+0000","last_unstale":"2024-04-24T01:46:43.033100+0000","last_undegraded":"2024-04-24T01:46:43.033100+0000","last_fullsized":"2024-04-24T01:46:43.033100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T01:46:43.032993+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T01:46:43.032993+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.032993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:51.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.865588+0000","last_change":"2024-04-24T01:46:40.865588+0000","last_active":"2024-04-24T01:46:40.865588+0000","last_peered":"2024-04-24T01:46:40.865588+0000","last_clean":"2024-04-24T01:46:40.865588+0000","last_became_active":"2024-04-24T01:42:32.739412+0000","last_became_peered":"2024-04-24T01:42:32.739412+0000","last_unstale":"2024-04-24T01:46:40.865588+0000","last_undegraded":"2024-04-24T01:46:40.865588+0000","last_fullsized":"2024-04-24T01:46:40.865588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:40.865456+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.865456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:54.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.978549+0000","last_change":"2024-04-24T01:46:49.978580+0000","last_active":"2024-04-24T01:46:49.978549+0000","last_peered":"2024-04-24T01:46:49.978549+0000","last_clean":"2024-04-24T01:46:49.978549+0000","last_became_active":"2024-04-24T01:42:40.769061+0000","last_became_peered":"2024-04-24T01:42:40.769061+0000","last_unstale":"2024-04-24T01:46:49.978549+0000","last_undegraded":"2024-04-24T01:46:49.978549+0000","last_fullsized":"2024-04-24T01:46:49.978549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:49.978455+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:49.978455+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.978455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:23:23.581015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":16,"num_write_kb":8818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.850406+0000","last_change":"2024-04-24T01:46:21.850406+0000","last_active":"2024-04-24T01:46:21.850406+0000","last_peered":"2024-04-24T01:46:21.850406+0000","last_clean":"2024-04-24T01:46:21.850406+0000","last_became_active":"2024-04-24T01:42:44.768392+0000","last_became_peered":"2024-04-24T01:42:44.768392+0000","last_unstale":"2024-04-24T01:46:21.850406+0000","last_undegraded":"2024-04-24T01:46:21.850406+0000","last_fullsized":"2024-04-24T01:46:21.850406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:21.850235+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.850235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:05.283033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.865174+0000","last_change":"2024-04-24T01:46:09.865174+0000","last_active":"2024-04-24T01:46:09.865174+0000","last_peered":"2024-04-24T01:46:09.865174+0000","last_clean":"2024-04-24T01:46:09.865174+0000","last_became_active":"2024-04-24T01:42:46.780434+0000","last_became_peered":"2024-04-24T01:42:46.780434+0000","last_unstale":"2024-04-24T01:46:09.865174+0000","last_undegraded":"2024-04-24T01:46:09.865174+0000","last_fullsized":"2024-04-24T01:46:09.865174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:46:09.865033+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.865033+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:26.768496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.219562+0000","last_change":"2024-04-24T01:46:17.219562+0000","last_active":"2024-04-24T01:46:17.219562+0000","last_peered":"2024-04-24T01:46:17.219562+0000","last_clean":"2024-04-24T01:46:17.219562+0000","last_became_active":"2024-04-24T01:42:48.793224+0000","last_became_peered":"2024-04-24T01:42:48.793224+0000","last_unstale":"2024-04-24T01:46:17.219562+0000","last_undegraded":"2024-04-24T01:46:17.219562+0000","last_fullsized":"2024-04-24T01:46:17.219562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.219377+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.219377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:20.724218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:23.723557+0000","last_change":"2024-04-24T01:47:23.723596+0000","last_active":"2024-04-24T01:47:23.723557+0000","last_peered":"2024-04-24T01:47:23.723557+0000","last_clean":"2024-04-24T01:47:23.723557+0000","last_became_active":"2024-04-24T01:42:50.802453+0000","last_became_peered":"2024-04-24T01:42:50.802453+0000","last_unstale":"2024-04-24T01:47:23.723557+0000","last_undegraded":"2024-04-24T01:47:23.723557+0000","last_fullsized":"2024-04-24T01:47:23.723557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:23.723439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:23.723439+0000","last_clean_scrub_stamp":"2024-04-24T01:47:23.723439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:46:02.692332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.084556+0000","last_change":"2024-04-24T01:46:31.084556+0000","last_active":"2024-04-24T01:46:31.084556+0000","last_peered":"2024-04-24T01:46:31.084556+0000","last_clean":"2024-04-24T01:46:31.084556+0000","last_became_active":"2024-04-24T01:42:42.775261+0000","last_became_peered":"2024-04-24T01:42:42.775261+0000","last_unstale":"2024-04-24T01:46:31.084556+0000","last_undegraded":"2024-04-24T01:46:31.084556+0000","last_fullsized":"2024-04-24T01:46:31.084556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:31.084413+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.084413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:24.777154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:12.653703+0000","last_change":"2024-04-24T01:47:12.653726+0000","last_active":"2024-04-24T01:47:12.653703+0000","last_peered":"2024-04-24T01:47:12.653703+0000","last_clean":"2024-04-24T01:47:12.653703+0000","last_became_active":"2024-04-24T01:42:32.739909+0000","last_became_peered":"2024-04-24T01:42:32.739909+0000","last_unstale":"2024-04-24T01:47:12.653703+0000","last_undegraded":"2024-04-24T01:47:12.653703+0000","last_fullsized":"2024-04-24T01:47:12.653703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:12.653598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:12.653598+0000","last_clean_scrub_stamp":"2024-04-24T01:47:12.653598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:22:15.155401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.912286+0000","last_change":"2024-04-24T01:46:41.912286+0000","last_active":"2024-04-24T01:46:41.912286+0000","last_peered":"2024-04-24T01:46:41.912286+0000","last_clean":"2024-04-24T01:46:41.912286+0000","last_became_active":"2024-04-24T01:42:40.768787+0000","last_became_peered":"2024-04-24T01:42:40.768787+0000","last_unstale":"2024-04-24T01:46:41.912286+0000","last_undegraded":"2024-04-24T01:46:41.912286+0000","last_fullsized":"2024-04-24T01:46:41.912286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:41.912117+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:41.912117+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.912117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:42.249111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.225235+0000","last_change":"2024-04-24T01:46:16.225235+0000","last_active":"2024-04-24T01:46:16.225235+0000","last_peered":"2024-04-24T01:46:16.225235+0000","last_clean":"2024-04-24T01:46:16.225235+0000","last_became_active":"2024-04-24T01:42:44.777961+0000","last_became_peered":"2024-04-24T01:42:44.777961+0000","last_unstale":"2024-04-24T01:46:16.225235+0000","last_undegraded":"2024-04-24T01:46:16.225235+0000","last_fullsized":"2024-04-24T01:46:16.225235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.225104+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.225104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:22.216443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.361545+0000","last_change":"2024-04-24T01:46:29.361545+0000","last_active":"2024-04-24T01:46:29.361545+0000","last_peered":"2024-04-24T01:46:29.361545+0000","last_clean":"2024-04-24T01:46:29.361545+0000","last_became_active":"2024-04-24T01:42:46.782066+0000","last_became_peered":"2024-04-24T01:42:46.782066+0000","last_unstale":"2024-04-24T01:46:29.361545+0000","last_undegraded":"2024-04-24T01:46:29.361545+0000","last_fullsized":"2024-04-24T01:46:29.361545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-24T01:46:29.361431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.361431+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:30.282814+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.364979+0000","last_change":"2024-04-24T01:46:27.364979+0000","last_active":"2024-04-24T01:46:27.364979+0000","last_peered":"2024-04-24T01:46:27.364979+0000","last_clean":"2024-04-24T01:46:27.364979+0000","last_became_active":"2024-04-24T01:42:48.789286+0000","last_became_peered":"2024-04-24T01:42:48.789286+0000","last_unstale":"2024-04-24T01:46:27.364979+0000","last_undegraded":"2024-04-24T01:46:27.364979+0000","last_fullsized":"2024-04-24T01:46:27.364979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.364865+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.364865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:11.158866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:00.453310+0000","last_change":"2024-04-24T01:47:00.453310+0000","last_active":"2024-04-24T01:47:00.453310+0000","last_peered":"2024-04-24T01:47:00.453310+0000","last_clean":"2024-04-24T01:47:00.453310+0000","last_became_active":"2024-04-24T01:42:50.802163+0000","last_became_peered":"2024-04-24T01:42:50.802163+0000","last_unstale":"2024-04-24T01:47:00.453310+0000","last_undegraded":"2024-04-24T01:47:00.453310+0000","last_fullsized":"2024-04-24T01:47:00.453310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:47:00.453192+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:47:00.453192+0000","last_clean_scrub_stamp":"2024-04-24T01:47:00.453192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:22:55.876575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.536415+0000","last_change":"2024-04-24T01:46:36.536415+0000","last_active":"2024-04-24T01:46:36.536415+0000","last_peered":"2024-04-24T01:46:36.536415+0000","last_clean":"2024-04-24T01:46:36.536415+0000","last_became_active":"2024-04-24T01:42:42.782016+0000","last_became_peered":"2024-04-24T01:42:42.782016+0000","last_unstale":"2024-04-24T01:46:36.536415+0000","last_undegraded":"2024-04-24T01:46:36.536415+0000","last_fullsized":"2024-04-24T01:46:36.536415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:36.536262+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.536262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:42.146239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:42.865928+0000","last_change":"2024-04-24T01:46:42.865928+0000","last_active":"2024-04-24T01:46:42.865928+0000","last_peered":"2024-04-24T01:46:42.865928+0000","last_clean":"2024-04-24T01:46:42.865928+0000","last_became_active":"2024-04-24T01:42:40.774317+0000","last_became_peered":"2024-04-24T01:42:40.774317+0000","last_unstale":"2024-04-24T01:46:42.865928+0000","last_undegraded":"2024-04-24T01:46:42.865928+0000","last_fullsized":"2024-04-24T01:46:42.865928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:42.865739+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:42.865739+0000","last_clean_scrub_stamp":"2024-04-24T01:46:42.865739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:09.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.010284+0000","last_change":"2024-04-24T01:46:47.010324+0000","last_active":"2024-04-24T01:46:47.010284+0000","last_peered":"2024-04-24T01:46:47.010284+0000","last_clean":"2024-04-24T01:46:47.010284+0000","last_became_active":"2024-04-24T01:42:32.733815+0000","last_became_peered":"2024-04-24T01:42:32.733815+0000","last_unstale":"2024-04-24T01:46:47.010284+0000","last_undegraded":"2024-04-24T01:46:47.010284+0000","last_fullsized":"2024-04-24T01:46:47.010284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.010163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.010163+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.010163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:37:23.212750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.015222+0000","last_change":"2024-04-24T01:46:53.015222+0000","last_active":"2024-04-24T01:46:53.015222+0000","last_peered":"2024-04-24T01:46:53.015222+0000","last_clean":"2024-04-24T01:46:53.015222+0000","last_became_active":"2024-04-24T01:43:21.813942+0000","last_became_peered":"2024-04-24T01:43:21.813942+0000","last_unstale":"2024-04-24T01:46:53.015222+0000","last_undegraded":"2024-04-24T01:46:53.015222+0000","last_fullsized":"2024-04-24T01:46:53.015222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.015074+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.015074+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.015074+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:46:25.180917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'89","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.233696+0000","last_change":"2024-04-24T01:46:07.233696+0000","last_active":"2024-04-24T01:46:07.233696+0000","last_peered":"2024-04-24T01:46:07.233696+0000","last_clean":"2024-04-24T01:46:07.233696+0000","last_became_active":"2024-04-24T01:42:46.779332+0000","last_became_peered":"2024-04-24T01:42:46.779332+0000","last_unstale":"2024-04-24T01:46:07.233696+0000","last_undegraded":"2024-04-24T01:46:07.233696+0000","last_fullsized":"2024-04-24T01:46:07.233696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'89","last_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_deep_scrub":"34'89","last_deep_scrub_stamp":"2024-04-24T01:46:07.233553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.233553+0000","objects_scrubbed":11,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:30:09.955408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":99,"num_write":46,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.891045+0000","last_change":"2024-04-24T01:46:06.891045+0000","last_active":"2024-04-24T01:46:06.891045+0000","last_peered":"2024-04-24T01:46:06.891045+0000","last_clean":"2024-04-24T01:46:06.891045+0000","last_became_active":"2024-04-24T01:42:48.792322+0000","last_became_peered":"2024-04-24T01:42:48.792322+0000","last_unstale":"2024-04-24T01:46:06.891045+0000","last_undegraded":"2024-04-24T01:46:06.891045+0000","last_fullsized":"2024-04-24T01:46:06.891045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:06.890898+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.890898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:03.226630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.132700+0000","last_change":"2024-04-24T01:46:29.132700+0000","last_active":"2024-04-24T01:46:29.132700+0000","last_peered":"2024-04-24T01:46:29.132700+0000","last_clean":"2024-04-24T01:46:29.132700+0000","last_became_active":"2024-04-24T01:42:50.792732+0000","last_became_peered":"2024-04-24T01:42:50.792732+0000","last_unstale":"2024-04-24T01:46:29.132700+0000","last_undegraded":"2024-04-24T01:46:29.132700+0000","last_fullsized":"2024-04-24T01:46:29.132700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:29.132536+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.132536+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:12.697153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.728154+0000","last_change":"2024-04-24T01:46:21.728154+0000","last_active":"2024-04-24T01:46:21.728154+0000","last_peered":"2024-04-24T01:46:21.728154+0000","last_clean":"2024-04-24T01:46:21.728154+0000","last_became_active":"2024-04-24T01:42:42.789464+0000","last_became_peered":"2024-04-24T01:42:42.789464+0000","last_unstale":"2024-04-24T01:46:21.728154+0000","last_undegraded":"2024-04-24T01:46:21.728154+0000","last_fullsized":"2024-04-24T01:46:21.728154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:21.728040+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.728040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:08.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.014866+0000","last_change":"2024-04-24T01:46:40.014866+0000","last_active":"2024-04-24T01:46:40.014866+0000","last_peered":"2024-04-24T01:46:40.014866+0000","last_clean":"2024-04-24T01:46:40.014866+0000","last_became_active":"2024-04-24T01:42:40.777731+0000","last_became_peered":"2024-04-24T01:42:40.777731+0000","last_unstale":"2024-04-24T01:46:40.014866+0000","last_undegraded":"2024-04-24T01:46:40.014866+0000","last_fullsized":"2024-04-24T01:46:40.014866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:40.014720+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:40.014720+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.014720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:59.544406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:10.652385+0000","last_change":"2024-04-24T01:47:10.652407+0000","last_active":"2024-04-24T01:47:10.652385+0000","last_peered":"2024-04-24T01:47:10.652385+0000","last_clean":"2024-04-24T01:47:10.652385+0000","last_became_active":"2024-04-24T01:42:32.739328+0000","last_became_peered":"2024-04-24T01:42:32.739328+0000","last_unstale":"2024-04-24T01:47:10.652385+0000","last_undegraded":"2024-04-24T01:47:10.652385+0000","last_fullsized":"2024-04-24T01:47:10.652385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:10.652290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:10.652290+0000","last_clean_scrub_stamp":"2024-04-24T01:47:10.652290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:53:43.335089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.278325+0000","last_change":"2024-04-24T01:46:12.278325+0000","last_active":"2024-04-24T01:46:12.278325+0000","last_peered":"2024-04-24T01:46:12.278325+0000","last_clean":"2024-04-24T01:46:12.278325+0000","last_became_active":"2024-04-24T01:42:44.772915+0000","last_became_peered":"2024-04-24T01:42:44.772915+0000","last_unstale":"2024-04-24T01:46:12.278325+0000","last_undegraded":"2024-04-24T01:46:12.278325+0000","last_fullsized":"2024-04-24T01:46:12.278325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.278217+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.278217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:12.615210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.482085+0000","last_change":"2024-04-24T01:46:01.482085+0000","last_active":"2024-04-24T01:46:01.482085+0000","last_peered":"2024-04-24T01:46:01.482085+0000","last_clean":"2024-04-24T01:46:01.482085+0000","last_became_active":"2024-04-24T01:42:46.779775+0000","last_became_peered":"2024-04-24T01:42:46.779775+0000","last_unstale":"2024-04-24T01:46:01.482085+0000","last_undegraded":"2024-04-24T01:46:01.482085+0000","last_fullsized":"2024-04-24T01:46:01.482085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:46:01.481946+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.481946+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:57.817678+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.707597+0000","last_change":"2024-04-24T01:46:24.707597+0000","last_active":"2024-04-24T01:46:24.707597+0000","last_peered":"2024-04-24T01:46:24.707597+0000","last_clean":"2024-04-24T01:46:24.707597+0000","last_became_active":"2024-04-24T01:42:48.794215+0000","last_became_peered":"2024-04-24T01:42:48.794215+0000","last_unstale":"2024-04-24T01:46:24.707597+0000","last_undegraded":"2024-04-24T01:46:24.707597+0000","last_fullsized":"2024-04-24T01:46:24.707597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:24.707426+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.707426+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:18.013223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:22.706255+0000","last_change":"2024-04-24T01:47:22.706308+0000","last_active":"2024-04-24T01:47:22.706255+0000","last_peered":"2024-04-24T01:47:22.706255+0000","last_clean":"2024-04-24T01:47:22.706255+0000","last_became_active":"2024-04-24T01:42:50.802112+0000","last_became_peered":"2024-04-24T01:42:50.802112+0000","last_unstale":"2024-04-24T01:47:22.706255+0000","last_undegraded":"2024-04-24T01:47:22.706255+0000","last_fullsized":"2024-04-24T01:47:22.706255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:22.706128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:22.706128+0000","last_clean_scrub_stamp":"2024-04-24T01:47:22.706128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:11.860681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.287073+0000","last_change":"2024-04-24T01:46:14.287073+0000","last_active":"2024-04-24T01:46:14.287073+0000","last_peered":"2024-04-24T01:46:14.287073+0000","last_clean":"2024-04-24T01:46:14.287073+0000","last_became_active":"2024-04-24T01:42:42.787694+0000","last_became_peered":"2024-04-24T01:42:42.787694+0000","last_unstale":"2024-04-24T01:46:14.287073+0000","last_undegraded":"2024-04-24T01:46:14.287073+0000","last_fullsized":"2024-04-24T01:46:14.287073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:14.286944+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.286944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:31.444362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.558770+0000","last_change":"2024-04-24T01:46:56.558770+0000","last_active":"2024-04-24T01:46:56.558770+0000","last_peered":"2024-04-24T01:46:56.558770+0000","last_clean":"2024-04-24T01:46:56.558770+0000","last_became_active":"2024-04-24T01:42:40.785602+0000","last_became_peered":"2024-04-24T01:42:40.785602+0000","last_unstale":"2024-04-24T01:46:56.558770+0000","last_undegraded":"2024-04-24T01:46:56.558770+0000","last_fullsized":"2024-04-24T01:46:56.558770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:56.558658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:56.558658+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.558658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:53:32.368481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.982868+0000","last_change":"2024-04-24T01:46:47.982868+0000","last_active":"2024-04-24T01:46:47.982868+0000","last_peered":"2024-04-24T01:46:47.982868+0000","last_clean":"2024-04-24T01:46:47.982868+0000","last_became_active":"2024-04-24T01:42:32.734226+0000","last_became_peered":"2024-04-24T01:42:32.734226+0000","last_unstale":"2024-04-24T01:46:47.982868+0000","last_undegraded":"2024-04-24T01:46:47.982868+0000","last_fullsized":"2024-04-24T01:46:47.982868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.982756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.982756+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.982756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:33:59.525276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.333093+0000","last_change":"2024-04-24T01:46:08.333093+0000","last_active":"2024-04-24T01:46:08.333093+0000","last_peered":"2024-04-24T01:46:08.333093+0000","last_clean":"2024-04-24T01:46:08.333093+0000","last_became_active":"2024-04-24T01:42:44.776937+0000","last_became_peered":"2024-04-24T01:42:44.776937+0000","last_unstale":"2024-04-24T01:46:08.333093+0000","last_undegraded":"2024-04-24T01:46:08.333093+0000","last_fullsized":"2024-04-24T01:46:08.333093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:08.332981+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.332981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:48.671731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'24","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.321125+0000","last_change":"2024-04-24T01:46:19.321125+0000","last_active":"2024-04-24T01:46:19.321125+0000","last_peered":"2024-04-24T01:46:19.321125+0000","last_clean":"2024-04-24T01:46:19.321125+0000","last_became_active":"2024-04-24T01:42:46.782252+0000","last_became_peered":"2024-04-24T01:42:46.782252+0000","last_unstale":"2024-04-24T01:46:19.321125+0000","last_undegraded":"2024-04-24T01:46:19.321125+0000","last_fullsized":"2024-04-24T01:46:19.321125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-04-24T01:46:19.320973+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.320973+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:45:49.328557+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.218953+0000","last_change":"2024-04-24T01:46:02.218953+0000","last_active":"2024-04-24T01:46:02.218953+0000","last_peered":"2024-04-24T01:46:02.218953+0000","last_clean":"2024-04-24T01:46:02.218953+0000","last_became_active":"2024-04-24T01:42:48.784115+0000","last_became_peered":"2024-04-24T01:42:48.784115+0000","last_unstale":"2024-04-24T01:46:02.218953+0000","last_undegraded":"2024-04-24T01:46:02.218953+0000","last_fullsized":"2024-04-24T01:46:02.218953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.218804+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.218804+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:46.449166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'9","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:58.541942+0000","last_change":"2024-04-24T01:46:58.541942+0000","last_active":"2024-04-24T01:46:58.541942+0000","last_peered":"2024-04-24T01:46:58.541942+0000","last_clean":"2024-04-24T01:46:58.541942+0000","last_became_active":"2024-04-24T01:42:50.801933+0000","last_became_peered":"2024-04-24T01:42:50.801933+0000","last_unstale":"2024-04-24T01:46:58.541942+0000","last_undegraded":"2024-04-24T01:46:58.541942+0000","last_fullsized":"2024-04-24T01:46:58.541942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:46:58.541808+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:46:58.541808+0000","last_clean_scrub_stamp":"2024-04-24T01:46:58.541808+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.746837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.831123+0000","last_change":"2024-04-24T01:46:32.831123+0000","last_active":"2024-04-24T01:46:32.831123+0000","last_peered":"2024-04-24T01:46:32.831123+0000","last_clean":"2024-04-24T01:46:32.831123+0000","last_became_active":"2024-04-24T01:42:42.788627+0000","last_became_peered":"2024-04-24T01:42:42.788627+0000","last_unstale":"2024-04-24T01:46:32.831123+0000","last_undegraded":"2024-04-24T01:46:32.831123+0000","last_fullsized":"2024-04-24T01:46:32.831123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:32.831018+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.831018+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:14.457711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.703562+0000","last_change":"2024-04-24T01:46:51.703562+0000","last_active":"2024-04-24T01:46:51.703562+0000","last_peered":"2024-04-24T01:46:51.703562+0000","last_clean":"2024-04-24T01:46:51.703562+0000","last_became_active":"2024-04-24T01:42:40.788293+0000","last_became_peered":"2024-04-24T01:42:40.788293+0000","last_unstale":"2024-04-24T01:46:51.703562+0000","last_undegraded":"2024-04-24T01:46:51.703562+0000","last_fullsized":"2024-04-24T01:46:51.703562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:51.703403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:51.703403+0000","last_clean_scrub_stamp":"2024-04-24T01:46:51.703403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:20.140548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:13.687114+0000","last_change":"2024-04-24T01:47:13.687138+0000","last_active":"2024-04-24T01:47:13.687114+0000","last_peered":"2024-04-24T01:47:13.687114+0000","last_clean":"2024-04-24T01:47:13.687114+0000","last_became_active":"2024-04-24T01:42:33.179201+0000","last_became_peered":"2024-04-24T01:42:33.179201+0000","last_unstale":"2024-04-24T01:47:13.687114+0000","last_undegraded":"2024-04-24T01:47:13.687114+0000","last_fullsized":"2024-04-24T01:47:13.687114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:13.687007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:13.687007+0000","last_clean_scrub_stamp":"2024-04-24T01:47:13.687007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:32.559784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.339389+0000","last_change":"2024-04-24T01:46:09.339389+0000","last_active":"2024-04-24T01:46:09.339389+0000","last_peered":"2024-04-24T01:46:09.339389+0000","last_clean":"2024-04-24T01:46:09.339389+0000","last_became_active":"2024-04-24T01:42:44.776515+0000","last_became_peered":"2024-04-24T01:42:44.776515+0000","last_unstale":"2024-04-24T01:46:09.339389+0000","last_undegraded":"2024-04-24T01:46:09.339389+0000","last_fullsized":"2024-04-24T01:46:09.339389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:09.339282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.339282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:41:17.983913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'104","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.891513+0000","last_change":"2024-04-24T01:46:07.891513+0000","last_active":"2024-04-24T01:46:07.891513+0000","last_peered":"2024-04-24T01:46:07.891513+0000","last_clean":"2024-04-24T01:46:07.891513+0000","last_became_active":"2024-04-24T01:42:46.781443+0000","last_became_peered":"2024-04-24T01:42:46.781443+0000","last_unstale":"2024-04-24T01:46:07.891513+0000","last_undegraded":"2024-04-24T01:46:07.891513+0000","last_fullsized":"2024-04-24T01:46:07.891513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'104","last_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_deep_scrub":"34'104","last_deep_scrub_stamp":"2024-04-24T01:46:07.891371+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.891371+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.493980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.166279+0000","last_change":"2024-04-24T01:46:13.166279+0000","last_active":"2024-04-24T01:46:13.166279+0000","last_peered":"2024-04-24T01:46:13.166279+0000","last_clean":"2024-04-24T01:46:13.166279+0000","last_became_active":"2024-04-24T01:42:48.791164+0000","last_became_peered":"2024-04-24T01:42:48.791164+0000","last_unstale":"2024-04-24T01:46:13.166279+0000","last_undegraded":"2024-04-24T01:46:13.166279+0000","last_fullsized":"2024-04-24T01:46:13.166279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.166175+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.166175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:35.987875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.893005+0000","last_change":"2024-04-24T01:46:14.893005+0000","last_active":"2024-04-24T01:46:14.893005+0000","last_peered":"2024-04-24T01:46:14.893005+0000","last_clean":"2024-04-24T01:46:14.893005+0000","last_became_active":"2024-04-24T01:42:50.791078+0000","last_became_peered":"2024-04-24T01:42:50.791078+0000","last_unstale":"2024-04-24T01:46:14.893005+0000","last_undegraded":"2024-04-24T01:46:14.893005+0000","last_fullsized":"2024-04-24T01:46:14.893005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:14.892893+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.892893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:00.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:51.000042+0000","last_change":"2024-04-24T01:46:51.000042+0000","last_active":"2024-04-24T01:46:51.000042+0000","last_peered":"2024-04-24T01:46:51.000042+0000","last_clean":"2024-04-24T01:46:51.000042+0000","last_became_active":"2024-04-24T01:42:50.799930+0000","last_became_peered":"2024-04-24T01:42:50.799930+0000","last_unstale":"2024-04-24T01:46:51.000042+0000","last_undegraded":"2024-04-24T01:46:51.000042+0000","last_fullsized":"2024-04-24T01:46:51.000042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.999930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.999930+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.999930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:21:28.174222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.778252+0000","last_change":"2024-04-24T01:46:23.778252+0000","last_active":"2024-04-24T01:46:23.778252+0000","last_peered":"2024-04-24T01:46:23.778252+0000","last_clean":"2024-04-24T01:46:23.778252+0000","last_became_active":"2024-04-24T01:42:42.790787+0000","last_became_peered":"2024-04-24T01:42:42.790787+0000","last_unstale":"2024-04-24T01:46:23.778252+0000","last_undegraded":"2024-04-24T01:46:23.778252+0000","last_fullsized":"2024-04-24T01:46:23.778252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:23.778097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.778097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:35.360382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:15.686301+0000","last_change":"2024-04-24T01:47:15.686301+0000","last_active":"2024-04-24T01:47:15.686301+0000","last_peered":"2024-04-24T01:47:15.686301+0000","last_clean":"2024-04-24T01:47:15.686301+0000","last_became_active":"2024-04-24T01:42:40.775736+0000","last_became_peered":"2024-04-24T01:42:40.775736+0000","last_unstale":"2024-04-24T01:47:15.686301+0000","last_undegraded":"2024-04-24T01:47:15.686301+0000","last_fullsized":"2024-04-24T01:47:15.686301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:15.686173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:15.686173+0000","last_clean_scrub_stamp":"2024-04-24T01:47:15.686173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:06:49.936416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:13.657398+0000","last_change":"2024-04-24T01:46:13.657398+0000","last_active":"2024-04-24T01:46:13.657398+0000","last_peered":"2024-04-24T01:46:13.657398+0000","last_clean":"2024-04-24T01:46:13.657398+0000","last_became_active":"2024-04-24T01:42:44.775217+0000","last_became_peered":"2024-04-24T01:42:44.775217+0000","last_unstale":"2024-04-24T01:46:13.657398+0000","last_undegraded":"2024-04-24T01:46:13.657398+0000","last_fullsized":"2024-04-24T01:46:13.657398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:13.657273+0000","last_clean_scrub_stamp":"2024-04-24T01:46:13.657273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:54.140958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.290116+0000","last_change":"2024-04-24T01:46:11.290116+0000","last_active":"2024-04-24T01:46:11.290116+0000","last_peered":"2024-04-24T01:46:11.290116+0000","last_clean":"2024-04-24T01:46:11.290116+0000","last_became_active":"2024-04-24T01:42:46.779597+0000","last_became_peered":"2024-04-24T01:42:46.779597+0000","last_unstale":"2024-04-24T01:46:11.290116+0000","last_undegraded":"2024-04-24T01:46:11.290116+0000","last_fullsized":"2024-04-24T01:46:11.290116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:11.289983+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.289983+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:25.084406+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:21.324364+0000","last_change":"2024-04-24T01:46:21.324364+0000","last_active":"2024-04-24T01:46:21.324364+0000","last_peered":"2024-04-24T01:46:21.324364+0000","last_clean":"2024-04-24T01:46:21.324364+0000","last_became_active":"2024-04-24T01:42:48.786122+0000","last_became_peered":"2024-04-24T01:42:48.786122+0000","last_unstale":"2024-04-24T01:46:21.324364+0000","last_undegraded":"2024-04-24T01:46:21.324364+0000","last_fullsized":"2024-04-24T01:46:21.324364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:21.324188+0000","last_clean_scrub_stamp":"2024-04-24T01:46:21.324188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:58.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:01.965715+0000","last_change":"2024-04-24T01:47:01.965742+0000","last_active":"2024-04-24T01:47:01.965715+0000","last_peered":"2024-04-24T01:47:01.965715+0000","last_clean":"2024-04-24T01:47:01.965715+0000","last_became_active":"2024-04-24T01:42:50.802164+0000","last_became_peered":"2024-04-24T01:42:50.802164+0000","last_unstale":"2024-04-24T01:47:01.965715+0000","last_undegraded":"2024-04-24T01:47:01.965715+0000","last_fullsized":"2024-04-24T01:47:01.965715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:47:01.965621+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:47:01.965621+0000","last_clean_scrub_stamp":"2024-04-24T01:47:01.965621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:53.556941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.748224+0000","last_change":"2024-04-24T01:46:31.748224+0000","last_active":"2024-04-24T01:46:31.748224+0000","last_peered":"2024-04-24T01:46:31.748224+0000","last_clean":"2024-04-24T01:46:31.748224+0000","last_became_active":"2024-04-24T01:42:42.781062+0000","last_became_peered":"2024-04-24T01:42:42.781062+0000","last_unstale":"2024-04-24T01:46:31.748224+0000","last_undegraded":"2024-04-24T01:46:31.748224+0000","last_fullsized":"2024-04-24T01:46:31.748224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:31.748068+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.748068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:58.027530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:31.830423+0000","last_change":"2024-04-24T01:46:31.830423+0000","last_active":"2024-04-24T01:46:31.830423+0000","last_peered":"2024-04-24T01:46:31.830423+0000","last_clean":"2024-04-24T01:46:31.830423+0000","last_became_active":"2024-04-24T01:42:40.782698+0000","last_became_peered":"2024-04-24T01:42:40.782698+0000","last_unstale":"2024-04-24T01:46:31.830423+0000","last_undegraded":"2024-04-24T01:46:31.830423+0000","last_fullsized":"2024-04-24T01:46:31.830423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:31.830255+0000","last_clean_scrub_stamp":"2024-04-24T01:46:31.830255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:38.220407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.257440+0000","last_change":"2024-04-24T01:46:04.257440+0000","last_active":"2024-04-24T01:46:04.257440+0000","last_peered":"2024-04-24T01:46:04.257440+0000","last_clean":"2024-04-24T01:46:04.257440+0000","last_became_active":"2024-04-24T01:42:44.777200+0000","last_became_peered":"2024-04-24T01:42:44.777200+0000","last_unstale":"2024-04-24T01:46:04.257440+0000","last_undegraded":"2024-04-24T01:46:04.257440+0000","last_fullsized":"2024-04-24T01:46:04.257440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.257282+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.257282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:11:20.008478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:14.173677+0000","last_change":"2024-04-24T01:46:14.173677+0000","last_active":"2024-04-24T01:46:14.173677+0000","last_peered":"2024-04-24T01:46:14.173677+0000","last_clean":"2024-04-24T01:46:14.173677+0000","last_became_active":"2024-04-24T01:42:46.775850+0000","last_became_peered":"2024-04-24T01:42:46.775850+0000","last_unstale":"2024-04-24T01:46:14.173677+0000","last_undegraded":"2024-04-24T01:46:14.173677+0000","last_fullsized":"2024-04-24T01:46:14.173677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:14.173554+0000","last_clean_scrub_stamp":"2024-04-24T01:46:14.173554+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:46.693848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.821203+0000","last_change":"2024-04-24T01:46:01.821203+0000","last_active":"2024-04-24T01:46:01.821203+0000","last_peered":"2024-04-24T01:46:01.821203+0000","last_clean":"2024-04-24T01:46:01.821203+0000","last_became_active":"2024-04-24T01:42:48.788994+0000","last_became_peered":"2024-04-24T01:42:48.788994+0000","last_unstale":"2024-04-24T01:46:01.821203+0000","last_undegraded":"2024-04-24T01:46:01.821203+0000","last_fullsized":"2024-04-24T01:46:01.821203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.821055+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.821055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:04:47.582844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.878399+0000","last_change":"2024-04-24T01:46:55.878435+0000","last_active":"2024-04-24T01:46:55.878399+0000","last_peered":"2024-04-24T01:46:55.878399+0000","last_clean":"2024-04-24T01:46:55.878399+0000","last_became_active":"2024-04-24T01:42:50.793075+0000","last_became_peered":"2024-04-24T01:42:50.793075+0000","last_unstale":"2024-04-24T01:46:55.878399+0000","last_undegraded":"2024-04-24T01:46:55.878399+0000","last_fullsized":"2024-04-24T01:46:55.878399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:55.878310+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:55.878310+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.878310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:00.355820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'22","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.102527+0000","last_change":"2024-04-24T01:46:30.102527+0000","last_active":"2024-04-24T01:46:30.102527+0000","last_peered":"2024-04-24T01:46:30.102527+0000","last_clean":"2024-04-24T01:46:30.102527+0000","last_became_active":"2024-04-24T01:42:42.790127+0000","last_became_peered":"2024-04-24T01:42:42.790127+0000","last_unstale":"2024-04-24T01:46:30.102527+0000","last_undegraded":"2024-04-24T01:46:30.102527+0000","last_fullsized":"2024-04-24T01:46:30.102527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:30.102347+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.102347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:37.775249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":71,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.971498+0000","last_change":"2024-04-24T01:46:46.971498+0000","last_active":"2024-04-24T01:46:46.971498+0000","last_peered":"2024-04-24T01:46:46.971498+0000","last_clean":"2024-04-24T01:46:46.971498+0000","last_became_active":"2024-04-24T01:42:40.776932+0000","last_became_peered":"2024-04-24T01:42:40.776932+0000","last_unstale":"2024-04-24T01:46:46.971498+0000","last_undegraded":"2024-04-24T01:46:46.971498+0000","last_fullsized":"2024-04-24T01:46:46.971498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:46.971350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:46.971350+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.971350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:46.898467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:15.846094+0000","last_change":"2024-04-24T01:46:15.846094+0000","last_active":"2024-04-24T01:46:15.846094+0000","last_peered":"2024-04-24T01:46:15.846094+0000","last_clean":"2024-04-24T01:46:15.846094+0000","last_became_active":"2024-04-24T01:42:44.779441+0000","last_became_peered":"2024-04-24T01:42:44.779441+0000","last_unstale":"2024-04-24T01:46:15.846094+0000","last_undegraded":"2024-04-24T01:46:15.846094+0000","last_fullsized":"2024-04-24T01:46:15.846094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:15.845975+0000","last_clean_scrub_stamp":"2024-04-24T01:46:15.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:10.556639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:08.247891+0000","last_change":"2024-04-24T01:46:08.247891+0000","last_active":"2024-04-24T01:46:08.247891+0000","last_peered":"2024-04-24T01:46:08.247891+0000","last_clean":"2024-04-24T01:46:08.247891+0000","last_became_active":"2024-04-24T01:42:46.778971+0000","last_became_peered":"2024-04-24T01:42:46.778971+0000","last_unstale":"2024-04-24T01:46:08.247891+0000","last_undegraded":"2024-04-24T01:46:08.247891+0000","last_fullsized":"2024-04-24T01:46:08.247891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:46:08.247768+0000","last_clean_scrub_stamp":"2024-04-24T01:46:08.247768+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:06:04.087642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.609659+0000","last_change":"2024-04-24T01:46:12.609659+0000","last_active":"2024-04-24T01:46:12.609659+0000","last_peered":"2024-04-24T01:46:12.609659+0000","last_clean":"2024-04-24T01:46:12.609659+0000","last_became_active":"2024-04-24T01:42:48.790638+0000","last_became_peered":"2024-04-24T01:42:48.790638+0000","last_unstale":"2024-04-24T01:46:12.609659+0000","last_undegraded":"2024-04-24T01:46:12.609659+0000","last_fullsized":"2024-04-24T01:46:12.609659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:12.609553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.609553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:24:25.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:19.667564+0000","last_change":"2024-04-24T01:47:19.667595+0000","last_active":"2024-04-24T01:47:19.667564+0000","last_peered":"2024-04-24T01:47:19.667564+0000","last_clean":"2024-04-24T01:47:19.667564+0000","last_became_active":"2024-04-24T01:42:50.800771+0000","last_became_peered":"2024-04-24T01:42:50.800771+0000","last_unstale":"2024-04-24T01:47:19.667564+0000","last_undegraded":"2024-04-24T01:47:19.667564+0000","last_fullsized":"2024-04-24T01:47:19.667564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:19.667472+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:19.667472+0000","last_clean_scrub_stamp":"2024-04-24T01:47:19.667472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:08:45.916278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:18.327664+0000","last_change":"2024-04-24T01:46:18.327664+0000","last_active":"2024-04-24T01:46:18.327664+0000","last_peered":"2024-04-24T01:46:18.327664+0000","last_clean":"2024-04-24T01:46:18.327664+0000","last_became_active":"2024-04-24T01:42:42.786000+0000","last_became_peered":"2024-04-24T01:42:42.786000+0000","last_unstale":"2024-04-24T01:46:18.327664+0000","last_undegraded":"2024-04-24T01:46:18.327664+0000","last_fullsized":"2024-04-24T01:46:18.327664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:18.327548+0000","last_clean_scrub_stamp":"2024-04-24T01:46:18.327548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:36.700735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.594312+0000","last_change":"2024-04-24T01:46:45.594312+0000","last_active":"2024-04-24T01:46:45.594312+0000","last_peered":"2024-04-24T01:46:45.594312+0000","last_clean":"2024-04-24T01:46:45.594312+0000","last_became_active":"2024-04-24T01:42:40.789095+0000","last_became_peered":"2024-04-24T01:42:40.789095+0000","last_unstale":"2024-04-24T01:46:45.594312+0000","last_undegraded":"2024-04-24T01:46:45.594312+0000","last_fullsized":"2024-04-24T01:46:45.594312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:45.594150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:45.594150+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.594150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:47.377188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.312308+0000","last_change":"2024-04-24T01:46:10.312308+0000","last_active":"2024-04-24T01:46:10.312308+0000","last_peered":"2024-04-24T01:46:10.312308+0000","last_clean":"2024-04-24T01:46:10.312308+0000","last_became_active":"2024-04-24T01:42:44.775567+0000","last_became_peered":"2024-04-24T01:42:44.775567+0000","last_unstale":"2024-04-24T01:46:10.312308+0000","last_undegraded":"2024-04-24T01:46:10.312308+0000","last_fullsized":"2024-04-24T01:46:10.312308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:10.312190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.312190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:07.102122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.806479+0000","last_change":"2024-04-24T01:46:12.806479+0000","last_active":"2024-04-24T01:46:12.806479+0000","last_peered":"2024-04-24T01:46:12.806479+0000","last_clean":"2024-04-24T01:46:12.806479+0000","last_became_active":"2024-04-24T01:42:46.777356+0000","last_became_peered":"2024-04-24T01:42:46.777356+0000","last_unstale":"2024-04-24T01:46:12.806479+0000","last_undegraded":"2024-04-24T01:46:12.806479+0000","last_fullsized":"2024-04-24T01:46:12.806479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:46:12.806352+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.806352+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:58.427653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:03.869117+0000","last_change":"2024-04-24T01:46:03.869117+0000","last_active":"2024-04-24T01:46:03.869117+0000","last_peered":"2024-04-24T01:46:03.869117+0000","last_clean":"2024-04-24T01:46:03.869117+0000","last_became_active":"2024-04-24T01:42:48.783062+0000","last_became_peered":"2024-04-24T01:42:48.783062+0000","last_unstale":"2024-04-24T01:46:03.869117+0000","last_undegraded":"2024-04-24T01:46:03.869117+0000","last_fullsized":"2024-04-24T01:46:03.869117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:03.868982+0000","last_clean_scrub_stamp":"2024-04-24T01:46:03.868982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:27:47.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.097703+0000","last_change":"2024-04-24T01:46:55.097703+0000","last_active":"2024-04-24T01:46:55.097703+0000","last_peered":"2024-04-24T01:46:55.097703+0000","last_clean":"2024-04-24T01:46:55.097703+0000","last_became_active":"2024-04-24T01:43:21.862446+0000","last_became_peered":"2024-04-24T01:43:21.862446+0000","last_unstale":"2024-04-24T01:46:55.097703+0000","last_undegraded":"2024-04-24T01:46:55.097703+0000","last_fullsized":"2024-04-24T01:46:55.097703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:55.097583+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:55.097583+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.097583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:19.009019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:01.610445+0000","last_change":"2024-04-24T01:47:01.610445+0000","last_active":"2024-04-24T01:47:01.610445+0000","last_peered":"2024-04-24T01:47:01.610445+0000","last_clean":"2024-04-24T01:47:01.610445+0000","last_became_active":"2024-04-24T01:42:40.787555+0000","last_became_peered":"2024-04-24T01:42:40.787555+0000","last_unstale":"2024-04-24T01:47:01.610445+0000","last_undegraded":"2024-04-24T01:47:01.610445+0000","last_fullsized":"2024-04-24T01:47:01.610445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:01.610315+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:01.610315+0000","last_clean_scrub_stamp":"2024-04-24T01:47:01.610315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:10.405618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.176864+0000","last_change":"2024-04-24T01:46:24.176864+0000","last_active":"2024-04-24T01:46:24.176864+0000","last_peered":"2024-04-24T01:46:24.176864+0000","last_clean":"2024-04-24T01:46:24.176864+0000","last_became_active":"2024-04-24T01:42:44.773002+0000","last_became_peered":"2024-04-24T01:42:44.773002+0000","last_unstale":"2024-04-24T01:46:24.176864+0000","last_undegraded":"2024-04-24T01:46:24.176864+0000","last_fullsized":"2024-04-24T01:46:24.176864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:24.176757+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.176757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:03.301459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:10.198038+0000","last_change":"2024-04-24T01:46:10.198112+0000","last_active":"2024-04-24T01:46:10.198038+0000","last_peered":"2024-04-24T01:46:10.198038+0000","last_clean":"2024-04-24T01:46:10.198038+0000","last_became_active":"2024-04-24T01:42:46.777689+0000","last_became_peered":"2024-04-24T01:42:46.777689+0000","last_unstale":"2024-04-24T01:46:10.198038+0000","last_undegraded":"2024-04-24T01:46:10.198038+0000","last_fullsized":"2024-04-24T01:46:10.198038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:46:10.197934+0000","last_clean_scrub_stamp":"2024-04-24T01:46:10.197934+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:55.839910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.889685+0000","last_change":"2024-04-24T01:46:04.889720+0000","last_active":"2024-04-24T01:46:04.889685+0000","last_peered":"2024-04-24T01:46:04.889685+0000","last_clean":"2024-04-24T01:46:04.889685+0000","last_became_active":"2024-04-24T01:42:48.782152+0000","last_became_peered":"2024-04-24T01:42:48.782152+0000","last_unstale":"2024-04-24T01:46:04.889685+0000","last_undegraded":"2024-04-24T01:46:04.889685+0000","last_fullsized":"2024-04-24T01:46:04.889685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.889593+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.889593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:29.941134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:59.982020+0000","last_change":"2024-04-24T01:46:59.982020+0000","last_active":"2024-04-24T01:46:59.982020+0000","last_peered":"2024-04-24T01:46:59.982020+0000","last_clean":"2024-04-24T01:46:59.982020+0000","last_became_active":"2024-04-24T01:42:50.794603+0000","last_became_peered":"2024-04-24T01:42:50.794603+0000","last_unstale":"2024-04-24T01:46:59.982020+0000","last_undegraded":"2024-04-24T01:46:59.982020+0000","last_fullsized":"2024-04-24T01:46:59.982020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:46:59.981903+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:46:59.981903+0000","last_clean_scrub_stamp":"2024-04-24T01:46:59.981903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:17.961774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.006935+0000","last_change":"2024-04-24T01:46:39.006935+0000","last_active":"2024-04-24T01:46:39.006935+0000","last_peered":"2024-04-24T01:46:39.006935+0000","last_clean":"2024-04-24T01:46:39.006935+0000","last_became_active":"2024-04-24T01:42:42.783119+0000","last_became_peered":"2024-04-24T01:42:42.783119+0000","last_unstale":"2024-04-24T01:46:39.006935+0000","last_undegraded":"2024-04-24T01:46:39.006935+0000","last_fullsized":"2024-04-24T01:46:39.006935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-04-24T01:46:39.006790+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.006790+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:00.354935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.670814+0000","last_change":"2024-04-24T01:46:52.670814+0000","last_active":"2024-04-24T01:46:52.670814+0000","last_peered":"2024-04-24T01:46:52.670814+0000","last_clean":"2024-04-24T01:46:52.670814+0000","last_became_active":"2024-04-24T01:42:40.788448+0000","last_became_peered":"2024-04-24T01:42:40.788448+0000","last_unstale":"2024-04-24T01:46:52.670814+0000","last_undegraded":"2024-04-24T01:46:52.670814+0000","last_fullsized":"2024-04-24T01:46:52.670814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:52.670660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:52.670660+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.670660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:26.413731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.846187+0000","last_change":"2024-04-24T01:46:20.846187+0000","last_active":"2024-04-24T01:46:20.846187+0000","last_peered":"2024-04-24T01:46:20.846187+0000","last_clean":"2024-04-24T01:46:20.846187+0000","last_became_active":"2024-04-24T01:42:44.774631+0000","last_became_peered":"2024-04-24T01:42:44.774631+0000","last_unstale":"2024-04-24T01:46:20.846187+0000","last_undegraded":"2024-04-24T01:46:20.846187+0000","last_fullsized":"2024-04-24T01:46:20.846187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.846022+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.846022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:44.249657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.332061+0000","last_change":"2024-04-24T01:46:28.332109+0000","last_active":"2024-04-24T01:46:28.332061+0000","last_peered":"2024-04-24T01:46:28.332061+0000","last_clean":"2024-04-24T01:46:28.332061+0000","last_became_active":"2024-04-24T01:42:46.782876+0000","last_became_peered":"2024-04-24T01:42:46.782876+0000","last_unstale":"2024-04-24T01:46:28.332061+0000","last_undegraded":"2024-04-24T01:46:28.332061+0000","last_fullsized":"2024-04-24T01:46:28.332061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:28.331976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.331976+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:47:29.283395+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:16.676027+0000","last_change":"2024-04-24T01:46:16.676052+0000","last_active":"2024-04-24T01:46:16.676027+0000","last_peered":"2024-04-24T01:46:16.676027+0000","last_clean":"2024-04-24T01:46:16.676027+0000","last_became_active":"2024-04-24T01:42:48.790783+0000","last_became_peered":"2024-04-24T01:42:48.790783+0000","last_unstale":"2024-04-24T01:46:16.676027+0000","last_undegraded":"2024-04-24T01:46:16.676027+0000","last_fullsized":"2024-04-24T01:46:16.676027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:16.675939+0000","last_clean_scrub_stamp":"2024-04-24T01:46:16.675939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:00.108736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:43.459800+0000","last_change":"2024-04-24T01:46:43.459800+0000","last_active":"2024-04-24T01:46:43.459800+0000","last_peered":"2024-04-24T01:46:43.459800+0000","last_clean":"2024-04-24T01:46:43.459800+0000","last_became_active":"2024-04-24T01:42:50.797540+0000","last_became_peered":"2024-04-24T01:42:50.797540+0000","last_unstale":"2024-04-24T01:46:43.459800+0000","last_undegraded":"2024-04-24T01:46:43.459800+0000","last_fullsized":"2024-04-24T01:46:43.459800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:43.459683+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:43.459683+0000","last_clean_scrub_stamp":"2024-04-24T01:46:43.459683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:38:34.496131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:20.302166+0000","last_change":"2024-04-24T01:46:20.302191+0000","last_active":"2024-04-24T01:46:20.302166+0000","last_peered":"2024-04-24T01:46:20.302166+0000","last_clean":"2024-04-24T01:46:20.302166+0000","last_became_active":"2024-04-24T01:42:42.785458+0000","last_became_peered":"2024-04-24T01:42:42.785458+0000","last_unstale":"2024-04-24T01:46:20.302166+0000","last_undegraded":"2024-04-24T01:46:20.302166+0000","last_fullsized":"2024-04-24T01:46:20.302166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:20.302076+0000","last_clean_scrub_stamp":"2024-04-24T01:46:20.302076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:18.662863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.609040+0000","last_change":"2024-04-24T01:46:47.609040+0000","last_active":"2024-04-24T01:46:47.609040+0000","last_peered":"2024-04-24T01:46:47.609040+0000","last_clean":"2024-04-24T01:46:47.609040+0000","last_became_active":"2024-04-24T01:42:40.769384+0000","last_became_peered":"2024-04-24T01:42:40.769384+0000","last_unstale":"2024-04-24T01:46:47.609040+0000","last_undegraded":"2024-04-24T01:46:47.609040+0000","last_fullsized":"2024-04-24T01:46:47.609040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:47.608894+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:47.608894+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.608894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:11.183336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.842016+0000","last_change":"2024-04-24T01:46:19.842038+0000","last_active":"2024-04-24T01:46:19.842016+0000","last_peered":"2024-04-24T01:46:19.842016+0000","last_clean":"2024-04-24T01:46:19.842016+0000","last_became_active":"2024-04-24T01:42:44.774699+0000","last_became_peered":"2024-04-24T01:42:44.774699+0000","last_unstale":"2024-04-24T01:46:19.842016+0000","last_undegraded":"2024-04-24T01:46:19.842016+0000","last_fullsized":"2024-04-24T01:46:19.842016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:19.841928+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.841928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:50:06.176480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:12.208833+0000","last_change":"2024-04-24T01:46:12.208833+0000","last_active":"2024-04-24T01:46:12.208833+0000","last_peered":"2024-04-24T01:46:12.208833+0000","last_clean":"2024-04-24T01:46:12.208833+0000","last_became_active":"2024-04-24T01:42:46.776835+0000","last_became_peered":"2024-04-24T01:42:46.776835+0000","last_unstale":"2024-04-24T01:46:12.208833+0000","last_undegraded":"2024-04-24T01:46:12.208833+0000","last_fullsized":"2024-04-24T01:46:12.208833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:46:12.208700+0000","last_clean_scrub_stamp":"2024-04-24T01:46:12.208700+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:29.667207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:04.222190+0000","last_change":"2024-04-24T01:46:04.222190+0000","last_active":"2024-04-24T01:46:04.222190+0000","last_peered":"2024-04-24T01:46:04.222190+0000","last_clean":"2024-04-24T01:46:04.222190+0000","last_became_active":"2024-04-24T01:42:48.783542+0000","last_became_peered":"2024-04-24T01:42:48.783542+0000","last_unstale":"2024-04-24T01:46:04.222190+0000","last_undegraded":"2024-04-24T01:46:04.222190+0000","last_fullsized":"2024-04-24T01:46:04.222190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:04.222084+0000","last_clean_scrub_stamp":"2024-04-24T01:46:04.222084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:26.106809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:24.713363+0000","last_change":"2024-04-24T01:47:24.713363+0000","last_active":"2024-04-24T01:47:24.713363+0000","last_peered":"2024-04-24T01:47:24.713363+0000","last_clean":"2024-04-24T01:47:24.713363+0000","last_became_active":"2024-04-24T01:42:50.803756+0000","last_became_peered":"2024-04-24T01:42:50.803756+0000","last_unstale":"2024-04-24T01:47:24.713363+0000","last_undegraded":"2024-04-24T01:47:24.713363+0000","last_fullsized":"2024-04-24T01:47:24.713363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:47:24.713229+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:47:24.713229+0000","last_clean_scrub_stamp":"2024-04-24T01:47:24.713229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:16.970870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.060904+0000","last_change":"2024-04-24T01:46:35.060928+0000","last_active":"2024-04-24T01:46:35.060904+0000","last_peered":"2024-04-24T01:46:35.060904+0000","last_clean":"2024-04-24T01:46:35.060904+0000","last_became_active":"2024-04-24T01:42:42.775940+0000","last_became_peered":"2024-04-24T01:42:42.775940+0000","last_unstale":"2024-04-24T01:46:35.060904+0000","last_undegraded":"2024-04-24T01:46:35.060904+0000","last_fullsized":"2024-04-24T01:46:35.060904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:35.060814+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.060814+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:10.400767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.498321+0000","last_change":"2024-04-24T01:46:50.498321+0000","last_active":"2024-04-24T01:46:50.498321+0000","last_peered":"2024-04-24T01:46:50.498321+0000","last_clean":"2024-04-24T01:46:50.498321+0000","last_became_active":"2024-04-24T01:42:40.790676+0000","last_became_peered":"2024-04-24T01:42:40.790676+0000","last_unstale":"2024-04-24T01:46:50.498321+0000","last_undegraded":"2024-04-24T01:46:50.498321+0000","last_fullsized":"2024-04-24T01:46:50.498321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:50.498211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:50.498211+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.498211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:11.641334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.688836+0000","last_change":"2024-04-24T01:46:17.688868+0000","last_active":"2024-04-24T01:46:17.688836+0000","last_peered":"2024-04-24T01:46:17.688836+0000","last_clean":"2024-04-24T01:46:17.688836+0000","last_became_active":"2024-04-24T01:42:44.775123+0000","last_became_peered":"2024-04-24T01:42:44.775123+0000","last_unstale":"2024-04-24T01:46:17.688836+0000","last_undegraded":"2024-04-24T01:46:17.688836+0000","last_fullsized":"2024-04-24T01:46:17.688836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.688748+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.688748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:53.186579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.316258+0000","last_change":"2024-04-24T01:46:25.316258+0000","last_active":"2024-04-24T01:46:25.316258+0000","last_peered":"2024-04-24T01:46:25.316258+0000","last_clean":"2024-04-24T01:46:25.316258+0000","last_became_active":"2024-04-24T01:42:46.784729+0000","last_became_peered":"2024-04-24T01:42:46.784729+0000","last_unstale":"2024-04-24T01:46:25.316258+0000","last_undegraded":"2024-04-24T01:46:25.316258+0000","last_fullsized":"2024-04-24T01:46:25.316258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:25.316122+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.316122+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:09.639811+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:02.864906+0000","last_change":"2024-04-24T01:46:02.864906+0000","last_active":"2024-04-24T01:46:02.864906+0000","last_peered":"2024-04-24T01:46:02.864906+0000","last_clean":"2024-04-24T01:46:02.864906+0000","last_became_active":"2024-04-24T01:42:48.791087+0000","last_became_peered":"2024-04-24T01:42:48.791087+0000","last_unstale":"2024-04-24T01:46:02.864906+0000","last_undegraded":"2024-04-24T01:46:02.864906+0000","last_fullsized":"2024-04-24T01:46:02.864906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:46:02.864778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:02.864778+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:58.138209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:47.555558+0000","last_change":"2024-04-24T01:46:47.555558+0000","last_active":"2024-04-24T01:46:47.555558+0000","last_peered":"2024-04-24T01:46:47.555558+0000","last_clean":"2024-04-24T01:46:47.555558+0000","last_became_active":"2024-04-24T01:42:50.798012+0000","last_became_peered":"2024-04-24T01:42:50.798012+0000","last_unstale":"2024-04-24T01:46:47.555558+0000","last_undegraded":"2024-04-24T01:46:47.555558+0000","last_fullsized":"2024-04-24T01:46:47.555558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:47.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:47.555434+0000","last_clean_scrub_stamp":"2024-04-24T01:46:47.555434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:37.166499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:28.731138+0000","last_change":"2024-04-24T01:46:28.731165+0000","last_active":"2024-04-24T01:46:28.731138+0000","last_peered":"2024-04-24T01:46:28.731138+0000","last_clean":"2024-04-24T01:46:28.731138+0000","last_became_active":"2024-04-24T01:42:42.779427+0000","last_became_peered":"2024-04-24T01:42:42.779427+0000","last_unstale":"2024-04-24T01:46:28.731138+0000","last_undegraded":"2024-04-24T01:46:28.731138+0000","last_fullsized":"2024-04-24T01:46:28.731138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:28.731048+0000","last_clean_scrub_stamp":"2024-04-24T01:46:28.731048+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:37.095746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:50.672639+0000","last_change":"2024-04-24T01:46:50.672639+0000","last_active":"2024-04-24T01:46:50.672639+0000","last_peered":"2024-04-24T01:46:50.672639+0000","last_clean":"2024-04-24T01:46:50.672639+0000","last_became_active":"2024-04-24T01:42:40.782441+0000","last_became_peered":"2024-04-24T01:42:40.782441+0000","last_unstale":"2024-04-24T01:46:50.672639+0000","last_undegraded":"2024-04-24T01:46:50.672639+0000","last_fullsized":"2024-04-24T01:46:50.672639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:46:50.672502+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:46:50.672502+0000","last_clean_scrub_stamp":"2024-04-24T01:46:50.672502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:33.442436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.603073+0000","last_change":"2024-04-24T01:46:11.603100+0000","last_active":"2024-04-24T01:46:11.603073+0000","last_peered":"2024-04-24T01:46:11.603073+0000","last_clean":"2024-04-24T01:46:11.603073+0000","last_became_active":"2024-04-24T01:42:44.775549+0000","last_became_peered":"2024-04-24T01:42:44.775549+0000","last_unstale":"2024-04-24T01:46:11.603073+0000","last_undegraded":"2024-04-24T01:46:11.603073+0000","last_fullsized":"2024-04-24T01:46:11.603073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:11.602978+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.602978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:50.391941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'77","reported_seq":160,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:06.529785+0000","last_change":"2024-04-24T01:46:06.529785+0000","last_active":"2024-04-24T01:46:06.529785+0000","last_peered":"2024-04-24T01:46:06.529785+0000","last_clean":"2024-04-24T01:46:06.529785+0000","last_became_active":"2024-04-24T01:42:46.775906+0000","last_became_peered":"2024-04-24T01:42:46.775906+0000","last_unstale":"2024-04-24T01:46:06.529785+0000","last_undegraded":"2024-04-24T01:46:06.529785+0000","last_fullsized":"2024-04-24T01:46:06.529785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-04-24T01:46:06.529645+0000","last_clean_scrub_stamp":"2024-04-24T01:46:06.529645+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:07.671634+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":85,"num_read_kb":80,"num_write":48,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:01.248655+0000","last_change":"2024-04-24T01:46:01.248655+0000","last_active":"2024-04-24T01:46:01.248655+0000","last_peered":"2024-04-24T01:46:01.248655+0000","last_clean":"2024-04-24T01:46:01.248655+0000","last_became_active":"2024-04-24T01:42:48.788534+0000","last_became_peered":"2024-04-24T01:42:48.788534+0000","last_unstale":"2024-04-24T01:46:01.248655+0000","last_undegraded":"2024-04-24T01:46:01.248655+0000","last_fullsized":"2024-04-24T01:46:01.248655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:01.248553+0000","last_clean_scrub_stamp":"2024-04-24T01:46:01.248553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:14.454609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:55.663916+0000","last_change":"2024-04-24T01:46:55.663916+0000","last_active":"2024-04-24T01:46:55.663916+0000","last_peered":"2024-04-24T01:46:55.663916+0000","last_clean":"2024-04-24T01:46:55.663916+0000","last_became_active":"2024-04-24T01:42:50.796600+0000","last_became_peered":"2024-04-24T01:42:50.796600+0000","last_unstale":"2024-04-24T01:46:55.663916+0000","last_undegraded":"2024-04-24T01:46:55.663916+0000","last_fullsized":"2024-04-24T01:46:55.663916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:46:55.663784+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:46:55.663784+0000","last_clean_scrub_stamp":"2024-04-24T01:46:55.663784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:17.480072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:24.729913+0000","last_change":"2024-04-24T01:46:24.729938+0000","last_active":"2024-04-24T01:46:24.729913+0000","last_peered":"2024-04-24T01:46:24.729913+0000","last_clean":"2024-04-24T01:46:24.729913+0000","last_became_active":"2024-04-24T01:42:42.779231+0000","last_became_peered":"2024-04-24T01:42:42.779231+0000","last_unstale":"2024-04-24T01:46:24.729913+0000","last_undegraded":"2024-04-24T01:46:24.729913+0000","last_fullsized":"2024-04-24T01:46:24.729913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:24.729803+0000","last_clean_scrub_stamp":"2024-04-24T01:46:24.729803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:38.596795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:03.605559+0000","last_change":"2024-04-24T01:47:03.605559+0000","last_active":"2024-04-24T01:47:03.605559+0000","last_peered":"2024-04-24T01:47:03.605559+0000","last_clean":"2024-04-24T01:47:03.605559+0000","last_became_active":"2024-04-24T01:42:40.787728+0000","last_became_peered":"2024-04-24T01:42:40.787728+0000","last_unstale":"2024-04-24T01:47:03.605559+0000","last_undegraded":"2024-04-24T01:47:03.605559+0000","last_fullsized":"2024-04-24T01:47:03.605559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:03.605435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:03.605435+0000","last_clean_scrub_stamp":"2024-04-24T01:47:03.605435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:42.240673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:17.809263+0000","last_change":"2024-04-24T01:46:17.809286+0000","last_active":"2024-04-24T01:46:17.809263+0000","last_peered":"2024-04-24T01:46:17.809263+0000","last_clean":"2024-04-24T01:46:17.809263+0000","last_became_active":"2024-04-24T01:42:44.775466+0000","last_became_peered":"2024-04-24T01:42:44.775466+0000","last_unstale":"2024-04-24T01:46:17.809263+0000","last_undegraded":"2024-04-24T01:46:17.809263+0000","last_fullsized":"2024-04-24T01:46:17.809263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:17.809172+0000","last_clean_scrub_stamp":"2024-04-24T01:46:17.809172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:15:28.587615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:11.187562+0000","last_change":"2024-04-24T01:46:11.187562+0000","last_active":"2024-04-24T01:46:11.187562+0000","last_peered":"2024-04-24T01:46:11.187562+0000","last_clean":"2024-04-24T01:46:11.187562+0000","last_became_active":"2024-04-24T01:42:46.776807+0000","last_became_peered":"2024-04-24T01:42:46.776807+0000","last_unstale":"2024-04-24T01:46:11.187562+0000","last_undegraded":"2024-04-24T01:46:11.187562+0000","last_fullsized":"2024-04-24T01:46:11.187562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:46:11.187375+0000","last_clean_scrub_stamp":"2024-04-24T01:46:11.187375+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:33:05.075069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:22.327330+0000","last_change":"2024-04-24T01:46:22.327330+0000","last_active":"2024-04-24T01:46:22.327330+0000","last_peered":"2024-04-24T01:46:22.327330+0000","last_clean":"2024-04-24T01:46:22.327330+0000","last_became_active":"2024-04-24T01:42:48.784710+0000","last_became_peered":"2024-04-24T01:42:48.784710+0000","last_unstale":"2024-04-24T01:46:22.327330+0000","last_undegraded":"2024-04-24T01:46:22.327330+0000","last_fullsized":"2024-04-24T01:46:22.327330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:22.327198+0000","last_clean_scrub_stamp":"2024-04-24T01:46:22.327198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:51:25.780951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:20.717571+0000","last_change":"2024-04-24T01:47:20.717571+0000","last_active":"2024-04-24T01:47:20.717571+0000","last_peered":"2024-04-24T01:47:20.717571+0000","last_clean":"2024-04-24T01:47:20.717571+0000","last_became_active":"2024-04-24T01:42:50.801428+0000","last_became_peered":"2024-04-24T01:42:50.801428+0000","last_unstale":"2024-04-24T01:47:20.717571+0000","last_undegraded":"2024-04-24T01:47:20.717571+0000","last_fullsized":"2024-04-24T01:47:20.717571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:47:20.717402+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:47:20.717402+0000","last_clean_scrub_stamp":"2024-04-24T01:47:20.717402+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:05.285052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:56.083199+0000","last_change":"2024-04-24T01:46:56.083262+0000","last_active":"2024-04-24T01:46:56.083199+0000","last_peered":"2024-04-24T01:46:56.083199+0000","last_clean":"2024-04-24T01:46:56.083199+0000","last_became_active":"2024-04-24T01:43:21.864091+0000","last_became_peered":"2024-04-24T01:43:21.864091+0000","last_unstale":"2024-04-24T01:46:56.083199+0000","last_undegraded":"2024-04-24T01:46:56.083199+0000","last_fullsized":"2024-04-24T01:46:56.083199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:56.083100+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:56.083100+0000","last_clean_scrub_stamp":"2024-04-24T01:46:56.083100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:39.877101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:46.039300+0000","last_change":"2024-04-24T01:46:46.039351+0000","last_active":"2024-04-24T01:46:46.039300+0000","last_peered":"2024-04-24T01:46:46.039300+0000","last_clean":"2024-04-24T01:46:46.039300+0000","last_became_active":"2024-04-24T01:42:40.777692+0000","last_became_peered":"2024-04-24T01:42:40.777692+0000","last_unstale":"2024-04-24T01:46:46.039300+0000","last_undegraded":"2024-04-24T01:46:46.039300+0000","last_fullsized":"2024-04-24T01:46:46.039300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:46.039190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:46.039190+0000","last_clean_scrub_stamp":"2024-04-24T01:46:46.039190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:23:57.436296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:09.626256+0000","last_change":"2024-04-24T01:46:09.626256+0000","last_active":"2024-04-24T01:46:09.626256+0000","last_peered":"2024-04-24T01:46:09.626256+0000","last_clean":"2024-04-24T01:46:09.626256+0000","last_became_active":"2024-04-24T01:42:44.777862+0000","last_became_peered":"2024-04-24T01:42:44.777862+0000","last_unstale":"2024-04-24T01:46:09.626256+0000","last_undegraded":"2024-04-24T01:46:09.626256+0000","last_fullsized":"2024-04-24T01:46:09.626256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:46:09.626097+0000","last_clean_scrub_stamp":"2024-04-24T01:46:09.626097+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:56.352550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.447709+0000","last_change":"2024-04-24T01:46:32.447742+0000","last_active":"2024-04-24T01:46:32.447709+0000","last_peered":"2024-04-24T01:46:32.447709+0000","last_clean":"2024-04-24T01:46:32.447709+0000","last_became_active":"2024-04-24T01:42:46.782517+0000","last_became_peered":"2024-04-24T01:42:46.782517+0000","last_unstale":"2024-04-24T01:46:32.447709+0000","last_undegraded":"2024-04-24T01:46:32.447709+0000","last_fullsized":"2024-04-24T01:46:32.447709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:46:32.447622+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.447622+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:41:24.256346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.467508+0000","last_change":"2024-04-24T01:46:39.467533+0000","last_active":"2024-04-24T01:46:39.467508+0000","last_peered":"2024-04-24T01:46:39.467508+0000","last_clean":"2024-04-24T01:46:39.467508+0000","last_became_active":"2024-04-24T01:42:48.793334+0000","last_became_peered":"2024-04-24T01:42:48.793334+0000","last_unstale":"2024-04-24T01:46:39.467508+0000","last_undegraded":"2024-04-24T01:46:39.467508+0000","last_fullsized":"2024-04-24T01:46:39.467508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:39.467419+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.467419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:58.802238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:21.696983+0000","last_change":"2024-04-24T01:47:21.696983+0000","last_active":"2024-04-24T01:47:21.696983+0000","last_peered":"2024-04-24T01:47:21.696983+0000","last_clean":"2024-04-24T01:47:21.696983+0000","last_became_active":"2024-04-24T01:42:50.800378+0000","last_became_peered":"2024-04-24T01:42:50.800378+0000","last_unstale":"2024-04-24T01:47:21.696983+0000","last_undegraded":"2024-04-24T01:47:21.696983+0000","last_fullsized":"2024-04-24T01:47:21.696983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:47:21.696868+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:47:21.696868+0000","last_clean_scrub_stamp":"2024-04-24T01:47:21.696868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:11.255962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.657191+0000","last_change":"2024-04-24T01:46:26.657191+0000","last_active":"2024-04-24T01:46:26.657191+0000","last_peered":"2024-04-24T01:46:26.657191+0000","last_clean":"2024-04-24T01:46:26.657191+0000","last_became_active":"2024-04-24T01:42:42.779347+0000","last_became_peered":"2024-04-24T01:42:42.779347+0000","last_unstale":"2024-04-24T01:46:26.657191+0000","last_undegraded":"2024-04-24T01:46:26.657191+0000","last_fullsized":"2024-04-24T01:46:26.657191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:26.657061+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.657061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:13.375971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.675482+0000","last_change":"2024-04-24T01:46:53.675546+0000","last_active":"2024-04-24T01:46:53.675482+0000","last_peered":"2024-04-24T01:46:53.675482+0000","last_clean":"2024-04-24T01:46:53.675482+0000","last_became_active":"2024-04-24T01:42:40.788608+0000","last_became_peered":"2024-04-24T01:42:40.788608+0000","last_unstale":"2024-04-24T01:46:53.675482+0000","last_undegraded":"2024-04-24T01:46:53.675482+0000","last_fullsized":"2024-04-24T01:46:53.675482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.675383+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.675383+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.675383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:20.329284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:07.549244+0000","last_change":"2024-04-24T01:46:07.549244+0000","last_active":"2024-04-24T01:46:07.549244+0000","last_peered":"2024-04-24T01:46:07.549244+0000","last_clean":"2024-04-24T01:46:07.549244+0000","last_became_active":"2024-04-24T01:42:44.778490+0000","last_became_peered":"2024-04-24T01:42:44.778490+0000","last_unstale":"2024-04-24T01:46:07.549244+0000","last_undegraded":"2024-04-24T01:46:07.549244+0000","last_fullsized":"2024-04-24T01:46:07.549244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:07.549082+0000","last_clean_scrub_stamp":"2024-04-24T01:46:07.549082+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:53.170383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:30.365622+0000","last_change":"2024-04-24T01:46:30.365660+0000","last_active":"2024-04-24T01:46:30.365622+0000","last_peered":"2024-04-24T01:46:30.365622+0000","last_clean":"2024-04-24T01:46:30.365622+0000","last_became_active":"2024-04-24T01:42:46.782730+0000","last_became_peered":"2024-04-24T01:42:46.782730+0000","last_unstale":"2024-04-24T01:46:30.365622+0000","last_undegraded":"2024-04-24T01:46:30.365622+0000","last_fullsized":"2024-04-24T01:46:30.365622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:46:30.365531+0000","last_clean_scrub_stamp":"2024-04-24T01:46:30.365531+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:04.108602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:05.233029+0000","last_change":"2024-04-24T01:46:05.233070+0000","last_active":"2024-04-24T01:46:05.233029+0000","last_peered":"2024-04-24T01:46:05.233029+0000","last_clean":"2024-04-24T01:46:05.233029+0000","last_became_active":"2024-04-24T01:42:48.788658+0000","last_became_peered":"2024-04-24T01:42:48.788658+0000","last_unstale":"2024-04-24T01:46:05.233029+0000","last_undegraded":"2024-04-24T01:46:05.233029+0000","last_fullsized":"2024-04-24T01:46:05.233029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:05.232926+0000","last_clean_scrub_stamp":"2024-04-24T01:46:05.232926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:34.699770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:18.647049+0000","last_change":"2024-04-24T01:47:18.647049+0000","last_active":"2024-04-24T01:47:18.647049+0000","last_peered":"2024-04-24T01:47:18.647049+0000","last_clean":"2024-04-24T01:47:18.647049+0000","last_became_active":"2024-04-24T01:42:50.800395+0000","last_became_peered":"2024-04-24T01:42:50.800395+0000","last_unstale":"2024-04-24T01:47:18.647049+0000","last_undegraded":"2024-04-24T01:47:18.647049+0000","last_fullsized":"2024-04-24T01:47:18.647049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:47:18.646940+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:47:18.646940+0000","last_clean_scrub_stamp":"2024-04-24T01:47:18.646940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:57.874461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:19.738791+0000","last_change":"2024-04-24T01:46:19.738791+0000","last_active":"2024-04-24T01:46:19.738791+0000","last_peered":"2024-04-24T01:46:19.738791+0000","last_clean":"2024-04-24T01:46:19.738791+0000","last_became_active":"2024-04-24T01:42:42.790797+0000","last_became_peered":"2024-04-24T01:42:42.790797+0000","last_unstale":"2024-04-24T01:46:19.738791+0000","last_undegraded":"2024-04-24T01:46:19.738791+0000","last_fullsized":"2024-04-24T01:46:19.738791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:46:19.738637+0000","last_clean_scrub_stamp":"2024-04-24T01:46:19.738637+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:33.605630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.003925+0000","last_change":"2024-04-24T01:46:48.003925+0000","last_active":"2024-04-24T01:46:48.003925+0000","last_peered":"2024-04-24T01:46:48.003925+0000","last_clean":"2024-04-24T01:46:48.003925+0000","last_became_active":"2024-04-24T01:42:40.778084+0000","last_became_peered":"2024-04-24T01:42:40.778084+0000","last_unstale":"2024-04-24T01:46:48.003925+0000","last_undegraded":"2024-04-24T01:46:48.003925+0000","last_fullsized":"2024-04-24T01:46:48.003925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:48.003792+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:48.003792+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.003792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:58:51.323040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.009864+0000","last_change":"2024-04-24T01:46:37.009864+0000","last_active":"2024-04-24T01:46:37.009864+0000","last_peered":"2024-04-24T01:46:37.009864+0000","last_clean":"2024-04-24T01:46:37.009864+0000","last_became_active":"2024-04-24T01:42:42.779552+0000","last_became_peered":"2024-04-24T01:42:42.779552+0000","last_unstale":"2024-04-24T01:46:37.009864+0000","last_undegraded":"2024-04-24T01:46:37.009864+0000","last_fullsized":"2024-04-24T01:46:37.009864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:37.009754+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.009754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:24.687137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:36.055589+0000","last_change":"2024-04-24T01:46:36.055589+0000","last_active":"2024-04-24T01:46:36.055589+0000","last_peered":"2024-04-24T01:46:36.055589+0000","last_clean":"2024-04-24T01:46:36.055589+0000","last_became_active":"2024-04-24T01:42:40.780525+0000","last_became_peered":"2024-04-24T01:42:40.780525+0000","last_unstale":"2024-04-24T01:46:36.055589+0000","last_undegraded":"2024-04-24T01:46:36.055589+0000","last_fullsized":"2024-04-24T01:46:36.055589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:36.055479+0000","last_clean_scrub_stamp":"2024-04-24T01:46:36.055479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:08.968901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":129,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.483720+0000","last_change":"2024-04-24T01:46:41.483720+0000","last_active":"2024-04-24T01:46:41.483720+0000","last_peered":"2024-04-24T01:46:41.483720+0000","last_clean":"2024-04-24T01:46:41.483720+0000","last_became_active":"2024-04-24T01:42:42.781692+0000","last_became_peered":"2024-04-24T01:42:42.781692+0000","last_unstale":"2024-04-24T01:46:41.483720+0000","last_undegraded":"2024-04-24T01:46:41.483720+0000","last_fullsized":"2024-04-24T01:46:41.483720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:46:41.483543+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:46:41.483543+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.483543+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:05.658646+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:06.621271+0000","last_change":"2024-04-24T01:47:06.621294+0000","last_active":"2024-04-24T01:47:06.621271+0000","last_peered":"2024-04-24T01:47:06.621271+0000","last_clean":"2024-04-24T01:47:06.621271+0000","last_became_active":"2024-04-24T01:42:40.785284+0000","last_became_peered":"2024-04-24T01:42:40.785284+0000","last_unstale":"2024-04-24T01:47:06.621271+0000","last_undegraded":"2024-04-24T01:47:06.621271+0000","last_fullsized":"2024-04-24T01:47:06.621271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:06.621161+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:06.621161+0000","last_clean_scrub_stamp":"2024-04-24T01:47:06.621161+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:13.725774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.041537+0000","last_change":"2024-04-24T01:46:33.041537+0000","last_active":"2024-04-24T01:46:33.041537+0000","last_peered":"2024-04-24T01:46:33.041537+0000","last_clean":"2024-04-24T01:46:33.041537+0000","last_became_active":"2024-04-24T01:42:42.775290+0000","last_became_peered":"2024-04-24T01:42:42.775290+0000","last_unstale":"2024-04-24T01:46:33.041537+0000","last_undegraded":"2024-04-24T01:46:33.041537+0000","last_fullsized":"2024-04-24T01:46:33.041537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:33.041416+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.041416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:42.167160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:49.009961+0000","last_change":"2024-04-24T01:46:49.009961+0000","last_active":"2024-04-24T01:46:49.009961+0000","last_peered":"2024-04-24T01:46:49.009961+0000","last_clean":"2024-04-24T01:46:49.009961+0000","last_became_active":"2024-04-24T01:42:40.767978+0000","last_became_peered":"2024-04-24T01:42:40.767978+0000","last_unstale":"2024-04-24T01:46:49.009961+0000","last_undegraded":"2024-04-24T01:46:49.009961+0000","last_fullsized":"2024-04-24T01:46:49.009961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:49.009844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:49.009844+0000","last_clean_scrub_stamp":"2024-04-24T01:46:49.009844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:05.993663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.095611+0000","last_change":"2024-04-24T01:46:27.095611+0000","last_active":"2024-04-24T01:46:27.095611+0000","last_peered":"2024-04-24T01:46:27.095611+0000","last_clean":"2024-04-24T01:46:27.095611+0000","last_became_active":"2024-04-24T01:42:42.790458+0000","last_became_peered":"2024-04-24T01:42:42.790458+0000","last_unstale":"2024-04-24T01:46:27.095611+0000","last_undegraded":"2024-04-24T01:46:27.095611+0000","last_fullsized":"2024-04-24T01:46:27.095611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:27.095499+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.095499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:50.346774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.035932+0000","last_change":"2024-04-24T01:46:44.035932+0000","last_active":"2024-04-24T01:46:44.035932+0000","last_peered":"2024-04-24T01:46:44.035932+0000","last_clean":"2024-04-24T01:46:44.035932+0000","last_became_active":"2024-04-24T01:42:40.777711+0000","last_became_peered":"2024-04-24T01:42:40.777711+0000","last_unstale":"2024-04-24T01:46:44.035932+0000","last_undegraded":"2024-04-24T01:46:44.035932+0000","last_fullsized":"2024-04-24T01:46:44.035932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:44.035778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:44.035778+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.035778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:58.233960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:40.617579+0000","last_change":"2024-04-24T01:46:40.617579+0000","last_active":"2024-04-24T01:46:40.617579+0000","last_peered":"2024-04-24T01:46:40.617579+0000","last_clean":"2024-04-24T01:46:40.617579+0000","last_became_active":"2024-04-24T01:42:42.782052+0000","last_became_peered":"2024-04-24T01:42:42.782052+0000","last_unstale":"2024-04-24T01:46:40.617579+0000","last_undegraded":"2024-04-24T01:46:40.617579+0000","last_fullsized":"2024-04-24T01:46:40.617579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:40.617471+0000","last_clean_scrub_stamp":"2024-04-24T01:46:40.617471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:32:40.544588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:37.564301+0000","last_change":"2024-04-24T01:46:37.564301+0000","last_active":"2024-04-24T01:46:37.564301+0000","last_peered":"2024-04-24T01:46:37.564301+0000","last_clean":"2024-04-24T01:46:37.564301+0000","last_became_active":"2024-04-24T01:42:40.792441+0000","last_became_peered":"2024-04-24T01:42:40.792441+0000","last_unstale":"2024-04-24T01:46:37.564301+0000","last_undegraded":"2024-04-24T01:46:37.564301+0000","last_fullsized":"2024-04-24T01:46:37.564301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:37.564177+0000","last_clean_scrub_stamp":"2024-04-24T01:46:37.564177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:54.721595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:41.014543+0000","last_change":"2024-04-24T01:46:41.014543+0000","last_active":"2024-04-24T01:46:41.014543+0000","last_peered":"2024-04-24T01:46:41.014543+0000","last_clean":"2024-04-24T01:46:41.014543+0000","last_became_active":"2024-04-24T01:42:42.783235+0000","last_became_peered":"2024-04-24T01:42:42.783235+0000","last_unstale":"2024-04-24T01:46:41.014543+0000","last_undegraded":"2024-04-24T01:46:41.014543+0000","last_fullsized":"2024-04-24T01:46:41.014543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:41.014392+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:41.014392+0000","last_clean_scrub_stamp":"2024-04-24T01:46:41.014392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:58.382324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:27.684403+0000","last_change":"2024-04-24T01:46:27.684403+0000","last_active":"2024-04-24T01:46:27.684403+0000","last_peered":"2024-04-24T01:46:27.684403+0000","last_clean":"2024-04-24T01:46:27.684403+0000","last_became_active":"2024-04-24T01:42:40.783880+0000","last_became_peered":"2024-04-24T01:42:40.783880+0000","last_unstale":"2024-04-24T01:46:27.684403+0000","last_undegraded":"2024-04-24T01:46:27.684403+0000","last_fullsized":"2024-04-24T01:46:27.684403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:27.684268+0000","last_clean_scrub_stamp":"2024-04-24T01:46:27.684268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:36.612643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.763139+0000","last_change":"2024-04-24T01:46:26.763139+0000","last_active":"2024-04-24T01:46:26.763139+0000","last_peered":"2024-04-24T01:46:26.763139+0000","last_clean":"2024-04-24T01:46:26.763139+0000","last_became_active":"2024-04-24T01:42:42.784508+0000","last_became_peered":"2024-04-24T01:42:42.784508+0000","last_unstale":"2024-04-24T01:46:26.763139+0000","last_undegraded":"2024-04-24T01:46:26.763139+0000","last_fullsized":"2024-04-24T01:46:26.763139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.762976+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.762976+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:08.389668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:52.884016+0000","last_change":"2024-04-24T01:46:52.884016+0000","last_active":"2024-04-24T01:46:52.884016+0000","last_peered":"2024-04-24T01:46:52.884016+0000","last_clean":"2024-04-24T01:46:52.884016+0000","last_became_active":"2024-04-24T01:42:40.773921+0000","last_became_peered":"2024-04-24T01:42:40.773921+0000","last_unstale":"2024-04-24T01:46:52.884016+0000","last_undegraded":"2024-04-24T01:46:52.884016+0000","last_fullsized":"2024-04-24T01:46:52.884016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:52.883890+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:52.883890+0000","last_clean_scrub_stamp":"2024-04-24T01:46:52.883890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:00.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.601104+0000","last_change":"2024-04-24T01:46:38.601104+0000","last_active":"2024-04-24T01:46:38.601104+0000","last_peered":"2024-04-24T01:46:38.601104+0000","last_clean":"2024-04-24T01:46:38.601104+0000","last_became_active":"2024-04-24T01:42:42.783086+0000","last_became_peered":"2024-04-24T01:42:42.783086+0000","last_unstale":"2024-04-24T01:46:38.601104+0000","last_undegraded":"2024-04-24T01:46:38.601104+0000","last_fullsized":"2024-04-24T01:46:38.601104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:38.600952+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.600952+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:11:56.752401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:14.704478+0000","last_change":"2024-04-24T01:47:14.704524+0000","last_active":"2024-04-24T01:47:14.704478+0000","last_peered":"2024-04-24T01:47:14.704478+0000","last_clean":"2024-04-24T01:47:14.704478+0000","last_became_active":"2024-04-24T01:42:40.775910+0000","last_became_peered":"2024-04-24T01:42:40.775910+0000","last_unstale":"2024-04-24T01:47:14.704478+0000","last_undegraded":"2024-04-24T01:47:14.704478+0000","last_fullsized":"2024-04-24T01:47:14.704478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:14.704361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:14.704361+0000","last_clean_scrub_stamp":"2024-04-24T01:47:14.704361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:57.550931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:44.487204+0000","last_change":"2024-04-24T01:46:44.487204+0000","last_active":"2024-04-24T01:46:44.487204+0000","last_peered":"2024-04-24T01:46:44.487204+0000","last_clean":"2024-04-24T01:46:44.487204+0000","last_became_active":"2024-04-24T01:42:42.780441+0000","last_became_peered":"2024-04-24T01:42:42.780441+0000","last_unstale":"2024-04-24T01:46:44.487204+0000","last_undegraded":"2024-04-24T01:46:44.487204+0000","last_fullsized":"2024-04-24T01:46:44.487204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:44.487074+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:44.487074+0000","last_clean_scrub_stamp":"2024-04-24T01:46:44.487074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:02.177404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:53.886566+0000","last_change":"2024-04-24T01:46:53.886566+0000","last_active":"2024-04-24T01:46:53.886566+0000","last_peered":"2024-04-24T01:46:53.886566+0000","last_clean":"2024-04-24T01:46:53.886566+0000","last_became_active":"2024-04-24T01:42:40.774063+0000","last_became_peered":"2024-04-24T01:42:40.774063+0000","last_unstale":"2024-04-24T01:46:53.886566+0000","last_undegraded":"2024-04-24T01:46:53.886566+0000","last_fullsized":"2024-04-24T01:46:53.886566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:53.886386+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:53.886386+0000","last_clean_scrub_stamp":"2024-04-24T01:46:53.886386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:57:58.598237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:26.141005+0000","last_change":"2024-04-24T01:46:26.141005+0000","last_active":"2024-04-24T01:46:26.141005+0000","last_peered":"2024-04-24T01:46:26.141005+0000","last_clean":"2024-04-24T01:46:26.141005+0000","last_became_active":"2024-04-24T01:42:42.790640+0000","last_became_peered":"2024-04-24T01:42:42.790640+0000","last_unstale":"2024-04-24T01:46:26.141005+0000","last_undegraded":"2024-04-24T01:46:26.141005+0000","last_fullsized":"2024-04-24T01:46:26.141005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:26.140882+0000","last_clean_scrub_stamp":"2024-04-24T01:46:26.140882+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:51.458855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:35.584676+0000","last_change":"2024-04-24T01:46:35.584676+0000","last_active":"2024-04-24T01:46:35.584676+0000","last_peered":"2024-04-24T01:46:35.584676+0000","last_clean":"2024-04-24T01:46:35.584676+0000","last_became_active":"2024-04-24T01:42:40.793151+0000","last_became_peered":"2024-04-24T01:42:40.793151+0000","last_unstale":"2024-04-24T01:46:35.584676+0000","last_undegraded":"2024-04-24T01:46:35.584676+0000","last_fullsized":"2024-04-24T01:46:35.584676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:35.584557+0000","last_clean_scrub_stamp":"2024-04-24T01:46:35.584557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:35.921550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:33.671390+0000","last_change":"2024-04-24T01:46:33.671390+0000","last_active":"2024-04-24T01:46:33.671390+0000","last_peered":"2024-04-24T01:46:33.671390+0000","last_clean":"2024-04-24T01:46:33.671390+0000","last_became_active":"2024-04-24T01:42:42.780851+0000","last_became_peered":"2024-04-24T01:42:42.780851+0000","last_unstale":"2024-04-24T01:46:33.671390+0000","last_undegraded":"2024-04-24T01:46:33.671390+0000","last_fullsized":"2024-04-24T01:46:33.671390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:33.671230+0000","last_clean_scrub_stamp":"2024-04-24T01:46:33.671230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:30.461162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:48.634590+0000","last_change":"2024-04-24T01:46:48.634590+0000","last_active":"2024-04-24T01:46:48.634590+0000","last_peered":"2024-04-24T01:46:48.634590+0000","last_clean":"2024-04-24T01:46:48.634590+0000","last_became_active":"2024-04-24T01:42:40.770746+0000","last_became_peered":"2024-04-24T01:42:40.770746+0000","last_unstale":"2024-04-24T01:46:48.634590+0000","last_undegraded":"2024-04-24T01:46:48.634590+0000","last_fullsized":"2024-04-24T01:46:48.634590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:48.634448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:48.634448+0000","last_clean_scrub_stamp":"2024-04-24T01:46:48.634448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:47:05.635594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:32.701837+0000","last_change":"2024-04-24T01:46:32.701837+0000","last_active":"2024-04-24T01:46:32.701837+0000","last_peered":"2024-04-24T01:46:32.701837+0000","last_clean":"2024-04-24T01:46:32.701837+0000","last_became_active":"2024-04-24T01:42:42.781940+0000","last_became_peered":"2024-04-24T01:42:42.781940+0000","last_unstale":"2024-04-24T01:46:32.701837+0000","last_undegraded":"2024-04-24T01:46:32.701837+0000","last_fullsized":"2024-04-24T01:46:32.701837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:32.701691+0000","last_clean_scrub_stamp":"2024-04-24T01:46:32.701691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:25.764735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:04.578785+0000","last_change":"2024-04-24T01:47:04.578785+0000","last_active":"2024-04-24T01:47:04.578785+0000","last_peered":"2024-04-24T01:47:04.578785+0000","last_clean":"2024-04-24T01:47:04.578785+0000","last_became_active":"2024-04-24T01:42:40.785450+0000","last_became_peered":"2024-04-24T01:42:40.785450+0000","last_unstale":"2024-04-24T01:47:04.578785+0000","last_undegraded":"2024-04-24T01:47:04.578785+0000","last_fullsized":"2024-04-24T01:47:04.578785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:04.578633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:04.578633+0000","last_clean_scrub_stamp":"2024-04-24T01:47:04.578633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:08.768260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:29.780528+0000","last_change":"2024-04-24T01:46:29.780528+0000","last_active":"2024-04-24T01:46:29.780528+0000","last_peered":"2024-04-24T01:46:29.780528+0000","last_clean":"2024-04-24T01:46:29.780528+0000","last_became_active":"2024-04-24T01:42:42.783302+0000","last_became_peered":"2024-04-24T01:42:42.783302+0000","last_unstale":"2024-04-24T01:46:29.780528+0000","last_undegraded":"2024-04-24T01:46:29.780528+0000","last_fullsized":"2024-04-24T01:46:29.780528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:46:29.780404+0000","last_clean_scrub_stamp":"2024-04-24T01:46:29.780404+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:24.221782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:54.564325+0000","last_change":"2024-04-24T01:46:54.564325+0000","last_active":"2024-04-24T01:46:54.564325+0000","last_peered":"2024-04-24T01:46:54.564325+0000","last_clean":"2024-04-24T01:46:54.564325+0000","last_became_active":"2024-04-24T01:42:40.785332+0000","last_became_peered":"2024-04-24T01:42:40.785332+0000","last_unstale":"2024-04-24T01:46:54.564325+0000","last_undegraded":"2024-04-24T01:46:54.564325+0000","last_fullsized":"2024-04-24T01:46:54.564325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:46:54.564193+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:46:54.564193+0000","last_clean_scrub_stamp":"2024-04-24T01:46:54.564193+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:36.267776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:38.430544+0000","last_change":"2024-04-24T01:46:38.430544+0000","last_active":"2024-04-24T01:46:38.430544+0000","last_peered":"2024-04-24T01:46:38.430544+0000","last_clean":"2024-04-24T01:46:38.430544+0000","last_became_active":"2024-04-24T01:42:42.782717+0000","last_became_peered":"2024-04-24T01:42:42.782717+0000","last_unstale":"2024-04-24T01:46:38.430544+0000","last_undegraded":"2024-04-24T01:46:38.430544+0000","last_fullsized":"2024-04-24T01:46:38.430544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:46:38.430431+0000","last_clean_scrub_stamp":"2024-04-24T01:46:38.430431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:51.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:39.843242+0000","last_change":"2024-04-24T01:46:39.843242+0000","last_active":"2024-04-24T01:46:39.843242+0000","last_peered":"2024-04-24T01:46:39.843242+0000","last_clean":"2024-04-24T01:46:39.843242+0000","last_became_active":"2024-04-24T01:42:40.779195+0000","last_became_peered":"2024-04-24T01:42:40.779195+0000","last_unstale":"2024-04-24T01:46:39.843242+0000","last_undegraded":"2024-04-24T01:46:39.843242+0000","last_fullsized":"2024-04-24T01:46:39.843242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:46:39.843127+0000","last_clean_scrub_stamp":"2024-04-24T01:46:39.843127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:36.633059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:23.668254+0000","last_change":"2024-04-24T01:46:23.668254+0000","last_active":"2024-04-24T01:46:23.668254+0000","last_peered":"2024-04-24T01:46:23.668254+0000","last_clean":"2024-04-24T01:46:23.668254+0000","last_became_active":"2024-04-24T01:42:42.784453+0000","last_became_peered":"2024-04-24T01:42:42.784453+0000","last_unstale":"2024-04-24T01:46:23.668254+0000","last_undegraded":"2024-04-24T01:46:23.668254+0000","last_fullsized":"2024-04-24T01:46:23.668254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:23.668128+0000","last_clean_scrub_stamp":"2024-04-24T01:46:23.668128+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:28.941092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:02.650397+0000","last_change":"2024-04-24T01:47:02.650397+0000","last_active":"2024-04-24T01:47:02.650397+0000","last_peered":"2024-04-24T01:47:02.650397+0000","last_clean":"2024-04-24T01:47:02.650397+0000","last_became_active":"2024-04-24T01:42:40.785252+0000","last_became_peered":"2024-04-24T01:42:40.785252+0000","last_unstale":"2024-04-24T01:47:02.650397+0000","last_undegraded":"2024-04-24T01:47:02.650397+0000","last_fullsized":"2024-04-24T01:47:02.650397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:47:02.650297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:47:02.650297+0000","last_clean_scrub_stamp":"2024-04-24T01:47:02.650297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:41.826370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:47:08.658030+0000","last_change":"2024-04-24T01:47:08.658030+0000","last_active":"2024-04-24T01:47:08.658030+0000","last_peered":"2024-04-24T01:47:08.658030+0000","last_clean":"2024-04-24T01:47:08.658030+0000","last_became_active":"2024-04-24T01:42:40.778318+0000","last_became_peered":"2024-04-24T01:42:40.778318+0000","last_unstale":"2024-04-24T01:47:08.658030+0000","last_undegraded":"2024-04-24T01:47:08.658030+0000","last_fullsized":"2024-04-24T01:47:08.658030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:47:08.657913+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:47:08.657913+0000","last_clean_scrub_stamp":"2024-04-24T01:47:08.657913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:38.422300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:45.069683+0000","last_change":"2024-04-24T01:46:45.069683+0000","last_active":"2024-04-24T01:46:45.069683+0000","last_peered":"2024-04-24T01:46:45.069683+0000","last_clean":"2024-04-24T01:46:45.069683+0000","last_became_active":"2024-04-24T01:42:42.784890+0000","last_became_peered":"2024-04-24T01:42:42.784890+0000","last_unstale":"2024-04-24T01:46:45.069683+0000","last_undegraded":"2024-04-24T01:46:45.069683+0000","last_fullsized":"2024-04-24T01:46:45.069683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:46:45.069538+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:46:45.069538+0000","last_clean_scrub_stamp":"2024-04-24T01:46:45.069538+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:50:50.879461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:34.023306+0000","last_change":"2024-04-24T01:46:34.023306+0000","last_active":"2024-04-24T01:46:34.023306+0000","last_peered":"2024-04-24T01:46:34.023306+0000","last_clean":"2024-04-24T01:46:34.023306+0000","last_became_active":"2024-04-24T01:42:40.780979+0000","last_became_peered":"2024-04-24T01:42:40.780979+0000","last_unstale":"2024-04-24T01:46:34.023306+0000","last_undegraded":"2024-04-24T01:46:34.023306+0000","last_fullsized":"2024-04-24T01:46:34.023306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:46:34.023152+0000","last_clean_scrub_stamp":"2024-04-24T01:46:34.023152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:00.522740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:46:25.717306+0000","last_change":"2024-04-24T01:46:25.717306+0000","last_active":"2024-04-24T01:46:25.717306+0000","last_peered":"2024-04-24T01:46:25.717306+0000","last_clean":"2024-04-24T01:46:25.717306+0000","last_became_active":"2024-04-24T01:42:42.784419+0000","last_became_peered":"2024-04-24T01:42:42.784419+0000","last_unstale":"2024-04-24T01:46:25.717306+0000","last_undegraded":"2024-04-24T01:46:25.717306+0000","last_fullsized":"2024-04-24T01:46:25.717306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:46:25.717163+0000","last_clean_scrub_stamp":"2024-04-24T01:46:25.717163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:29:26.860189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640323,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":487424,"data_stored":151081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640324,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":737936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640323,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":739109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":148048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:47:43.204 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.322+0000 7f9baab8a640 1 Processor -- start 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.322+0000 7f9baab8a640 1 -- start start 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.322+0000 7f9baab8a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ba41287a0 0x7f9ba41303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.322+0000 7f9baab8a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba4098800 con 0x7f9ba4127cb0 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.322+0000 7f9baab8a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba4127b00 con 0x7f9ba41287a0 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.323+0000 7f9ba8926640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9ba4127cb0 0x7f9ba4128090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55852/0 (socket says 172.21.15.107:55852) 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.323+0000 7f9ba8926640 1 -- 172.21.15.107:0/1606968379 learned_addr learned my addr 172.21.15.107:0/1606968379 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.323+0000 7f9b9bfff640 1 --2- 172.21.15.107:0/1606968379 >> v2:172.21.15.107:3300/0 conn(0x7f9ba41287a0 0x7f9ba41303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.323+0000 7f9b9b7fe640 1 -- 172.21.15.107:0/1606968379 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588558473 0 0) 0x7f9ba4098800 con 0x7f9ba4127cb0 2024-04-24T01:47:43.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.323+0000 7f9b9b7fe640 1 -- 172.21.15.107:0/1606968379 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b8c003520 con 0x7f9ba4127cb0 2024-04-24T01:47:43.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.323+0000 7f9b9bfff640 1 -- 172.21.15.107:0/1606968379 >> v1:172.21.15.107:6789/0 conn(0x7f9ba4127cb0 legacy=0x7f9ba4128090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:43.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.323+0000 7f9b9bfff640 1 -- 172.21.15.107:0/1606968379 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba406f940 con 0x7f9ba41287a0 2024-04-24T01:47:43.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9b9bfff640 1 --2- 172.21.15.107:0/1606968379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba41287a0 0x7f9ba41303c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009720 tx=0x7f9b9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af662781f9c1b2af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:43.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9b9b7fe640 1 -- 172.21.15.107:0/1606968379 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b940316d0 con 0x7f9ba41287a0 2024-04-24T01:47:43.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9b9b7fe640 1 -- 172.21.15.107:0/1606968379 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b94037070 con 0x7f9ba41287a0 2024-04-24T01:47:43.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9b9b7fe640 1 -- 172.21.15.107:0/1606968379 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b940319a0 con 0x7f9ba41287a0 2024-04-24T01:47:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9baab8a640 1 -- 172.21.15.107:0/1606968379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba41287a0 msgr2=0x7f9ba41303c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9baab8a640 1 --2- 172.21.15.107:0/1606968379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba41287a0 0x7f9ba41303c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009720 tx=0x7f9b9402b840 comp rx=0 tx=0).stop 2024-04-24T01:47:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9baab8a640 1 -- 172.21.15.107:0/1606968379 shutdown_connections 2024-04-24T01:47:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9baab8a640 1 --2- 172.21.15.107:0/1606968379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba41287a0 0x7f9ba41303c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9baab8a640 1 -- 172.21.15.107:0/1606968379 >> 172.21.15.107:0/1606968379 conn(0x7f9ba4099680 msgr2=0x7f9ba4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9baab8a640 1 -- 172.21.15.107:0/1606968379 shutdown_connections 2024-04-24T01:47:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.324+0000 7f9baab8a640 1 -- 172.21.15.107:0/1606968379 wait complete. 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.325+0000 7f9baab8a640 1 Processor -- start 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.325+0000 7f9baab8a640 1 -- start start 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.325+0000 7f9baab8a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4127cb0 0x7f9ba41248a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.325+0000 7f9baab8a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba4130900 con 0x7f9ba4127cb0 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9ba8926640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4127cb0 0x7f9ba41248a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9ba8926640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4127cb0 0x7f9ba41248a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57970/0 (socket says 172.21.15.107:57970) 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9ba8926640 1 -- 172.21.15.107:0/2610206342 learned_addr learned my addr 172.21.15.107:0/2610206342 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9ba8926640 1 -- 172.21.15.107:0/2610206342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba408a000 con 0x7f9ba4127cb0 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9ba8926640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4127cb0 0x7f9ba41248a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c3b0 tx=0x7f9ba000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ba0017070 con 0x7f9ba4127cb0 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba0005c10 con 0x7f9ba4127cb0 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba4130190 con 0x7f9ba4127cb0 2024-04-24T01:47:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ba00070d0 con 0x7f9ba4127cb0 2024-04-24T01:47:43.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.326+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba4127620 con 0x7f9ba4127cb0 2024-04-24T01:47:43.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.327+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9ba001a070 con 0x7f9ba4127cb0 2024-04-24T01:47:43.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.327+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba4062da0 con 0x7f9ba4127cb0 2024-04-24T01:47:43.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.327+0000 7f9b997fa640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b90038090 0x7f9b9003a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:47:43.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.327+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9ba004aee0 con 0x7f9ba4127cb0 2024-04-24T01:47:43.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.327+0000 7f9b9bfff640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b90038090 0x7f9b9003a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:47:43.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.328+0000 7f9b9bfff640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b90038090 0x7f9b9003a550 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009720 tx=0x7f9b94008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:47:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.332+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9ba0019e10 con 0x7f9ba4127cb0 2024-04-24T01:47:43.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.506+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9ba4071f80 con 0x7f9ba4127cb0 2024-04-24T01:47:43.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.509+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f9ba0049300 con 0x7f9ba4127cb0 2024-04-24T01:47:43.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.509+0000 7f9b997fa640 1 -- 172.21.15.107:0/2610206342 <== mon.0 v2:172.21.15.107:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ba0010b90 con 0x7f9ba4127cb0 2024-04-24T01:47:43.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b90038090 msgr2=0x7f9b9003a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:43.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b90038090 0x7f9b9003a550 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009720 tx=0x7f9b94008030 comp rx=0 tx=0).stop 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4127cb0 msgr2=0x7f9ba41248a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4127cb0 0x7f9ba41248a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c3b0 tx=0x7f9ba000c870 comp rx=0 tx=0).stop 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 shutdown_connections 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.131:6824/3835564877,v1:172.21.15.131:6825/3835564877] conn(0x7f9b90038090 0x7f9b9003a550 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 --2- 172.21.15.107:0/2610206342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ba4127cb0 0x7f9ba41248a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 >> 172.21.15.107:0/2610206342 conn(0x7f9ba4099680 msgr2=0x7f9ba412c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 shutdown_connections 2024-04-24T01:47:43.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-24T01:47:43.511+0000 7f9baab8a640 1 -- 172.21.15.107:0/2610206342 wait complete. 2024-04-24T01:47:43.522 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T01:47:43.522 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T01:47:43.523 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T01:47:43.523 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:47:43.564 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T01:47:43.564 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T01:47:43.564 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:47:43.604 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T01:47:43.605 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T01:47:43.605 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:47:43.673 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T01:47:43.674 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T01:47:43.674 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:47:43.745 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T01:47:43.745 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T01:47:43.745 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T01:47:43.745 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:47:43.814 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T01:47:43.814 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T01:47:43.814 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T01:47:43.814 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:47:43.825 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T01:47:43.825 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T01:47:43.825 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-24T01:47:43.892 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2024-04-24T01:47:43.892 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T01:47:44.031 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:47:44.031 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T01:47:44.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:47:44.225 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T01:47:44.333 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:47:44.333 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T01:47:44.399 INFO:tasks.ceph:Archiving mon data... 2024-04-24T01:47:44.400 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/data/mon.a.tgz 2024-04-24T01:47:44.400 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-04-24T01:47:44.415 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.Z5VXCIzI6V 2024-04-24T01:47:44.415 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Z5VXCIzI6V 2024-04-24T01:47:44.545 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.Z5VXCIzI6V 2024-04-24T01:47:44.626 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.Z5VXCIzI6V is 270KB 2024-04-24T01:47:44.720 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.Z5VXCIzI6V 2024-04-24T01:47:44.734 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T01:47:44.735 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T01:47:44.776 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T01:47:44.851 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T01:47:44.868 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T01:47:44.868 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T01:47:44.869 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/remote/smithi107/crash 2024-04-24T01:47:44.870 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T01:47:44.914 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/remote/smithi131/crash 2024-04-24T01:47:44.915 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T01:47:44.952 INFO:tasks.ceph:Compressing logs... 2024-04-24T01:47:44.952 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T01:47:44.959 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T01:47:44.979 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30356.log 2024-04-24T01:47:44.979 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31106.log 2024-04-24T01:47:44.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31484.log 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31106.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30356.log.gz 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31484.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31106.log.gz 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30044.log 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31484.log.gz 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26134.log 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30464.log 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.tmp-client.admin.26134.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30044.log.gz 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31442.log 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26134.log.gz 2024-04-24T01:47:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30464.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31442.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30464.log.gz 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30504.log 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31442.log.gz 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31190.log 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29918.log 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31190.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30504.log.gz 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30854.log 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.29918.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31190.log.gz 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31274.log 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29918.log.gz 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27954.log 2024-04-24T01:47:44.996 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30854.log.gz 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31232.log 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.27954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30716.log 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31274.log.gz 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.27954.log.gz 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30544.log 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31232.log.gz 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29862.log 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30716.log.gz 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31064.log 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30544.log.gz 2024-04-24T01:47:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.29862.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29862.log.gz 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27836.log 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31064.log.gz 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30185.log 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.27836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31022.log 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30185.log: 84.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.27836.log.gz -5 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.27997.log 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30185.log.gz 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30187.log 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.27997.log: gzip 86.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.31022.log.gz -- 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr: /var/log/ceph/ceph-client.admin.30503.log 2024-04-24T01:47:44.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30187.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.27997.log.gz 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30632.log 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30187.log.gz 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30296.log 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2%/var/log/ceph/ceph-client.admin.30632.log: -- replaced with /var/log/ceph/ceph-client.admin.30503.log.gz 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30980.log 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30296.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30632.log.gz 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30296.log.gz 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30086.log 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31316.log 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30980.log.gz 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30355.log 2024-04-24T01:47:44.999 INFO:teuthology.orchestra.run.smithi107.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30086.log.gz 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30188.log 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31316.log.gz 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31400.log 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30355.log.gz 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30186.log 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29805.log 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30188.log.gz 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31400.log.gz 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31148.log 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30938.log 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30186.log.gz 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.29805.log: /var/log/ceph/ceph-client.admin.31148.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29805.log.gz 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30812.log 2024-04-24T01:47:45.000 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31148.log.gz 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30896.log 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30938.log: /var/log/ceph/ceph-client.admin.30812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30938.log.gz 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30896.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30812.log.gz 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31524.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30896.log.gz 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29960.log 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30674.log 2024-04-24T01:47:45.001 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.29960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30354.log 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29960.log.gz 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31358.log 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30674.log: /var/log/ceph/ceph-client.admin.30354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30770.log 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30674.log.gz 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30354.log.gz 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.31358.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31358.log.gz 2024-04-24T01:47:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.30770.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30770.log.gz 2024-04-24T01:47:45.028 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68018.log 2024-04-24T01:47:45.029 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43818.log 2024-04-24T01:47:45.029 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.68018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41398.log 2024-04-24T01:47:45.029 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.43818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52893.log 2024-04-24T01:47:45.029 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.41398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83748.log 2024-04-24T01:47:45.050 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.52893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58943.log 2024-04-24T01:47:45.050 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.83748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92188.log 2024-04-24T01:47:45.050 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43818.log.gz 2024-04-24T01:47:45.050 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.58943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61968.log 2024-04-24T01:47:45.050 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41398.log.gz 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.92188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94608.log 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.68018.log.gz 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52893.log.gz 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.61968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63178.log 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83748.log.gz 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46238.log 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.94608.log: /var/log/ceph/ceph-client.0.63178.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.58943.log.gz 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92188.log.gz 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57128.log 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56523.log 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.46238.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61968.log.gz 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.57128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53498.log 2024-04-24T01:47:45.051 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94608.log.gz 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.56523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54708.log 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63178.log.gz 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.53498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44423.log 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46238.log.gz 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.54708.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57128.log.gz 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94003.log 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.44423.log: /var/log/ceph/ceph-client.0.94003.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53498.log.gz 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56523.log.gz 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91583.log 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65598.log 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.0.91583.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54708.log.gz 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51078.log 2024-04-24T01:47:45.052 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44423.log.gz 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.65598.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94003.log.gz 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30287.log 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40188.log 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.51078.log: /var/log/ceph/ceph-client.admin.30287.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91583.log.gz 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36564.log 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.30287.log.gz 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87348.log 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.40188.log: /var/log/ceph/ceph-client.0.36564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46843.log 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.65598.log.gz 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.87348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38379.log 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51078.log.gz 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.46843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70438.log 2024-04-24T01:47:45.053 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40188.log.gz 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.38379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95870.log 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.70438.log: gzip -5 --verbose 91.5% -- /var/log/ceph/ceph-client.0.78908.log 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87348.log.gz 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.0.36564.log.gz 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.95870.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.46843.log.gz 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.0.78908.log: -5 --verbose -- /var/log/ceph/ceph-client.0.93398.log 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70438.log.gz 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38379.log.gz 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80118.log 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.93398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37169.log 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.80118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58338.log 2024-04-24T01:47:45.054 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.37169.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.0.78908.log.gz 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.58338.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.93398.log.gz 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.49868.log 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80118.log.gz 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72253.log 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.95870.log.gz 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.49868.log: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37169.log.gz 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.72253.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49868.log.gz 2024-04-24T01:47:45.055 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58338.log.gz 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57733.log 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48053.log 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.57733.log: gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.72253.log.gz 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-client.0.61363.log 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.48053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92793.log 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.61363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83143.log 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.92793.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.57733.log.gz 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.48053.log.gz 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64993.log 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.83143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54103.log 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% 91.3% -- replaced with /var/log/ceph/ceph-client.0.61363.log.gz 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.0.92793.log.gz 2024-04-24T01:47:45.056 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.64993.log: -- /var/log/ceph/ceph-client.0.45633.log 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.54103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69228.log 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.45633.log: 91.4% 91.6% -- replaced with /var/log/ceph/ceph-client.0.83143.log.gz 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.0.64993.log.gz 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54103.log.gz 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35959.log 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45633.log.gz 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.69228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30207.log 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.35959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89768.log 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.30207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80723.log 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30207.log.gz 2024-04-24T01:47:45.057 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.89768.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35959.log.gz 2024-04-24T01:47:45.106 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 92.6% 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.0.69228.log.gz 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.80723.log: gzip 91.2% -- replaced with /var/log/ceph/ceph-client.0.89768.log.gz 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.66203.log 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35126.log 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.66203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30327.log 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.35126.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35126.log.gz 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6%gzip -- replaced with /var/log/ceph/ceph-client.0.80723.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.49263.log 2024-04-24T01:47:45.107 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66203.log.gz 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55313.log 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.30327.log: /var/log/ceph/ceph-client.0.49263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64388.log 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30327.log.gz 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.55313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82538.log 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.64388.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49263.log.gz 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55313.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.90373.log 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.82538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68623.log 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.90373.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64388.log.gz 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51683.log 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82538.log.gz/var/log/ceph/ceph-client.0.68623.log: 2024-04-24T01:47:45.108 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73463.log 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.51683.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.90373.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77698.log 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.73463.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51683.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86749.log 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.77698.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.73463.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30247.log 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.86749.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77698.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.68623.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.86749.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35166.log 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.30247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66808.log 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30247.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.35166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60153.log 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35166.log.gz 2024-04-24T01:47:45.109 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.66808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71043.log 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.60153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42003.log 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.71043.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66808.log.gz 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.60153.log.gz 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.78303.log 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.42003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43213.log 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71043.log.gz 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74068.log 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.78303.log: /var/log/ceph/ceph-client.0.43213.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42003.log.gz 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67413.log 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43213.log.gz 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.74068.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78303.log.gz 2024-04-24T01:47:45.110 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75278.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.67413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47448.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.75278.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74068.log.gz 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89163.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.67413.log.gz/var/log/ceph/ceph-client.0.47448.log: 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38984.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75278.log.gz 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.89163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75883.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.38984.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47448.log.gz 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76488.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.75883.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.38984.log.gz 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59548.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.89163.log.gz 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.76488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40793.log 2024-04-24T01:47:45.111 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.59548.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75883.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48658.log 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.40793.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76488.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59548.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87953.log 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39583.log 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.48658.log: 91.2%/var/log/ceph/ceph-client.0.87953.log: -- replaced with /var/log/ceph/ceph-client.0.40793.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86150.log 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.39583.log: 91.1% 91.4% -- replaced with /var/log/ceph/ceph-client.0.48658.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.0.87953.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81328.log 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.86150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74673.log 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.39583.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86150.log.gz 2024-04-24T01:47:45.112 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.81328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84952.log 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.74673.log: -- /var/log/ceph/ceph-client.0.62573.log 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.84952.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.84952.log.gz 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74673.log.gz 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35086.log 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81328.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.81933.log 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.62573.log: /var/log/ceph/ceph-client.admin.35086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69833.log 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr: 86.1%/var/log/ceph/ceph-client.0.81933.log: -- replaced with /var/log/ceph/ceph-client.admin.35086.log.gz 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37774.log 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.69833.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81933.log.gz 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62573.log.gz 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72858.log 2024-04-24T01:47:45.113 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.37774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60758.log 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69833.log.gz 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.72858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90978.log 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.60758.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37774.log.gz 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35046.log 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.90978.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72858.log.gz 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60758.log.gz 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88558.log 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52288.log 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.35046.log: /var/log/ceph/ceph-client.0.88558.log: 86.1% 91.1% -- replaced with /var/log/ceph/ceph-client.0.90978.log.gz -- replaced with /var/log/ceph/ceph-client.admin.35046.log.gz 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50473.log 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.52288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55918.log 2024-04-24T01:47:45.114 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.50473.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88558.log.gz 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42608.log 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52288.log.gz 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.55918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79513.log 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.42608.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50473.log.gz 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95213.log 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5%/var/log/ceph/ceph-client.0.79513.log: -- replaced with /var/log/ceph/ceph-client.0.55918.log.gz 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84353.log 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.95213.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42608.log.gz 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35006.log 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79513.log.gz 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.84353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45028.log 2024-04-24T01:47:45.115 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.35006.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95213.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.84353.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35006.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71648.log 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5/var/log/ceph/ceph-client.0.45028.log: --verbose -- /var/log/ceph/ceph-client.0.63783.log 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.71648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77093.log 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.63783.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45028.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85551.log 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.77093.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63783.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.71648.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.85551.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.85551.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77093.log.gz 2024-04-24T01:47:45.116 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-24T01:47:45.117 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T01:47:45.160 INFO:teuthology.orchestra.run.smithi107.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T01:47:45.909 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T01:47:45.918 INFO:teuthology.orchestra.run.smithi107.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T01:47:45.920 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-04-24T01:47:45.920 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m0.950s 2024-04-24T01:47:45.921 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m1.110s 2024-04-24T01:47:45.921 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.054s 2024-04-24T01:47:46.074 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T01:47:46.075 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T01:47:46.077 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-24T01:47:46.077 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m1.059s 2024-04-24T01:47:46.077 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m3.092s 2024-04-24T01:47:46.077 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m0.218s 2024-04-24T01:47:46.077 INFO:tasks.ceph:Archiving logs... 2024-04-24T01:47:46.077 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/remote/smithi107/log 2024-04-24T01:47:46.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T01:47:46.308 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/remote/smithi131/log 2024-04-24T01:47:46.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T01:47:46.905 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T01:47:46.917 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T01:47:46.917 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T01:47:46.920 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T01:47:46.995 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T01:47:47.005 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T01:47:47.005 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:47:47.008 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:47:47.021 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:47:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:47:47.025 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:47:47.025 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-04-24T01:47:47.026 INFO:teuthology.orchestra.run.smithi107.stdout:^- hv01.front.sepia.ceph.com 2 6 377 22 +1417us[+1417us] +/- 570ms 2024-04-24T01:47:47.026 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 -645us[ -597us] +/- 70ms 2024-04-24T01:47:47.026 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +608us[ +656us] +/- 61ms 2024-04-24T01:47:47.026 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:47:47.027 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:47:47.027 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-04-24T01:47:47.027 INFO:teuthology.orchestra.run.smithi131.stdout:^- hv01.front.sepia.ceph.com 2 6 377 25 +1416us[+1488us] +/- 570ms 2024-04-24T01:47:47.027 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -634us[ -562us] +/- 70ms 2024-04-24T01:47:47.027 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +617us[ +617us] +/- 61ms 2024-04-24T01:47:47.028 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:47:47.028 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T01:47:47.037 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T01:47:47.037 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T01:47:47.061 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T01:47:47.129 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T01:47:47.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:47:47.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:47:47.213 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:47:47.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:47:47.239 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T01:47:47.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T01:47:47.287 INFO:teuthology.task.internal:Duration was 756.728112 seconds 2024-04-24T01:47:47.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T01:47:47.340 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T01:47:47.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T01:47:47.343 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T01:47:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:47:47.379 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:47:47.565 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T01:47:47.565 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-04-24T01:47:47.566 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T01:47:47.626 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-04-24T01:47:47.626 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T01:47:47.647 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T01:47:47.647 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T01:47:47.669 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T01:47:47.712 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T01:47:47.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T01:47:47.734 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T01:47:47.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T01:47:47.856 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T01:47:47.856 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T01:47:47.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T01:47:47.904 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T01:47:47.914 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:47:47.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:47:47.941 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-04-24T01:47:47.965 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-04-24T01:47:47.999 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:47:48.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:47:48.024 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:47:48.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:47:48.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T01:47:48.065 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T01:47:48.065 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/remote/smithi107 2024-04-24T01:47:48.065 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T01:47:48.097 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670613/remote/smithi131 2024-04-24T01:47:48.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T01:47:48.139 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T01:47:48.139 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T01:47:48.142 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T01:47:48.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T01:47:48.198 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T01:47:48.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T01:47:48.222 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T01:47:48.223 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T01:47:48.225 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T01:47:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 01:47 /home/ubuntu/cephtest 2024-04-24T01:47:48.240 INFO:teuthology.orchestra.run.smithi131.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 01:47 /home/ubuntu/cephtest 2024-04-24T01:47:48.241 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T01:47:48.255 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T01:47:48.323 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 756.7281119823456 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-24T01:47:48.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T01:47:48.403 INFO:teuthology.run:pass